Apr 14 00:00:33 user nova-compute[82479]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Apr 14 00:00:36 user nova-compute[82479]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=82479) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=82479) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=82479) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 14 00:00:36 user nova-compute[82479]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:00:36 user nova-compute[82479]: INFO nova.virt.driver [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] Loading compute driver 'libvirt.LibvirtDriver'
Apr 14 00:00:36 user nova-compute[82479]: INFO nova.compute.provider_config [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] Acquiring lock "singleton_lock" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] Acquired lock "singleton_lock" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] Releasing lock "singleton_lock" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] Full set of CONF: {{(pid=82479) _wait_for_exit_or_signal /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:362}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] ******************************************************************************** {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] Configuration options gathered from: {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] ================================================================================ {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] allow_resize_to_same_host      = True {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] arq_binding_timeout            = 300 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] backdoor_port                  = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] backdoor_socket                = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] block_device_allocate_retries  = 300 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] block_device_allocate_retries_interval = 5 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] cert                           = self.pem {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] compute_monitors               = [] {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] config_dir                     = [] {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] config_drive_format            = iso9660 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] config_source                  = [] {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] console_host                   = user {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] control_exchange               = nova {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] cpu_allocation_ratio           = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] daemon                         = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] debug                          = True {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] default_access_ip_network_name = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] default_availability_zone      = nova {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] default_ephemeral_format       = ext4 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] default_schedule_zone          = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] disk_allocation_ratio          = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] enable_new_services            = True {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] enabled_apis                   = ['osapi_compute'] {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] enabled_ssl_apis               = [] {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] flat_injected                  = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] force_config_drive             = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] force_raw_images               = True {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] graceful_shutdown_timeout      = 5 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] heal_instance_info_cache_interval = 60 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] host                           = user {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] initial_disk_allocation_ratio  = 1.0 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] initial_ram_allocation_ratio   = 1.0 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] instance_build_timeout         = 0 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] instance_delete_interval       = 300 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] instance_format                = [instance: %(uuid)s]  {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] instance_name_template         = instance-%08x {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] instance_usage_audit           = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] instance_usage_audit_period    = month {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] internal_service_availability_zone = internal {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] key                            = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] live_migration_retry_count     = 30 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] log_config_append              = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] log_dir                        = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] log_file                       = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] log_options                    = True {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] log_rotate_interval            = 1 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] log_rotate_interval_type       = days {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] log_rotation_type              = none {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] long_rpc_timeout               = 1800 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] max_concurrent_builds          = 10 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] max_concurrent_live_migrations = 1 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] max_concurrent_snapshots       = 5 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] max_local_block_devices        = 3 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] max_logfile_count              = 30 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] max_logfile_size_mb            = 200 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] maximum_instance_delete_attempts = 5 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] metadata_listen                = 0.0.0.0 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] metadata_listen_port           = 8775 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] metadata_workers               = 3 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] migrate_max_retries            = -1 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] mkisofs_cmd                    = genisoimage {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] my_block_storage_ip            = 10.0.0.210 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] my_ip                          = 10.0.0.210 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] network_allocate_retries       = 0 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] osapi_compute_listen           = 0.0.0.0 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] osapi_compute_listen_port      = 8774 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] osapi_compute_unique_server_name_scope =  {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] osapi_compute_workers          = 3 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] password_length                = 12 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] periodic_enable                = True {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] periodic_fuzzy_delay           = 60 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] pointer_model                  = ps2mouse {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] preallocate_images             = none {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] publish_errors                 = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] pybasedir                      = /opt/stack/nova {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] ram_allocation_ratio           = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] rate_limit_burst               = 0 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] rate_limit_except_level        = CRITICAL {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] rate_limit_interval            = 0 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] reboot_timeout                 = 0 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] reclaim_instance_interval      = 0 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] record                         = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] reimage_timeout_per_gb         = 20 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] report_interval                = 10 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] rescue_timeout                 = 0 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] reserved_host_cpus             = 0 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] reserved_host_disk_mb          = 0 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] reserved_host_memory_mb        = 512 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] reserved_huge_pages            = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] resize_confirm_window          = 0 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] resize_fs_using_block_device   = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] resume_guests_state_on_host_boot = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] rpc_response_timeout           = 60 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] run_external_periodic_tasks    = True {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] running_deleted_instance_action = reap {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] running_deleted_instance_poll_interval = 1800 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] running_deleted_instance_timeout = 0 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] scheduler_instance_sync_interval = 120 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] service_down_time              = 60 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] servicegroup_driver            = db {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] shelved_offload_time           = 0 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] shelved_poll_interval          = 3600 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] shutdown_timeout               = 0 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] source_is_ipv6                 = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] ssl_only                       = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] state_path                     = /opt/stack/data/nova {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] sync_power_state_interval      = 600 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] sync_power_state_pool_size     = 1000 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] syslog_log_facility            = LOG_USER {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] tempdir                        = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] timeout_nbd                    = 10 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] transport_url                  = **** {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] update_resources_interval      = 0 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] use_cow_images                 = True {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] use_eventlog                   = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] use_journal                    = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] use_json                       = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] use_rootwrap_daemon            = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] use_stderr                     = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] use_syslog                     = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] vcpu_pin_set                   = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] vif_plugging_is_fatal          = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] vif_plugging_timeout           = 0 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] virt_mkfs                      = [] {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] volume_usage_poll_interval     = 0 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] watch_log_file                 = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] web                            = /usr/share/spice-html5 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_concurrency.disable_process_locking = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] api.auth_strategy              = keystone {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] api.compute_link_prefix        = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] api.dhcp_domain                = novalocal {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] api.enable_instance_password   = True {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] api.glance_link_prefix         = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] api.instance_list_cells_batch_strategy = distributed {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] api.instance_list_per_project_cells = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] api.list_records_by_skipping_down_cells = True {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] api.local_metadata_per_cell    = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] api.max_limit                  = 1000 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] api.metadata_cache_expiration  = 15 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] api.neutron_default_tenant_id  = default {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] api.use_forwarded_for          = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] api.use_neutron_default_nets   = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] api.vendordata_dynamic_failure_fatal = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] api.vendordata_dynamic_targets = [] {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] api.vendordata_jsonfile_path   = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] cache.backend                  = dogpile.cache.memcached {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] cache.backend_argument         = **** {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] cache.config_prefix            = cache.oslo {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] cache.dead_timeout             = 60.0 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] cache.debug_cache_backend      = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] cache.enable_retry_client      = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] cache.enable_socket_keepalive  = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] cache.enabled                  = True {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] cache.expiration_time          = 600 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] cache.hashclient_retry_attempts = 2 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] cache.hashclient_retry_delay   = 1.0 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] cache.memcache_dead_retry      = 300 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] cache.memcache_password        =  {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] cache.memcache_pool_maxsize    = 10 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] cache.memcache_sasl_enabled    = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] cache.memcache_socket_timeout  = 1.0 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] cache.memcache_username        =  {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] cache.proxies                  = [] {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] cache.retry_attempts           = 2 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] cache.retry_delay              = 0.0 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] cache.socket_keepalive_count   = 1 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] cache.socket_keepalive_idle    = 1 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] cache.socket_keepalive_interval = 1 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] cache.tls_allowed_ciphers      = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] cache.tls_cafile               = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] cache.tls_certfile             = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] cache.tls_enabled              = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] cache.tls_keyfile              = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] cinder.auth_section            = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] cinder.auth_type               = password {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] cinder.cafile                  = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] cinder.catalog_info            = volumev3::publicURL {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] cinder.certfile                = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] cinder.collect_timing          = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] cinder.cross_az_attach         = True {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] cinder.debug                   = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] cinder.endpoint_template       = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] cinder.http_retries            = 3 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] cinder.insecure                = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] cinder.keyfile                 = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] cinder.os_region_name          = RegionOne {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] cinder.split_loggers           = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] cinder.timeout                 = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] compute.cpu_dedicated_set      = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] compute.cpu_shared_set         = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] compute.image_type_exclude_list = [] {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] compute.live_migration_wait_for_vif_plug = True {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] compute.max_concurrent_disk_ops = 0 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] compute.max_disk_devices_to_attach = -1 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] compute.resource_provider_association_refresh = 300 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] compute.shutdown_retry_interval = 10 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] conductor.workers              = 3 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] console.allowed_origins        = [] {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] console.ssl_ciphers            = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] console.ssl_minimum_version    = default {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] consoleauth.token_ttl          = 600 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] cyborg.cafile                  = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] cyborg.certfile                = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] cyborg.collect_timing          = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] cyborg.connect_retries         = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] cyborg.connect_retry_delay     = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] cyborg.endpoint_override       = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] cyborg.insecure                = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] cyborg.keyfile                 = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] cyborg.max_version             = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] cyborg.min_version             = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] cyborg.region_name             = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] cyborg.service_name            = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] cyborg.service_type            = accelerator {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] cyborg.split_loggers           = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] cyborg.status_code_retries     = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] cyborg.status_code_retry_delay = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] cyborg.timeout                 = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] cyborg.version                 = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] database.backend               = sqlalchemy {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] database.connection            = **** {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] database.connection_debug      = 0 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] database.connection_parameters =  {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] database.connection_recycle_time = 3600 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] database.connection_trace      = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] database.db_inc_retry_interval = True {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] database.db_max_retries        = 20 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] database.db_max_retry_interval = 10 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] database.db_retry_interval     = 1 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] database.max_overflow          = 50 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] database.max_pool_size         = 5 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] database.max_retries           = 10 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] database.mysql_enable_ndb      = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] database.mysql_wsrep_sync_wait = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] database.pool_timeout          = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] database.retry_interval        = 10 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] database.slave_connection      = **** {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] database.sqlite_synchronous    = True {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] api_database.backend           = sqlalchemy {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] api_database.connection        = **** {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] api_database.connection_debug  = 0 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] api_database.connection_parameters =  {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] api_database.connection_recycle_time = 3600 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] api_database.connection_trace  = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] api_database.db_inc_retry_interval = True {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] api_database.db_max_retries    = 20 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] api_database.db_max_retry_interval = 10 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] api_database.db_retry_interval = 1 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] api_database.max_overflow      = 50 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] api_database.max_pool_size     = 5 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] api_database.max_retries       = 10 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] api_database.mysql_enable_ndb  = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] api_database.mysql_wsrep_sync_wait = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] api_database.pool_timeout      = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] api_database.retry_interval    = 10 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] api_database.slave_connection  = **** {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] api_database.sqlite_synchronous = True {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] devices.enabled_mdev_types     = [] {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] ephemeral_storage_encryption.enabled = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] ephemeral_storage_encryption.key_size = 512 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] glance.api_servers             = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] glance.cafile                  = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] glance.certfile                = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] glance.collect_timing          = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] glance.connect_retries         = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] glance.connect_retry_delay     = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] glance.debug                   = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] glance.default_trusted_certificate_ids = [] {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] glance.enable_certificate_validation = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] glance.enable_rbd_download     = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] glance.endpoint_override       = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] glance.insecure                = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] glance.keyfile                 = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] glance.max_version             = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] glance.min_version             = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] glance.num_retries             = 3 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] glance.rbd_ceph_conf           =  {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] glance.rbd_connect_timeout     = 5 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] glance.rbd_pool                =  {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] glance.rbd_user                =  {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] glance.region_name             = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] glance.service_name            = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] glance.service_type            = image {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] glance.split_loggers           = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] glance.status_code_retries     = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] glance.status_code_retry_delay = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] glance.timeout                 = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] glance.verify_glance_signatures = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] glance.version                 = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] guestfs.debug                  = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] hyperv.config_drive_cdrom      = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] hyperv.config_drive_inject_password = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] hyperv.enable_instance_metrics_collection = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] hyperv.enable_remotefx         = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] hyperv.instances_path_share    =  {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] hyperv.iscsi_initiator_list    = [] {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] hyperv.limit_cpu_features      = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] hyperv.power_state_check_timeframe = 60 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] hyperv.power_state_event_polling_interval = 2 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] hyperv.use_multipath_io        = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] hyperv.volume_attach_retry_count = 10 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] hyperv.volume_attach_retry_interval = 5 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] hyperv.vswitch_name            = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] mks.enabled                    = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] image_cache.manager_interval   = 2400 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] image_cache.precache_concurrency = 1 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] image_cache.remove_unused_base_images = True {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] image_cache.subdirectory_name  = _base {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] ironic.api_max_retries         = 60 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] ironic.api_retry_interval      = 2 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] ironic.auth_section            = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] ironic.auth_type               = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] ironic.cafile                  = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] ironic.certfile                = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] ironic.collect_timing          = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] ironic.connect_retries         = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] ironic.connect_retry_delay     = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] ironic.endpoint_override       = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] ironic.insecure                = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] ironic.keyfile                 = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] ironic.max_version             = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] ironic.min_version             = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] ironic.partition_key           = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] ironic.peer_list               = [] {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] ironic.region_name             = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] ironic.serial_console_state_timeout = 10 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] ironic.service_name            = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] ironic.service_type            = baremetal {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] ironic.split_loggers           = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] ironic.status_code_retries     = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] ironic.status_code_retry_delay = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] ironic.timeout                 = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] ironic.version                 = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] key_manager.fixed_key          = **** {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] barbican.barbican_api_version  = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] barbican.barbican_endpoint     = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] barbican.barbican_endpoint_type = public {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] barbican.barbican_region_name  = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] barbican.cafile                = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] barbican.certfile              = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] barbican.collect_timing        = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] barbican.insecure              = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] barbican.keyfile               = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] barbican.number_of_retries     = 60 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] barbican.retry_delay           = 1 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] barbican.send_service_user_token = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] barbican.split_loggers         = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] barbican.timeout               = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] barbican.verify_ssl            = True {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] barbican.verify_ssl_path       = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] barbican_service_user.auth_section = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] barbican_service_user.auth_type = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] barbican_service_user.cafile   = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] barbican_service_user.certfile = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] barbican_service_user.collect_timing = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:36 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] barbican_service_user.insecure = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] barbican_service_user.keyfile  = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] barbican_service_user.split_loggers = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] barbican_service_user.timeout  = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] vault.approle_role_id          = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] vault.approle_secret_id        = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] vault.cafile                   = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] vault.certfile                 = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] vault.collect_timing           = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] vault.insecure                 = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] vault.keyfile                  = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] vault.kv_mountpoint            = secret {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] vault.kv_version               = 2 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] vault.namespace                = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] vault.root_token_id            = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] vault.split_loggers            = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] vault.ssl_ca_crt_file          = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] vault.timeout                  = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] vault.use_ssl                  = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] keystone.cafile                = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] keystone.certfile              = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] keystone.collect_timing        = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] keystone.connect_retries       = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] keystone.connect_retry_delay   = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] keystone.endpoint_override     = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] keystone.insecure              = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] keystone.keyfile               = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] keystone.max_version           = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] keystone.min_version           = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] keystone.region_name           = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] keystone.service_name          = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] keystone.service_type          = identity {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] keystone.split_loggers         = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] keystone.status_code_retries   = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] keystone.status_code_retry_delay = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] keystone.timeout               = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] keystone.version               = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.connection_uri         =  {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.cpu_mode               = custom {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.cpu_model_extra_flags  = [] {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: WARNING oslo_config.cfg [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.cpu_power_governor_high = performance {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.cpu_power_governor_low = powersave {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.cpu_power_management   = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.device_detach_attempts = 8 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.device_detach_timeout  = 20 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.disk_cachemodes        = [] {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.disk_prefix            = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.enabled_perf_events    = [] {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.file_backed_memory     = 0 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.gid_maps               = [] {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.hw_disk_discard        = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.hw_machine_type        = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.images_rbd_ceph_conf   =  {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.images_rbd_glance_store_name =  {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.images_rbd_pool        = rbd {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.images_type            = default {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.images_volume_group    = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.inject_key             = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.inject_partition       = -2 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.inject_password        = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.iscsi_iface            = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.iser_use_multipath     = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.live_migration_bandwidth = 0 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.live_migration_completion_timeout = 800 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.live_migration_downtime = 500 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.live_migration_downtime_delay = 75 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.live_migration_downtime_steps = 10 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.live_migration_inbound_addr = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.live_migration_permit_auto_converge = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.live_migration_permit_post_copy = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.live_migration_scheme  = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.live_migration_timeout_action = abort {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.live_migration_tunnelled = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: WARNING oslo_config.cfg [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Apr 14 00:00:37 user nova-compute[82479]: live_migration_uri is deprecated for removal in favor of two other options that
Apr 14 00:00:37 user nova-compute[82479]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Apr 14 00:00:37 user nova-compute[82479]: and ``live_migration_inbound_addr`` respectively.
Apr 14 00:00:37 user nova-compute[82479]: ).  Its value may be silently ignored in the future.
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.live_migration_with_native_tls = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.max_queues             = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.mem_stats_period_seconds = 10 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.nfs_mount_options      = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.num_aoe_discover_tries = 3 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.num_iser_scan_tries    = 5 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.num_memory_encrypted_guests = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.num_nvme_discover_tries = 5 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.num_pcie_ports         = 0 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.num_volume_scan_tries  = 5 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.pmem_namespaces        = [] {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.quobyte_client_cfg     = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.rbd_connect_timeout    = 5 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.rbd_secret_uuid        = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.rbd_user               = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.realtime_scheduler_priority = 1 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.remote_filesystem_transport = ssh {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.rescue_image_id        = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.rescue_kernel_id       = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.rescue_ramdisk_id      = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.rx_queue_size          = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.smbfs_mount_options    =  {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.snapshot_compression   = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.snapshot_image_format  = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.sparse_logical_volumes = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.swtpm_enabled          = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.swtpm_group            = tss {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.swtpm_user             = tss {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.sysinfo_serial         = unique {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.tx_queue_size          = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.uid_maps               = [] {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.use_virtio_for_bridges = True {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.virt_type              = kvm {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.volume_clear           = zero {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.volume_clear_size      = 0 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.volume_use_multipath   = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.vzstorage_cache_path   = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.vzstorage_mount_group  = qemu {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.vzstorage_mount_opts   = [] {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.vzstorage_mount_user   = stack {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] neutron.auth_section           = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] neutron.auth_type              = password {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] neutron.cafile                 = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] neutron.certfile               = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] neutron.collect_timing         = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] neutron.connect_retries        = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] neutron.connect_retry_delay    = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] neutron.default_floating_pool  = public {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] neutron.endpoint_override      = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] neutron.extension_sync_interval = 600 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] neutron.http_retries           = 3 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] neutron.insecure               = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] neutron.keyfile                = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] neutron.max_version            = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] neutron.metadata_proxy_shared_secret = **** {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] neutron.min_version            = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] neutron.ovs_bridge             = br-int {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] neutron.physnets               = [] {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] neutron.region_name            = RegionOne {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] neutron.service_metadata_proxy = True {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] neutron.service_name           = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] neutron.service_type           = network {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] neutron.split_loggers          = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] neutron.status_code_retries    = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] neutron.status_code_retry_delay = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] neutron.timeout                = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] neutron.version                = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] notifications.bdms_in_notifications = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] notifications.default_level    = INFO {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] notifications.notification_format = unversioned {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] notifications.notify_on_state_change = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] pci.alias                      = [] {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] pci.device_spec                = [] {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] pci.report_in_placement        = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] placement.auth_section         = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] placement.auth_type            = password {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] placement.cafile               = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] placement.certfile             = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] placement.collect_timing       = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] placement.connect_retries      = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] placement.connect_retry_delay  = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] placement.default_domain_id    = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] placement.default_domain_name  = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] placement.domain_id            = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] placement.domain_name          = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] placement.endpoint_override    = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] placement.insecure             = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] placement.keyfile              = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] placement.max_version          = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] placement.min_version          = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] placement.password             = **** {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] placement.project_domain_id    = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] placement.project_domain_name  = Default {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] placement.project_id           = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] placement.project_name         = service {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] placement.region_name          = RegionOne {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] placement.service_name         = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] placement.service_type         = placement {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] placement.split_loggers        = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] placement.status_code_retries  = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] placement.status_code_retry_delay = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] placement.system_scope         = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] placement.timeout              = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] placement.trust_id             = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] placement.user_domain_id       = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] placement.user_domain_name     = Default {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] placement.user_id              = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] placement.username             = placement {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] placement.version              = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] quota.cores                    = 20 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] quota.count_usage_from_placement = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] quota.injected_file_content_bytes = 10240 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] quota.injected_file_path_length = 255 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] quota.injected_files           = 5 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] quota.instances                = 10 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] quota.key_pairs                = 100 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] quota.metadata_items           = 128 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] quota.ram                      = 51200 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] quota.recheck_quota            = True {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] quota.server_group_members     = 10 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] quota.server_groups            = 10 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] rdp.enabled                    = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] scheduler.image_metadata_prefilter = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] scheduler.max_attempts         = 3 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] scheduler.max_placement_results = 1000 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] scheduler.query_placement_for_availability_zone = True {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] scheduler.query_placement_for_image_type_support = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] scheduler.workers              = 3 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] filter_scheduler.host_subset_size = 1 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] filter_scheduler.image_properties_default_architecture = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] filter_scheduler.isolated_hosts = [] {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] filter_scheduler.isolated_images = [] {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] filter_scheduler.max_instances_per_host = 50 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] filter_scheduler.pci_in_placement = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] filter_scheduler.track_instance_changes = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] metrics.required               = True {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] metrics.weight_multiplier      = 1.0 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] metrics.weight_setting         = [] {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] serial_console.enabled         = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] serial_console.port_range      = 10000:20000 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] serial_console.serialproxy_port = 6083 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] service_user.auth_section      = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] service_user.auth_type         = password {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] service_user.cafile            = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] service_user.certfile          = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] service_user.collect_timing    = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] service_user.insecure          = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] service_user.keyfile           = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] service_user.send_service_user_token = True {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] service_user.split_loggers     = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] service_user.timeout           = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] spice.agent_enabled            = True {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] spice.enabled                  = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] spice.html5proxy_port          = 6082 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] spice.image_compression        = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] spice.jpeg_compression         = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] spice.playback_compression     = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] spice.server_listen            = 127.0.0.1 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] spice.streaming_mode           = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] spice.zlib_compression         = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] upgrade_levels.baseapi         = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] upgrade_levels.cert            = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] upgrade_levels.compute         = auto {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] upgrade_levels.conductor       = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] upgrade_levels.scheduler       = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] vendordata_dynamic_auth.auth_section = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] vendordata_dynamic_auth.auth_type = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] vendordata_dynamic_auth.cafile = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] vendordata_dynamic_auth.certfile = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] vendordata_dynamic_auth.collect_timing = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] vendordata_dynamic_auth.insecure = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] vendordata_dynamic_auth.keyfile = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] vendordata_dynamic_auth.split_loggers = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] vendordata_dynamic_auth.timeout = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] vmware.api_retry_count         = 10 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] vmware.ca_file                 = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] vmware.cache_prefix            = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] vmware.cluster_name            = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] vmware.connection_pool_size    = 10 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] vmware.console_delay_seconds   = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] vmware.datastore_regex         = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] vmware.host_ip                 = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] vmware.host_password           = **** {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] vmware.host_port               = 443 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] vmware.host_username           = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] vmware.insecure                = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] vmware.integration_bridge      = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] vmware.maximum_objects         = 100 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] vmware.pbm_default_policy      = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] vmware.pbm_enabled             = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] vmware.pbm_wsdl_location       = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] vmware.serial_port_proxy_uri   = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] vmware.serial_port_service_uri = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] vmware.task_poll_interval      = 0.5 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] vmware.use_linked_clone        = True {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] vmware.vnc_keymap              = en-us {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] vmware.vnc_port                = 5900 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] vmware.vnc_port_total          = 10000 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] vnc.auth_schemes               = ['none'] {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] vnc.enabled                    = True {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] vnc.novncproxy_port            = 6080 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] vnc.server_listen              = 0.0.0.0 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] vnc.vencrypt_ca_certs          = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] vnc.vencrypt_client_cert       = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] vnc.vencrypt_client_key        = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] workarounds.disable_fallback_pcpu_query = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] workarounds.disable_group_policy_check_upcall = True {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] workarounds.disable_rootwrap   = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] workarounds.enable_numa_live_migration = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] workarounds.handle_virt_lifecycle_events = True {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] workarounds.libvirt_disable_apic = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] workarounds.never_download_image_if_on_rbd = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] wsgi.client_socket_timeout     = 900 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] wsgi.default_pool_size         = 1000 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] wsgi.keep_alive                = True {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] wsgi.max_header_line           = 16384 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] wsgi.secure_proxy_ssl_header   = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] wsgi.ssl_ca_file               = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] wsgi.ssl_cert_file             = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] wsgi.ssl_key_file              = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] wsgi.tcp_keepidle              = 600 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] zvm.ca_file                    = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] zvm.cloud_connector_url        = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] zvm.reachable_timeout          = 300 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_policy.enforce_new_defaults = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_policy.enforce_scope      = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_policy.policy_default_rule = default {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_policy.policy_file        = policy.yaml {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] profiler.connection_string     = messaging:// {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] profiler.enabled               = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] profiler.es_doc_type           = notification {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] profiler.es_scroll_size        = 10000 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] profiler.es_scroll_time        = 2m {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] profiler.filter_error_trace    = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] profiler.hmac_keys             = SECRET_KEY {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] profiler.sentinel_service_name = mymaster {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] profiler.socket_timeout        = 0.1 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] profiler.trace_sqlalchemy      = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] remote_debug.host              = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] remote_debug.port              = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_messaging_rabbit.ssl      = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_messaging_rabbit.ssl_version =  {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_messaging_notifications.retry = -1 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_messaging_notifications.transport_url = **** {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_limit.auth_section        = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_limit.auth_type           = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_limit.cafile              = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_limit.certfile            = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_limit.collect_timing      = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_limit.connect_retries     = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_limit.connect_retry_delay = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_limit.endpoint_id         = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_limit.endpoint_override   = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_limit.insecure            = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_limit.keyfile             = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_limit.max_version         = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_limit.min_version         = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_limit.region_name         = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_limit.service_name        = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_limit.service_type        = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_limit.split_loggers       = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_limit.status_code_retries = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_limit.status_code_retry_delay = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_limit.timeout             = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_limit.valid_interfaces    = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_limit.version             = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_reports.file_event_handler = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] oslo_reports.log_dir           = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] vif_plug_linux_bridge_privileged.group = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] vif_plug_linux_bridge_privileged.user = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] vif_plug_ovs_privileged.group  = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] vif_plug_ovs_privileged.helper_command = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] vif_plug_ovs_privileged.user   = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] os_vif_linux_bridge.flat_interface = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] os_vif_linux_bridge.vlan_interface = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] os_vif_ovs.isolate_vif         = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] os_vif_ovs.ovsdb_interface     = native {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] os_vif_ovs.per_port_bridge     = False {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] os_brick.lock_path             = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] privsep_osbrick.capabilities   = [21] {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] privsep_osbrick.group          = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] privsep_osbrick.helper_command = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] privsep_osbrick.thread_pool_size = 12 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] privsep_osbrick.user           = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] nova_sys_admin.group           = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] nova_sys_admin.helper_command  = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] nova_sys_admin.thread_pool_size = 12 {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] nova_sys_admin.user            = None {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG oslo_service.service [None req-cdfde0e9-d14d-4755-ad1c-e6e6bd9e4f0e None None] ******************************************************************************** {{(pid=82479) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}}
Apr 14 00:00:37 user nova-compute[82479]: INFO nova.service [-] Starting compute node (version 0.0.0)
Apr 14 00:00:37 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Starting native event thread {{(pid=82479) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Starting green dispatch thread {{(pid=82479) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Starting connection event dispatch thread {{(pid=82479) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Connecting to libvirt: qemu:///system {{(pid=82479) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f3340bc65f0> {{(pid=82479) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Apr 14 00:00:37 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f3340bc65f0> {{(pid=82479) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Apr 14 00:00:37 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Connection event '1' reason 'None'
Apr 14 00:00:37 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Apr 14 00:00:37 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.mount [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Initialising _HostMountState generation 0 {{(pid=82479) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Apr 14 00:00:44 user nova-compute[82479]: INFO nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Libvirt host capabilities <capabilities>
Apr 14 00:00:44 user nova-compute[82479]:   <host>
Apr 14 00:00:44 user nova-compute[82479]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Apr 14 00:00:44 user nova-compute[82479]:     <cpu>
Apr 14 00:00:44 user nova-compute[82479]:       <arch>x86_64</arch>
Apr 14 00:00:44 user nova-compute[82479]:       <model>IvyBridge-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <vendor>Intel</vendor>
Apr 14 00:00:44 user nova-compute[82479]:       <microcode version='1070'/>
Apr 14 00:00:44 user nova-compute[82479]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Apr 14 00:00:44 user nova-compute[82479]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature name='ss'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature name='vmx'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature name='pcid'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature name='osxsave'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature name='hypervisor'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature name='arat'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature name='tsc_adjust'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature name='md-clear'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature name='stibp'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature name='arch-capabilities'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature name='ssbd'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature name='invtsc'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature name='rsba'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature name='skip-l1dfl-vmentry'/>
Apr 14 00:00:44 user nova-compute[82479]:       <pages unit='KiB' size='4'/>
Apr 14 00:00:44 user nova-compute[82479]:       <pages unit='KiB' size='2048'/>
Apr 14 00:00:44 user nova-compute[82479]:     </cpu>
Apr 14 00:00:44 user nova-compute[82479]:     <power_management>
Apr 14 00:00:44 user nova-compute[82479]:       <suspend_mem/>
Apr 14 00:00:44 user nova-compute[82479]:       <suspend_disk/>
Apr 14 00:00:44 user nova-compute[82479]:       <suspend_hybrid/>
Apr 14 00:00:44 user nova-compute[82479]:     </power_management>
Apr 14 00:00:44 user nova-compute[82479]:     <iommu support='no'/>
Apr 14 00:00:44 user nova-compute[82479]:     <migration_features>
Apr 14 00:00:44 user nova-compute[82479]:       <live/>
Apr 14 00:00:44 user nova-compute[82479]:       <uri_transports>
Apr 14 00:00:44 user nova-compute[82479]:         <uri_transport>tcp</uri_transport>
Apr 14 00:00:44 user nova-compute[82479]:         <uri_transport>rdma</uri_transport>
Apr 14 00:00:44 user nova-compute[82479]:       </uri_transports>
Apr 14 00:00:44 user nova-compute[82479]:     </migration_features>
Apr 14 00:00:44 user nova-compute[82479]:     <topology>
Apr 14 00:00:44 user nova-compute[82479]:       <cells num='2'>
Apr 14 00:00:44 user nova-compute[82479]:         <cell id='0'>
Apr 14 00:00:44 user nova-compute[82479]:           <memory unit='KiB'>8189224</memory>
Apr 14 00:00:44 user nova-compute[82479]:           <pages unit='KiB' size='4'>2047306</pages>
Apr 14 00:00:44 user nova-compute[82479]:           <pages unit='KiB' size='2048'>0</pages>
Apr 14 00:00:44 user nova-compute[82479]:           <distances>
Apr 14 00:00:44 user nova-compute[82479]:             <sibling id='0' value='10'/>
Apr 14 00:00:44 user nova-compute[82479]:             <sibling id='1' value='20'/>
Apr 14 00:00:44 user nova-compute[82479]:           </distances>
Apr 14 00:00:44 user nova-compute[82479]:           <cpus num='6'>
Apr 14 00:00:44 user nova-compute[82479]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Apr 14 00:00:44 user nova-compute[82479]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Apr 14 00:00:44 user nova-compute[82479]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Apr 14 00:00:44 user nova-compute[82479]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Apr 14 00:00:44 user nova-compute[82479]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Apr 14 00:00:44 user nova-compute[82479]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Apr 14 00:00:44 user nova-compute[82479]:           </cpus>
Apr 14 00:00:44 user nova-compute[82479]:         </cell>
Apr 14 00:00:44 user nova-compute[82479]:         <cell id='1'>
Apr 14 00:00:44 user nova-compute[82479]:           <memory unit='KiB'>8218764</memory>
Apr 14 00:00:44 user nova-compute[82479]:           <pages unit='KiB' size='4'>2054691</pages>
Apr 14 00:00:44 user nova-compute[82479]:           <pages unit='KiB' size='2048'>0</pages>
Apr 14 00:00:44 user nova-compute[82479]:           <distances>
Apr 14 00:00:44 user nova-compute[82479]:             <sibling id='0' value='20'/>
Apr 14 00:00:44 user nova-compute[82479]:             <sibling id='1' value='10'/>
Apr 14 00:00:44 user nova-compute[82479]:           </distances>
Apr 14 00:00:44 user nova-compute[82479]:           <cpus num='6'>
Apr 14 00:00:44 user nova-compute[82479]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Apr 14 00:00:44 user nova-compute[82479]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Apr 14 00:00:44 user nova-compute[82479]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Apr 14 00:00:44 user nova-compute[82479]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Apr 14 00:00:44 user nova-compute[82479]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Apr 14 00:00:44 user nova-compute[82479]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Apr 14 00:00:44 user nova-compute[82479]:           </cpus>
Apr 14 00:00:44 user nova-compute[82479]:         </cell>
Apr 14 00:00:44 user nova-compute[82479]:       </cells>
Apr 14 00:00:44 user nova-compute[82479]:     </topology>
Apr 14 00:00:44 user nova-compute[82479]:     <cache>
Apr 14 00:00:44 user nova-compute[82479]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Apr 14 00:00:44 user nova-compute[82479]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Apr 14 00:00:44 user nova-compute[82479]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Apr 14 00:00:44 user nova-compute[82479]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Apr 14 00:00:44 user nova-compute[82479]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Apr 14 00:00:44 user nova-compute[82479]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Apr 14 00:00:44 user nova-compute[82479]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Apr 14 00:00:44 user nova-compute[82479]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Apr 14 00:00:44 user nova-compute[82479]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Apr 14 00:00:44 user nova-compute[82479]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Apr 14 00:00:44 user nova-compute[82479]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Apr 14 00:00:44 user nova-compute[82479]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Apr 14 00:00:44 user nova-compute[82479]:     </cache>
Apr 14 00:00:44 user nova-compute[82479]:     <secmodel>
Apr 14 00:00:44 user nova-compute[82479]:       <model>apparmor</model>
Apr 14 00:00:44 user nova-compute[82479]:       <doi>0</doi>
Apr 14 00:00:44 user nova-compute[82479]:     </secmodel>
Apr 14 00:00:44 user nova-compute[82479]:     <secmodel>
Apr 14 00:00:44 user nova-compute[82479]:       <model>dac</model>
Apr 14 00:00:44 user nova-compute[82479]:       <doi>0</doi>
Apr 14 00:00:44 user nova-compute[82479]:       <baselabel type='kvm'>+64055:+108</baselabel>
Apr 14 00:00:44 user nova-compute[82479]:       <baselabel type='qemu'>+64055:+108</baselabel>
Apr 14 00:00:44 user nova-compute[82479]:     </secmodel>
Apr 14 00:00:44 user nova-compute[82479]:   </host>
Apr 14 00:00:44 user nova-compute[82479]:   <guest>
Apr 14 00:00:44 user nova-compute[82479]:     <os_type>hvm</os_type>
Apr 14 00:00:44 user nova-compute[82479]:     <arch name='alpha'>
Apr 14 00:00:44 user nova-compute[82479]:       <wordsize>64</wordsize>
Apr 14 00:00:44 user nova-compute[82479]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='4'>clipper</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <domain type='qemu'/>
Apr 14 00:00:44 user nova-compute[82479]:     </arch>
Apr 14 00:00:44 user nova-compute[82479]:     <features>
Apr 14 00:00:44 user nova-compute[82479]:       <cpuselection/>
Apr 14 00:00:44 user nova-compute[82479]:       <deviceboot/>
Apr 14 00:00:44 user nova-compute[82479]:       <disksnapshot default='on' toggle='no'/>
Apr 14 00:00:44 user nova-compute[82479]:     </features>
Apr 14 00:00:44 user nova-compute[82479]:   </guest>
Apr 14 00:00:44 user nova-compute[82479]:   <guest>
Apr 14 00:00:44 user nova-compute[82479]:     <os_type>hvm</os_type>
Apr 14 00:00:44 user nova-compute[82479]:     <arch name='armv6l'>
Apr 14 00:00:44 user nova-compute[82479]:       <wordsize>32</wordsize>
Apr 14 00:00:44 user nova-compute[82479]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>integratorcp</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>borzoi</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>spitz</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2'>nuri</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2'>musca-b1</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>versatileab</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>kzm</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2'>musca-a</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2'>smdkc210</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>sx1</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>z2</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>tosa</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='4'>sabrelite</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>realview-eb</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>n810</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>n800</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>versatilepb</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>terrier</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>mainstone</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='4'>midway</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>musicpal</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>microbit</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>cubieboard</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>verdex</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>netduino2</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='4'>raspi2b</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>cheetah</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='4'>highbank</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>akita</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>connex</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>collie</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>raspi0</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <domain type='qemu'/>
Apr 14 00:00:44 user nova-compute[82479]:     </arch>
Apr 14 00:00:44 user nova-compute[82479]:     <features>
Apr 14 00:00:44 user nova-compute[82479]:       <cpuselection/>
Apr 14 00:00:44 user nova-compute[82479]:       <deviceboot/>
Apr 14 00:00:44 user nova-compute[82479]:       <disksnapshot default='on' toggle='no'/>
Apr 14 00:00:44 user nova-compute[82479]:     </features>
Apr 14 00:00:44 user nova-compute[82479]:   </guest>
Apr 14 00:00:44 user nova-compute[82479]:   <guest>
Apr 14 00:00:44 user nova-compute[82479]:     <os_type>hvm</os_type>
Apr 14 00:00:44 user nova-compute[82479]:     <arch name='armv7l'>
Apr 14 00:00:44 user nova-compute[82479]:       <wordsize>32</wordsize>
Apr 14 00:00:44 user nova-compute[82479]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>integratorcp</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>borzoi</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>spitz</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2'>nuri</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2'>musca-b1</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>versatileab</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>kzm</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2'>musca-a</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2'>smdkc210</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>sx1</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>z2</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>tosa</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='4'>sabrelite</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>realview-eb</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>n810</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>n800</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>versatilepb</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>terrier</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>mainstone</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='4'>midway</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>musicpal</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>microbit</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>cubieboard</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>verdex</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>netduino2</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='4'>raspi2b</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>cheetah</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='4'>highbank</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>akita</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>connex</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>collie</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>raspi0</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <domain type='qemu'/>
Apr 14 00:00:44 user nova-compute[82479]:     </arch>
Apr 14 00:00:44 user nova-compute[82479]:     <features>
Apr 14 00:00:44 user nova-compute[82479]:       <cpuselection/>
Apr 14 00:00:44 user nova-compute[82479]:       <deviceboot/>
Apr 14 00:00:44 user nova-compute[82479]:       <disksnapshot default='on' toggle='no'/>
Apr 14 00:00:44 user nova-compute[82479]:     </features>
Apr 14 00:00:44 user nova-compute[82479]:   </guest>
Apr 14 00:00:44 user nova-compute[82479]:   <guest>
Apr 14 00:00:44 user nova-compute[82479]:     <os_type>hvm</os_type>
Apr 14 00:00:44 user nova-compute[82479]:     <arch name='aarch64'>
Apr 14 00:00:44 user nova-compute[82479]:       <wordsize>64</wordsize>
Apr 14 00:00:44 user nova-compute[82479]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>integratorcp</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>borzoi</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>spitz</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2'>nuri</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2'>musca-b1</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>versatileab</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>kzm</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2'>musca-a</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2'>smdkc210</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>sx1</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>z2</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>tosa</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='4'>sabrelite</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>realview-eb</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='512'>sbsa-ref</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>n810</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>n800</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>versatilepb</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>terrier</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>mainstone</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='4'>midway</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>musicpal</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>microbit</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='4'>raspi3ap</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>cubieboard</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>verdex</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>netduino2</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='4'>raspi3b</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='4'>raspi2b</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>cheetah</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='4'>highbank</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>akita</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>connex</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>collie</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>raspi0</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <domain type='qemu'/>
Apr 14 00:00:44 user nova-compute[82479]:     </arch>
Apr 14 00:00:44 user nova-compute[82479]:     <features>
Apr 14 00:00:44 user nova-compute[82479]:       <acpi default='on' toggle='yes'/>
Apr 14 00:00:44 user nova-compute[82479]:       <cpuselection/>
Apr 14 00:00:44 user nova-compute[82479]:       <deviceboot/>
Apr 14 00:00:44 user nova-compute[82479]:       <disksnapshot default='on' toggle='no'/>
Apr 14 00:00:44 user nova-compute[82479]:     </features>
Apr 14 00:00:44 user nova-compute[82479]:   </guest>
Apr 14 00:00:44 user nova-compute[82479]:   <guest>
Apr 14 00:00:44 user nova-compute[82479]:     <os_type>hvm</os_type>
Apr 14 00:00:44 user nova-compute[82479]:     <arch name='cris'>
Apr 14 00:00:44 user nova-compute[82479]:       <wordsize>32</wordsize>
Apr 14 00:00:44 user nova-compute[82479]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>axis-dev88</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <domain type='qemu'/>
Apr 14 00:00:44 user nova-compute[82479]:     </arch>
Apr 14 00:00:44 user nova-compute[82479]:     <features>
Apr 14 00:00:44 user nova-compute[82479]:       <cpuselection/>
Apr 14 00:00:44 user nova-compute[82479]:       <deviceboot/>
Apr 14 00:00:44 user nova-compute[82479]:       <disksnapshot default='on' toggle='no'/>
Apr 14 00:00:44 user nova-compute[82479]:     </features>
Apr 14 00:00:44 user nova-compute[82479]:   </guest>
Apr 14 00:00:44 user nova-compute[82479]:   <guest>
Apr 14 00:00:44 user nova-compute[82479]:     <os_type>hvm</os_type>
Apr 14 00:00:44 user nova-compute[82479]:     <arch name='i686'>
Apr 14 00:00:44 user nova-compute[82479]:       <wordsize>32</wordsize>
Apr 14 00:00:44 user nova-compute[82479]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>pc-q35-artful</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>x-remote</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>isapc</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>pc-q35-disco</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>pc-q35-impish</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>pc-q35-focal</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>microvm</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <domain type='qemu'/>
Apr 14 00:00:44 user nova-compute[82479]:       <domain type='kvm'/>
Apr 14 00:00:44 user nova-compute[82479]:     </arch>
Apr 14 00:00:44 user nova-compute[82479]:     <features>
Apr 14 00:00:44 user nova-compute[82479]:       <pae/>
Apr 14 00:00:44 user nova-compute[82479]:       <nonpae/>
Apr 14 00:00:44 user nova-compute[82479]:       <acpi default='on' toggle='yes'/>
Apr 14 00:00:44 user nova-compute[82479]:       <apic default='on' toggle='no'/>
Apr 14 00:00:44 user nova-compute[82479]:       <cpuselection/>
Apr 14 00:00:44 user nova-compute[82479]:       <deviceboot/>
Apr 14 00:00:44 user nova-compute[82479]:       <disksnapshot default='on' toggle='no'/>
Apr 14 00:00:44 user nova-compute[82479]:     </features>
Apr 14 00:00:44 user nova-compute[82479]:   </guest>
Apr 14 00:00:44 user nova-compute[82479]:   <guest>
Apr 14 00:00:44 user nova-compute[82479]:     <os_type>hvm</os_type>
Apr 14 00:00:44 user nova-compute[82479]:     <arch name='m68k'>
Apr 14 00:00:44 user nova-compute[82479]:       <wordsize>32</wordsize>
Apr 14 00:00:44 user nova-compute[82479]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>mcf5208evb</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>an5206</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>virt-6.0</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>q800</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>virt-6.2</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>next-cube</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>virt-6.1</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <domain type='qemu'/>
Apr 14 00:00:44 user nova-compute[82479]:     </arch>
Apr 14 00:00:44 user nova-compute[82479]:     <features>
Apr 14 00:00:44 user nova-compute[82479]:       <cpuselection/>
Apr 14 00:00:44 user nova-compute[82479]:       <deviceboot/>
Apr 14 00:00:44 user nova-compute[82479]:       <disksnapshot default='on' toggle='no'/>
Apr 14 00:00:44 user nova-compute[82479]:     </features>
Apr 14 00:00:44 user nova-compute[82479]:   </guest>
Apr 14 00:00:44 user nova-compute[82479]:   <guest>
Apr 14 00:00:44 user nova-compute[82479]:     <os_type>hvm</os_type>
Apr 14 00:00:44 user nova-compute[82479]:     <arch name='microblaze'>
Apr 14 00:00:44 user nova-compute[82479]:       <wordsize>32</wordsize>
Apr 14 00:00:44 user nova-compute[82479]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>petalogix-ml605</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <domain type='qemu'/>
Apr 14 00:00:44 user nova-compute[82479]:     </arch>
Apr 14 00:00:44 user nova-compute[82479]:     <features>
Apr 14 00:00:44 user nova-compute[82479]:       <cpuselection/>
Apr 14 00:00:44 user nova-compute[82479]:       <deviceboot/>
Apr 14 00:00:44 user nova-compute[82479]:       <disksnapshot default='on' toggle='no'/>
Apr 14 00:00:44 user nova-compute[82479]:     </features>
Apr 14 00:00:44 user nova-compute[82479]:   </guest>
Apr 14 00:00:44 user nova-compute[82479]:   <guest>
Apr 14 00:00:44 user nova-compute[82479]:     <os_type>hvm</os_type>
Apr 14 00:00:44 user nova-compute[82479]:     <arch name='microblazeel'>
Apr 14 00:00:44 user nova-compute[82479]:       <wordsize>32</wordsize>
Apr 14 00:00:44 user nova-compute[82479]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>petalogix-ml605</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <domain type='qemu'/>
Apr 14 00:00:44 user nova-compute[82479]:     </arch>
Apr 14 00:00:44 user nova-compute[82479]:     <features>
Apr 14 00:00:44 user nova-compute[82479]:       <cpuselection/>
Apr 14 00:00:44 user nova-compute[82479]:       <deviceboot/>
Apr 14 00:00:44 user nova-compute[82479]:       <disksnapshot default='on' toggle='no'/>
Apr 14 00:00:44 user nova-compute[82479]:     </features>
Apr 14 00:00:44 user nova-compute[82479]:   </guest>
Apr 14 00:00:44 user nova-compute[82479]:   <guest>
Apr 14 00:00:44 user nova-compute[82479]:     <os_type>hvm</os_type>
Apr 14 00:00:44 user nova-compute[82479]:     <arch name='mips'>
Apr 14 00:00:44 user nova-compute[82479]:       <wordsize>32</wordsize>
Apr 14 00:00:44 user nova-compute[82479]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='16'>malta</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>mipssim</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <domain type='qemu'/>
Apr 14 00:00:44 user nova-compute[82479]:     </arch>
Apr 14 00:00:44 user nova-compute[82479]:     <features>
Apr 14 00:00:44 user nova-compute[82479]:       <cpuselection/>
Apr 14 00:00:44 user nova-compute[82479]:       <deviceboot/>
Apr 14 00:00:44 user nova-compute[82479]:       <disksnapshot default='on' toggle='no'/>
Apr 14 00:00:44 user nova-compute[82479]:     </features>
Apr 14 00:00:44 user nova-compute[82479]:   </guest>
Apr 14 00:00:44 user nova-compute[82479]:   <guest>
Apr 14 00:00:44 user nova-compute[82479]:     <os_type>hvm</os_type>
Apr 14 00:00:44 user nova-compute[82479]:     <arch name='mipsel'>
Apr 14 00:00:44 user nova-compute[82479]:       <wordsize>32</wordsize>
Apr 14 00:00:44 user nova-compute[82479]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='16'>malta</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>mipssim</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <domain type='qemu'/>
Apr 14 00:00:44 user nova-compute[82479]:     </arch>
Apr 14 00:00:44 user nova-compute[82479]:     <features>
Apr 14 00:00:44 user nova-compute[82479]:       <cpuselection/>
Apr 14 00:00:44 user nova-compute[82479]:       <deviceboot/>
Apr 14 00:00:44 user nova-compute[82479]:       <disksnapshot default='on' toggle='no'/>
Apr 14 00:00:44 user nova-compute[82479]:     </features>
Apr 14 00:00:44 user nova-compute[82479]:   </guest>
Apr 14 00:00:44 user nova-compute[82479]:   <guest>
Apr 14 00:00:44 user nova-compute[82479]:     <os_type>hvm</os_type>
Apr 14 00:00:44 user nova-compute[82479]:     <arch name='mips64'>
Apr 14 00:00:44 user nova-compute[82479]:       <wordsize>64</wordsize>
Apr 14 00:00:44 user nova-compute[82479]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='16'>malta</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>mipssim</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>pica61</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>magnum</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <domain type='qemu'/>
Apr 14 00:00:44 user nova-compute[82479]:     </arch>
Apr 14 00:00:44 user nova-compute[82479]:     <features>
Apr 14 00:00:44 user nova-compute[82479]:       <cpuselection/>
Apr 14 00:00:44 user nova-compute[82479]:       <deviceboot/>
Apr 14 00:00:44 user nova-compute[82479]:       <disksnapshot default='on' toggle='no'/>
Apr 14 00:00:44 user nova-compute[82479]:     </features>
Apr 14 00:00:44 user nova-compute[82479]:   </guest>
Apr 14 00:00:44 user nova-compute[82479]:   <guest>
Apr 14 00:00:44 user nova-compute[82479]:     <os_type>hvm</os_type>
Apr 14 00:00:44 user nova-compute[82479]:     <arch name='mips64el'>
Apr 14 00:00:44 user nova-compute[82479]:       <wordsize>64</wordsize>
Apr 14 00:00:44 user nova-compute[82479]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='16'>malta</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='16'>loongson3-virt</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>mipssim</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>pica61</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>magnum</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='16'>boston</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>fuloong2e</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <domain type='qemu'/>
Apr 14 00:00:44 user nova-compute[82479]:     </arch>
Apr 14 00:00:44 user nova-compute[82479]:     <features>
Apr 14 00:00:44 user nova-compute[82479]:       <cpuselection/>
Apr 14 00:00:44 user nova-compute[82479]:       <deviceboot/>
Apr 14 00:00:44 user nova-compute[82479]:       <disksnapshot default='on' toggle='no'/>
Apr 14 00:00:44 user nova-compute[82479]:     </features>
Apr 14 00:00:44 user nova-compute[82479]:   </guest>
Apr 14 00:00:44 user nova-compute[82479]:   <guest>
Apr 14 00:00:44 user nova-compute[82479]:     <os_type>hvm</os_type>
Apr 14 00:00:44 user nova-compute[82479]:     <arch name='ppc'>
Apr 14 00:00:44 user nova-compute[82479]:       <wordsize>32</wordsize>
Apr 14 00:00:44 user nova-compute[82479]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>g3beige</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>mac99</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='32'>ppce500</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>pegasos2</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>sam460ex</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>bamboo</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>40p</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>ref405ep</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>taihu</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <domain type='qemu'/>
Apr 14 00:00:44 user nova-compute[82479]:     </arch>
Apr 14 00:00:44 user nova-compute[82479]:     <features>
Apr 14 00:00:44 user nova-compute[82479]:       <cpuselection/>
Apr 14 00:00:44 user nova-compute[82479]:       <deviceboot/>
Apr 14 00:00:44 user nova-compute[82479]:       <disksnapshot default='on' toggle='no'/>
Apr 14 00:00:44 user nova-compute[82479]:     </features>
Apr 14 00:00:44 user nova-compute[82479]:   </guest>
Apr 14 00:00:44 user nova-compute[82479]:   <guest>
Apr 14 00:00:44 user nova-compute[82479]:     <os_type>hvm</os_type>
Apr 14 00:00:44 user nova-compute[82479]:     <arch name='ppc64'>
Apr 14 00:00:44 user nova-compute[82479]:       <wordsize>64</wordsize>
Apr 14 00:00:44 user nova-compute[82479]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2048'>powernv9</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>taihu</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2048'>powernv10</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='32'>ppce500</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>40p</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>pegasos2</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>bamboo</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>g3beige</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>mac99</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>sam460ex</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>ref405ep</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2048'>powernv8</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <domain type='qemu'/>
Apr 14 00:00:44 user nova-compute[82479]:     </arch>
Apr 14 00:00:44 user nova-compute[82479]:     <features>
Apr 14 00:00:44 user nova-compute[82479]:       <cpuselection/>
Apr 14 00:00:44 user nova-compute[82479]:       <deviceboot/>
Apr 14 00:00:44 user nova-compute[82479]:       <disksnapshot default='on' toggle='no'/>
Apr 14 00:00:44 user nova-compute[82479]:     </features>
Apr 14 00:00:44 user nova-compute[82479]:   </guest>
Apr 14 00:00:44 user nova-compute[82479]:   <guest>
Apr 14 00:00:44 user nova-compute[82479]:     <os_type>hvm</os_type>
Apr 14 00:00:44 user nova-compute[82479]:     <arch name='ppc64le'>
Apr 14 00:00:44 user nova-compute[82479]:       <wordsize>64</wordsize>
Apr 14 00:00:44 user nova-compute[82479]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2048'>powernv9</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>taihu</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2048'>powernv10</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='32'>ppce500</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>40p</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>pegasos2</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>bamboo</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>g3beige</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>mac99</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>sam460ex</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>ref405ep</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2048'>powernv8</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <domain type='qemu'/>
Apr 14 00:00:44 user nova-compute[82479]:     </arch>
Apr 14 00:00:44 user nova-compute[82479]:     <features>
Apr 14 00:00:44 user nova-compute[82479]:       <cpuselection/>
Apr 14 00:00:44 user nova-compute[82479]:       <deviceboot/>
Apr 14 00:00:44 user nova-compute[82479]:       <disksnapshot default='on' toggle='no'/>
Apr 14 00:00:44 user nova-compute[82479]:     </features>
Apr 14 00:00:44 user nova-compute[82479]:   </guest>
Apr 14 00:00:44 user nova-compute[82479]:   <guest>
Apr 14 00:00:44 user nova-compute[82479]:     <os_type>hvm</os_type>
Apr 14 00:00:44 user nova-compute[82479]:     <arch name='riscv32'>
Apr 14 00:00:44 user nova-compute[82479]:       <wordsize>32</wordsize>
Apr 14 00:00:44 user nova-compute[82479]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='8'>spike</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>opentitan</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='5'>sifive_u</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>sifive_e</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='8'>virt</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <domain type='qemu'/>
Apr 14 00:00:44 user nova-compute[82479]:     </arch>
Apr 14 00:00:44 user nova-compute[82479]:     <features>
Apr 14 00:00:44 user nova-compute[82479]:       <cpuselection/>
Apr 14 00:00:44 user nova-compute[82479]:       <deviceboot/>
Apr 14 00:00:44 user nova-compute[82479]:       <disksnapshot default='on' toggle='no'/>
Apr 14 00:00:44 user nova-compute[82479]:     </features>
Apr 14 00:00:44 user nova-compute[82479]:   </guest>
Apr 14 00:00:44 user nova-compute[82479]:   <guest>
Apr 14 00:00:44 user nova-compute[82479]:     <os_type>hvm</os_type>
Apr 14 00:00:44 user nova-compute[82479]:     <arch name='riscv64'>
Apr 14 00:00:44 user nova-compute[82479]:       <wordsize>64</wordsize>
Apr 14 00:00:44 user nova-compute[82479]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='8'>spike</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='5'>sifive_u</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>shakti_c</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>sifive_e</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='8'>virt</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <domain type='qemu'/>
Apr 14 00:00:44 user nova-compute[82479]:     </arch>
Apr 14 00:00:44 user nova-compute[82479]:     <features>
Apr 14 00:00:44 user nova-compute[82479]:       <cpuselection/>
Apr 14 00:00:44 user nova-compute[82479]:       <deviceboot/>
Apr 14 00:00:44 user nova-compute[82479]:       <disksnapshot default='on' toggle='no'/>
Apr 14 00:00:44 user nova-compute[82479]:     </features>
Apr 14 00:00:44 user nova-compute[82479]:   </guest>
Apr 14 00:00:44 user nova-compute[82479]:   <guest>
Apr 14 00:00:44 user nova-compute[82479]:     <os_type>hvm</os_type>
Apr 14 00:00:44 user nova-compute[82479]:     <arch name='s390x'>
Apr 14 00:00:44 user nova-compute[82479]:       <wordsize>64</wordsize>
Apr 14 00:00:44 user nova-compute[82479]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <domain type='qemu'/>
Apr 14 00:00:44 user nova-compute[82479]:     </arch>
Apr 14 00:00:44 user nova-compute[82479]:     <features>
Apr 14 00:00:44 user nova-compute[82479]:       <cpuselection/>
Apr 14 00:00:44 user nova-compute[82479]:       <deviceboot/>
Apr 14 00:00:44 user nova-compute[82479]:       <disksnapshot default='on' toggle='no'/>
Apr 14 00:00:44 user nova-compute[82479]:     </features>
Apr 14 00:00:44 user nova-compute[82479]:   </guest>
Apr 14 00:00:44 user nova-compute[82479]:   <guest>
Apr 14 00:00:44 user nova-compute[82479]:     <os_type>hvm</os_type>
Apr 14 00:00:44 user nova-compute[82479]:     <arch name='sh4'>
Apr 14 00:00:44 user nova-compute[82479]:       <wordsize>32</wordsize>
Apr 14 00:00:44 user nova-compute[82479]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>shix</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>r2d</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <domain type='qemu'/>
Apr 14 00:00:44 user nova-compute[82479]:     </arch>
Apr 14 00:00:44 user nova-compute[82479]:     <features>
Apr 14 00:00:44 user nova-compute[82479]:       <cpuselection/>
Apr 14 00:00:44 user nova-compute[82479]:       <deviceboot/>
Apr 14 00:00:44 user nova-compute[82479]:       <disksnapshot default='on' toggle='no'/>
Apr 14 00:00:44 user nova-compute[82479]:     </features>
Apr 14 00:00:44 user nova-compute[82479]:   </guest>
Apr 14 00:00:44 user nova-compute[82479]:   <guest>
Apr 14 00:00:44 user nova-compute[82479]:     <os_type>hvm</os_type>
Apr 14 00:00:44 user nova-compute[82479]:     <arch name='sh4eb'>
Apr 14 00:00:44 user nova-compute[82479]:       <wordsize>64</wordsize>
Apr 14 00:00:44 user nova-compute[82479]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>shix</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>r2d</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <domain type='qemu'/>
Apr 14 00:00:44 user nova-compute[82479]:     </arch>
Apr 14 00:00:44 user nova-compute[82479]:     <features>
Apr 14 00:00:44 user nova-compute[82479]:       <cpuselection/>
Apr 14 00:00:44 user nova-compute[82479]:       <deviceboot/>
Apr 14 00:00:44 user nova-compute[82479]:       <disksnapshot default='on' toggle='no'/>
Apr 14 00:00:44 user nova-compute[82479]:     </features>
Apr 14 00:00:44 user nova-compute[82479]:   </guest>
Apr 14 00:00:44 user nova-compute[82479]:   <guest>
Apr 14 00:00:44 user nova-compute[82479]:     <os_type>hvm</os_type>
Apr 14 00:00:44 user nova-compute[82479]:     <arch name='sparc'>
Apr 14 00:00:44 user nova-compute[82479]:       <wordsize>32</wordsize>
Apr 14 00:00:44 user nova-compute[82479]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>SS-5</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='4'>SS-20</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>LX</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>SPARCClassic</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>leon3_generic</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>SPARCbook</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>SS-4</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='4'>SS-600MP</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='4'>SS-10</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>Voyager</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <domain type='qemu'/>
Apr 14 00:00:44 user nova-compute[82479]:     </arch>
Apr 14 00:00:44 user nova-compute[82479]:     <features>
Apr 14 00:00:44 user nova-compute[82479]:       <cpuselection/>
Apr 14 00:00:44 user nova-compute[82479]:       <deviceboot/>
Apr 14 00:00:44 user nova-compute[82479]:       <disksnapshot default='on' toggle='no'/>
Apr 14 00:00:44 user nova-compute[82479]:     </features>
Apr 14 00:00:44 user nova-compute[82479]:   </guest>
Apr 14 00:00:44 user nova-compute[82479]:   <guest>
Apr 14 00:00:44 user nova-compute[82479]:     <os_type>hvm</os_type>
Apr 14 00:00:44 user nova-compute[82479]:     <arch name='sparc64'>
Apr 14 00:00:44 user nova-compute[82479]:       <wordsize>64</wordsize>
Apr 14 00:00:44 user nova-compute[82479]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>sun4u</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>niagara</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>sun4v</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <domain type='qemu'/>
Apr 14 00:00:44 user nova-compute[82479]:     </arch>
Apr 14 00:00:44 user nova-compute[82479]:     <features>
Apr 14 00:00:44 user nova-compute[82479]:       <cpuselection/>
Apr 14 00:00:44 user nova-compute[82479]:       <deviceboot/>
Apr 14 00:00:44 user nova-compute[82479]:       <disksnapshot default='on' toggle='no'/>
Apr 14 00:00:44 user nova-compute[82479]:     </features>
Apr 14 00:00:44 user nova-compute[82479]:   </guest>
Apr 14 00:00:44 user nova-compute[82479]:   <guest>
Apr 14 00:00:44 user nova-compute[82479]:     <os_type>hvm</os_type>
Apr 14 00:00:44 user nova-compute[82479]:     <arch name='x86_64'>
Apr 14 00:00:44 user nova-compute[82479]:       <wordsize>64</wordsize>
Apr 14 00:00:44 user nova-compute[82479]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>pc-q35-artful</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>x-remote</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='1'>isapc</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>pc-q35-disco</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>pc-q35-impish</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>pc-q35-focal</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>microvm</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <domain type='qemu'/>
Apr 14 00:00:44 user nova-compute[82479]:       <domain type='kvm'/>
Apr 14 00:00:44 user nova-compute[82479]:     </arch>
Apr 14 00:00:44 user nova-compute[82479]:     <features>
Apr 14 00:00:44 user nova-compute[82479]:       <acpi default='on' toggle='yes'/>
Apr 14 00:00:44 user nova-compute[82479]:       <apic default='on' toggle='no'/>
Apr 14 00:00:44 user nova-compute[82479]:       <cpuselection/>
Apr 14 00:00:44 user nova-compute[82479]:       <deviceboot/>
Apr 14 00:00:44 user nova-compute[82479]:       <disksnapshot default='on' toggle='no'/>
Apr 14 00:00:44 user nova-compute[82479]:     </features>
Apr 14 00:00:44 user nova-compute[82479]:   </guest>
Apr 14 00:00:44 user nova-compute[82479]:   <guest>
Apr 14 00:00:44 user nova-compute[82479]:     <os_type>hvm</os_type>
Apr 14 00:00:44 user nova-compute[82479]:     <arch name='xtensa'>
Apr 14 00:00:44 user nova-compute[82479]:       <wordsize>32</wordsize>
Apr 14 00:00:44 user nova-compute[82479]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='4'>sim</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='32'>kc705</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='32'>ml605</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='32'>ml605-nommu</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='32'>virt</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='32'>lx60-nommu</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='32'>lx200</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='32'>lx200-nommu</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='32'>lx60</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='32'>kc705-nommu</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <domain type='qemu'/>
Apr 14 00:00:44 user nova-compute[82479]:     </arch>
Apr 14 00:00:44 user nova-compute[82479]:     <features>
Apr 14 00:00:44 user nova-compute[82479]:       <cpuselection/>
Apr 14 00:00:44 user nova-compute[82479]:       <deviceboot/>
Apr 14 00:00:44 user nova-compute[82479]:       <disksnapshot default='on' toggle='no'/>
Apr 14 00:00:44 user nova-compute[82479]:     </features>
Apr 14 00:00:44 user nova-compute[82479]:   </guest>
Apr 14 00:00:44 user nova-compute[82479]:   <guest>
Apr 14 00:00:44 user nova-compute[82479]:     <os_type>hvm</os_type>
Apr 14 00:00:44 user nova-compute[82479]:     <arch name='xtensaeb'>
Apr 14 00:00:44 user nova-compute[82479]:       <wordsize>32</wordsize>
Apr 14 00:00:44 user nova-compute[82479]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='4'>sim</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='32'>kc705</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='32'>ml605</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='32'>ml605-nommu</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='32'>virt</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='32'>lx60-nommu</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='32'>lx200</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='32'>lx200-nommu</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='32'>lx60</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <machine maxCpus='32'>kc705-nommu</machine>
Apr 14 00:00:44 user nova-compute[82479]:       <domain type='qemu'/>
Apr 14 00:00:44 user nova-compute[82479]:     </arch>
Apr 14 00:00:44 user nova-compute[82479]:     <features>
Apr 14 00:00:44 user nova-compute[82479]:       <cpuselection/>
Apr 14 00:00:44 user nova-compute[82479]:       <deviceboot/>
Apr 14 00:00:44 user nova-compute[82479]:       <disksnapshot default='on' toggle='no'/>
Apr 14 00:00:44 user nova-compute[82479]:     </features>
Apr 14 00:00:44 user nova-compute[82479]:   </guest>
Apr 14 00:00:44 user nova-compute[82479]: </capabilities>
Apr 14 00:00:44 user nova-compute[82479]: 
Apr 14 00:00:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=82479) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 00:00:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=82479) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 00:00:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=82479) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 00:00:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=82479) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 00:00:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=82479) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 00:00:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=82479) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 00:00:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=82479) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 00:00:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=82479) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 00:00:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=82479) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 00:00:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Getting domain capabilities for cris via machine types: {None} {{(pid=82479) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 00:00:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=82479) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 00:00:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Getting domain capabilities for i686 via machine types: {'pc', 'ubuntu', 'q35', 'ubuntu-q35'} {{(pid=82479) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 00:00:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Apr 14 00:00:44 user nova-compute[82479]: <domainCapabilities>
Apr 14 00:00:44 user nova-compute[82479]:   <path>/usr/bin/qemu-system-i386</path>
Apr 14 00:00:44 user nova-compute[82479]:   <domain>kvm</domain>
Apr 14 00:00:44 user nova-compute[82479]:   <machine>pc-i440fx-6.2</machine>
Apr 14 00:00:44 user nova-compute[82479]:   <arch>i686</arch>
Apr 14 00:00:44 user nova-compute[82479]:   <vcpu max='255'/>
Apr 14 00:00:44 user nova-compute[82479]:   <iothreads supported='yes'/>
Apr 14 00:00:44 user nova-compute[82479]:   <os supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:     <enum name='firmware'/>
Apr 14 00:00:44 user nova-compute[82479]:     <loader supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 14 00:00:44 user nova-compute[82479]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 14 00:00:44 user nova-compute[82479]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 14 00:00:44 user nova-compute[82479]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 14 00:00:44 user nova-compute[82479]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='type'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>rom</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>pflash</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='readonly'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>yes</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>no</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='secure'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>no</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:     </loader>
Apr 14 00:00:44 user nova-compute[82479]:   </os>
Apr 14 00:00:44 user nova-compute[82479]:   <cpu>
Apr 14 00:00:44 user nova-compute[82479]:     <mode name='host-passthrough' supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='hostPassthroughMigratable'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>off</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:     </mode>
Apr 14 00:00:44 user nova-compute[82479]:     <mode name='maximum' supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='maximumMigratable'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>on</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>off</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:     </mode>
Apr 14 00:00:44 user nova-compute[82479]:     <mode name='host-model' supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <vendor>Intel</vendor>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='ss'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='vmx'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='pcid'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='hypervisor'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='arat'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='umip'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='md-clear'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='stibp'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='ssbd'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='ibpb'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='ibrs'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='amd-stibp'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='disable' name='erms'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='disable' name='lm'/>
Apr 14 00:00:44 user nova-compute[82479]:     </mode>
Apr 14 00:00:44 user nova-compute[82479]:     <mode name='custom' supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>qemu64</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>qemu32</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>phenom</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>pentium3</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>pentium2</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>pentium</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>n270</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>kvm64</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>kvm32</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>coreduo</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>core2duo</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>athlon</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Westmere-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Westmere</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Snowridge</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Skylake-Server</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Skylake-Client</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>SandyBridge</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Penryn</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Opteron_G5</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Opteron_G4</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Opteron_G3</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Opteron_G2</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Opteron_G1</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Nehalem-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Nehalem</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>IvyBridge</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Icelake-Server</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Haswell</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>EPYC-Rome</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>EPYC-Milan</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>EPYC</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Dhyana</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Cooperlake</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Conroe</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Broadwell</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>486</model>
Apr 14 00:00:44 user nova-compute[82479]:     </mode>
Apr 14 00:00:44 user nova-compute[82479]:   </cpu>
Apr 14 00:00:44 user nova-compute[82479]:   <memoryBacking supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:     <enum name='sourceType'>
Apr 14 00:00:44 user nova-compute[82479]:       <value>file</value>
Apr 14 00:00:44 user nova-compute[82479]:       <value>anonymous</value>
Apr 14 00:00:44 user nova-compute[82479]:       <value>memfd</value>
Apr 14 00:00:44 user nova-compute[82479]:     </enum>
Apr 14 00:00:44 user nova-compute[82479]:   </memoryBacking>
Apr 14 00:00:44 user nova-compute[82479]:   <devices>
Apr 14 00:00:44 user nova-compute[82479]:     <disk supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='diskDevice'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>disk</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>cdrom</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>floppy</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>lun</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='bus'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>ide</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>fdc</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>scsi</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>virtio</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>usb</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>sata</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='model'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>virtio</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>virtio-transitional</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>virtio-non-transitional</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:     </disk>
Apr 14 00:00:44 user nova-compute[82479]:     <graphics supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='type'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>sdl</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>vnc</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>spice</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>egl-headless</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:     </graphics>
Apr 14 00:00:44 user nova-compute[82479]:     <video supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='modelType'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>vga</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>cirrus</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>vmvga</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>qxl</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>virtio</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>none</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>bochs</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>ramfb</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:     </video>
Apr 14 00:00:44 user nova-compute[82479]:     <hostdev supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='mode'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>subsystem</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='startupPolicy'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>default</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>mandatory</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>requisite</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>optional</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='subsysType'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>usb</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>pci</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>scsi</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='capsType'/>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='pciBackend'/>
Apr 14 00:00:44 user nova-compute[82479]:     </hostdev>
Apr 14 00:00:44 user nova-compute[82479]:     <rng supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='model'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>virtio</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>virtio-transitional</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>virtio-non-transitional</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='backendModel'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>random</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>egd</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>builtin</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:     </rng>
Apr 14 00:00:44 user nova-compute[82479]:     <filesystem supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='driverType'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>path</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>handle</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>virtiofs</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:     </filesystem>
Apr 14 00:00:44 user nova-compute[82479]:     <tpm supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='model'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>tpm-tis</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>tpm-crb</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='backendModel'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>passthrough</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>emulator</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:     </tpm>
Apr 14 00:00:44 user nova-compute[82479]:   </devices>
Apr 14 00:00:44 user nova-compute[82479]:   <features>
Apr 14 00:00:44 user nova-compute[82479]:     <gic supported='no'/>
Apr 14 00:00:44 user nova-compute[82479]:     <vmcoreinfo supported='yes'/>
Apr 14 00:00:44 user nova-compute[82479]:     <genid supported='yes'/>
Apr 14 00:00:44 user nova-compute[82479]:     <backingStoreInput supported='yes'/>
Apr 14 00:00:44 user nova-compute[82479]:     <backup supported='yes'/>
Apr 14 00:00:44 user nova-compute[82479]:     <sev supported='no'/>
Apr 14 00:00:44 user nova-compute[82479]:   </features>
Apr 14 00:00:44 user nova-compute[82479]: </domainCapabilities>
Apr 14 00:00:44 user nova-compute[82479]:  {{(pid=82479) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 00:00:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Apr 14 00:00:44 user nova-compute[82479]: <domainCapabilities>
Apr 14 00:00:44 user nova-compute[82479]:   <path>/usr/bin/qemu-system-i386</path>
Apr 14 00:00:44 user nova-compute[82479]:   <domain>kvm</domain>
Apr 14 00:00:44 user nova-compute[82479]:   <machine>pc-i440fx-jammy</machine>
Apr 14 00:00:44 user nova-compute[82479]:   <arch>i686</arch>
Apr 14 00:00:44 user nova-compute[82479]:   <vcpu max='255'/>
Apr 14 00:00:44 user nova-compute[82479]:   <iothreads supported='yes'/>
Apr 14 00:00:44 user nova-compute[82479]:   <os supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:     <enum name='firmware'/>
Apr 14 00:00:44 user nova-compute[82479]:     <loader supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 14 00:00:44 user nova-compute[82479]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 14 00:00:44 user nova-compute[82479]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 14 00:00:44 user nova-compute[82479]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 14 00:00:44 user nova-compute[82479]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='type'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>rom</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>pflash</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='readonly'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>yes</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>no</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='secure'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>no</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:     </loader>
Apr 14 00:00:44 user nova-compute[82479]:   </os>
Apr 14 00:00:44 user nova-compute[82479]:   <cpu>
Apr 14 00:00:44 user nova-compute[82479]:     <mode name='host-passthrough' supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='hostPassthroughMigratable'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>off</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:     </mode>
Apr 14 00:00:44 user nova-compute[82479]:     <mode name='maximum' supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='maximumMigratable'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>on</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>off</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:     </mode>
Apr 14 00:00:44 user nova-compute[82479]:     <mode name='host-model' supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <vendor>Intel</vendor>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='ss'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='vmx'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='pcid'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='hypervisor'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='arat'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='umip'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='md-clear'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='stibp'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='ssbd'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='ibpb'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='ibrs'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='amd-stibp'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='disable' name='erms'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='disable' name='lm'/>
Apr 14 00:00:44 user nova-compute[82479]:     </mode>
Apr 14 00:00:44 user nova-compute[82479]:     <mode name='custom' supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>qemu64</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>qemu32</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>phenom</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>pentium3</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>pentium2</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>pentium</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>n270</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>kvm64</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>kvm32</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>coreduo</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>core2duo</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>athlon</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Westmere-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Westmere</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Snowridge</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Skylake-Server</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Skylake-Client</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>SandyBridge</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Penryn</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Opteron_G5</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Opteron_G4</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Opteron_G3</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Opteron_G2</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Opteron_G1</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Nehalem-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Nehalem</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>IvyBridge</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Icelake-Server</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Haswell</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>EPYC-Rome</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>EPYC-Milan</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>EPYC</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Dhyana</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Cooperlake</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Conroe</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Broadwell</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>486</model>
Apr 14 00:00:44 user nova-compute[82479]:     </mode>
Apr 14 00:00:44 user nova-compute[82479]:   </cpu>
Apr 14 00:00:44 user nova-compute[82479]:   <memoryBacking supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:     <enum name='sourceType'>
Apr 14 00:00:44 user nova-compute[82479]:       <value>file</value>
Apr 14 00:00:44 user nova-compute[82479]:       <value>anonymous</value>
Apr 14 00:00:44 user nova-compute[82479]:       <value>memfd</value>
Apr 14 00:00:44 user nova-compute[82479]:     </enum>
Apr 14 00:00:44 user nova-compute[82479]:   </memoryBacking>
Apr 14 00:00:44 user nova-compute[82479]:   <devices>
Apr 14 00:00:44 user nova-compute[82479]:     <disk supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='diskDevice'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>disk</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>cdrom</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>floppy</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>lun</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='bus'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>ide</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>fdc</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>scsi</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>virtio</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>usb</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>sata</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='model'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>virtio</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>virtio-transitional</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>virtio-non-transitional</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:     </disk>
Apr 14 00:00:44 user nova-compute[82479]:     <graphics supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='type'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>sdl</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>vnc</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>spice</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>egl-headless</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:     </graphics>
Apr 14 00:00:44 user nova-compute[82479]:     <video supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='modelType'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>vga</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>cirrus</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>vmvga</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>qxl</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>virtio</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>none</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>bochs</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>ramfb</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:     </video>
Apr 14 00:00:44 user nova-compute[82479]:     <hostdev supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='mode'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>subsystem</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='startupPolicy'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>default</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>mandatory</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>requisite</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>optional</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='subsysType'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>usb</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>pci</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>scsi</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='capsType'/>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='pciBackend'/>
Apr 14 00:00:44 user nova-compute[82479]:     </hostdev>
Apr 14 00:00:44 user nova-compute[82479]:     <rng supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='model'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>virtio</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>virtio-transitional</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>virtio-non-transitional</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='backendModel'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>random</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>egd</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>builtin</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:     </rng>
Apr 14 00:00:44 user nova-compute[82479]:     <filesystem supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='driverType'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>path</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>handle</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>virtiofs</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:     </filesystem>
Apr 14 00:00:44 user nova-compute[82479]:     <tpm supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='model'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>tpm-tis</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>tpm-crb</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='backendModel'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>passthrough</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>emulator</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:     </tpm>
Apr 14 00:00:44 user nova-compute[82479]:   </devices>
Apr 14 00:00:44 user nova-compute[82479]:   <features>
Apr 14 00:00:44 user nova-compute[82479]:     <gic supported='no'/>
Apr 14 00:00:44 user nova-compute[82479]:     <vmcoreinfo supported='yes'/>
Apr 14 00:00:44 user nova-compute[82479]:     <genid supported='yes'/>
Apr 14 00:00:44 user nova-compute[82479]:     <backingStoreInput supported='yes'/>
Apr 14 00:00:44 user nova-compute[82479]:     <backup supported='yes'/>
Apr 14 00:00:44 user nova-compute[82479]:     <sev supported='no'/>
Apr 14 00:00:44 user nova-compute[82479]:   </features>
Apr 14 00:00:44 user nova-compute[82479]: </domainCapabilities>
Apr 14 00:00:44 user nova-compute[82479]:  {{(pid=82479) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 00:00:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Apr 14 00:00:44 user nova-compute[82479]: <domainCapabilities>
Apr 14 00:00:44 user nova-compute[82479]:   <path>/usr/bin/qemu-system-i386</path>
Apr 14 00:00:44 user nova-compute[82479]:   <domain>kvm</domain>
Apr 14 00:00:44 user nova-compute[82479]:   <machine>pc-q35-6.2</machine>
Apr 14 00:00:44 user nova-compute[82479]:   <arch>i686</arch>
Apr 14 00:00:44 user nova-compute[82479]:   <vcpu max='288'/>
Apr 14 00:00:44 user nova-compute[82479]:   <iothreads supported='yes'/>
Apr 14 00:00:44 user nova-compute[82479]:   <os supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:     <enum name='firmware'/>
Apr 14 00:00:44 user nova-compute[82479]:     <loader supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 14 00:00:44 user nova-compute[82479]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 14 00:00:44 user nova-compute[82479]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 14 00:00:44 user nova-compute[82479]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 14 00:00:44 user nova-compute[82479]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='type'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>rom</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>pflash</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='readonly'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>yes</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>no</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='secure'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>no</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:     </loader>
Apr 14 00:00:44 user nova-compute[82479]:   </os>
Apr 14 00:00:44 user nova-compute[82479]:   <cpu>
Apr 14 00:00:44 user nova-compute[82479]:     <mode name='host-passthrough' supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='hostPassthroughMigratable'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>off</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:     </mode>
Apr 14 00:00:44 user nova-compute[82479]:     <mode name='maximum' supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='maximumMigratable'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>on</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>off</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:     </mode>
Apr 14 00:00:44 user nova-compute[82479]:     <mode name='host-model' supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <vendor>Intel</vendor>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='ss'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='vmx'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='pcid'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='hypervisor'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='arat'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='umip'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='md-clear'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='stibp'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='ssbd'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='ibpb'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='ibrs'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='amd-stibp'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='disable' name='erms'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='disable' name='lm'/>
Apr 14 00:00:44 user nova-compute[82479]:     </mode>
Apr 14 00:00:44 user nova-compute[82479]:     <mode name='custom' supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>qemu64</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>qemu32</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>phenom</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>pentium3</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>pentium2</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>pentium</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>n270</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>kvm64</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>kvm32</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>coreduo</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>core2duo</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>athlon</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Westmere-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Westmere</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Snowridge</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Skylake-Server</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Skylake-Client</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>SandyBridge</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Penryn</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Opteron_G5</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Opteron_G4</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Opteron_G3</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Opteron_G2</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Opteron_G1</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Nehalem-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Nehalem</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>IvyBridge</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Icelake-Server</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Haswell</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>EPYC-Rome</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>EPYC-Milan</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>EPYC</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Dhyana</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Cooperlake</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Conroe</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Broadwell</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>486</model>
Apr 14 00:00:44 user nova-compute[82479]:     </mode>
Apr 14 00:00:44 user nova-compute[82479]:   </cpu>
Apr 14 00:00:44 user nova-compute[82479]:   <memoryBacking supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:     <enum name='sourceType'>
Apr 14 00:00:44 user nova-compute[82479]:       <value>file</value>
Apr 14 00:00:44 user nova-compute[82479]:       <value>anonymous</value>
Apr 14 00:00:44 user nova-compute[82479]:       <value>memfd</value>
Apr 14 00:00:44 user nova-compute[82479]:     </enum>
Apr 14 00:00:44 user nova-compute[82479]:   </memoryBacking>
Apr 14 00:00:44 user nova-compute[82479]:   <devices>
Apr 14 00:00:44 user nova-compute[82479]:     <disk supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='diskDevice'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>disk</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>cdrom</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>floppy</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>lun</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='bus'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>fdc</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>scsi</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>virtio</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>usb</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>sata</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='model'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>virtio</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>virtio-transitional</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>virtio-non-transitional</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:     </disk>
Apr 14 00:00:44 user nova-compute[82479]:     <graphics supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='type'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>sdl</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>vnc</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>spice</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>egl-headless</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:     </graphics>
Apr 14 00:00:44 user nova-compute[82479]:     <video supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='modelType'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>vga</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>cirrus</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>vmvga</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>qxl</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>virtio</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>none</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>bochs</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>ramfb</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:     </video>
Apr 14 00:00:44 user nova-compute[82479]:     <hostdev supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='mode'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>subsystem</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='startupPolicy'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>default</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>mandatory</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>requisite</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>optional</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='subsysType'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>usb</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>pci</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>scsi</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='capsType'/>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='pciBackend'/>
Apr 14 00:00:44 user nova-compute[82479]:     </hostdev>
Apr 14 00:00:44 user nova-compute[82479]:     <rng supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='model'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>virtio</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>virtio-transitional</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>virtio-non-transitional</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='backendModel'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>random</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>egd</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>builtin</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:     </rng>
Apr 14 00:00:44 user nova-compute[82479]:     <filesystem supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='driverType'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>path</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>handle</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>virtiofs</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:     </filesystem>
Apr 14 00:00:44 user nova-compute[82479]:     <tpm supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='model'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>tpm-tis</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>tpm-crb</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='backendModel'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>passthrough</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>emulator</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:     </tpm>
Apr 14 00:00:44 user nova-compute[82479]:   </devices>
Apr 14 00:00:44 user nova-compute[82479]:   <features>
Apr 14 00:00:44 user nova-compute[82479]:     <gic supported='no'/>
Apr 14 00:00:44 user nova-compute[82479]:     <vmcoreinfo supported='yes'/>
Apr 14 00:00:44 user nova-compute[82479]:     <genid supported='yes'/>
Apr 14 00:00:44 user nova-compute[82479]:     <backingStoreInput supported='yes'/>
Apr 14 00:00:44 user nova-compute[82479]:     <backup supported='yes'/>
Apr 14 00:00:44 user nova-compute[82479]:     <sev supported='no'/>
Apr 14 00:00:44 user nova-compute[82479]:   </features>
Apr 14 00:00:44 user nova-compute[82479]: </domainCapabilities>
Apr 14 00:00:44 user nova-compute[82479]:  {{(pid=82479) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 00:00:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Apr 14 00:00:44 user nova-compute[82479]: <domainCapabilities>
Apr 14 00:00:44 user nova-compute[82479]:   <path>/usr/bin/qemu-system-i386</path>
Apr 14 00:00:44 user nova-compute[82479]:   <domain>kvm</domain>
Apr 14 00:00:44 user nova-compute[82479]:   <machine>pc-q35-jammy</machine>
Apr 14 00:00:44 user nova-compute[82479]:   <arch>i686</arch>
Apr 14 00:00:44 user nova-compute[82479]:   <vcpu max='288'/>
Apr 14 00:00:44 user nova-compute[82479]:   <iothreads supported='yes'/>
Apr 14 00:00:44 user nova-compute[82479]:   <os supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:     <enum name='firmware'/>
Apr 14 00:00:44 user nova-compute[82479]:     <loader supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 14 00:00:44 user nova-compute[82479]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 14 00:00:44 user nova-compute[82479]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 14 00:00:44 user nova-compute[82479]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 14 00:00:44 user nova-compute[82479]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='type'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>rom</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>pflash</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='readonly'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>yes</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>no</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='secure'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>no</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:     </loader>
Apr 14 00:00:44 user nova-compute[82479]:   </os>
Apr 14 00:00:44 user nova-compute[82479]:   <cpu>
Apr 14 00:00:44 user nova-compute[82479]:     <mode name='host-passthrough' supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='hostPassthroughMigratable'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>off</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:     </mode>
Apr 14 00:00:44 user nova-compute[82479]:     <mode name='maximum' supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='maximumMigratable'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>on</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>off</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:     </mode>
Apr 14 00:00:44 user nova-compute[82479]:     <mode name='host-model' supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <vendor>Intel</vendor>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='ss'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='vmx'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='pcid'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='hypervisor'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='arat'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='umip'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='md-clear'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='stibp'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='ssbd'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='ibpb'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='ibrs'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='amd-stibp'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='disable' name='erms'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='disable' name='lm'/>
Apr 14 00:00:44 user nova-compute[82479]:     </mode>
Apr 14 00:00:44 user nova-compute[82479]:     <mode name='custom' supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>qemu64</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>qemu32</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>phenom</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>pentium3</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>pentium2</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>pentium</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>n270</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>kvm64</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>kvm32</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>coreduo</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>core2duo</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>athlon</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Westmere-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Westmere</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Snowridge</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Skylake-Server</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Skylake-Client</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>SandyBridge</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Penryn</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Opteron_G5</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Opteron_G4</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Opteron_G3</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Opteron_G2</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Opteron_G1</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Nehalem-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Nehalem</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>IvyBridge</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Icelake-Server</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Haswell</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>EPYC-Rome</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>EPYC-Milan</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>EPYC</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Dhyana</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Cooperlake</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Conroe</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Broadwell</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>486</model>
Apr 14 00:00:44 user nova-compute[82479]:     </mode>
Apr 14 00:00:44 user nova-compute[82479]:   </cpu>
Apr 14 00:00:44 user nova-compute[82479]:   <memoryBacking supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:     <enum name='sourceType'>
Apr 14 00:00:44 user nova-compute[82479]:       <value>file</value>
Apr 14 00:00:44 user nova-compute[82479]:       <value>anonymous</value>
Apr 14 00:00:44 user nova-compute[82479]:       <value>memfd</value>
Apr 14 00:00:44 user nova-compute[82479]:     </enum>
Apr 14 00:00:44 user nova-compute[82479]:   </memoryBacking>
Apr 14 00:00:44 user nova-compute[82479]:   <devices>
Apr 14 00:00:44 user nova-compute[82479]:     <disk supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='diskDevice'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>disk</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>cdrom</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>floppy</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>lun</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='bus'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>fdc</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>scsi</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>virtio</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>usb</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>sata</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='model'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>virtio</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>virtio-transitional</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>virtio-non-transitional</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:     </disk>
Apr 14 00:00:44 user nova-compute[82479]:     <graphics supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='type'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>sdl</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>vnc</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>spice</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>egl-headless</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:     </graphics>
Apr 14 00:00:44 user nova-compute[82479]:     <video supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='modelType'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>vga</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>cirrus</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>vmvga</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>qxl</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>virtio</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>none</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>bochs</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>ramfb</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:     </video>
Apr 14 00:00:44 user nova-compute[82479]:     <hostdev supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='mode'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>subsystem</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='startupPolicy'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>default</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>mandatory</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>requisite</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>optional</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='subsysType'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>usb</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>pci</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>scsi</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='capsType'/>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='pciBackend'/>
Apr 14 00:00:44 user nova-compute[82479]:     </hostdev>
Apr 14 00:00:44 user nova-compute[82479]:     <rng supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='model'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>virtio</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>virtio-transitional</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>virtio-non-transitional</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='backendModel'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>random</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>egd</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>builtin</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:     </rng>
Apr 14 00:00:44 user nova-compute[82479]:     <filesystem supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='driverType'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>path</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>handle</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>virtiofs</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:     </filesystem>
Apr 14 00:00:44 user nova-compute[82479]:     <tpm supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='model'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>tpm-tis</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>tpm-crb</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='backendModel'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>passthrough</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>emulator</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:     </tpm>
Apr 14 00:00:44 user nova-compute[82479]:   </devices>
Apr 14 00:00:44 user nova-compute[82479]:   <features>
Apr 14 00:00:44 user nova-compute[82479]:     <gic supported='no'/>
Apr 14 00:00:44 user nova-compute[82479]:     <vmcoreinfo supported='yes'/>
Apr 14 00:00:44 user nova-compute[82479]:     <genid supported='yes'/>
Apr 14 00:00:44 user nova-compute[82479]:     <backingStoreInput supported='yes'/>
Apr 14 00:00:44 user nova-compute[82479]:     <backup supported='yes'/>
Apr 14 00:00:44 user nova-compute[82479]:     <sev supported='no'/>
Apr 14 00:00:44 user nova-compute[82479]:   </features>
Apr 14 00:00:44 user nova-compute[82479]: </domainCapabilities>
Apr 14 00:00:44 user nova-compute[82479]:  {{(pid=82479) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 00:00:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=82479) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 00:00:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=82479) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 00:00:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=82479) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 00:00:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=82479) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 00:00:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=82479) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 00:00:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=82479) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 00:00:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=82479) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 00:00:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Getting domain capabilities for mips via machine types: {None} {{(pid=82479) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 00:00:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=82479) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 00:00:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=82479) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 00:00:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=82479) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 00:00:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=82479) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 00:00:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=82479) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 00:00:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=82479) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 00:00:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=82479) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 00:00:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=82479) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 00:00:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=82479) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 00:00:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Getting domain capabilities for ppc64 via machine types: {'powernv', None, 'pseries'} {{(pid=82479) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 00:00:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=82479) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 00:00:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=82479) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 00:00:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=82479) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 00:00:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=82479) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 00:00:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=82479) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 00:00:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=82479) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 00:00:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=82479) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 00:00:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=82479) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 00:00:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=82479) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 00:00:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=82479) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 00:00:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=82479) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 00:00:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=82479) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 00:00:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=82479) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 00:00:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=82479) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 00:00:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=82479) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 00:00:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=82479) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 00:00:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=82479) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 00:00:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=82479) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 00:00:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=82479) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 00:00:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=82479) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 00:00:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'ubuntu', 'q35', 'ubuntu-q35'} {{(pid=82479) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 00:00:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Apr 14 00:00:44 user nova-compute[82479]: <domainCapabilities>
Apr 14 00:00:44 user nova-compute[82479]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 14 00:00:44 user nova-compute[82479]:   <domain>kvm</domain>
Apr 14 00:00:44 user nova-compute[82479]:   <machine>pc-i440fx-6.2</machine>
Apr 14 00:00:44 user nova-compute[82479]:   <arch>x86_64</arch>
Apr 14 00:00:44 user nova-compute[82479]:   <vcpu max='255'/>
Apr 14 00:00:44 user nova-compute[82479]:   <iothreads supported='yes'/>
Apr 14 00:00:44 user nova-compute[82479]:   <os supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:     <enum name='firmware'>
Apr 14 00:00:44 user nova-compute[82479]:       <value>efi</value>
Apr 14 00:00:44 user nova-compute[82479]:     </enum>
Apr 14 00:00:44 user nova-compute[82479]:     <loader supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='type'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>rom</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>pflash</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='readonly'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>yes</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>no</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='secure'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>no</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:     </loader>
Apr 14 00:00:44 user nova-compute[82479]:   </os>
Apr 14 00:00:44 user nova-compute[82479]:   <cpu>
Apr 14 00:00:44 user nova-compute[82479]:     <mode name='host-passthrough' supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='hostPassthroughMigratable'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>on</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>off</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:     </mode>
Apr 14 00:00:44 user nova-compute[82479]:     <mode name='maximum' supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='maximumMigratable'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>on</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>off</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:     </mode>
Apr 14 00:00:44 user nova-compute[82479]:     <mode name='host-model' supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <vendor>Intel</vendor>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='ss'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='vmx'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='pcid'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='hypervisor'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='arat'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='umip'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='md-clear'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='stibp'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='ssbd'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='invtsc'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='ibpb'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='ibrs'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='amd-stibp'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='rsba'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='pschange-mc-no'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='disable' name='erms'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 00:00:44 user nova-compute[82479]:     </mode>
Apr 14 00:00:44 user nova-compute[82479]:     <mode name='custom' supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>qemu64</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>qemu32</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>phenom</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>pentium3</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>pentium2</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>pentium</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>n270</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>kvm64</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>kvm32</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>coreduo</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>core2duo</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>athlon</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>Westmere-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>Westmere</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Snowridge</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Skylake-Server</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Skylake-Client</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>SandyBridge</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>Penryn</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Opteron_G5</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Opteron_G4</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Opteron_G3</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Opteron_G2</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>Opteron_G1</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>Nehalem</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>IvyBridge</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Icelake-Server</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Haswell</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>EPYC-Rome</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>EPYC-Milan</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>EPYC</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Dhyana</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Cooperlake</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>Conroe</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Broadwell</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>486</model>
Apr 14 00:00:44 user nova-compute[82479]:     </mode>
Apr 14 00:00:44 user nova-compute[82479]:   </cpu>
Apr 14 00:00:44 user nova-compute[82479]:   <memoryBacking supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:     <enum name='sourceType'>
Apr 14 00:00:44 user nova-compute[82479]:       <value>file</value>
Apr 14 00:00:44 user nova-compute[82479]:       <value>anonymous</value>
Apr 14 00:00:44 user nova-compute[82479]:       <value>memfd</value>
Apr 14 00:00:44 user nova-compute[82479]:     </enum>
Apr 14 00:00:44 user nova-compute[82479]:   </memoryBacking>
Apr 14 00:00:44 user nova-compute[82479]:   <devices>
Apr 14 00:00:44 user nova-compute[82479]:     <disk supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='diskDevice'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>disk</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>cdrom</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>floppy</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>lun</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='bus'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>ide</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>fdc</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>scsi</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>virtio</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>usb</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>sata</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='model'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>virtio</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>virtio-transitional</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>virtio-non-transitional</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:     </disk>
Apr 14 00:00:44 user nova-compute[82479]:     <graphics supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='type'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>sdl</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>vnc</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>spice</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>egl-headless</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:     </graphics>
Apr 14 00:00:44 user nova-compute[82479]:     <video supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='modelType'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>vga</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>cirrus</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>vmvga</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>qxl</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>virtio</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>none</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>bochs</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>ramfb</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:     </video>
Apr 14 00:00:44 user nova-compute[82479]:     <hostdev supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='mode'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>subsystem</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='startupPolicy'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>default</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>mandatory</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>requisite</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>optional</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='subsysType'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>usb</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>pci</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>scsi</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='capsType'/>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='pciBackend'/>
Apr 14 00:00:44 user nova-compute[82479]:     </hostdev>
Apr 14 00:00:44 user nova-compute[82479]:     <rng supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='model'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>virtio</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>virtio-transitional</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>virtio-non-transitional</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='backendModel'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>random</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>egd</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>builtin</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:     </rng>
Apr 14 00:00:44 user nova-compute[82479]:     <filesystem supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='driverType'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>path</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>handle</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>virtiofs</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:     </filesystem>
Apr 14 00:00:44 user nova-compute[82479]:     <tpm supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='model'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>tpm-tis</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>tpm-crb</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='backendModel'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>passthrough</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>emulator</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:     </tpm>
Apr 14 00:00:44 user nova-compute[82479]:   </devices>
Apr 14 00:00:44 user nova-compute[82479]:   <features>
Apr 14 00:00:44 user nova-compute[82479]:     <gic supported='no'/>
Apr 14 00:00:44 user nova-compute[82479]:     <vmcoreinfo supported='yes'/>
Apr 14 00:00:44 user nova-compute[82479]:     <genid supported='yes'/>
Apr 14 00:00:44 user nova-compute[82479]:     <backingStoreInput supported='yes'/>
Apr 14 00:00:44 user nova-compute[82479]:     <backup supported='yes'/>
Apr 14 00:00:44 user nova-compute[82479]:     <sev supported='no'/>
Apr 14 00:00:44 user nova-compute[82479]:   </features>
Apr 14 00:00:44 user nova-compute[82479]: </domainCapabilities>
Apr 14 00:00:44 user nova-compute[82479]:  {{(pid=82479) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 00:00:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Apr 14 00:00:44 user nova-compute[82479]: <domainCapabilities>
Apr 14 00:00:44 user nova-compute[82479]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 14 00:00:44 user nova-compute[82479]:   <domain>kvm</domain>
Apr 14 00:00:44 user nova-compute[82479]:   <machine>pc-i440fx-jammy</machine>
Apr 14 00:00:44 user nova-compute[82479]:   <arch>x86_64</arch>
Apr 14 00:00:44 user nova-compute[82479]:   <vcpu max='255'/>
Apr 14 00:00:44 user nova-compute[82479]:   <iothreads supported='yes'/>
Apr 14 00:00:44 user nova-compute[82479]:   <os supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:     <enum name='firmware'>
Apr 14 00:00:44 user nova-compute[82479]:       <value>efi</value>
Apr 14 00:00:44 user nova-compute[82479]:     </enum>
Apr 14 00:00:44 user nova-compute[82479]:     <loader supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='type'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>rom</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>pflash</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='readonly'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>yes</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>no</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='secure'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>no</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:     </loader>
Apr 14 00:00:44 user nova-compute[82479]:   </os>
Apr 14 00:00:44 user nova-compute[82479]:   <cpu>
Apr 14 00:00:44 user nova-compute[82479]:     <mode name='host-passthrough' supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='hostPassthroughMigratable'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>on</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>off</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:     </mode>
Apr 14 00:00:44 user nova-compute[82479]:     <mode name='maximum' supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='maximumMigratable'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>on</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>off</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:     </mode>
Apr 14 00:00:44 user nova-compute[82479]:     <mode name='host-model' supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <vendor>Intel</vendor>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='ss'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='vmx'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='pcid'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='hypervisor'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='arat'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='umip'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='md-clear'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='stibp'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='ssbd'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='invtsc'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='ibpb'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='ibrs'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='amd-stibp'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='rsba'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='pschange-mc-no'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='disable' name='erms'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 00:00:44 user nova-compute[82479]:     </mode>
Apr 14 00:00:44 user nova-compute[82479]:     <mode name='custom' supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>qemu64</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>qemu32</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>phenom</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>pentium3</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>pentium2</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>pentium</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>n270</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>kvm64</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>kvm32</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>coreduo</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>core2duo</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>athlon</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>Westmere-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>Westmere</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Snowridge</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Skylake-Server</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Skylake-Client</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>SandyBridge</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>Penryn</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Opteron_G5</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Opteron_G4</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Opteron_G3</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Opteron_G2</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>Opteron_G1</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>Nehalem</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>IvyBridge</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Icelake-Server</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Haswell</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>EPYC-Rome</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>EPYC-Milan</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>EPYC</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Dhyana</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Cooperlake</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>Conroe</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Broadwell</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>486</model>
Apr 14 00:00:44 user nova-compute[82479]:     </mode>
Apr 14 00:00:44 user nova-compute[82479]:   </cpu>
Apr 14 00:00:44 user nova-compute[82479]:   <memoryBacking supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:     <enum name='sourceType'>
Apr 14 00:00:44 user nova-compute[82479]:       <value>file</value>
Apr 14 00:00:44 user nova-compute[82479]:       <value>anonymous</value>
Apr 14 00:00:44 user nova-compute[82479]:       <value>memfd</value>
Apr 14 00:00:44 user nova-compute[82479]:     </enum>
Apr 14 00:00:44 user nova-compute[82479]:   </memoryBacking>
Apr 14 00:00:44 user nova-compute[82479]:   <devices>
Apr 14 00:00:44 user nova-compute[82479]:     <disk supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='diskDevice'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>disk</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>cdrom</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>floppy</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>lun</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='bus'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>ide</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>fdc</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>scsi</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>virtio</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>usb</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>sata</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='model'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>virtio</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>virtio-transitional</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>virtio-non-transitional</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:     </disk>
Apr 14 00:00:44 user nova-compute[82479]:     <graphics supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='type'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>sdl</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>vnc</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>spice</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>egl-headless</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:     </graphics>
Apr 14 00:00:44 user nova-compute[82479]:     <video supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='modelType'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>vga</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>cirrus</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>vmvga</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>qxl</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>virtio</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>none</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>bochs</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>ramfb</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:     </video>
Apr 14 00:00:44 user nova-compute[82479]:     <hostdev supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='mode'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>subsystem</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='startupPolicy'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>default</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>mandatory</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>requisite</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>optional</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='subsysType'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>usb</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>pci</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>scsi</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='capsType'/>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='pciBackend'/>
Apr 14 00:00:44 user nova-compute[82479]:     </hostdev>
Apr 14 00:00:44 user nova-compute[82479]:     <rng supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='model'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>virtio</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>virtio-transitional</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>virtio-non-transitional</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='backendModel'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>random</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>egd</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>builtin</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:     </rng>
Apr 14 00:00:44 user nova-compute[82479]:     <filesystem supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='driverType'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>path</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>handle</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>virtiofs</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:     </filesystem>
Apr 14 00:00:44 user nova-compute[82479]:     <tpm supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='model'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>tpm-tis</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>tpm-crb</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='backendModel'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>passthrough</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>emulator</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:     </tpm>
Apr 14 00:00:44 user nova-compute[82479]:   </devices>
Apr 14 00:00:44 user nova-compute[82479]:   <features>
Apr 14 00:00:44 user nova-compute[82479]:     <gic supported='no'/>
Apr 14 00:00:44 user nova-compute[82479]:     <vmcoreinfo supported='yes'/>
Apr 14 00:00:44 user nova-compute[82479]:     <genid supported='yes'/>
Apr 14 00:00:44 user nova-compute[82479]:     <backingStoreInput supported='yes'/>
Apr 14 00:00:44 user nova-compute[82479]:     <backup supported='yes'/>
Apr 14 00:00:44 user nova-compute[82479]:     <sev supported='no'/>
Apr 14 00:00:44 user nova-compute[82479]:   </features>
Apr 14 00:00:44 user nova-compute[82479]: </domainCapabilities>
Apr 14 00:00:44 user nova-compute[82479]:  {{(pid=82479) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 00:00:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Apr 14 00:00:44 user nova-compute[82479]: <domainCapabilities>
Apr 14 00:00:44 user nova-compute[82479]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 14 00:00:44 user nova-compute[82479]:   <domain>kvm</domain>
Apr 14 00:00:44 user nova-compute[82479]:   <machine>pc-q35-6.2</machine>
Apr 14 00:00:44 user nova-compute[82479]:   <arch>x86_64</arch>
Apr 14 00:00:44 user nova-compute[82479]:   <vcpu max='288'/>
Apr 14 00:00:44 user nova-compute[82479]:   <iothreads supported='yes'/>
Apr 14 00:00:44 user nova-compute[82479]:   <os supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:     <enum name='firmware'>
Apr 14 00:00:44 user nova-compute[82479]:       <value>efi</value>
Apr 14 00:00:44 user nova-compute[82479]:     </enum>
Apr 14 00:00:44 user nova-compute[82479]:     <loader supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Apr 14 00:00:44 user nova-compute[82479]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Apr 14 00:00:44 user nova-compute[82479]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='type'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>rom</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>pflash</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='readonly'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>yes</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>no</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='secure'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>yes</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>no</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:     </loader>
Apr 14 00:00:44 user nova-compute[82479]:   </os>
Apr 14 00:00:44 user nova-compute[82479]:   <cpu>
Apr 14 00:00:44 user nova-compute[82479]:     <mode name='host-passthrough' supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='hostPassthroughMigratable'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>on</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>off</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:     </mode>
Apr 14 00:00:44 user nova-compute[82479]:     <mode name='maximum' supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='maximumMigratable'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>on</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>off</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:     </mode>
Apr 14 00:00:44 user nova-compute[82479]:     <mode name='host-model' supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <vendor>Intel</vendor>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='ss'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='vmx'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='pcid'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='hypervisor'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='arat'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='umip'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='md-clear'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='stibp'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='ssbd'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='invtsc'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='ibpb'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='ibrs'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='amd-stibp'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='rsba'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='pschange-mc-no'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='disable' name='erms'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 00:00:44 user nova-compute[82479]:     </mode>
Apr 14 00:00:44 user nova-compute[82479]:     <mode name='custom' supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>qemu64</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>qemu32</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>phenom</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>pentium3</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>pentium2</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>pentium</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>n270</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>kvm64</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>kvm32</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>coreduo</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>core2duo</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>athlon</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>Westmere-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>Westmere</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Snowridge</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Skylake-Server</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Skylake-Client</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>SandyBridge</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>Penryn</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Opteron_G5</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Opteron_G4</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Opteron_G3</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Opteron_G2</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>Opteron_G1</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>Nehalem</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>IvyBridge</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Icelake-Server</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Haswell</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>EPYC-Rome</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>EPYC-Milan</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>EPYC</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Dhyana</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Cooperlake</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>Conroe</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Broadwell</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>486</model>
Apr 14 00:00:44 user nova-compute[82479]:     </mode>
Apr 14 00:00:44 user nova-compute[82479]:   </cpu>
Apr 14 00:00:44 user nova-compute[82479]:   <memoryBacking supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:     <enum name='sourceType'>
Apr 14 00:00:44 user nova-compute[82479]:       <value>file</value>
Apr 14 00:00:44 user nova-compute[82479]:       <value>anonymous</value>
Apr 14 00:00:44 user nova-compute[82479]:       <value>memfd</value>
Apr 14 00:00:44 user nova-compute[82479]:     </enum>
Apr 14 00:00:44 user nova-compute[82479]:   </memoryBacking>
Apr 14 00:00:44 user nova-compute[82479]:   <devices>
Apr 14 00:00:44 user nova-compute[82479]:     <disk supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='diskDevice'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>disk</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>cdrom</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>floppy</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>lun</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='bus'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>fdc</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>scsi</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>virtio</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>usb</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>sata</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='model'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>virtio</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>virtio-transitional</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>virtio-non-transitional</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:     </disk>
Apr 14 00:00:44 user nova-compute[82479]:     <graphics supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='type'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>sdl</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>vnc</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>spice</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>egl-headless</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:     </graphics>
Apr 14 00:00:44 user nova-compute[82479]:     <video supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='modelType'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>vga</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>cirrus</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>vmvga</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>qxl</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>virtio</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>none</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>bochs</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>ramfb</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:     </video>
Apr 14 00:00:44 user nova-compute[82479]:     <hostdev supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='mode'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>subsystem</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='startupPolicy'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>default</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>mandatory</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>requisite</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>optional</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='subsysType'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>usb</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>pci</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>scsi</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='capsType'/>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='pciBackend'/>
Apr 14 00:00:44 user nova-compute[82479]:     </hostdev>
Apr 14 00:00:44 user nova-compute[82479]:     <rng supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='model'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>virtio</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>virtio-transitional</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>virtio-non-transitional</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='backendModel'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>random</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>egd</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>builtin</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:     </rng>
Apr 14 00:00:44 user nova-compute[82479]:     <filesystem supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='driverType'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>path</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>handle</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>virtiofs</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:     </filesystem>
Apr 14 00:00:44 user nova-compute[82479]:     <tpm supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='model'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>tpm-tis</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>tpm-crb</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='backendModel'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>passthrough</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>emulator</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:     </tpm>
Apr 14 00:00:44 user nova-compute[82479]:   </devices>
Apr 14 00:00:44 user nova-compute[82479]:   <features>
Apr 14 00:00:44 user nova-compute[82479]:     <gic supported='no'/>
Apr 14 00:00:44 user nova-compute[82479]:     <vmcoreinfo supported='yes'/>
Apr 14 00:00:44 user nova-compute[82479]:     <genid supported='yes'/>
Apr 14 00:00:44 user nova-compute[82479]:     <backingStoreInput supported='yes'/>
Apr 14 00:00:44 user nova-compute[82479]:     <backup supported='yes'/>
Apr 14 00:00:44 user nova-compute[82479]:     <sev supported='no'/>
Apr 14 00:00:44 user nova-compute[82479]:   </features>
Apr 14 00:00:44 user nova-compute[82479]: </domainCapabilities>
Apr 14 00:00:44 user nova-compute[82479]:  {{(pid=82479) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 00:00:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Apr 14 00:00:44 user nova-compute[82479]: <domainCapabilities>
Apr 14 00:00:44 user nova-compute[82479]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 14 00:00:44 user nova-compute[82479]:   <domain>kvm</domain>
Apr 14 00:00:44 user nova-compute[82479]:   <machine>pc-q35-jammy</machine>
Apr 14 00:00:44 user nova-compute[82479]:   <arch>x86_64</arch>
Apr 14 00:00:44 user nova-compute[82479]:   <vcpu max='288'/>
Apr 14 00:00:44 user nova-compute[82479]:   <iothreads supported='yes'/>
Apr 14 00:00:44 user nova-compute[82479]:   <os supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:     <enum name='firmware'>
Apr 14 00:00:44 user nova-compute[82479]:       <value>efi</value>
Apr 14 00:00:44 user nova-compute[82479]:     </enum>
Apr 14 00:00:44 user nova-compute[82479]:     <loader supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Apr 14 00:00:44 user nova-compute[82479]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Apr 14 00:00:44 user nova-compute[82479]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='type'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>rom</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>pflash</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='readonly'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>yes</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>no</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='secure'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>yes</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>no</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:     </loader>
Apr 14 00:00:44 user nova-compute[82479]:   </os>
Apr 14 00:00:44 user nova-compute[82479]:   <cpu>
Apr 14 00:00:44 user nova-compute[82479]:     <mode name='host-passthrough' supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='hostPassthroughMigratable'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>on</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>off</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:     </mode>
Apr 14 00:00:44 user nova-compute[82479]:     <mode name='maximum' supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='maximumMigratable'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>on</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>off</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:     </mode>
Apr 14 00:00:44 user nova-compute[82479]:     <mode name='host-model' supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <vendor>Intel</vendor>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='ss'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='vmx'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='pcid'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='hypervisor'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='arat'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='umip'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='md-clear'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='stibp'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='ssbd'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='invtsc'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='ibpb'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='ibrs'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='amd-stibp'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='rsba'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='require' name='pschange-mc-no'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='disable' name='erms'/>
Apr 14 00:00:44 user nova-compute[82479]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 00:00:44 user nova-compute[82479]:     </mode>
Apr 14 00:00:44 user nova-compute[82479]:     <mode name='custom' supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>qemu64</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>qemu32</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>phenom</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>pentium3</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>pentium2</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>pentium</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>n270</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>kvm64</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>kvm32</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>coreduo</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>core2duo</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>athlon</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>Westmere-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>Westmere</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Snowridge</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Skylake-Server</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Skylake-Client</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>SandyBridge</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>Penryn</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Opteron_G5</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Opteron_G4</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Opteron_G3</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Opteron_G2</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>Opteron_G1</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>Nehalem</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>IvyBridge</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Icelake-Server</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Haswell</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>EPYC-Rome</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>EPYC-Milan</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>EPYC</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Dhyana</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Cooperlake</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>Conroe</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='no'>Broadwell</model>
Apr 14 00:00:44 user nova-compute[82479]:       <model usable='yes'>486</model>
Apr 14 00:00:44 user nova-compute[82479]:     </mode>
Apr 14 00:00:44 user nova-compute[82479]:   </cpu>
Apr 14 00:00:44 user nova-compute[82479]:   <memoryBacking supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:     <enum name='sourceType'>
Apr 14 00:00:44 user nova-compute[82479]:       <value>file</value>
Apr 14 00:00:44 user nova-compute[82479]:       <value>anonymous</value>
Apr 14 00:00:44 user nova-compute[82479]:       <value>memfd</value>
Apr 14 00:00:44 user nova-compute[82479]:     </enum>
Apr 14 00:00:44 user nova-compute[82479]:   </memoryBacking>
Apr 14 00:00:44 user nova-compute[82479]:   <devices>
Apr 14 00:00:44 user nova-compute[82479]:     <disk supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='diskDevice'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>disk</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>cdrom</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>floppy</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>lun</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='bus'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>fdc</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>scsi</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>virtio</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>usb</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>sata</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='model'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>virtio</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>virtio-transitional</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>virtio-non-transitional</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:     </disk>
Apr 14 00:00:44 user nova-compute[82479]:     <graphics supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='type'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>sdl</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>vnc</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>spice</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>egl-headless</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:     </graphics>
Apr 14 00:00:44 user nova-compute[82479]:     <video supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='modelType'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>vga</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>cirrus</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>vmvga</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>qxl</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>virtio</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>none</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>bochs</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>ramfb</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:     </video>
Apr 14 00:00:44 user nova-compute[82479]:     <hostdev supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='mode'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>subsystem</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='startupPolicy'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>default</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>mandatory</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>requisite</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>optional</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='subsysType'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>usb</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>pci</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>scsi</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='capsType'/>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='pciBackend'/>
Apr 14 00:00:44 user nova-compute[82479]:     </hostdev>
Apr 14 00:00:44 user nova-compute[82479]:     <rng supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='model'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>virtio</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>virtio-transitional</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>virtio-non-transitional</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='backendModel'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>random</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>egd</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>builtin</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:     </rng>
Apr 14 00:00:44 user nova-compute[82479]:     <filesystem supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='driverType'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>path</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>handle</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>virtiofs</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:     </filesystem>
Apr 14 00:00:44 user nova-compute[82479]:     <tpm supported='yes'>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='model'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>tpm-tis</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>tpm-crb</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:       <enum name='backendModel'>
Apr 14 00:00:44 user nova-compute[82479]:         <value>passthrough</value>
Apr 14 00:00:44 user nova-compute[82479]:         <value>emulator</value>
Apr 14 00:00:44 user nova-compute[82479]:       </enum>
Apr 14 00:00:44 user nova-compute[82479]:     </tpm>
Apr 14 00:00:44 user nova-compute[82479]:   </devices>
Apr 14 00:00:44 user nova-compute[82479]:   <features>
Apr 14 00:00:44 user nova-compute[82479]:     <gic supported='no'/>
Apr 14 00:00:44 user nova-compute[82479]:     <vmcoreinfo supported='yes'/>
Apr 14 00:00:44 user nova-compute[82479]:     <genid supported='yes'/>
Apr 14 00:00:44 user nova-compute[82479]:     <backingStoreInput supported='yes'/>
Apr 14 00:00:44 user nova-compute[82479]:     <backup supported='yes'/>
Apr 14 00:00:44 user nova-compute[82479]:     <sev supported='no'/>
Apr 14 00:00:44 user nova-compute[82479]:   </features>
Apr 14 00:00:44 user nova-compute[82479]: </domainCapabilities>
Apr 14 00:00:44 user nova-compute[82479]:  {{(pid=82479) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 00:00:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=82479) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 00:00:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=82479) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 00:00:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=82479) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 00:00:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=82479) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 00:00:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Checking secure boot support for host arch (x86_64) {{(pid=82479) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 14 00:00:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Checking secure boot support for host arch (x86_64) {{(pid=82479) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 14 00:00:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Checking secure boot support for host arch (x86_64) {{(pid=82479) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 14 00:00:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Checking secure boot support for host arch (x86_64) {{(pid=82479) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 14 00:00:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Checking secure boot support for host arch (x86_64) {{(pid=82479) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 14 00:00:44 user nova-compute[82479]: INFO nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Secure Boot support detected
Apr 14 00:00:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] cpu compare xml: <cpu match="exact">
Apr 14 00:00:44 user nova-compute[82479]:   <model>Nehalem</model>
Apr 14 00:00:44 user nova-compute[82479]: </cpu>
Apr 14 00:00:44 user nova-compute[82479]:  {{(pid=82479) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:9996}}
Apr 14 00:00:44 user nova-compute[82479]: INFO nova.virt.node [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Generated node identity 3847975a-19aa-4b27-9180-14b5cc49044a
Apr 14 00:00:44 user nova-compute[82479]: INFO nova.virt.node [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Wrote node identity 3847975a-19aa-4b27-9180-14b5cc49044a to /opt/stack/data/nova/compute_id
Apr 14 00:00:44 user nova-compute[82479]: WARNING nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Compute nodes ['3847975a-19aa-4b27-9180-14b5cc49044a'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Apr 14 00:00:45 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Apr 14 00:00:45 user nova-compute[82479]: WARNING nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Apr 14 00:00:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:00:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:00:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:00:45 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Auditing locally available compute resources for user (node: user) {{(pid=82479) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 00:00:45 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:00:45 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:00:45 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Hypervisor/Node resource view: name=user free_ram=10818MB free_disk=27.081424713134766GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=82479) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 00:00:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:00:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:00:45 user nova-compute[82479]: WARNING nova.compute.resource_tracker [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] No compute node record for user:3847975a-19aa-4b27-9180-14b5cc49044a: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 3847975a-19aa-4b27-9180-14b5cc49044a could not be found.
Apr 14 00:00:45 user nova-compute[82479]: INFO nova.compute.resource_tracker [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Compute node record created for user:user with uuid: 3847975a-19aa-4b27-9180-14b5cc49044a
Apr 14 00:00:45 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 00:00:45 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 00:00:45 user nova-compute[82479]: INFO nova.scheduler.client.report [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [req-c50d860a-db43-4520-acc1-812ed571b598] Created resource provider record via placement API for resource provider with UUID 3847975a-19aa-4b27-9180-14b5cc49044a and name user.
Apr 14 00:00:45 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=82479) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1766}}
Apr 14 00:00:45 user nova-compute[82479]: INFO nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] kernel doesn't support AMD SEV
Apr 14 00:00:45 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Updating inventory in ProviderTree for provider 3847975a-19aa-4b27-9180-14b5cc49044a with inventory: {'MEMORY_MB': {'total': 16023, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 00:00:45 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82479) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 00:00:45 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Libvirt baseline CPU <cpu>
Apr 14 00:00:45 user nova-compute[82479]:   <arch>x86_64</arch>
Apr 14 00:00:45 user nova-compute[82479]:   <model>Nehalem</model>
Apr 14 00:00:45 user nova-compute[82479]:   <vendor>Intel</vendor>
Apr 14 00:00:45 user nova-compute[82479]:   <topology sockets="6" cores="1" threads="1"/>
Apr 14 00:00:45 user nova-compute[82479]: </cpu>
Apr 14 00:00:45 user nova-compute[82479]:  {{(pid=82479) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12486}}
Apr 14 00:00:45 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Updated inventory for provider 3847975a-19aa-4b27-9180-14b5cc49044a with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16023, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Apr 14 00:00:45 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Updating resource provider 3847975a-19aa-4b27-9180-14b5cc49044a generation from 0 to 1 during operation: update_inventory {{(pid=82479) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Apr 14 00:00:45 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Updating inventory in ProviderTree for provider 3847975a-19aa-4b27-9180-14b5cc49044a with inventory: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 00:00:46 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Updating resource provider 3847975a-19aa-4b27-9180-14b5cc49044a generation from 1 to 2 during operation: update_traits {{(pid=82479) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Apr 14 00:00:46 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Compute_service record updated for user:user {{(pid=82479) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 00:00:46 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.756s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:00:46 user nova-compute[82479]: DEBUG nova.service [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Creating RPC server for service compute {{(pid=82479) start /opt/stack/nova/nova/service.py:182}}
Apr 14 00:00:46 user nova-compute[82479]: DEBUG nova.service [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Join ServiceGroup membership for this service compute {{(pid=82479) start /opt/stack/nova/nova/service.py:199}}
Apr 14 00:00:46 user nova-compute[82479]: DEBUG nova.servicegroup.drivers.db [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=82479) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Apr 14 00:01:35 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._sync_power_states {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:01:35 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:01:36 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:01:36 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:01:36 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Starting heal instance info cache {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 00:01:36 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Rebuilding the list of instances to heal {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 00:01:36 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Didn't find any instances for network info cache update. {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 00:01:36 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:01:36 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:01:36 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:01:36 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:01:36 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:01:36 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:01:36 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82479) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 00:01:36 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:01:36 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:01:36 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:01:36 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:01:36 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Auditing locally available compute resources for user (node: user) {{(pid=82479) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 00:01:37 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:01:37 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:01:37 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Hypervisor/Node resource view: name=user free_ram=10200MB free_disk=26.99521255493164GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=82479) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 00:01:37 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:01:37 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:01:37 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 00:01:37 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 00:01:37 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:01:37 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:01:37 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Compute_service record updated for user:user {{(pid=82479) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 00:01:37 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.148s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:02:37 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:02:37 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:02:37 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:02:37 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Starting heal instance info cache {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 00:02:37 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Rebuilding the list of instances to heal {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 00:02:37 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Didn't find any instances for network info cache update. {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 00:02:37 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:02:37 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:02:38 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:02:38 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:02:38 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:02:38 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:02:38 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82479) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 00:02:38 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:02:38 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:02:38 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:02:38 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:02:38 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Auditing locally available compute resources for user (node: user) {{(pid=82479) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 00:02:38 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:02:38 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:02:38 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Hypervisor/Node resource view: name=user free_ram=10141MB free_disk=27.041255950927734GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=82479) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 00:02:38 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:02:38 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:02:38 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 00:02:38 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 00:02:39 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:02:39 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:02:39 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Compute_service record updated for user:user {{(pid=82479) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 00:02:39 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.116s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:03:37 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:03:37 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:03:38 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:03:38 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Starting heal instance info cache {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 00:03:38 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Rebuilding the list of instances to heal {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 00:03:38 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Didn't find any instances for network info cache update. {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 00:03:38 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:03:38 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:03:38 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82479) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 00:03:38 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:03:38 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:03:38 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:03:38 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:03:38 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Auditing locally available compute resources for user (node: user) {{(pid=82479) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 00:03:38 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:03:38 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:03:38 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Hypervisor/Node resource view: name=user free_ram=10134MB free_disk=26.81744384765625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=82479) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 00:03:38 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:03:38 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:03:39 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 00:03:39 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 00:03:39 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:03:39 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:03:39 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Compute_service record updated for user:user {{(pid=82479) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 00:03:39 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.130s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:03:40 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:03:40 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:03:40 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:04:36 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:04:36 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:04:37 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:04:38 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:04:38 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Starting heal instance info cache {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 00:04:38 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Rebuilding the list of instances to heal {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 00:04:38 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Didn't find any instances for network info cache update. {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 00:04:39 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:04:39 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:04:39 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:04:39 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82479) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 00:04:39 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:04:39 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:04:39 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:04:39 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.003s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:04:39 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Auditing locally available compute resources for user (node: user) {{(pid=82479) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 00:04:39 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:04:39 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:04:39 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Hypervisor/Node resource view: name=user free_ram=9419MB free_disk=26.848670959472656GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=82479) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 00:04:39 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:04:39 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:04:40 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 00:04:40 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 00:04:40 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:04:40 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:04:40 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Compute_service record updated for user:user {{(pid=82479) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 00:04:40 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.176s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:04:41 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:04:41 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:04:53 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Acquiring lock "cae47769-02cd-4118-af46-0d3521ef7564" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:04:53 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Lock "cae47769-02cd-4118-af46-0d3521ef7564" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:04:53 user nova-compute[82479]: DEBUG nova.compute.manager [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Starting instance... {{(pid=82479) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 00:04:53 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "23718fd0-58b8-47f9-b1ef-a26a90741ecc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:04:53 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "23718fd0-58b8-47f9-b1ef-a26a90741ecc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:04:53 user nova-compute[82479]: DEBUG nova.compute.manager [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Starting instance... {{(pid=82479) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 00:04:53 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:04:53 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:04:53 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82479) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 00:04:53 user nova-compute[82479]: INFO nova.compute.claims [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Claim successful on node user
Apr 14 00:04:53 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:04:54 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:04:54 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:04:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.310s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:04:54 user nova-compute[82479]: DEBUG nova.compute.manager [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Start building networks asynchronously for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 00:04:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.252s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:04:54 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82479) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 00:04:54 user nova-compute[82479]: INFO nova.compute.claims [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Claim successful on node user
Apr 14 00:04:54 user nova-compute[82479]: DEBUG nova.compute.manager [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Allocating IP information in the background. {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 00:04:54 user nova-compute[82479]: DEBUG nova.network.neutron [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] [instance: cae47769-02cd-4118-af46-0d3521ef7564] allocate_for_instance() {{(pid=82479) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 00:04:54 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 00:04:54 user nova-compute[82479]: DEBUG nova.compute.manager [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Start building block device mappings for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 00:04:54 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:04:54 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:04:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.336s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:04:54 user nova-compute[82479]: DEBUG nova.compute.manager [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Start building networks asynchronously for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 00:04:54 user nova-compute[82479]: DEBUG nova.compute.manager [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Allocating IP information in the background. {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 00:04:54 user nova-compute[82479]: DEBUG nova.network.neutron [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] allocate_for_instance() {{(pid=82479) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 00:04:54 user nova-compute[82479]: DEBUG nova.compute.manager [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Start spawning the instance on the hypervisor. {{(pid=82479) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 00:04:54 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Creating instance directory {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 00:04:54 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Creating image(s)
Apr 14 00:04:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Acquiring lock "/opt/stack/data/nova/instances/cae47769-02cd-4118-af46-0d3521ef7564/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:04:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Lock "/opt/stack/data/nova/instances/cae47769-02cd-4118-af46-0d3521ef7564/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:04:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Lock "/opt/stack/data/nova/instances/cae47769-02cd-4118-af46-0d3521ef7564/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:04:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Acquiring lock "3e200e101633f2016e569ae4c0a352380507d1e4" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:04:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Lock "3e200e101633f2016e569ae4c0a352380507d1e4" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:04:54 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 00:04:54 user nova-compute[82479]: DEBUG nova.compute.manager [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Start building block device mappings for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 00:04:54 user nova-compute[82479]: DEBUG nova.compute.manager [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Start spawning the instance on the hypervisor. {{(pid=82479) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 00:04:54 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Creating instance directory {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 00:04:54 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Creating image(s)
Apr 14 00:04:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "/opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:04:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "/opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:04:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "/opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:04:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "3e200e101633f2016e569ae4c0a352380507d1e4" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:04:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4.part --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:04:55 user nova-compute[82479]: DEBUG nova.policy [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '90bad96535c3453792982c5acab9dbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f111e24414976beddba7ef90c4793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82479) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 00:04:55 user nova-compute[82479]: DEBUG nova.policy [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '457273b82bcb4fa6bbee81fdd9e0265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834d867e665a4671a901218d21fa8704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82479) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 00:04:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4.part --force-share --output=json" returned: 0 in 0.174s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:04:55 user nova-compute[82479]: DEBUG nova.virt.images [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] 6db62068-7278-4cd8-b41f-d0140d89e199 was qcow2, converting to raw {{(pid=82479) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 00:04:55 user nova-compute[82479]: DEBUG nova.privsep.utils [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82479) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 00:04:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4.part /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4.converted {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:04:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4.part /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4.converted" returned: 0 in 0.148s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:04:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4.converted --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:04:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Acquiring lock "3a6b9f89-e462-47d8-84a1-0ac4ade3ab97" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:04:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "3a6b9f89-e462-47d8-84a1-0ac4ade3ab97" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:04:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4.converted --force-share --output=json" returned: 0 in 0.147s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:04:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Lock "3e200e101633f2016e569ae4c0a352380507d1e4" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.051s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:04:55 user nova-compute[82479]: INFO oslo.privsep.daemon [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp5f7929fp/privsep.sock']
Apr 14 00:04:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "3e200e101633f2016e569ae4c0a352380507d1e4" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.865s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:04:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "3e200e101633f2016e569ae4c0a352380507d1e4" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:04:55 user sudo[91222]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp5f7929fp/privsep.sock
Apr 14 00:04:55 user sudo[91222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 14 00:04:55 user nova-compute[82479]: DEBUG nova.compute.manager [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Starting instance... {{(pid=82479) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 00:04:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:04:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:04:55 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82479) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 00:04:55 user nova-compute[82479]: INFO nova.compute.claims [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Claim successful on node user
Apr 14 00:04:56 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:04:56 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:04:56 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.324s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:04:56 user nova-compute[82479]: DEBUG nova.compute.manager [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Start building networks asynchronously for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 00:04:56 user nova-compute[82479]: DEBUG nova.compute.manager [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Allocating IP information in the background. {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 00:04:56 user nova-compute[82479]: DEBUG nova.network.neutron [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] allocate_for_instance() {{(pid=82479) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 00:04:56 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 00:04:56 user nova-compute[82479]: DEBUG nova.compute.manager [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Start building block device mappings for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 00:04:56 user nova-compute[82479]: DEBUG nova.compute.manager [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Start spawning the instance on the hypervisor. {{(pid=82479) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 00:04:56 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Creating instance directory {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 00:04:56 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Creating image(s)
Apr 14 00:04:56 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Acquiring lock "/opt/stack/data/nova/instances/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:04:56 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "/opt/stack/data/nova/instances/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:04:56 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "/opt/stack/data/nova/instances/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:04:56 user nova-compute[82479]: DEBUG nova.policy [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '97374cd3cdc448cd8710561d44756ead', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c931198e56de4cf08db59bcc40f2a260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82479) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 00:04:57 user sudo[91222]: pam_unix(sudo:session): session closed for user root
Apr 14 00:04:57 user nova-compute[82479]: INFO oslo.privsep.daemon [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Spawned new privsep daemon via rootwrap
Apr 14 00:04:57 user nova-compute[82479]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 14 00:04:57 user nova-compute[82479]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 14 00:04:57 user nova-compute[82479]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Apr 14 00:04:57 user nova-compute[82479]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 91225
Apr 14 00:04:57 user nova-compute[82479]: WARNING oslo_privsep.priv_context [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] privsep daemon already running
Apr 14 00:04:57 user nova-compute[82479]: WARNING oslo_privsep.priv_context [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] privsep daemon already running
Apr 14 00:04:57 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:04:57 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:04:57 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:04:57 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.159s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:04:57 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "3e200e101633f2016e569ae4c0a352380507d1e4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:04:57 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "3e200e101633f2016e569ae4c0a352380507d1e4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:04:57 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:04:57 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.148s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:04:57 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Acquiring lock "3e200e101633f2016e569ae4c0a352380507d1e4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:04:57 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.150s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:04:57 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Acquiring lock "3e200e101633f2016e569ae4c0a352380507d1e4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:04:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.160s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:04:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk 1073741824 {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:04:58 user nova-compute[82479]: DEBUG nova.network.neutron [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Successfully created port: 43fb1710-4018-42d7-88ad-b5cb3970204a {{(pid=82479) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 00:04:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk 1073741824" returned: 0 in 0.073s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:04:58 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "3e200e101633f2016e569ae4c0a352380507d1e4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:04:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:04:58 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Lock "3e200e101633f2016e569ae4c0a352380507d1e4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.235s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:04:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:04:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.137s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:04:58 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Checking if we can resize image /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk. size=1073741824 {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 00:04:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:04:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.168s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:04:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/cae47769-02cd-4118-af46-0d3521ef7564/disk 1073741824 {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:04:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/cae47769-02cd-4118-af46-0d3521ef7564/disk 1073741824" returned: 0 in 0.043s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:04:58 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Lock "3e200e101633f2016e569ae4c0a352380507d1e4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.217s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:04:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:04:58 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "3e200e101633f2016e569ae4c0a352380507d1e4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.452s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:04:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:04:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:04:58 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Cannot resize image /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk to a smaller size. {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 00:04:58 user nova-compute[82479]: DEBUG nova.objects.instance [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lazy-loading 'migration_context' on Instance uuid 23718fd0-58b8-47f9-b1ef-a26a90741ecc {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:04:58 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Created local disks {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 00:04:58 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Ensure instance console log exists: /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/console.log {{(pid=82479) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 00:04:58 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:04:58 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:04:58 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:04:58 user nova-compute[82479]: DEBUG nova.network.neutron [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Successfully created port: db4fcb1f-e93d-4eee-851d-0c47f24dcdb3 {{(pid=82479) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 00:04:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.134s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:04:58 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cae47769-02cd-4118-af46-0d3521ef7564/disk. size=1073741824 {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 00:04:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae47769-02cd-4118-af46-0d3521ef7564/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:04:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.135s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:04:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97/disk 1073741824 {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:04:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97/disk 1073741824" returned: 0 in 0.060s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:04:58 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "3e200e101633f2016e569ae4c0a352380507d1e4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:04:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:04:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae47769-02cd-4118-af46-0d3521ef7564/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:04:58 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Cannot resize image /opt/stack/data/nova/instances/cae47769-02cd-4118-af46-0d3521ef7564/disk to a smaller size. {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 00:04:58 user nova-compute[82479]: DEBUG nova.objects.instance [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Lazy-loading 'migration_context' on Instance uuid cae47769-02cd-4118-af46-0d3521ef7564 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:04:58 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Created local disks {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 00:04:58 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Ensure instance console log exists: /opt/stack/data/nova/instances/cae47769-02cd-4118-af46-0d3521ef7564/console.log {{(pid=82479) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 00:04:58 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:04:58 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:04:58 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:04:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.151s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:04:58 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97/disk. size=1073741824 {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 00:04:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:04:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:04:58 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Cannot resize image /opt/stack/data/nova/instances/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97/disk to a smaller size. {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 00:04:58 user nova-compute[82479]: DEBUG nova.objects.instance [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lazy-loading 'migration_context' on Instance uuid 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:04:58 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Created local disks {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 00:04:58 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Ensure instance console log exists: /opt/stack/data/nova/instances/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97/console.log {{(pid=82479) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 00:04:58 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:04:58 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:04:58 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:04:59 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:04:59 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:04:59 user nova-compute[82479]: DEBUG nova.compute.manager [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Starting instance... {{(pid=82479) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 00:04:59 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:04:59 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:04:59 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82479) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 00:04:59 user nova-compute[82479]: INFO nova.compute.claims [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Claim successful on node user
Apr 14 00:04:59 user nova-compute[82479]: DEBUG nova.network.neutron [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Successfully created port: 4085de4c-cb9e-452b-9504-b7c7f8621213 {{(pid=82479) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 00:04:59 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:04:59 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:04:59 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.360s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:04:59 user nova-compute[82479]: DEBUG nova.compute.manager [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Start building networks asynchronously for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 00:04:59 user nova-compute[82479]: DEBUG nova.compute.manager [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Allocating IP information in the background. {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 00:04:59 user nova-compute[82479]: DEBUG nova.network.neutron [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] allocate_for_instance() {{(pid=82479) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 00:04:59 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 00:04:59 user nova-compute[82479]: DEBUG nova.compute.manager [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Start building block device mappings for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 00:05:00 user nova-compute[82479]: DEBUG nova.compute.manager [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Start spawning the instance on the hypervisor. {{(pid=82479) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 00:05:00 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Creating instance directory {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 00:05:00 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Creating image(s)
Apr 14 00:05:00 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "/opt/stack/data/nova/instances/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:05:00 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "/opt/stack/data/nova/instances/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:05:00 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "/opt/stack/data/nova/instances/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:05:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:05:00 user nova-compute[82479]: DEBUG nova.policy [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2f8b18d40ecd4b4e976cf2018af8220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f20caf676a64b9b97027f3fc9bc724c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82479) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 00:05:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.282s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:05:00 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "3e200e101633f2016e569ae4c0a352380507d1e4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:05:00 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "3e200e101633f2016e569ae4c0a352380507d1e4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:05:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:05:00 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "01a65362-36ea-4817-8e83-f75d6daf808b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:05:00 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "01a65362-36ea-4817-8e83-f75d6daf808b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:05:00 user nova-compute[82479]: DEBUG nova.compute.manager [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Starting instance... {{(pid=82479) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 00:05:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.148s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:05:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a/disk 1073741824 {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:05:00 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:05:00 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:05:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a/disk 1073741824" returned: 0 in 0.048s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:05:00 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "3e200e101633f2016e569ae4c0a352380507d1e4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:05:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:05:00 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82479) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 00:05:00 user nova-compute[82479]: INFO nova.compute.claims [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Claim successful on node user
Apr 14 00:05:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.139s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:05:00 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a/disk. size=1073741824 {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 00:05:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:05:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:05:00 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Cannot resize image /opt/stack/data/nova/instances/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a/disk to a smaller size. {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 00:05:00 user nova-compute[82479]: DEBUG nova.objects.instance [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lazy-loading 'migration_context' on Instance uuid 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:05:00 user nova-compute[82479]: DEBUG nova.network.neutron [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Successfully updated port: 43fb1710-4018-42d7-88ad-b5cb3970204a {{(pid=82479) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 00:05:00 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Created local disks {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 00:05:00 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Ensure instance console log exists: /opt/stack/data/nova/instances/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a/console.log {{(pid=82479) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 00:05:00 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:05:00 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:05:00 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:05:00 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:05:00 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Acquiring lock "refresh_cache-cae47769-02cd-4118-af46-0d3521ef7564" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:05:00 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Acquired lock "refresh_cache-cae47769-02cd-4118-af46-0d3521ef7564" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:05:00 user nova-compute[82479]: DEBUG nova.network.neutron [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 00:05:00 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:05:00 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.461s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:05:00 user nova-compute[82479]: DEBUG nova.compute.manager [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Start building networks asynchronously for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 00:05:01 user nova-compute[82479]: DEBUG nova.network.neutron [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Instance cache missing network info. {{(pid=82479) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 00:05:01 user nova-compute[82479]: DEBUG nova.compute.manager [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Allocating IP information in the background. {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 00:05:01 user nova-compute[82479]: DEBUG nova.network.neutron [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] allocate_for_instance() {{(pid=82479) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 00:05:01 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 00:05:01 user nova-compute[82479]: DEBUG nova.compute.manager [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Start building block device mappings for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 00:05:01 user nova-compute[82479]: DEBUG nova.compute.manager [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Start spawning the instance on the hypervisor. {{(pid=82479) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 00:05:01 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Creating instance directory {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 00:05:01 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Creating image(s)
Apr 14 00:05:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "/opt/stack/data/nova/instances/01a65362-36ea-4817-8e83-f75d6daf808b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:05:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "/opt/stack/data/nova/instances/01a65362-36ea-4817-8e83-f75d6daf808b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:05:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "/opt/stack/data/nova/instances/01a65362-36ea-4817-8e83-f75d6daf808b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:05:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:05:01 user nova-compute[82479]: DEBUG nova.policy [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '44530987616b417d87ce5909d8de1871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1aab0338ff4bd195a37a4199a378eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82479) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 00:05:01 user nova-compute[82479]: DEBUG nova.compute.manager [req-810accd2-cb3c-475b-9188-a377e1576f85 req-1732d212-07d0-4d39-b7b4-76ebe50e6b87 service nova] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Received event network-changed-43fb1710-4018-42d7-88ad-b5cb3970204a {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:05:01 user nova-compute[82479]: DEBUG nova.compute.manager [req-810accd2-cb3c-475b-9188-a377e1576f85 req-1732d212-07d0-4d39-b7b4-76ebe50e6b87 service nova] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Refreshing instance network info cache due to event network-changed-43fb1710-4018-42d7-88ad-b5cb3970204a. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:05:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-810accd2-cb3c-475b-9188-a377e1576f85 req-1732d212-07d0-4d39-b7b4-76ebe50e6b87 service nova] Acquiring lock "refresh_cache-cae47769-02cd-4118-af46-0d3521ef7564" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:05:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.149s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:05:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "3e200e101633f2016e569ae4c0a352380507d1e4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:05:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "3e200e101633f2016e569ae4c0a352380507d1e4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:05:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:05:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.128s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:05:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/01a65362-36ea-4817-8e83-f75d6daf808b/disk 1073741824 {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:05:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/01a65362-36ea-4817-8e83-f75d6daf808b/disk 1073741824" returned: 0 in 0.048s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:05:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "3e200e101633f2016e569ae4c0a352380507d1e4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.179s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:05:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:05:01 user nova-compute[82479]: DEBUG nova.network.neutron [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Successfully updated port: db4fcb1f-e93d-4eee-851d-0c47f24dcdb3 {{(pid=82479) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 00:05:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "refresh_cache-23718fd0-58b8-47f9-b1ef-a26a90741ecc" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:05:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquired lock "refresh_cache-23718fd0-58b8-47f9-b1ef-a26a90741ecc" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:05:01 user nova-compute[82479]: DEBUG nova.network.neutron [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 00:05:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.140s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:05:01 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Checking if we can resize image /opt/stack/data/nova/instances/01a65362-36ea-4817-8e83-f75d6daf808b/disk. size=1073741824 {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 00:05:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01a65362-36ea-4817-8e83-f75d6daf808b/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:05:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01a65362-36ea-4817-8e83-f75d6daf808b/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:05:01 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Cannot resize image /opt/stack/data/nova/instances/01a65362-36ea-4817-8e83-f75d6daf808b/disk to a smaller size. {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 00:05:01 user nova-compute[82479]: DEBUG nova.objects.instance [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lazy-loading 'migration_context' on Instance uuid 01a65362-36ea-4817-8e83-f75d6daf808b {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:05:01 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Created local disks {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 00:05:01 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Ensure instance console log exists: /opt/stack/data/nova/instances/01a65362-36ea-4817-8e83-f75d6daf808b/console.log {{(pid=82479) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 00:05:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:05:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:05:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:05:01 user nova-compute[82479]: DEBUG nova.network.neutron [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Successfully updated port: 4085de4c-cb9e-452b-9504-b7c7f8621213 {{(pid=82479) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 00:05:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Acquiring lock "refresh_cache-3a6b9f89-e462-47d8-84a1-0ac4ade3ab97" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:05:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Acquired lock "refresh_cache-3a6b9f89-e462-47d8-84a1-0ac4ade3ab97" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:05:01 user nova-compute[82479]: DEBUG nova.network.neutron [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 00:05:02 user nova-compute[82479]: DEBUG nova.network.neutron [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Instance cache missing network info. {{(pid=82479) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 00:05:02 user nova-compute[82479]: DEBUG nova.network.neutron [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Updating instance_info_cache with network_info: [{"id": "43fb1710-4018-42d7-88ad-b5cb3970204a", "address": "fa:16:3e:92:89:19", "network": {"id": "598c3cc3-627d-4abe-beb6-93721d4334a1", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-214699134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "834d867e665a4671a901218d21fa8704", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43fb1710-40", "ovs_interfaceid": "43fb1710-4018-42d7-88ad-b5cb3970204a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:05:02 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Releasing lock "refresh_cache-cae47769-02cd-4118-af46-0d3521ef7564" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:05:02 user nova-compute[82479]: DEBUG nova.compute.manager [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Instance network_info: |[{"id": "43fb1710-4018-42d7-88ad-b5cb3970204a", "address": "fa:16:3e:92:89:19", "network": {"id": "598c3cc3-627d-4abe-beb6-93721d4334a1", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-214699134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "834d867e665a4671a901218d21fa8704", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43fb1710-40", "ovs_interfaceid": "43fb1710-4018-42d7-88ad-b5cb3970204a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 00:05:02 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-810accd2-cb3c-475b-9188-a377e1576f85 req-1732d212-07d0-4d39-b7b4-76ebe50e6b87 service nova] Acquired lock "refresh_cache-cae47769-02cd-4118-af46-0d3521ef7564" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:05:02 user nova-compute[82479]: DEBUG nova.network.neutron [req-810accd2-cb3c-475b-9188-a377e1576f85 req-1732d212-07d0-4d39-b7b4-76ebe50e6b87 service nova] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Refreshing network info cache for port 43fb1710-4018-42d7-88ad-b5cb3970204a {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:05:02 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Start _get_guest_xml network_info=[{"id": "43fb1710-4018-42d7-88ad-b5cb3970204a", "address": "fa:16:3e:92:89:19", "network": {"id": "598c3cc3-627d-4abe-beb6-93721d4334a1", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-214699134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "834d867e665a4671a901218d21fa8704", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43fb1710-40", "ovs_interfaceid": "43fb1710-4018-42d7-88ad-b5cb3970204a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 00:05:02 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:05:02 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:05:02 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82479) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 00:05:02 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T00:02:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 00:05:02 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Flavor limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 00:05:02 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Image limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 00:05:02 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Flavor pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 00:05:02 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Image pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 00:05:02 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 00:05:02 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 00:05:02 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 00:05:02 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Got 1 possible topologies {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 00:05:02 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 00:05:02 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 00:05:02 user nova-compute[82479]: DEBUG nova.privsep.utils [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82479) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 00:05:02 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:04:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1972873917',display_name='tempest-DeleteServersTestJSON-server-1972873917',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1972873917',id=1,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='834d867e665a4671a901218d21fa8704',ramdisk_id='',reservation_id='r-0jntl0mr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1615746799',owner_user_name='tempest-DeleteServersTestJSON-1615746799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:04:54Z,user_data=None,user_id='457273b82bcb4fa6bbee81fdd9e0265c',uuid=cae47769-02cd-4118-af46-0d3521ef7564,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43fb1710-4018-42d7-88ad-b5cb3970204a", "address": "fa:16:3e:92:89:19", "network": {"id": "598c3cc3-627d-4abe-beb6-93721d4334a1", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-214699134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "834d867e665a4671a901218d21fa8704", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43fb1710-40", "ovs_interfaceid": "43fb1710-4018-42d7-88ad-b5cb3970204a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82479) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 00:05:02 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Converting VIF {"id": "43fb1710-4018-42d7-88ad-b5cb3970204a", "address": "fa:16:3e:92:89:19", "network": {"id": "598c3cc3-627d-4abe-beb6-93721d4334a1", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-214699134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "834d867e665a4671a901218d21fa8704", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43fb1710-40", "ovs_interfaceid": "43fb1710-4018-42d7-88ad-b5cb3970204a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:05:02 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:89:19,bridge_name='br-int',has_traffic_filtering=True,id=43fb1710-4018-42d7-88ad-b5cb3970204a,network=Network(598c3cc3-627d-4abe-beb6-93721d4334a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43fb1710-40') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:05:02 user nova-compute[82479]: DEBUG nova.objects.instance [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Lazy-loading 'pci_devices' on Instance uuid cae47769-02cd-4118-af46-0d3521ef7564 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:05:02 user nova-compute[82479]: DEBUG nova.network.neutron [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Instance cache missing network info. {{(pid=82479) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 00:05:02 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] [instance: cae47769-02cd-4118-af46-0d3521ef7564] End _get_guest_xml xml=<domain type="kvm">
Apr 14 00:05:02 user nova-compute[82479]:   <uuid>cae47769-02cd-4118-af46-0d3521ef7564</uuid>
Apr 14 00:05:02 user nova-compute[82479]:   <name>instance-00000001</name>
Apr 14 00:05:02 user nova-compute[82479]:   <memory>131072</memory>
Apr 14 00:05:02 user nova-compute[82479]:   <vcpu>1</vcpu>
Apr 14 00:05:02 user nova-compute[82479]:   <metadata>
Apr 14 00:05:02 user nova-compute[82479]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 00:05:02 user nova-compute[82479]:       <nova:package version="0.0.0"/>
Apr 14 00:05:02 user nova-compute[82479]:       <nova:name>tempest-DeleteServersTestJSON-server-1972873917</nova:name>
Apr 14 00:05:02 user nova-compute[82479]:       <nova:creationTime>2023-04-14 00:05:02</nova:creationTime>
Apr 14 00:05:02 user nova-compute[82479]:       <nova:flavor name="m1.nano">
Apr 14 00:05:02 user nova-compute[82479]:         <nova:memory>128</nova:memory>
Apr 14 00:05:02 user nova-compute[82479]:         <nova:disk>1</nova:disk>
Apr 14 00:05:02 user nova-compute[82479]:         <nova:swap>0</nova:swap>
Apr 14 00:05:02 user nova-compute[82479]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 00:05:02 user nova-compute[82479]:         <nova:vcpus>1</nova:vcpus>
Apr 14 00:05:02 user nova-compute[82479]:       </nova:flavor>
Apr 14 00:05:02 user nova-compute[82479]:       <nova:owner>
Apr 14 00:05:02 user nova-compute[82479]:         <nova:user uuid="457273b82bcb4fa6bbee81fdd9e0265c">tempest-DeleteServersTestJSON-1615746799-project-member</nova:user>
Apr 14 00:05:02 user nova-compute[82479]:         <nova:project uuid="834d867e665a4671a901218d21fa8704">tempest-DeleteServersTestJSON-1615746799</nova:project>
Apr 14 00:05:02 user nova-compute[82479]:       </nova:owner>
Apr 14 00:05:02 user nova-compute[82479]:       <nova:root type="image" uuid="6db62068-7278-4cd8-b41f-d0140d89e199"/>
Apr 14 00:05:02 user nova-compute[82479]:       <nova:ports>
Apr 14 00:05:02 user nova-compute[82479]:         <nova:port uuid="43fb1710-4018-42d7-88ad-b5cb3970204a">
Apr 14 00:05:02 user nova-compute[82479]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 14 00:05:02 user nova-compute[82479]:         </nova:port>
Apr 14 00:05:02 user nova-compute[82479]:       </nova:ports>
Apr 14 00:05:02 user nova-compute[82479]:     </nova:instance>
Apr 14 00:05:02 user nova-compute[82479]:   </metadata>
Apr 14 00:05:02 user nova-compute[82479]:   <sysinfo type="smbios">
Apr 14 00:05:02 user nova-compute[82479]:     <system>
Apr 14 00:05:02 user nova-compute[82479]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 00:05:02 user nova-compute[82479]:       <entry name="product">OpenStack Nova</entry>
Apr 14 00:05:02 user nova-compute[82479]:       <entry name="version">0.0.0</entry>
Apr 14 00:05:02 user nova-compute[82479]:       <entry name="serial">cae47769-02cd-4118-af46-0d3521ef7564</entry>
Apr 14 00:05:02 user nova-compute[82479]:       <entry name="uuid">cae47769-02cd-4118-af46-0d3521ef7564</entry>
Apr 14 00:05:02 user nova-compute[82479]:       <entry name="family">Virtual Machine</entry>
Apr 14 00:05:02 user nova-compute[82479]:     </system>
Apr 14 00:05:02 user nova-compute[82479]:   </sysinfo>
Apr 14 00:05:02 user nova-compute[82479]:   <os>
Apr 14 00:05:02 user nova-compute[82479]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 00:05:02 user nova-compute[82479]:     <boot dev="hd"/>
Apr 14 00:05:02 user nova-compute[82479]:     <smbios mode="sysinfo"/>
Apr 14 00:05:02 user nova-compute[82479]:   </os>
Apr 14 00:05:02 user nova-compute[82479]:   <features>
Apr 14 00:05:02 user nova-compute[82479]:     <acpi/>
Apr 14 00:05:02 user nova-compute[82479]:     <apic/>
Apr 14 00:05:02 user nova-compute[82479]:     <vmcoreinfo/>
Apr 14 00:05:02 user nova-compute[82479]:   </features>
Apr 14 00:05:02 user nova-compute[82479]:   <clock offset="utc">
Apr 14 00:05:02 user nova-compute[82479]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 00:05:02 user nova-compute[82479]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 00:05:02 user nova-compute[82479]:     <timer name="hpet" present="no"/>
Apr 14 00:05:02 user nova-compute[82479]:   </clock>
Apr 14 00:05:02 user nova-compute[82479]:   <cpu mode="custom" match="exact">
Apr 14 00:05:02 user nova-compute[82479]:     <model>Nehalem</model>
Apr 14 00:05:02 user nova-compute[82479]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 00:05:02 user nova-compute[82479]:   </cpu>
Apr 14 00:05:02 user nova-compute[82479]:   <devices>
Apr 14 00:05:02 user nova-compute[82479]:     <disk type="file" device="disk">
Apr 14 00:05:02 user nova-compute[82479]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 00:05:02 user nova-compute[82479]:       <source file="/opt/stack/data/nova/instances/cae47769-02cd-4118-af46-0d3521ef7564/disk"/>
Apr 14 00:05:02 user nova-compute[82479]:       <target dev="vda" bus="virtio"/>
Apr 14 00:05:02 user nova-compute[82479]:     </disk>
Apr 14 00:05:02 user nova-compute[82479]:     <interface type="ethernet">
Apr 14 00:05:02 user nova-compute[82479]:       <mac address="fa:16:3e:92:89:19"/>
Apr 14 00:05:02 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:05:02 user nova-compute[82479]:       <mtu size="1442"/>
Apr 14 00:05:02 user nova-compute[82479]:       <target dev="tap43fb1710-40"/>
Apr 14 00:05:02 user nova-compute[82479]:     </interface>
Apr 14 00:05:02 user nova-compute[82479]:     <serial type="pty">
Apr 14 00:05:02 user nova-compute[82479]:       <log file="/opt/stack/data/nova/instances/cae47769-02cd-4118-af46-0d3521ef7564/console.log" append="off"/>
Apr 14 00:05:02 user nova-compute[82479]:     </serial>
Apr 14 00:05:02 user nova-compute[82479]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 00:05:02 user nova-compute[82479]:     <video>
Apr 14 00:05:02 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:05:02 user nova-compute[82479]:     </video>
Apr 14 00:05:02 user nova-compute[82479]:     <rng model="virtio">
Apr 14 00:05:02 user nova-compute[82479]:       <backend model="random">/dev/urandom</backend>
Apr 14 00:05:02 user nova-compute[82479]:     </rng>
Apr 14 00:05:02 user nova-compute[82479]:     <controller type="usb" index="0" model="none"/>
Apr 14 00:05:02 user nova-compute[82479]:     <memballoon model="virtio">
Apr 14 00:05:02 user nova-compute[82479]:       <stats period="10"/>
Apr 14 00:05:02 user nova-compute[82479]:     </memballoon>
Apr 14 00:05:02 user nova-compute[82479]:   </devices>
Apr 14 00:05:02 user nova-compute[82479]: </domain>
Apr 14 00:05:02 user nova-compute[82479]:  {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 00:05:02 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:04:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1972873917',display_name='tempest-DeleteServersTestJSON-server-1972873917',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1972873917',id=1,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='834d867e665a4671a901218d21fa8704',ramdisk_id='',reservation_id='r-0jntl0mr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1615746799',owner_user_name='tempest-DeleteServersTestJSON-1615746799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:04:54Z,user_data=None,user_id='457273b82bcb4fa6bbee81fdd9e0265c',uuid=cae47769-02cd-4118-af46-0d3521ef7564,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43fb1710-4018-42d7-88ad-b5cb3970204a", "address": "fa:16:3e:92:89:19", "network": {"id": "598c3cc3-627d-4abe-beb6-93721d4334a1", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-214699134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "834d867e665a4671a901218d21fa8704", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43fb1710-40", "ovs_interfaceid": "43fb1710-4018-42d7-88ad-b5cb3970204a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 00:05:02 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Converting VIF {"id": "43fb1710-4018-42d7-88ad-b5cb3970204a", "address": "fa:16:3e:92:89:19", "network": {"id": "598c3cc3-627d-4abe-beb6-93721d4334a1", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-214699134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "834d867e665a4671a901218d21fa8704", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43fb1710-40", "ovs_interfaceid": "43fb1710-4018-42d7-88ad-b5cb3970204a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:05:02 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:89:19,bridge_name='br-int',has_traffic_filtering=True,id=43fb1710-4018-42d7-88ad-b5cb3970204a,network=Network(598c3cc3-627d-4abe-beb6-93721d4334a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43fb1710-40') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:05:02 user nova-compute[82479]: DEBUG os_vif [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:89:19,bridge_name='br-int',has_traffic_filtering=True,id=43fb1710-4018-42d7-88ad-b5cb3970204a,network=Network(598c3cc3-627d-4abe-beb6-93721d4334a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43fb1710-40') {{(pid=82479) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 00:05:02 user nova-compute[82479]: DEBUG nova.compute.manager [req-c183addc-104c-4d8a-92bd-0b9b980d6177 req-2330ba97-eeab-4e31-8d2f-300c665cc9fe service nova] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Received event network-changed-db4fcb1f-e93d-4eee-851d-0c47f24dcdb3 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:05:02 user nova-compute[82479]: DEBUG nova.compute.manager [req-c183addc-104c-4d8a-92bd-0b9b980d6177 req-2330ba97-eeab-4e31-8d2f-300c665cc9fe service nova] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Refreshing instance network info cache due to event network-changed-db4fcb1f-e93d-4eee-851d-0c47f24dcdb3. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:05:02 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-c183addc-104c-4d8a-92bd-0b9b980d6177 req-2330ba97-eeab-4e31-8d2f-300c665cc9fe service nova] Acquiring lock "refresh_cache-23718fd0-58b8-47f9-b1ef-a26a90741ecc" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:05:02 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Created schema index Interface.name {{(pid=82479) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 14 00:05:02 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Created schema index Port.name {{(pid=82479) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 14 00:05:02 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Created schema index Bridge.name {{(pid=82479) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 14 00:05:02 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:05:02 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] [POLLOUT] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:02 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:05:02 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:02 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:02 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:02 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:02 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:05:02 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 00:05:02 user nova-compute[82479]: INFO oslo.privsep.daemon [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpvb954jmm/privsep.sock']
Apr 14 00:05:02 user sudo[91305]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpvb954jmm/privsep.sock
Apr 14 00:05:02 user sudo[91305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 14 00:05:03 user nova-compute[82479]: DEBUG nova.network.neutron [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Updating instance_info_cache with network_info: [{"id": "db4fcb1f-e93d-4eee-851d-0c47f24dcdb3", "address": "fa:16:3e:28:8a:3c", "network": {"id": "491696ea-38ef-4c19-9d94-a61223c1fa00", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1323121698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3f111e24414976beddba7ef90c4793", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb4fcb1f-e9", "ovs_interfaceid": "db4fcb1f-e93d-4eee-851d-0c47f24dcdb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:05:03 user nova-compute[82479]: DEBUG nova.network.neutron [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Successfully created port: 1b166f8e-a207-48d3-a0a9-2ad6c44774b2 {{(pid=82479) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 00:05:03 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Releasing lock "refresh_cache-23718fd0-58b8-47f9-b1ef-a26a90741ecc" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:05:03 user nova-compute[82479]: DEBUG nova.compute.manager [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Instance network_info: |[{"id": "db4fcb1f-e93d-4eee-851d-0c47f24dcdb3", "address": "fa:16:3e:28:8a:3c", "network": {"id": "491696ea-38ef-4c19-9d94-a61223c1fa00", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1323121698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3f111e24414976beddba7ef90c4793", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb4fcb1f-e9", "ovs_interfaceid": "db4fcb1f-e93d-4eee-851d-0c47f24dcdb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 00:05:03 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-c183addc-104c-4d8a-92bd-0b9b980d6177 req-2330ba97-eeab-4e31-8d2f-300c665cc9fe service nova] Acquired lock "refresh_cache-23718fd0-58b8-47f9-b1ef-a26a90741ecc" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:05:03 user nova-compute[82479]: DEBUG nova.network.neutron [req-c183addc-104c-4d8a-92bd-0b9b980d6177 req-2330ba97-eeab-4e31-8d2f-300c665cc9fe service nova] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Refreshing network info cache for port db4fcb1f-e93d-4eee-851d-0c47f24dcdb3 {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:05:03 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Start _get_guest_xml network_info=[{"id": "db4fcb1f-e93d-4eee-851d-0c47f24dcdb3", "address": "fa:16:3e:28:8a:3c", "network": {"id": "491696ea-38ef-4c19-9d94-a61223c1fa00", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1323121698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3f111e24414976beddba7ef90c4793", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb4fcb1f-e9", "ovs_interfaceid": "db4fcb1f-e93d-4eee-851d-0c47f24dcdb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 00:05:03 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:05:03 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:05:03 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82479) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 00:05:03 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T00:02:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 00:05:03 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Flavor limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 00:05:03 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Image limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 00:05:03 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Flavor pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 00:05:03 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Image pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 00:05:03 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 00:05:03 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 00:05:03 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 00:05:03 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Got 1 possible topologies {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 00:05:03 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 00:05:03 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 00:05:03 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:04:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-762920045',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-762920045',id=2,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba3f111e24414976beddba7ef90c4793',ramdisk_id='',reservation_id='r-8yse6wut',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1545234843',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:04:55Z,user_data=None,user_id='90bad96535c3453792982c5acab9dbc6',uuid=23718fd0-58b8-47f9-b1ef-a26a90741ecc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db4fcb1f-e93d-4eee-851d-0c47f24dcdb3", "address": "fa:16:3e:28:8a:3c", "network": {"id": "491696ea-38ef-4c19-9d94-a61223c1fa00", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1323121698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3f111e24414976beddba7ef90c4793", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb4fcb1f-e9", "ovs_interfaceid": "db4fcb1f-e93d-4eee-851d-0c47f24dcdb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82479) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 00:05:03 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Converting VIF {"id": "db4fcb1f-e93d-4eee-851d-0c47f24dcdb3", "address": "fa:16:3e:28:8a:3c", "network": {"id": "491696ea-38ef-4c19-9d94-a61223c1fa00", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1323121698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3f111e24414976beddba7ef90c4793", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb4fcb1f-e9", "ovs_interfaceid": "db4fcb1f-e93d-4eee-851d-0c47f24dcdb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:05:03 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:8a:3c,bridge_name='br-int',has_traffic_filtering=True,id=db4fcb1f-e93d-4eee-851d-0c47f24dcdb3,network=Network(491696ea-38ef-4c19-9d94-a61223c1fa00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb4fcb1f-e9') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:05:03 user nova-compute[82479]: DEBUG nova.objects.instance [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lazy-loading 'pci_devices' on Instance uuid 23718fd0-58b8-47f9-b1ef-a26a90741ecc {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:05:03 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] End _get_guest_xml xml=<domain type="kvm">
Apr 14 00:05:03 user nova-compute[82479]:   <uuid>23718fd0-58b8-47f9-b1ef-a26a90741ecc</uuid>
Apr 14 00:05:03 user nova-compute[82479]:   <name>instance-00000002</name>
Apr 14 00:05:03 user nova-compute[82479]:   <memory>131072</memory>
Apr 14 00:05:03 user nova-compute[82479]:   <vcpu>1</vcpu>
Apr 14 00:05:03 user nova-compute[82479]:   <metadata>
Apr 14 00:05:03 user nova-compute[82479]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 00:05:03 user nova-compute[82479]:       <nova:package version="0.0.0"/>
Apr 14 00:05:03 user nova-compute[82479]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-762920045</nova:name>
Apr 14 00:05:03 user nova-compute[82479]:       <nova:creationTime>2023-04-14 00:05:03</nova:creationTime>
Apr 14 00:05:03 user nova-compute[82479]:       <nova:flavor name="m1.nano">
Apr 14 00:05:03 user nova-compute[82479]:         <nova:memory>128</nova:memory>
Apr 14 00:05:03 user nova-compute[82479]:         <nova:disk>1</nova:disk>
Apr 14 00:05:03 user nova-compute[82479]:         <nova:swap>0</nova:swap>
Apr 14 00:05:03 user nova-compute[82479]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 00:05:03 user nova-compute[82479]:         <nova:vcpus>1</nova:vcpus>
Apr 14 00:05:03 user nova-compute[82479]:       </nova:flavor>
Apr 14 00:05:03 user nova-compute[82479]:       <nova:owner>
Apr 14 00:05:03 user nova-compute[82479]:         <nova:user uuid="90bad96535c3453792982c5acab9dbc6">tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member</nova:user>
Apr 14 00:05:03 user nova-compute[82479]:         <nova:project uuid="ba3f111e24414976beddba7ef90c4793">tempest-ServerBootFromVolumeStableRescueTest-1545234843</nova:project>
Apr 14 00:05:03 user nova-compute[82479]:       </nova:owner>
Apr 14 00:05:03 user nova-compute[82479]:       <nova:root type="image" uuid="6db62068-7278-4cd8-b41f-d0140d89e199"/>
Apr 14 00:05:03 user nova-compute[82479]:       <nova:ports>
Apr 14 00:05:03 user nova-compute[82479]:         <nova:port uuid="db4fcb1f-e93d-4eee-851d-0c47f24dcdb3">
Apr 14 00:05:03 user nova-compute[82479]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 14 00:05:03 user nova-compute[82479]:         </nova:port>
Apr 14 00:05:03 user nova-compute[82479]:       </nova:ports>
Apr 14 00:05:03 user nova-compute[82479]:     </nova:instance>
Apr 14 00:05:03 user nova-compute[82479]:   </metadata>
Apr 14 00:05:03 user nova-compute[82479]:   <sysinfo type="smbios">
Apr 14 00:05:03 user nova-compute[82479]:     <system>
Apr 14 00:05:03 user nova-compute[82479]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 00:05:03 user nova-compute[82479]:       <entry name="product">OpenStack Nova</entry>
Apr 14 00:05:03 user nova-compute[82479]:       <entry name="version">0.0.0</entry>
Apr 14 00:05:03 user nova-compute[82479]:       <entry name="serial">23718fd0-58b8-47f9-b1ef-a26a90741ecc</entry>
Apr 14 00:05:03 user nova-compute[82479]:       <entry name="uuid">23718fd0-58b8-47f9-b1ef-a26a90741ecc</entry>
Apr 14 00:05:03 user nova-compute[82479]:       <entry name="family">Virtual Machine</entry>
Apr 14 00:05:03 user nova-compute[82479]:     </system>
Apr 14 00:05:03 user nova-compute[82479]:   </sysinfo>
Apr 14 00:05:03 user nova-compute[82479]:   <os>
Apr 14 00:05:03 user nova-compute[82479]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 00:05:03 user nova-compute[82479]:     <boot dev="hd"/>
Apr 14 00:05:03 user nova-compute[82479]:     <smbios mode="sysinfo"/>
Apr 14 00:05:03 user nova-compute[82479]:   </os>
Apr 14 00:05:03 user nova-compute[82479]:   <features>
Apr 14 00:05:03 user nova-compute[82479]:     <acpi/>
Apr 14 00:05:03 user nova-compute[82479]:     <apic/>
Apr 14 00:05:03 user nova-compute[82479]:     <vmcoreinfo/>
Apr 14 00:05:03 user nova-compute[82479]:   </features>
Apr 14 00:05:03 user nova-compute[82479]:   <clock offset="utc">
Apr 14 00:05:03 user nova-compute[82479]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 00:05:03 user nova-compute[82479]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 00:05:03 user nova-compute[82479]:     <timer name="hpet" present="no"/>
Apr 14 00:05:03 user nova-compute[82479]:   </clock>
Apr 14 00:05:03 user nova-compute[82479]:   <cpu mode="custom" match="exact">
Apr 14 00:05:03 user nova-compute[82479]:     <model>Nehalem</model>
Apr 14 00:05:03 user nova-compute[82479]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 00:05:03 user nova-compute[82479]:   </cpu>
Apr 14 00:05:03 user nova-compute[82479]:   <devices>
Apr 14 00:05:03 user nova-compute[82479]:     <disk type="file" device="disk">
Apr 14 00:05:03 user nova-compute[82479]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 00:05:03 user nova-compute[82479]:       <source file="/opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk"/>
Apr 14 00:05:03 user nova-compute[82479]:       <target dev="vda" bus="virtio"/>
Apr 14 00:05:03 user nova-compute[82479]:     </disk>
Apr 14 00:05:03 user nova-compute[82479]:     <interface type="ethernet">
Apr 14 00:05:03 user nova-compute[82479]:       <mac address="fa:16:3e:28:8a:3c"/>
Apr 14 00:05:03 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:05:03 user nova-compute[82479]:       <mtu size="1442"/>
Apr 14 00:05:03 user nova-compute[82479]:       <target dev="tapdb4fcb1f-e9"/>
Apr 14 00:05:03 user nova-compute[82479]:     </interface>
Apr 14 00:05:03 user nova-compute[82479]:     <serial type="pty">
Apr 14 00:05:03 user nova-compute[82479]:       <log file="/opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/console.log" append="off"/>
Apr 14 00:05:03 user nova-compute[82479]:     </serial>
Apr 14 00:05:03 user nova-compute[82479]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 00:05:03 user nova-compute[82479]:     <video>
Apr 14 00:05:03 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:05:03 user nova-compute[82479]:     </video>
Apr 14 00:05:03 user nova-compute[82479]:     <rng model="virtio">
Apr 14 00:05:03 user nova-compute[82479]:       <backend model="random">/dev/urandom</backend>
Apr 14 00:05:03 user nova-compute[82479]:     </rng>
Apr 14 00:05:03 user nova-compute[82479]:     <controller type="usb" index="0" model="none"/>
Apr 14 00:05:03 user nova-compute[82479]:     <memballoon model="virtio">
Apr 14 00:05:03 user nova-compute[82479]:       <stats period="10"/>
Apr 14 00:05:03 user nova-compute[82479]:     </memballoon>
Apr 14 00:05:03 user nova-compute[82479]:   </devices>
Apr 14 00:05:03 user nova-compute[82479]: </domain>
Apr 14 00:05:03 user nova-compute[82479]:  {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 00:05:03 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:04:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-762920045',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-762920045',id=2,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba3f111e24414976beddba7ef90c4793',ramdisk_id='',reservation_id='r-8yse6wut',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1545234843',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:04:55Z,user_data=None,user_id='90bad96535c3453792982c5acab9dbc6',uuid=23718fd0-58b8-47f9-b1ef-a26a90741ecc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db4fcb1f-e93d-4eee-851d-0c47f24dcdb3", "address": "fa:16:3e:28:8a:3c", "network": {"id": "491696ea-38ef-4c19-9d94-a61223c1fa00", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1323121698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3f111e24414976beddba7ef90c4793", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb4fcb1f-e9", "ovs_interfaceid": "db4fcb1f-e93d-4eee-851d-0c47f24dcdb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 00:05:03 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Converting VIF {"id": "db4fcb1f-e93d-4eee-851d-0c47f24dcdb3", "address": "fa:16:3e:28:8a:3c", "network": {"id": "491696ea-38ef-4c19-9d94-a61223c1fa00", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1323121698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3f111e24414976beddba7ef90c4793", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb4fcb1f-e9", "ovs_interfaceid": "db4fcb1f-e93d-4eee-851d-0c47f24dcdb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:05:03 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:8a:3c,bridge_name='br-int',has_traffic_filtering=True,id=db4fcb1f-e93d-4eee-851d-0c47f24dcdb3,network=Network(491696ea-38ef-4c19-9d94-a61223c1fa00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb4fcb1f-e9') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:05:03 user nova-compute[82479]: DEBUG os_vif [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:8a:3c,bridge_name='br-int',has_traffic_filtering=True,id=db4fcb1f-e93d-4eee-851d-0c47f24dcdb3,network=Network(491696ea-38ef-4c19-9d94-a61223c1fa00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb4fcb1f-e9') {{(pid=82479) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 00:05:03 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:03 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:05:03 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 00:05:03 user nova-compute[82479]: DEBUG nova.network.neutron [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Updating instance_info_cache with network_info: [{"id": "4085de4c-cb9e-452b-9504-b7c7f8621213", "address": "fa:16:3e:2b:ab:7d", "network": {"id": "10c34d1a-edc4-4b0c-96a7-b29a7c292e74", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-573422654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931198e56de4cf08db59bcc40f2a260", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4085de4c-cb", "ovs_interfaceid": "4085de4c-cb9e-452b-9504-b7c7f8621213", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:05:03 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Releasing lock "refresh_cache-3a6b9f89-e462-47d8-84a1-0ac4ade3ab97" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:05:03 user nova-compute[82479]: DEBUG nova.compute.manager [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Instance network_info: |[{"id": "4085de4c-cb9e-452b-9504-b7c7f8621213", "address": "fa:16:3e:2b:ab:7d", "network": {"id": "10c34d1a-edc4-4b0c-96a7-b29a7c292e74", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-573422654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931198e56de4cf08db59bcc40f2a260", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4085de4c-cb", "ovs_interfaceid": "4085de4c-cb9e-452b-9504-b7c7f8621213", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 00:05:03 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Start _get_guest_xml network_info=[{"id": "4085de4c-cb9e-452b-9504-b7c7f8621213", "address": "fa:16:3e:2b:ab:7d", "network": {"id": "10c34d1a-edc4-4b0c-96a7-b29a7c292e74", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-573422654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931198e56de4cf08db59bcc40f2a260", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4085de4c-cb", "ovs_interfaceid": "4085de4c-cb9e-452b-9504-b7c7f8621213", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 00:05:03 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:05:03 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:05:03 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82479) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 00:05:03 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T00:02:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 00:05:03 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Flavor limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 00:05:03 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Image limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 00:05:03 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Flavor pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 00:05:03 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Image pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 00:05:03 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 00:05:03 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 00:05:03 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 00:05:03 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Got 1 possible topologies {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 00:05:03 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 00:05:03 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 00:05:03 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:04:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1358925619',display_name='tempest-ServerStableDeviceRescueTest-server-1358925619',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1358925619',id=3,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZuJ+sB897ViN2VTH0JXlcH9ndfvRNhk01+KgyuP9jwhkZ5ef42HmlxNSsq22e8Y5akz0iE7TkYd8Z+WgwsB4uFLI7jFktxjc9ufhBjq2ACCm1woK6wgYMrlECKBNQ8fA==',key_name='tempest-keypair-1540032684',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c931198e56de4cf08db59bcc40f2a260',ramdisk_id='',reservation_id='r-g35xdtri',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-481368698',owner_user_name='tempest-ServerStableDeviceRescueTest-481368698-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:04:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97374cd3cdc448cd8710561d44756ead',uuid=3a6b9f89-e462-47d8-84a1-0ac4ade3ab97,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4085de4c-cb9e-452b-9504-b7c7f8621213", "address": "fa:16:3e:2b:ab:7d", "network": {"id": "10c34d1a-edc4-4b0c-96a7-b29a7c292e74", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-573422654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931198e56de4cf08db59bcc40f2a260", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4085de4c-cb", "ovs_interfaceid": "4085de4c-cb9e-452b-9504-b7c7f8621213", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82479) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 00:05:03 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Converting VIF {"id": "4085de4c-cb9e-452b-9504-b7c7f8621213", "address": "fa:16:3e:2b:ab:7d", "network": {"id": "10c34d1a-edc4-4b0c-96a7-b29a7c292e74", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-573422654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931198e56de4cf08db59bcc40f2a260", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4085de4c-cb", "ovs_interfaceid": "4085de4c-cb9e-452b-9504-b7c7f8621213", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:05:03 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:ab:7d,bridge_name='br-int',has_traffic_filtering=True,id=4085de4c-cb9e-452b-9504-b7c7f8621213,network=Network(10c34d1a-edc4-4b0c-96a7-b29a7c292e74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4085de4c-cb') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:05:03 user nova-compute[82479]: DEBUG nova.objects.instance [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lazy-loading 'pci_devices' on Instance uuid 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:05:03 user nova-compute[82479]: DEBUG nova.compute.manager [req-9396faaf-e447-453f-817f-578245759637 req-8f6954cb-86da-48fc-9b97-951230e19bee service nova] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Received event network-changed-4085de4c-cb9e-452b-9504-b7c7f8621213 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:05:03 user nova-compute[82479]: DEBUG nova.compute.manager [req-9396faaf-e447-453f-817f-578245759637 req-8f6954cb-86da-48fc-9b97-951230e19bee service nova] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Refreshing instance network info cache due to event network-changed-4085de4c-cb9e-452b-9504-b7c7f8621213. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:05:03 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-9396faaf-e447-453f-817f-578245759637 req-8f6954cb-86da-48fc-9b97-951230e19bee service nova] Acquiring lock "refresh_cache-3a6b9f89-e462-47d8-84a1-0ac4ade3ab97" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:05:03 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-9396faaf-e447-453f-817f-578245759637 req-8f6954cb-86da-48fc-9b97-951230e19bee service nova] Acquired lock "refresh_cache-3a6b9f89-e462-47d8-84a1-0ac4ade3ab97" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:05:03 user nova-compute[82479]: DEBUG nova.network.neutron [req-9396faaf-e447-453f-817f-578245759637 req-8f6954cb-86da-48fc-9b97-951230e19bee service nova] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Refreshing network info cache for port 4085de4c-cb9e-452b-9504-b7c7f8621213 {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:05:03 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] End _get_guest_xml xml=<domain type="kvm">
Apr 14 00:05:03 user nova-compute[82479]:   <uuid>3a6b9f89-e462-47d8-84a1-0ac4ade3ab97</uuid>
Apr 14 00:05:03 user nova-compute[82479]:   <name>instance-00000003</name>
Apr 14 00:05:03 user nova-compute[82479]:   <memory>131072</memory>
Apr 14 00:05:03 user nova-compute[82479]:   <vcpu>1</vcpu>
Apr 14 00:05:03 user nova-compute[82479]:   <metadata>
Apr 14 00:05:03 user nova-compute[82479]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 00:05:03 user nova-compute[82479]:       <nova:package version="0.0.0"/>
Apr 14 00:05:03 user nova-compute[82479]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1358925619</nova:name>
Apr 14 00:05:03 user nova-compute[82479]:       <nova:creationTime>2023-04-14 00:05:03</nova:creationTime>
Apr 14 00:05:03 user nova-compute[82479]:       <nova:flavor name="m1.nano">
Apr 14 00:05:03 user nova-compute[82479]:         <nova:memory>128</nova:memory>
Apr 14 00:05:03 user nova-compute[82479]:         <nova:disk>1</nova:disk>
Apr 14 00:05:03 user nova-compute[82479]:         <nova:swap>0</nova:swap>
Apr 14 00:05:03 user nova-compute[82479]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 00:05:03 user nova-compute[82479]:         <nova:vcpus>1</nova:vcpus>
Apr 14 00:05:03 user nova-compute[82479]:       </nova:flavor>
Apr 14 00:05:03 user nova-compute[82479]:       <nova:owner>
Apr 14 00:05:03 user nova-compute[82479]:         <nova:user uuid="97374cd3cdc448cd8710561d44756ead">tempest-ServerStableDeviceRescueTest-481368698-project-member</nova:user>
Apr 14 00:05:03 user nova-compute[82479]:         <nova:project uuid="c931198e56de4cf08db59bcc40f2a260">tempest-ServerStableDeviceRescueTest-481368698</nova:project>
Apr 14 00:05:03 user nova-compute[82479]:       </nova:owner>
Apr 14 00:05:03 user nova-compute[82479]:       <nova:root type="image" uuid="6db62068-7278-4cd8-b41f-d0140d89e199"/>
Apr 14 00:05:03 user nova-compute[82479]:       <nova:ports>
Apr 14 00:05:03 user nova-compute[82479]:         <nova:port uuid="4085de4c-cb9e-452b-9504-b7c7f8621213">
Apr 14 00:05:03 user nova-compute[82479]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 00:05:03 user nova-compute[82479]:         </nova:port>
Apr 14 00:05:03 user nova-compute[82479]:       </nova:ports>
Apr 14 00:05:03 user nova-compute[82479]:     </nova:instance>
Apr 14 00:05:03 user nova-compute[82479]:   </metadata>
Apr 14 00:05:03 user nova-compute[82479]:   <sysinfo type="smbios">
Apr 14 00:05:03 user nova-compute[82479]:     <system>
Apr 14 00:05:03 user nova-compute[82479]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 00:05:03 user nova-compute[82479]:       <entry name="product">OpenStack Nova</entry>
Apr 14 00:05:03 user nova-compute[82479]:       <entry name="version">0.0.0</entry>
Apr 14 00:05:03 user nova-compute[82479]:       <entry name="serial">3a6b9f89-e462-47d8-84a1-0ac4ade3ab97</entry>
Apr 14 00:05:03 user nova-compute[82479]:       <entry name="uuid">3a6b9f89-e462-47d8-84a1-0ac4ade3ab97</entry>
Apr 14 00:05:03 user nova-compute[82479]:       <entry name="family">Virtual Machine</entry>
Apr 14 00:05:03 user nova-compute[82479]:     </system>
Apr 14 00:05:03 user nova-compute[82479]:   </sysinfo>
Apr 14 00:05:03 user nova-compute[82479]:   <os>
Apr 14 00:05:03 user nova-compute[82479]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 00:05:03 user nova-compute[82479]:     <boot dev="hd"/>
Apr 14 00:05:03 user nova-compute[82479]:     <smbios mode="sysinfo"/>
Apr 14 00:05:03 user nova-compute[82479]:   </os>
Apr 14 00:05:03 user nova-compute[82479]:   <features>
Apr 14 00:05:03 user nova-compute[82479]:     <acpi/>
Apr 14 00:05:03 user nova-compute[82479]:     <apic/>
Apr 14 00:05:03 user nova-compute[82479]:     <vmcoreinfo/>
Apr 14 00:05:03 user nova-compute[82479]:   </features>
Apr 14 00:05:03 user nova-compute[82479]:   <clock offset="utc">
Apr 14 00:05:03 user nova-compute[82479]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 00:05:03 user nova-compute[82479]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 00:05:03 user nova-compute[82479]:     <timer name="hpet" present="no"/>
Apr 14 00:05:03 user nova-compute[82479]:   </clock>
Apr 14 00:05:03 user nova-compute[82479]:   <cpu mode="custom" match="exact">
Apr 14 00:05:03 user nova-compute[82479]:     <model>Nehalem</model>
Apr 14 00:05:03 user nova-compute[82479]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 00:05:03 user nova-compute[82479]:   </cpu>
Apr 14 00:05:03 user nova-compute[82479]:   <devices>
Apr 14 00:05:03 user nova-compute[82479]:     <disk type="file" device="disk">
Apr 14 00:05:03 user nova-compute[82479]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 00:05:03 user nova-compute[82479]:       <source file="/opt/stack/data/nova/instances/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97/disk"/>
Apr 14 00:05:03 user nova-compute[82479]:       <target dev="vda" bus="virtio"/>
Apr 14 00:05:03 user nova-compute[82479]:     </disk>
Apr 14 00:05:03 user nova-compute[82479]:     <interface type="ethernet">
Apr 14 00:05:03 user nova-compute[82479]:       <mac address="fa:16:3e:2b:ab:7d"/>
Apr 14 00:05:03 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:05:03 user nova-compute[82479]:       <mtu size="1442"/>
Apr 14 00:05:03 user nova-compute[82479]:       <target dev="tap4085de4c-cb"/>
Apr 14 00:05:03 user nova-compute[82479]:     </interface>
Apr 14 00:05:03 user nova-compute[82479]:     <serial type="pty">
Apr 14 00:05:03 user nova-compute[82479]:       <log file="/opt/stack/data/nova/instances/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97/console.log" append="off"/>
Apr 14 00:05:03 user nova-compute[82479]:     </serial>
Apr 14 00:05:03 user nova-compute[82479]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 00:05:03 user nova-compute[82479]:     <video>
Apr 14 00:05:03 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:05:03 user nova-compute[82479]:     </video>
Apr 14 00:05:03 user nova-compute[82479]:     <rng model="virtio">
Apr 14 00:05:03 user nova-compute[82479]:       <backend model="random">/dev/urandom</backend>
Apr 14 00:05:03 user nova-compute[82479]:     </rng>
Apr 14 00:05:03 user nova-compute[82479]:     <controller type="usb" index="0" model="none"/>
Apr 14 00:05:03 user nova-compute[82479]:     <memballoon model="virtio">
Apr 14 00:05:03 user nova-compute[82479]:       <stats period="10"/>
Apr 14 00:05:03 user nova-compute[82479]:     </memballoon>
Apr 14 00:05:03 user nova-compute[82479]:   </devices>
Apr 14 00:05:03 user nova-compute[82479]: </domain>
Apr 14 00:05:03 user nova-compute[82479]:  {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 00:05:03 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:04:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1358925619',display_name='tempest-ServerStableDeviceRescueTest-server-1358925619',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1358925619',id=3,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZuJ+sB897ViN2VTH0JXlcH9ndfvRNhk01+KgyuP9jwhkZ5ef42HmlxNSsq22e8Y5akz0iE7TkYd8Z+WgwsB4uFLI7jFktxjc9ufhBjq2ACCm1woK6wgYMrlECKBNQ8fA==',key_name='tempest-keypair-1540032684',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c931198e56de4cf08db59bcc40f2a260',ramdisk_id='',reservation_id='r-g35xdtri',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-481368698',owner_user_name='tempest-ServerStableDeviceRescueTest-481368698-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:04:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97374cd3cdc448cd8710561d44756ead',uuid=3a6b9f89-e462-47d8-84a1-0ac4ade3ab97,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4085de4c-cb9e-452b-9504-b7c7f8621213", "address": "fa:16:3e:2b:ab:7d", "network": {"id": "10c34d1a-edc4-4b0c-96a7-b29a7c292e74", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-573422654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931198e56de4cf08db59bcc40f2a260", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4085de4c-cb", "ovs_interfaceid": "4085de4c-cb9e-452b-9504-b7c7f8621213", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 00:05:03 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Converting VIF {"id": "4085de4c-cb9e-452b-9504-b7c7f8621213", "address": "fa:16:3e:2b:ab:7d", "network": {"id": "10c34d1a-edc4-4b0c-96a7-b29a7c292e74", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-573422654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931198e56de4cf08db59bcc40f2a260", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4085de4c-cb", "ovs_interfaceid": "4085de4c-cb9e-452b-9504-b7c7f8621213", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:05:03 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:ab:7d,bridge_name='br-int',has_traffic_filtering=True,id=4085de4c-cb9e-452b-9504-b7c7f8621213,network=Network(10c34d1a-edc4-4b0c-96a7-b29a7c292e74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4085de4c-cb') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:05:03 user nova-compute[82479]: DEBUG os_vif [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:ab:7d,bridge_name='br-int',has_traffic_filtering=True,id=4085de4c-cb9e-452b-9504-b7c7f8621213,network=Network(10c34d1a-edc4-4b0c-96a7-b29a7c292e74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4085de4c-cb') {{(pid=82479) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 00:05:03 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:03 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:05:03 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 00:05:03 user nova-compute[82479]: DEBUG nova.network.neutron [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Successfully created port: b5dfa187-0a42-4319-990f-1d3b22691c27 {{(pid=82479) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 00:05:03 user nova-compute[82479]: DEBUG nova.network.neutron [req-810accd2-cb3c-475b-9188-a377e1576f85 req-1732d212-07d0-4d39-b7b4-76ebe50e6b87 service nova] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Updated VIF entry in instance network info cache for port 43fb1710-4018-42d7-88ad-b5cb3970204a. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:05:03 user nova-compute[82479]: DEBUG nova.network.neutron [req-810accd2-cb3c-475b-9188-a377e1576f85 req-1732d212-07d0-4d39-b7b4-76ebe50e6b87 service nova] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Updating instance_info_cache with network_info: [{"id": "43fb1710-4018-42d7-88ad-b5cb3970204a", "address": "fa:16:3e:92:89:19", "network": {"id": "598c3cc3-627d-4abe-beb6-93721d4334a1", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-214699134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "834d867e665a4671a901218d21fa8704", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43fb1710-40", "ovs_interfaceid": "43fb1710-4018-42d7-88ad-b5cb3970204a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:05:03 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-810accd2-cb3c-475b-9188-a377e1576f85 req-1732d212-07d0-4d39-b7b4-76ebe50e6b87 service nova] Releasing lock "refresh_cache-cae47769-02cd-4118-af46-0d3521ef7564" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:05:04 user sudo[91305]: pam_unix(sudo:session): session closed for user root
Apr 14 00:05:04 user nova-compute[82479]: INFO oslo.privsep.daemon [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Spawned new privsep daemon via rootwrap
Apr 14 00:05:04 user nova-compute[82479]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 14 00:05:04 user nova-compute[82479]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 14 00:05:04 user nova-compute[82479]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Apr 14 00:05:04 user nova-compute[82479]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 91308
Apr 14 00:05:04 user nova-compute[82479]: WARNING oslo_privsep.priv_context [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] privsep daemon already running
Apr 14 00:05:04 user nova-compute[82479]: WARNING oslo_privsep.priv_context [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] privsep daemon already running
Apr 14 00:05:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:04 user nova-compute[82479]: DEBUG nova.network.neutron [req-c183addc-104c-4d8a-92bd-0b9b980d6177 req-2330ba97-eeab-4e31-8d2f-300c665cc9fe service nova] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Updated VIF entry in instance network info cache for port db4fcb1f-e93d-4eee-851d-0c47f24dcdb3. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:05:04 user nova-compute[82479]: DEBUG nova.network.neutron [req-c183addc-104c-4d8a-92bd-0b9b980d6177 req-2330ba97-eeab-4e31-8d2f-300c665cc9fe service nova] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Updating instance_info_cache with network_info: [{"id": "db4fcb1f-e93d-4eee-851d-0c47f24dcdb3", "address": "fa:16:3e:28:8a:3c", "network": {"id": "491696ea-38ef-4c19-9d94-a61223c1fa00", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1323121698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3f111e24414976beddba7ef90c4793", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb4fcb1f-e9", "ovs_interfaceid": "db4fcb1f-e93d-4eee-851d-0c47f24dcdb3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:05:04 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-c183addc-104c-4d8a-92bd-0b9b980d6177 req-2330ba97-eeab-4e31-8d2f-300c665cc9fe service nova] Releasing lock "refresh_cache-23718fd0-58b8-47f9-b1ef-a26a90741ecc" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:05:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4085de4c-cb, may_exist=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:05:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4085de4c-cb, col_values=(('external_ids', {'iface-id': '4085de4c-cb9e-452b-9504-b7c7f8621213', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2b:ab:7d', 'vm-uuid': '3a6b9f89-e462-47d8-84a1-0ac4ade3ab97'}),)) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:05:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:05:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:04 user nova-compute[82479]: INFO os_vif [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:ab:7d,bridge_name='br-int',has_traffic_filtering=True,id=4085de4c-cb9e-452b-9504-b7c7f8621213,network=Network(10c34d1a-edc4-4b0c-96a7-b29a7c292e74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4085de4c-cb')
Apr 14 00:05:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap43fb1710-40, may_exist=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:05:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap43fb1710-40, col_values=(('external_ids', {'iface-id': '43fb1710-4018-42d7-88ad-b5cb3970204a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:89:19', 'vm-uuid': 'cae47769-02cd-4118-af46-0d3521ef7564'}),)) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:05:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:05:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:04 user nova-compute[82479]: INFO os_vif [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:89:19,bridge_name='br-int',has_traffic_filtering=True,id=43fb1710-4018-42d7-88ad-b5cb3970204a,network=Network(598c3cc3-627d-4abe-beb6-93721d4334a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43fb1710-40')
Apr 14 00:05:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdb4fcb1f-e9, may_exist=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:05:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdb4fcb1f-e9, col_values=(('external_ids', {'iface-id': 'db4fcb1f-e93d-4eee-851d-0c47f24dcdb3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:8a:3c', 'vm-uuid': '23718fd0-58b8-47f9-b1ef-a26a90741ecc'}),)) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:05:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:05:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:04 user nova-compute[82479]: INFO os_vif [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:8a:3c,bridge_name='br-int',has_traffic_filtering=True,id=db4fcb1f-e93d-4eee-851d-0c47f24dcdb3,network=Network(491696ea-38ef-4c19-9d94-a61223c1fa00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb4fcb1f-e9')
Apr 14 00:05:04 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:05:04 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] No VIF found with MAC fa:16:3e:2b:ab:7d, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:05:04 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:05:04 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] No VIF found with MAC fa:16:3e:92:89:19, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:05:04 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:05:04 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] No VIF found with MAC fa:16:3e:28:8a:3c, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:05:05 user nova-compute[82479]: DEBUG nova.network.neutron [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Successfully updated port: 1b166f8e-a207-48d3-a0a9-2ad6c44774b2 {{(pid=82479) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 00:05:05 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "refresh_cache-1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:05:05 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquired lock "refresh_cache-1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:05:05 user nova-compute[82479]: DEBUG nova.network.neutron [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 00:05:05 user nova-compute[82479]: DEBUG nova.compute.manager [req-281907eb-0f80-461b-b75e-31f9f929cf99 req-5f44f9af-f8a7-475b-8266-6a1e4d20ce69 service nova] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Received event network-changed-1b166f8e-a207-48d3-a0a9-2ad6c44774b2 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:05:05 user nova-compute[82479]: DEBUG nova.compute.manager [req-281907eb-0f80-461b-b75e-31f9f929cf99 req-5f44f9af-f8a7-475b-8266-6a1e4d20ce69 service nova] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Refreshing instance network info cache due to event network-changed-1b166f8e-a207-48d3-a0a9-2ad6c44774b2. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:05:05 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-281907eb-0f80-461b-b75e-31f9f929cf99 req-5f44f9af-f8a7-475b-8266-6a1e4d20ce69 service nova] Acquiring lock "refresh_cache-1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:05:05 user nova-compute[82479]: DEBUG nova.network.neutron [req-9396faaf-e447-453f-817f-578245759637 req-8f6954cb-86da-48fc-9b97-951230e19bee service nova] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Updated VIF entry in instance network info cache for port 4085de4c-cb9e-452b-9504-b7c7f8621213. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:05:05 user nova-compute[82479]: DEBUG nova.network.neutron [req-9396faaf-e447-453f-817f-578245759637 req-8f6954cb-86da-48fc-9b97-951230e19bee service nova] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Updating instance_info_cache with network_info: [{"id": "4085de4c-cb9e-452b-9504-b7c7f8621213", "address": "fa:16:3e:2b:ab:7d", "network": {"id": "10c34d1a-edc4-4b0c-96a7-b29a7c292e74", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-573422654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931198e56de4cf08db59bcc40f2a260", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4085de4c-cb", "ovs_interfaceid": "4085de4c-cb9e-452b-9504-b7c7f8621213", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:05:05 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-9396faaf-e447-453f-817f-578245759637 req-8f6954cb-86da-48fc-9b97-951230e19bee service nova] Releasing lock "refresh_cache-3a6b9f89-e462-47d8-84a1-0ac4ade3ab97" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:05:05 user nova-compute[82479]: DEBUG nova.network.neutron [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Instance cache missing network info. {{(pid=82479) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 00:05:05 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:05 user nova-compute[82479]: DEBUG nova.network.neutron [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Updating instance_info_cache with network_info: [{"id": "1b166f8e-a207-48d3-a0a9-2ad6c44774b2", "address": "fa:16:3e:2b:d2:f7", "network": {"id": "66316d10-fed3-4fb9-877e-a01542ca5855", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-93456010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f20caf676a64b9b97027f3fc9bc724c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b166f8e-a2", "ovs_interfaceid": "1b166f8e-a207-48d3-a0a9-2ad6c44774b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:05:05 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Releasing lock "refresh_cache-1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:05:05 user nova-compute[82479]: DEBUG nova.compute.manager [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Instance network_info: |[{"id": "1b166f8e-a207-48d3-a0a9-2ad6c44774b2", "address": "fa:16:3e:2b:d2:f7", "network": {"id": "66316d10-fed3-4fb9-877e-a01542ca5855", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-93456010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f20caf676a64b9b97027f3fc9bc724c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b166f8e-a2", "ovs_interfaceid": "1b166f8e-a207-48d3-a0a9-2ad6c44774b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 00:05:05 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-281907eb-0f80-461b-b75e-31f9f929cf99 req-5f44f9af-f8a7-475b-8266-6a1e4d20ce69 service nova] Acquired lock "refresh_cache-1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:05:05 user nova-compute[82479]: DEBUG nova.network.neutron [req-281907eb-0f80-461b-b75e-31f9f929cf99 req-5f44f9af-f8a7-475b-8266-6a1e4d20ce69 service nova] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Refreshing network info cache for port 1b166f8e-a207-48d3-a0a9-2ad6c44774b2 {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:05:05 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Start _get_guest_xml network_info=[{"id": "1b166f8e-a207-48d3-a0a9-2ad6c44774b2", "address": "fa:16:3e:2b:d2:f7", "network": {"id": "66316d10-fed3-4fb9-877e-a01542ca5855", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-93456010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f20caf676a64b9b97027f3fc9bc724c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b166f8e-a2", "ovs_interfaceid": "1b166f8e-a207-48d3-a0a9-2ad6c44774b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 00:05:05 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:05:05 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:05:05 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82479) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 00:05:05 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T00:02:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 00:05:05 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Flavor limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 00:05:05 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Image limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 00:05:05 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Flavor pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 00:05:05 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Image pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 00:05:05 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 00:05:05 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 00:05:05 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 00:05:05 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Got 1 possible topologies {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 00:05:05 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 00:05:05 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 00:05:05 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:04:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-353632356',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-353632356',id=4,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHS95AsHXsHQ5WUo+qNFwgIJLlEtcpS8GwdztFmcvwprZsn2CsvfRn9jDCwGdOGL9HuU0oylsscRpNL9zF0nJQKzqNgC5UVyUERTxALD/prKFHPNrGlE0h48XNBp/faanQ==',key_name='tempest-keypair-138977160',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f20caf676a64b9b97027f3fc9bc724c',ramdisk_id='',reservation_id='r-0ad3gf97',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1395403129',owner_user_name='tempest-AttachVolumeShelveTestJSON-1395403129-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:05:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f8b18d40ecd4b4e976cf2018af8220c',uuid=1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b166f8e-a207-48d3-a0a9-2ad6c44774b2", "address": "fa:16:3e:2b:d2:f7", "network": {"id": "66316d10-fed3-4fb9-877e-a01542ca5855", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-93456010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f20caf676a64b9b97027f3fc9bc724c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b166f8e-a2", "ovs_interfaceid": "1b166f8e-a207-48d3-a0a9-2ad6c44774b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82479) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 00:05:05 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Converting VIF {"id": "1b166f8e-a207-48d3-a0a9-2ad6c44774b2", "address": "fa:16:3e:2b:d2:f7", "network": {"id": "66316d10-fed3-4fb9-877e-a01542ca5855", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-93456010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f20caf676a64b9b97027f3fc9bc724c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b166f8e-a2", "ovs_interfaceid": "1b166f8e-a207-48d3-a0a9-2ad6c44774b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:05:05 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:d2:f7,bridge_name='br-int',has_traffic_filtering=True,id=1b166f8e-a207-48d3-a0a9-2ad6c44774b2,network=Network(66316d10-fed3-4fb9-877e-a01542ca5855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b166f8e-a2') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:05:05 user nova-compute[82479]: DEBUG nova.objects.instance [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lazy-loading 'pci_devices' on Instance uuid 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:05:05 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] End _get_guest_xml xml=<domain type="kvm">
Apr 14 00:05:05 user nova-compute[82479]:   <uuid>1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a</uuid>
Apr 14 00:05:05 user nova-compute[82479]:   <name>instance-00000004</name>
Apr 14 00:05:05 user nova-compute[82479]:   <memory>131072</memory>
Apr 14 00:05:05 user nova-compute[82479]:   <vcpu>1</vcpu>
Apr 14 00:05:05 user nova-compute[82479]:   <metadata>
Apr 14 00:05:05 user nova-compute[82479]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 00:05:05 user nova-compute[82479]:       <nova:package version="0.0.0"/>
Apr 14 00:05:05 user nova-compute[82479]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-353632356</nova:name>
Apr 14 00:05:05 user nova-compute[82479]:       <nova:creationTime>2023-04-14 00:05:05</nova:creationTime>
Apr 14 00:05:05 user nova-compute[82479]:       <nova:flavor name="m1.nano">
Apr 14 00:05:05 user nova-compute[82479]:         <nova:memory>128</nova:memory>
Apr 14 00:05:05 user nova-compute[82479]:         <nova:disk>1</nova:disk>
Apr 14 00:05:05 user nova-compute[82479]:         <nova:swap>0</nova:swap>
Apr 14 00:05:05 user nova-compute[82479]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 00:05:05 user nova-compute[82479]:         <nova:vcpus>1</nova:vcpus>
Apr 14 00:05:05 user nova-compute[82479]:       </nova:flavor>
Apr 14 00:05:05 user nova-compute[82479]:       <nova:owner>
Apr 14 00:05:05 user nova-compute[82479]:         <nova:user uuid="2f8b18d40ecd4b4e976cf2018af8220c">tempest-AttachVolumeShelveTestJSON-1395403129-project-member</nova:user>
Apr 14 00:05:05 user nova-compute[82479]:         <nova:project uuid="4f20caf676a64b9b97027f3fc9bc724c">tempest-AttachVolumeShelveTestJSON-1395403129</nova:project>
Apr 14 00:05:05 user nova-compute[82479]:       </nova:owner>
Apr 14 00:05:05 user nova-compute[82479]:       <nova:root type="image" uuid="6db62068-7278-4cd8-b41f-d0140d89e199"/>
Apr 14 00:05:05 user nova-compute[82479]:       <nova:ports>
Apr 14 00:05:05 user nova-compute[82479]:         <nova:port uuid="1b166f8e-a207-48d3-a0a9-2ad6c44774b2">
Apr 14 00:05:05 user nova-compute[82479]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 14 00:05:05 user nova-compute[82479]:         </nova:port>
Apr 14 00:05:05 user nova-compute[82479]:       </nova:ports>
Apr 14 00:05:05 user nova-compute[82479]:     </nova:instance>
Apr 14 00:05:05 user nova-compute[82479]:   </metadata>
Apr 14 00:05:05 user nova-compute[82479]:   <sysinfo type="smbios">
Apr 14 00:05:05 user nova-compute[82479]:     <system>
Apr 14 00:05:05 user nova-compute[82479]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 00:05:05 user nova-compute[82479]:       <entry name="product">OpenStack Nova</entry>
Apr 14 00:05:05 user nova-compute[82479]:       <entry name="version">0.0.0</entry>
Apr 14 00:05:05 user nova-compute[82479]:       <entry name="serial">1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a</entry>
Apr 14 00:05:05 user nova-compute[82479]:       <entry name="uuid">1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a</entry>
Apr 14 00:05:05 user nova-compute[82479]:       <entry name="family">Virtual Machine</entry>
Apr 14 00:05:05 user nova-compute[82479]:     </system>
Apr 14 00:05:05 user nova-compute[82479]:   </sysinfo>
Apr 14 00:05:05 user nova-compute[82479]:   <os>
Apr 14 00:05:05 user nova-compute[82479]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 00:05:05 user nova-compute[82479]:     <boot dev="hd"/>
Apr 14 00:05:05 user nova-compute[82479]:     <smbios mode="sysinfo"/>
Apr 14 00:05:05 user nova-compute[82479]:   </os>
Apr 14 00:05:05 user nova-compute[82479]:   <features>
Apr 14 00:05:05 user nova-compute[82479]:     <acpi/>
Apr 14 00:05:05 user nova-compute[82479]:     <apic/>
Apr 14 00:05:05 user nova-compute[82479]:     <vmcoreinfo/>
Apr 14 00:05:05 user nova-compute[82479]:   </features>
Apr 14 00:05:05 user nova-compute[82479]:   <clock offset="utc">
Apr 14 00:05:05 user nova-compute[82479]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 00:05:05 user nova-compute[82479]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 00:05:05 user nova-compute[82479]:     <timer name="hpet" present="no"/>
Apr 14 00:05:05 user nova-compute[82479]:   </clock>
Apr 14 00:05:05 user nova-compute[82479]:   <cpu mode="custom" match="exact">
Apr 14 00:05:05 user nova-compute[82479]:     <model>Nehalem</model>
Apr 14 00:05:05 user nova-compute[82479]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 00:05:05 user nova-compute[82479]:   </cpu>
Apr 14 00:05:05 user nova-compute[82479]:   <devices>
Apr 14 00:05:05 user nova-compute[82479]:     <disk type="file" device="disk">
Apr 14 00:05:05 user nova-compute[82479]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 00:05:05 user nova-compute[82479]:       <source file="/opt/stack/data/nova/instances/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a/disk"/>
Apr 14 00:05:05 user nova-compute[82479]:       <target dev="vda" bus="virtio"/>
Apr 14 00:05:05 user nova-compute[82479]:     </disk>
Apr 14 00:05:05 user nova-compute[82479]:     <interface type="ethernet">
Apr 14 00:05:05 user nova-compute[82479]:       <mac address="fa:16:3e:2b:d2:f7"/>
Apr 14 00:05:05 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:05:05 user nova-compute[82479]:       <mtu size="1442"/>
Apr 14 00:05:05 user nova-compute[82479]:       <target dev="tap1b166f8e-a2"/>
Apr 14 00:05:05 user nova-compute[82479]:     </interface>
Apr 14 00:05:05 user nova-compute[82479]:     <serial type="pty">
Apr 14 00:05:05 user nova-compute[82479]:       <log file="/opt/stack/data/nova/instances/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a/console.log" append="off"/>
Apr 14 00:05:05 user nova-compute[82479]:     </serial>
Apr 14 00:05:05 user nova-compute[82479]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 00:05:05 user nova-compute[82479]:     <video>
Apr 14 00:05:05 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:05:05 user nova-compute[82479]:     </video>
Apr 14 00:05:05 user nova-compute[82479]:     <rng model="virtio">
Apr 14 00:05:05 user nova-compute[82479]:       <backend model="random">/dev/urandom</backend>
Apr 14 00:05:05 user nova-compute[82479]:     </rng>
Apr 14 00:05:05 user nova-compute[82479]:     <controller type="usb" index="0" model="none"/>
Apr 14 00:05:05 user nova-compute[82479]:     <memballoon model="virtio">
Apr 14 00:05:05 user nova-compute[82479]:       <stats period="10"/>
Apr 14 00:05:05 user nova-compute[82479]:     </memballoon>
Apr 14 00:05:05 user nova-compute[82479]:   </devices>
Apr 14 00:05:05 user nova-compute[82479]: </domain>
Apr 14 00:05:05 user nova-compute[82479]:  {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 00:05:05 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:04:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-353632356',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-353632356',id=4,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHS95AsHXsHQ5WUo+qNFwgIJLlEtcpS8GwdztFmcvwprZsn2CsvfRn9jDCwGdOGL9HuU0oylsscRpNL9zF0nJQKzqNgC5UVyUERTxALD/prKFHPNrGlE0h48XNBp/faanQ==',key_name='tempest-keypair-138977160',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f20caf676a64b9b97027f3fc9bc724c',ramdisk_id='',reservation_id='r-0ad3gf97',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1395403129',owner_user_name='tempest-AttachVolumeShelveTestJSON-1395403129-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:05:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f8b18d40ecd4b4e976cf2018af8220c',uuid=1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b166f8e-a207-48d3-a0a9-2ad6c44774b2", "address": "fa:16:3e:2b:d2:f7", "network": {"id": "66316d10-fed3-4fb9-877e-a01542ca5855", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-93456010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f20caf676a64b9b97027f3fc9bc724c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b166f8e-a2", "ovs_interfaceid": "1b166f8e-a207-48d3-a0a9-2ad6c44774b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 00:05:05 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Converting VIF {"id": "1b166f8e-a207-48d3-a0a9-2ad6c44774b2", "address": "fa:16:3e:2b:d2:f7", "network": {"id": "66316d10-fed3-4fb9-877e-a01542ca5855", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-93456010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f20caf676a64b9b97027f3fc9bc724c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b166f8e-a2", "ovs_interfaceid": "1b166f8e-a207-48d3-a0a9-2ad6c44774b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:05:05 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:d2:f7,bridge_name='br-int',has_traffic_filtering=True,id=1b166f8e-a207-48d3-a0a9-2ad6c44774b2,network=Network(66316d10-fed3-4fb9-877e-a01542ca5855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b166f8e-a2') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:05:05 user nova-compute[82479]: DEBUG os_vif [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:d2:f7,bridge_name='br-int',has_traffic_filtering=True,id=1b166f8e-a207-48d3-a0a9-2ad6c44774b2,network=Network(66316d10-fed3-4fb9-877e-a01542ca5855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b166f8e-a2') {{(pid=82479) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 00:05:05 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:05 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:05:05 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 00:05:05 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:05 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1b166f8e-a2, may_exist=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:05:05 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1b166f8e-a2, col_values=(('external_ids', {'iface-id': '1b166f8e-a207-48d3-a0a9-2ad6c44774b2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2b:d2:f7', 'vm-uuid': '1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a'}),)) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:05:05 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:05 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:05:05 user nova-compute[82479]: DEBUG nova.network.neutron [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Successfully updated port: b5dfa187-0a42-4319-990f-1d3b22691c27 {{(pid=82479) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 00:05:05 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "refresh_cache-01a65362-36ea-4817-8e83-f75d6daf808b" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:05:05 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquired lock "refresh_cache-01a65362-36ea-4817-8e83-f75d6daf808b" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:05:05 user nova-compute[82479]: DEBUG nova.network.neutron [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 00:05:05 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:05 user nova-compute[82479]: INFO os_vif [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:d2:f7,bridge_name='br-int',has_traffic_filtering=True,id=1b166f8e-a207-48d3-a0a9-2ad6c44774b2,network=Network(66316d10-fed3-4fb9-877e-a01542ca5855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b166f8e-a2')
Apr 14 00:05:05 user nova-compute[82479]: DEBUG nova.compute.manager [req-7eda0224-2471-4e8a-9116-60ef20f1eaec req-78a793bb-fcec-42aa-8fdb-02529675fa44 service nova] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Received event network-changed-b5dfa187-0a42-4319-990f-1d3b22691c27 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:05:05 user nova-compute[82479]: DEBUG nova.compute.manager [req-7eda0224-2471-4e8a-9116-60ef20f1eaec req-78a793bb-fcec-42aa-8fdb-02529675fa44 service nova] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Refreshing instance network info cache due to event network-changed-b5dfa187-0a42-4319-990f-1d3b22691c27. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:05:05 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-7eda0224-2471-4e8a-9116-60ef20f1eaec req-78a793bb-fcec-42aa-8fdb-02529675fa44 service nova] Acquiring lock "refresh_cache-01a65362-36ea-4817-8e83-f75d6daf808b" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:05:05 user nova-compute[82479]: DEBUG nova.network.neutron [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Instance cache missing network info. {{(pid=82479) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 00:05:06 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:05:06 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] No VIF found with MAC fa:16:3e:2b:d2:f7, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:05:06 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:06 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:05:06 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:05:06 user nova-compute[82479]: DEBUG nova.compute.manager [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Starting instance... {{(pid=82479) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 00:05:06 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:05:06 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:05:06 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82479) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 00:05:06 user nova-compute[82479]: INFO nova.compute.claims [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Claim successful on node user
Apr 14 00:05:06 user nova-compute[82479]: DEBUG nova.network.neutron [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Updating instance_info_cache with network_info: [{"id": "b5dfa187-0a42-4319-990f-1d3b22691c27", "address": "fa:16:3e:7b:38:3d", "network": {"id": "368d9445-850e-4f74-b5cc-86d1eaa95d63", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374332689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec1aab0338ff4bd195a37a4199a378eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5dfa187-0a", "ovs_interfaceid": "b5dfa187-0a42-4319-990f-1d3b22691c27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:05:06 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Releasing lock "refresh_cache-01a65362-36ea-4817-8e83-f75d6daf808b" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:05:06 user nova-compute[82479]: DEBUG nova.compute.manager [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Instance network_info: |[{"id": "b5dfa187-0a42-4319-990f-1d3b22691c27", "address": "fa:16:3e:7b:38:3d", "network": {"id": "368d9445-850e-4f74-b5cc-86d1eaa95d63", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374332689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec1aab0338ff4bd195a37a4199a378eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5dfa187-0a", "ovs_interfaceid": "b5dfa187-0a42-4319-990f-1d3b22691c27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 00:05:06 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-7eda0224-2471-4e8a-9116-60ef20f1eaec req-78a793bb-fcec-42aa-8fdb-02529675fa44 service nova] Acquired lock "refresh_cache-01a65362-36ea-4817-8e83-f75d6daf808b" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:05:06 user nova-compute[82479]: DEBUG nova.network.neutron [req-7eda0224-2471-4e8a-9116-60ef20f1eaec req-78a793bb-fcec-42aa-8fdb-02529675fa44 service nova] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Refreshing network info cache for port b5dfa187-0a42-4319-990f-1d3b22691c27 {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:05:06 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Start _get_guest_xml network_info=[{"id": "b5dfa187-0a42-4319-990f-1d3b22691c27", "address": "fa:16:3e:7b:38:3d", "network": {"id": "368d9445-850e-4f74-b5cc-86d1eaa95d63", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374332689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec1aab0338ff4bd195a37a4199a378eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5dfa187-0a", "ovs_interfaceid": "b5dfa187-0a42-4319-990f-1d3b22691c27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 00:05:06 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:05:06 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:05:06 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82479) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 00:05:06 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T00:02:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 00:05:06 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Flavor limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 00:05:06 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Image limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 00:05:06 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Flavor pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 00:05:06 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Image pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 00:05:06 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 00:05:06 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 00:05:06 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 00:05:06 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Got 1 possible topologies {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 00:05:06 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 00:05:06 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 00:05:07 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:04:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-874047723',display_name='tempest-AttachVolumeTestJSON-server-874047723',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-874047723',id=5,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFj5BOE0cuvlxZawRQVfnfugrJsq+vAMk/RiiLDSf3KCRmtu0WTqB0nwANMnYIuDZO4AsUPttsoe/j3WMHFiNDVdBMIPFOCGE/kkjYyw9NwqNVOKFmKjVIZ3x8l2xusRtg==',key_name='tempest-keypair-608426082',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ec1aab0338ff4bd195a37a4199a378eb',ramdisk_id='',reservation_id='r-n5aqf0fe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1885059489',owner_user_name='tempest-AttachVolumeTestJSON-1885059489-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:05:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44530987616b417d87ce5909d8de1871',uuid=01a65362-36ea-4817-8e83-f75d6daf808b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b5dfa187-0a42-4319-990f-1d3b22691c27", "address": "fa:16:3e:7b:38:3d", "network": {"id": "368d9445-850e-4f74-b5cc-86d1eaa95d63", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374332689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec1aab0338ff4bd195a37a4199a378eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5dfa187-0a", "ovs_interfaceid": "b5dfa187-0a42-4319-990f-1d3b22691c27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82479) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 00:05:07 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Converting VIF {"id": "b5dfa187-0a42-4319-990f-1d3b22691c27", "address": "fa:16:3e:7b:38:3d", "network": {"id": "368d9445-850e-4f74-b5cc-86d1eaa95d63", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374332689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec1aab0338ff4bd195a37a4199a378eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5dfa187-0a", "ovs_interfaceid": "b5dfa187-0a42-4319-990f-1d3b22691c27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:05:07 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:38:3d,bridge_name='br-int',has_traffic_filtering=True,id=b5dfa187-0a42-4319-990f-1d3b22691c27,network=Network(368d9445-850e-4f74-b5cc-86d1eaa95d63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5dfa187-0a') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:05:07 user nova-compute[82479]: DEBUG nova.objects.instance [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lazy-loading 'pci_devices' on Instance uuid 01a65362-36ea-4817-8e83-f75d6daf808b {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:05:07 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] End _get_guest_xml xml=<domain type="kvm">
Apr 14 00:05:07 user nova-compute[82479]:   <uuid>01a65362-36ea-4817-8e83-f75d6daf808b</uuid>
Apr 14 00:05:07 user nova-compute[82479]:   <name>instance-00000005</name>
Apr 14 00:05:07 user nova-compute[82479]:   <memory>131072</memory>
Apr 14 00:05:07 user nova-compute[82479]:   <vcpu>1</vcpu>
Apr 14 00:05:07 user nova-compute[82479]:   <metadata>
Apr 14 00:05:07 user nova-compute[82479]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 00:05:07 user nova-compute[82479]:       <nova:package version="0.0.0"/>
Apr 14 00:05:07 user nova-compute[82479]:       <nova:name>tempest-AttachVolumeTestJSON-server-874047723</nova:name>
Apr 14 00:05:07 user nova-compute[82479]:       <nova:creationTime>2023-04-14 00:05:06</nova:creationTime>
Apr 14 00:05:07 user nova-compute[82479]:       <nova:flavor name="m1.nano">
Apr 14 00:05:07 user nova-compute[82479]:         <nova:memory>128</nova:memory>
Apr 14 00:05:07 user nova-compute[82479]:         <nova:disk>1</nova:disk>
Apr 14 00:05:07 user nova-compute[82479]:         <nova:swap>0</nova:swap>
Apr 14 00:05:07 user nova-compute[82479]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 00:05:07 user nova-compute[82479]:         <nova:vcpus>1</nova:vcpus>
Apr 14 00:05:07 user nova-compute[82479]:       </nova:flavor>
Apr 14 00:05:07 user nova-compute[82479]:       <nova:owner>
Apr 14 00:05:07 user nova-compute[82479]:         <nova:user uuid="44530987616b417d87ce5909d8de1871">tempest-AttachVolumeTestJSON-1885059489-project-member</nova:user>
Apr 14 00:05:07 user nova-compute[82479]:         <nova:project uuid="ec1aab0338ff4bd195a37a4199a378eb">tempest-AttachVolumeTestJSON-1885059489</nova:project>
Apr 14 00:05:07 user nova-compute[82479]:       </nova:owner>
Apr 14 00:05:07 user nova-compute[82479]:       <nova:root type="image" uuid="6db62068-7278-4cd8-b41f-d0140d89e199"/>
Apr 14 00:05:07 user nova-compute[82479]:       <nova:ports>
Apr 14 00:05:07 user nova-compute[82479]:         <nova:port uuid="b5dfa187-0a42-4319-990f-1d3b22691c27">
Apr 14 00:05:07 user nova-compute[82479]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 14 00:05:07 user nova-compute[82479]:         </nova:port>
Apr 14 00:05:07 user nova-compute[82479]:       </nova:ports>
Apr 14 00:05:07 user nova-compute[82479]:     </nova:instance>
Apr 14 00:05:07 user nova-compute[82479]:   </metadata>
Apr 14 00:05:07 user nova-compute[82479]:   <sysinfo type="smbios">
Apr 14 00:05:07 user nova-compute[82479]:     <system>
Apr 14 00:05:07 user nova-compute[82479]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 00:05:07 user nova-compute[82479]:       <entry name="product">OpenStack Nova</entry>
Apr 14 00:05:07 user nova-compute[82479]:       <entry name="version">0.0.0</entry>
Apr 14 00:05:07 user nova-compute[82479]:       <entry name="serial">01a65362-36ea-4817-8e83-f75d6daf808b</entry>
Apr 14 00:05:07 user nova-compute[82479]:       <entry name="uuid">01a65362-36ea-4817-8e83-f75d6daf808b</entry>
Apr 14 00:05:07 user nova-compute[82479]:       <entry name="family">Virtual Machine</entry>
Apr 14 00:05:07 user nova-compute[82479]:     </system>
Apr 14 00:05:07 user nova-compute[82479]:   </sysinfo>
Apr 14 00:05:07 user nova-compute[82479]:   <os>
Apr 14 00:05:07 user nova-compute[82479]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 00:05:07 user nova-compute[82479]:     <boot dev="hd"/>
Apr 14 00:05:07 user nova-compute[82479]:     <smbios mode="sysinfo"/>
Apr 14 00:05:07 user nova-compute[82479]:   </os>
Apr 14 00:05:07 user nova-compute[82479]:   <features>
Apr 14 00:05:07 user nova-compute[82479]:     <acpi/>
Apr 14 00:05:07 user nova-compute[82479]:     <apic/>
Apr 14 00:05:07 user nova-compute[82479]:     <vmcoreinfo/>
Apr 14 00:05:07 user nova-compute[82479]:   </features>
Apr 14 00:05:07 user nova-compute[82479]:   <clock offset="utc">
Apr 14 00:05:07 user nova-compute[82479]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 00:05:07 user nova-compute[82479]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 00:05:07 user nova-compute[82479]:     <timer name="hpet" present="no"/>
Apr 14 00:05:07 user nova-compute[82479]:   </clock>
Apr 14 00:05:07 user nova-compute[82479]:   <cpu mode="custom" match="exact">
Apr 14 00:05:07 user nova-compute[82479]:     <model>Nehalem</model>
Apr 14 00:05:07 user nova-compute[82479]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 00:05:07 user nova-compute[82479]:   </cpu>
Apr 14 00:05:07 user nova-compute[82479]:   <devices>
Apr 14 00:05:07 user nova-compute[82479]:     <disk type="file" device="disk">
Apr 14 00:05:07 user nova-compute[82479]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 00:05:07 user nova-compute[82479]:       <source file="/opt/stack/data/nova/instances/01a65362-36ea-4817-8e83-f75d6daf808b/disk"/>
Apr 14 00:05:07 user nova-compute[82479]:       <target dev="vda" bus="virtio"/>
Apr 14 00:05:07 user nova-compute[82479]:     </disk>
Apr 14 00:05:07 user nova-compute[82479]:     <interface type="ethernet">
Apr 14 00:05:07 user nova-compute[82479]:       <mac address="fa:16:3e:7b:38:3d"/>
Apr 14 00:05:07 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:05:07 user nova-compute[82479]:       <mtu size="1442"/>
Apr 14 00:05:07 user nova-compute[82479]:       <target dev="tapb5dfa187-0a"/>
Apr 14 00:05:07 user nova-compute[82479]:     </interface>
Apr 14 00:05:07 user nova-compute[82479]:     <serial type="pty">
Apr 14 00:05:07 user nova-compute[82479]:       <log file="/opt/stack/data/nova/instances/01a65362-36ea-4817-8e83-f75d6daf808b/console.log" append="off"/>
Apr 14 00:05:07 user nova-compute[82479]:     </serial>
Apr 14 00:05:07 user nova-compute[82479]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 00:05:07 user nova-compute[82479]:     <video>
Apr 14 00:05:07 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:05:07 user nova-compute[82479]:     </video>
Apr 14 00:05:07 user nova-compute[82479]:     <rng model="virtio">
Apr 14 00:05:07 user nova-compute[82479]:       <backend model="random">/dev/urandom</backend>
Apr 14 00:05:07 user nova-compute[82479]:     </rng>
Apr 14 00:05:07 user nova-compute[82479]:     <controller type="usb" index="0" model="none"/>
Apr 14 00:05:07 user nova-compute[82479]:     <memballoon model="virtio">
Apr 14 00:05:07 user nova-compute[82479]:       <stats period="10"/>
Apr 14 00:05:07 user nova-compute[82479]:     </memballoon>
Apr 14 00:05:07 user nova-compute[82479]:   </devices>
Apr 14 00:05:07 user nova-compute[82479]: </domain>
Apr 14 00:05:07 user nova-compute[82479]:  {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 00:05:07 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:04:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-874047723',display_name='tempest-AttachVolumeTestJSON-server-874047723',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-874047723',id=5,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFj5BOE0cuvlxZawRQVfnfugrJsq+vAMk/RiiLDSf3KCRmtu0WTqB0nwANMnYIuDZO4AsUPttsoe/j3WMHFiNDVdBMIPFOCGE/kkjYyw9NwqNVOKFmKjVIZ3x8l2xusRtg==',key_name='tempest-keypair-608426082',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ec1aab0338ff4bd195a37a4199a378eb',ramdisk_id='',reservation_id='r-n5aqf0fe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1885059489',owner_user_name='tempest-AttachVolumeTestJSON-1885059489-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:05:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44530987616b417d87ce5909d8de1871',uuid=01a65362-36ea-4817-8e83-f75d6daf808b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b5dfa187-0a42-4319-990f-1d3b22691c27", "address": "fa:16:3e:7b:38:3d", "network": {"id": "368d9445-850e-4f74-b5cc-86d1eaa95d63", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374332689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec1aab0338ff4bd195a37a4199a378eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5dfa187-0a", "ovs_interfaceid": "b5dfa187-0a42-4319-990f-1d3b22691c27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 00:05:07 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Converting VIF {"id": "b5dfa187-0a42-4319-990f-1d3b22691c27", "address": "fa:16:3e:7b:38:3d", "network": {"id": "368d9445-850e-4f74-b5cc-86d1eaa95d63", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374332689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec1aab0338ff4bd195a37a4199a378eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5dfa187-0a", "ovs_interfaceid": "b5dfa187-0a42-4319-990f-1d3b22691c27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:05:07 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:38:3d,bridge_name='br-int',has_traffic_filtering=True,id=b5dfa187-0a42-4319-990f-1d3b22691c27,network=Network(368d9445-850e-4f74-b5cc-86d1eaa95d63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5dfa187-0a') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:05:07 user nova-compute[82479]: DEBUG os_vif [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:38:3d,bridge_name='br-int',has_traffic_filtering=True,id=b5dfa187-0a42-4319-990f-1d3b22691c27,network=Network(368d9445-850e-4f74-b5cc-86d1eaa95d63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5dfa187-0a') {{(pid=82479) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 00:05:07 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:07 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:05:07 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 00:05:07 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:07 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:07 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb5dfa187-0a, may_exist=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:05:07 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb5dfa187-0a, col_values=(('external_ids', {'iface-id': 'b5dfa187-0a42-4319-990f-1d3b22691c27', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:38:3d', 'vm-uuid': '01a65362-36ea-4817-8e83-f75d6daf808b'}),)) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:05:07 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:07 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:05:07 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:07 user nova-compute[82479]: INFO os_vif [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:38:3d,bridge_name='br-int',has_traffic_filtering=True,id=b5dfa187-0a42-4319-990f-1d3b22691c27,network=Network(368d9445-850e-4f74-b5cc-86d1eaa95d63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5dfa187-0a')
Apr 14 00:05:07 user nova-compute[82479]: DEBUG nova.network.neutron [req-281907eb-0f80-461b-b75e-31f9f929cf99 req-5f44f9af-f8a7-475b-8266-6a1e4d20ce69 service nova] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Updated VIF entry in instance network info cache for port 1b166f8e-a207-48d3-a0a9-2ad6c44774b2. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:05:07 user nova-compute[82479]: DEBUG nova.network.neutron [req-281907eb-0f80-461b-b75e-31f9f929cf99 req-5f44f9af-f8a7-475b-8266-6a1e4d20ce69 service nova] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Updating instance_info_cache with network_info: [{"id": "1b166f8e-a207-48d3-a0a9-2ad6c44774b2", "address": "fa:16:3e:2b:d2:f7", "network": {"id": "66316d10-fed3-4fb9-877e-a01542ca5855", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-93456010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f20caf676a64b9b97027f3fc9bc724c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b166f8e-a2", "ovs_interfaceid": "1b166f8e-a207-48d3-a0a9-2ad6c44774b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:05:07 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-281907eb-0f80-461b-b75e-31f9f929cf99 req-5f44f9af-f8a7-475b-8266-6a1e4d20ce69 service nova] Releasing lock "refresh_cache-1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:05:07 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:05:07 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:05:07 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] No VIF found with MAC fa:16:3e:7b:38:3d, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:05:07 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:05:07 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.559s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:05:07 user nova-compute[82479]: DEBUG nova.compute.manager [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Start building networks asynchronously for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 00:05:07 user nova-compute[82479]: DEBUG nova.compute.manager [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Allocating IP information in the background. {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 00:05:07 user nova-compute[82479]: DEBUG nova.network.neutron [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] allocate_for_instance() {{(pid=82479) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 00:05:07 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 00:05:07 user nova-compute[82479]: DEBUG nova.compute.manager [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Start building block device mappings for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 00:05:07 user nova-compute[82479]: DEBUG nova.policy [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3d86662f2c7648daad87118b7e9f757c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8663ccad9047f4b11b9ae0646c287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82479) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 00:05:07 user nova-compute[82479]: DEBUG nova.compute.manager [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Start spawning the instance on the hypervisor. {{(pid=82479) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 00:05:07 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Creating instance directory {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 00:05:07 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Creating image(s)
Apr 14 00:05:07 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "/opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:05:07 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "/opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:05:07 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "/opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:05:07 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:05:07 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.128s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:05:07 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "3e200e101633f2016e569ae4c0a352380507d1e4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:05:07 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "3e200e101633f2016e569ae4c0a352380507d1e4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:05:07 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:05:07 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.143s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:05:07 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk 1073741824 {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:05:07 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk 1073741824" returned: 0 in 0.050s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:05:07 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "3e200e101633f2016e569ae4c0a352380507d1e4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.197s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:05:07 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:05:08 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.130s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:05:08 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk. size=1073741824 {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 00:05:08 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:05:08 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:05:08 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Cannot resize image /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk to a smaller size. {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 00:05:08 user nova-compute[82479]: DEBUG nova.objects.instance [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lazy-loading 'migration_context' on Instance uuid b3475e7e-ceb4-452a-a045-dbf43c5944dd {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:05:08 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Created local disks {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 00:05:08 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Ensure instance console log exists: /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/console.log {{(pid=82479) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 00:05:08 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:05:08 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:05:08 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:05:08 user nova-compute[82479]: DEBUG nova.network.neutron [req-7eda0224-2471-4e8a-9116-60ef20f1eaec req-78a793bb-fcec-42aa-8fdb-02529675fa44 service nova] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Updated VIF entry in instance network info cache for port b5dfa187-0a42-4319-990f-1d3b22691c27. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:05:08 user nova-compute[82479]: DEBUG nova.network.neutron [req-7eda0224-2471-4e8a-9116-60ef20f1eaec req-78a793bb-fcec-42aa-8fdb-02529675fa44 service nova] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Updating instance_info_cache with network_info: [{"id": "b5dfa187-0a42-4319-990f-1d3b22691c27", "address": "fa:16:3e:7b:38:3d", "network": {"id": "368d9445-850e-4f74-b5cc-86d1eaa95d63", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374332689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec1aab0338ff4bd195a37a4199a378eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5dfa187-0a", "ovs_interfaceid": "b5dfa187-0a42-4319-990f-1d3b22691c27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:05:08 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-7eda0224-2471-4e8a-9116-60ef20f1eaec req-78a793bb-fcec-42aa-8fdb-02529675fa44 service nova] Releasing lock "refresh_cache-01a65362-36ea-4817-8e83-f75d6daf808b" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:05:08 user nova-compute[82479]: DEBUG nova.network.neutron [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Successfully created port: 617f05b8-c04e-4abf-b4e5-a0234209624a {{(pid=82479) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 00:05:09 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:09 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:09 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:09 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:10 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:10 user nova-compute[82479]: DEBUG nova.compute.manager [req-4a61e4fd-f767-492d-a504-e400d31fffd0 req-f7e12215-1788-40fe-8485-0780b9774ba2 service nova] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Received event network-vif-plugged-db4fcb1f-e93d-4eee-851d-0c47f24dcdb3 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:05:10 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-4a61e4fd-f767-492d-a504-e400d31fffd0 req-f7e12215-1788-40fe-8485-0780b9774ba2 service nova] Acquiring lock "23718fd0-58b8-47f9-b1ef-a26a90741ecc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:05:10 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-4a61e4fd-f767-492d-a504-e400d31fffd0 req-f7e12215-1788-40fe-8485-0780b9774ba2 service nova] Lock "23718fd0-58b8-47f9-b1ef-a26a90741ecc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.067s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:05:10 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-4a61e4fd-f767-492d-a504-e400d31fffd0 req-f7e12215-1788-40fe-8485-0780b9774ba2 service nova] Lock "23718fd0-58b8-47f9-b1ef-a26a90741ecc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:05:10 user nova-compute[82479]: DEBUG nova.compute.manager [req-4a61e4fd-f767-492d-a504-e400d31fffd0 req-f7e12215-1788-40fe-8485-0780b9774ba2 service nova] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] No waiting events found dispatching network-vif-plugged-db4fcb1f-e93d-4eee-851d-0c47f24dcdb3 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:05:10 user nova-compute[82479]: WARNING nova.compute.manager [req-4a61e4fd-f767-492d-a504-e400d31fffd0 req-f7e12215-1788-40fe-8485-0780b9774ba2 service nova] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Received unexpected event network-vif-plugged-db4fcb1f-e93d-4eee-851d-0c47f24dcdb3 for instance with vm_state building and task_state spawning.
Apr 14 00:05:10 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:10 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:10 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:10 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:10 user nova-compute[82479]: DEBUG nova.network.neutron [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Successfully updated port: 617f05b8-c04e-4abf-b4e5-a0234209624a {{(pid=82479) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 00:05:10 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "refresh_cache-b3475e7e-ceb4-452a-a045-dbf43c5944dd" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:05:10 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquired lock "refresh_cache-b3475e7e-ceb4-452a-a045-dbf43c5944dd" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:05:10 user nova-compute[82479]: DEBUG nova.network.neutron [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 00:05:10 user nova-compute[82479]: DEBUG nova.compute.manager [req-b5f8d5e7-73a2-4b36-9290-ef1ec1db778d req-0111784e-6afb-4065-81b1-25856f046d08 service nova] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Received event network-changed-617f05b8-c04e-4abf-b4e5-a0234209624a {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:05:10 user nova-compute[82479]: DEBUG nova.compute.manager [req-b5f8d5e7-73a2-4b36-9290-ef1ec1db778d req-0111784e-6afb-4065-81b1-25856f046d08 service nova] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Refreshing instance network info cache due to event network-changed-617f05b8-c04e-4abf-b4e5-a0234209624a. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:05:10 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-b5f8d5e7-73a2-4b36-9290-ef1ec1db778d req-0111784e-6afb-4065-81b1-25856f046d08 service nova] Acquiring lock "refresh_cache-b3475e7e-ceb4-452a-a045-dbf43c5944dd" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:05:10 user nova-compute[82479]: DEBUG nova.network.neutron [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Instance cache missing network info. {{(pid=82479) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 00:05:11 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:11 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:11 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:11 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:11 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:11 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:11 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:11 user nova-compute[82479]: DEBUG nova.network.neutron [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Updating instance_info_cache with network_info: [{"id": "617f05b8-c04e-4abf-b4e5-a0234209624a", "address": "fa:16:3e:f9:fd:1a", "network": {"id": "cb8c9bb1-a885-486d-aa6a-de600bc01c2e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1676259779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8663ccad9047f4b11b9ae0646c287a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617f05b8-c0", "ovs_interfaceid": "617f05b8-c04e-4abf-b4e5-a0234209624a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:05:11 user nova-compute[82479]: DEBUG nova.compute.manager [req-ee34cd88-4f4d-4bf0-b33f-17c3d07dfdb2 req-78f29ce4-fe84-45f5-8445-71f60447181b service nova] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Received event network-vif-plugged-4085de4c-cb9e-452b-9504-b7c7f8621213 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:05:11 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-ee34cd88-4f4d-4bf0-b33f-17c3d07dfdb2 req-78f29ce4-fe84-45f5-8445-71f60447181b service nova] Acquiring lock "3a6b9f89-e462-47d8-84a1-0ac4ade3ab97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:05:11 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-ee34cd88-4f4d-4bf0-b33f-17c3d07dfdb2 req-78f29ce4-fe84-45f5-8445-71f60447181b service nova] Lock "3a6b9f89-e462-47d8-84a1-0ac4ade3ab97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:05:11 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-ee34cd88-4f4d-4bf0-b33f-17c3d07dfdb2 req-78f29ce4-fe84-45f5-8445-71f60447181b service nova] Lock "3a6b9f89-e462-47d8-84a1-0ac4ade3ab97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:05:11 user nova-compute[82479]: DEBUG nova.compute.manager [req-ee34cd88-4f4d-4bf0-b33f-17c3d07dfdb2 req-78f29ce4-fe84-45f5-8445-71f60447181b service nova] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] No waiting events found dispatching network-vif-plugged-4085de4c-cb9e-452b-9504-b7c7f8621213 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:05:11 user nova-compute[82479]: WARNING nova.compute.manager [req-ee34cd88-4f4d-4bf0-b33f-17c3d07dfdb2 req-78f29ce4-fe84-45f5-8445-71f60447181b service nova] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Received unexpected event network-vif-plugged-4085de4c-cb9e-452b-9504-b7c7f8621213 for instance with vm_state building and task_state spawning.
Apr 14 00:05:11 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Releasing lock "refresh_cache-b3475e7e-ceb4-452a-a045-dbf43c5944dd" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:05:11 user nova-compute[82479]: DEBUG nova.compute.manager [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Instance network_info: |[{"id": "617f05b8-c04e-4abf-b4e5-a0234209624a", "address": "fa:16:3e:f9:fd:1a", "network": {"id": "cb8c9bb1-a885-486d-aa6a-de600bc01c2e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1676259779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8663ccad9047f4b11b9ae0646c287a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617f05b8-c0", "ovs_interfaceid": "617f05b8-c04e-4abf-b4e5-a0234209624a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 00:05:11 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-b5f8d5e7-73a2-4b36-9290-ef1ec1db778d req-0111784e-6afb-4065-81b1-25856f046d08 service nova] Acquired lock "refresh_cache-b3475e7e-ceb4-452a-a045-dbf43c5944dd" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:05:11 user nova-compute[82479]: DEBUG nova.network.neutron [req-b5f8d5e7-73a2-4b36-9290-ef1ec1db778d req-0111784e-6afb-4065-81b1-25856f046d08 service nova] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Refreshing network info cache for port 617f05b8-c04e-4abf-b4e5-a0234209624a {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:05:11 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Start _get_guest_xml network_info=[{"id": "617f05b8-c04e-4abf-b4e5-a0234209624a", "address": "fa:16:3e:f9:fd:1a", "network": {"id": "cb8c9bb1-a885-486d-aa6a-de600bc01c2e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1676259779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8663ccad9047f4b11b9ae0646c287a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617f05b8-c0", "ovs_interfaceid": "617f05b8-c04e-4abf-b4e5-a0234209624a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 00:05:12 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:12 user nova-compute[82479]: DEBUG nova.compute.manager [req-806578ba-1438-492a-8d62-11b9d5b964f0 req-513415f2-0cb5-409c-bc5f-b3e1560f91b8 service nova] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Received event network-vif-plugged-db4fcb1f-e93d-4eee-851d-0c47f24dcdb3 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:05:12 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-806578ba-1438-492a-8d62-11b9d5b964f0 req-513415f2-0cb5-409c-bc5f-b3e1560f91b8 service nova] Acquiring lock "23718fd0-58b8-47f9-b1ef-a26a90741ecc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:05:12 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-806578ba-1438-492a-8d62-11b9d5b964f0 req-513415f2-0cb5-409c-bc5f-b3e1560f91b8 service nova] Lock "23718fd0-58b8-47f9-b1ef-a26a90741ecc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:05:12 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-806578ba-1438-492a-8d62-11b9d5b964f0 req-513415f2-0cb5-409c-bc5f-b3e1560f91b8 service nova] Lock "23718fd0-58b8-47f9-b1ef-a26a90741ecc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:05:12 user nova-compute[82479]: DEBUG nova.compute.manager [req-806578ba-1438-492a-8d62-11b9d5b964f0 req-513415f2-0cb5-409c-bc5f-b3e1560f91b8 service nova] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] No waiting events found dispatching network-vif-plugged-db4fcb1f-e93d-4eee-851d-0c47f24dcdb3 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:05:12 user nova-compute[82479]: WARNING nova.compute.manager [req-806578ba-1438-492a-8d62-11b9d5b964f0 req-513415f2-0cb5-409c-bc5f-b3e1560f91b8 service nova] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Received unexpected event network-vif-plugged-db4fcb1f-e93d-4eee-851d-0c47f24dcdb3 for instance with vm_state building and task_state spawning.
Apr 14 00:05:12 user nova-compute[82479]: DEBUG nova.compute.manager [req-806578ba-1438-492a-8d62-11b9d5b964f0 req-513415f2-0cb5-409c-bc5f-b3e1560f91b8 service nova] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Received event network-vif-plugged-b5dfa187-0a42-4319-990f-1d3b22691c27 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:05:12 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-806578ba-1438-492a-8d62-11b9d5b964f0 req-513415f2-0cb5-409c-bc5f-b3e1560f91b8 service nova] Acquiring lock "01a65362-36ea-4817-8e83-f75d6daf808b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:05:12 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-806578ba-1438-492a-8d62-11b9d5b964f0 req-513415f2-0cb5-409c-bc5f-b3e1560f91b8 service nova] Lock "01a65362-36ea-4817-8e83-f75d6daf808b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:05:12 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-806578ba-1438-492a-8d62-11b9d5b964f0 req-513415f2-0cb5-409c-bc5f-b3e1560f91b8 service nova] Lock "01a65362-36ea-4817-8e83-f75d6daf808b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:05:12 user nova-compute[82479]: DEBUG nova.compute.manager [req-806578ba-1438-492a-8d62-11b9d5b964f0 req-513415f2-0cb5-409c-bc5f-b3e1560f91b8 service nova] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] No waiting events found dispatching network-vif-plugged-b5dfa187-0a42-4319-990f-1d3b22691c27 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:05:12 user nova-compute[82479]: WARNING nova.compute.manager [req-806578ba-1438-492a-8d62-11b9d5b964f0 req-513415f2-0cb5-409c-bc5f-b3e1560f91b8 service nova] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Received unexpected event network-vif-plugged-b5dfa187-0a42-4319-990f-1d3b22691c27 for instance with vm_state building and task_state spawning.
Apr 14 00:05:12 user nova-compute[82479]: DEBUG nova.compute.manager [req-806578ba-1438-492a-8d62-11b9d5b964f0 req-513415f2-0cb5-409c-bc5f-b3e1560f91b8 service nova] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Received event network-vif-plugged-b5dfa187-0a42-4319-990f-1d3b22691c27 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:05:12 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-806578ba-1438-492a-8d62-11b9d5b964f0 req-513415f2-0cb5-409c-bc5f-b3e1560f91b8 service nova] Acquiring lock "01a65362-36ea-4817-8e83-f75d6daf808b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:05:12 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-806578ba-1438-492a-8d62-11b9d5b964f0 req-513415f2-0cb5-409c-bc5f-b3e1560f91b8 service nova] Lock "01a65362-36ea-4817-8e83-f75d6daf808b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:05:12 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-806578ba-1438-492a-8d62-11b9d5b964f0 req-513415f2-0cb5-409c-bc5f-b3e1560f91b8 service nova] Lock "01a65362-36ea-4817-8e83-f75d6daf808b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:05:12 user nova-compute[82479]: DEBUG nova.compute.manager [req-806578ba-1438-492a-8d62-11b9d5b964f0 req-513415f2-0cb5-409c-bc5f-b3e1560f91b8 service nova] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] No waiting events found dispatching network-vif-plugged-b5dfa187-0a42-4319-990f-1d3b22691c27 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:05:12 user nova-compute[82479]: WARNING nova.compute.manager [req-806578ba-1438-492a-8d62-11b9d5b964f0 req-513415f2-0cb5-409c-bc5f-b3e1560f91b8 service nova] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Received unexpected event network-vif-plugged-b5dfa187-0a42-4319-990f-1d3b22691c27 for instance with vm_state building and task_state spawning.
Apr 14 00:05:12 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:12 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:13 user nova-compute[82479]: DEBUG nova.network.neutron [req-b5f8d5e7-73a2-4b36-9290-ef1ec1db778d req-0111784e-6afb-4065-81b1-25856f046d08 service nova] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Updated VIF entry in instance network info cache for port 617f05b8-c04e-4abf-b4e5-a0234209624a. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:05:13 user nova-compute[82479]: DEBUG nova.network.neutron [req-b5f8d5e7-73a2-4b36-9290-ef1ec1db778d req-0111784e-6afb-4065-81b1-25856f046d08 service nova] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Updating instance_info_cache with network_info: [{"id": "617f05b8-c04e-4abf-b4e5-a0234209624a", "address": "fa:16:3e:f9:fd:1a", "network": {"id": "cb8c9bb1-a885-486d-aa6a-de600bc01c2e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1676259779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8663ccad9047f4b11b9ae0646c287a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617f05b8-c0", "ovs_interfaceid": "617f05b8-c04e-4abf-b4e5-a0234209624a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:05:13 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-b5f8d5e7-73a2-4b36-9290-ef1ec1db778d req-0111784e-6afb-4065-81b1-25856f046d08 service nova] Releasing lock "refresh_cache-b3475e7e-ceb4-452a-a045-dbf43c5944dd" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:05:13 user nova-compute[82479]: DEBUG nova.compute.manager [req-582a7004-d5aa-42b5-9fca-74d746c6050b req-e6aaeadf-37db-472f-a9e1-7ae5c3748d19 service nova] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Received event network-vif-plugged-4085de4c-cb9e-452b-9504-b7c7f8621213 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:05:13 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-582a7004-d5aa-42b5-9fca-74d746c6050b req-e6aaeadf-37db-472f-a9e1-7ae5c3748d19 service nova] Acquiring lock "3a6b9f89-e462-47d8-84a1-0ac4ade3ab97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:05:13 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-582a7004-d5aa-42b5-9fca-74d746c6050b req-e6aaeadf-37db-472f-a9e1-7ae5c3748d19 service nova] Lock "3a6b9f89-e462-47d8-84a1-0ac4ade3ab97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:05:13 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-582a7004-d5aa-42b5-9fca-74d746c6050b req-e6aaeadf-37db-472f-a9e1-7ae5c3748d19 service nova] Lock "3a6b9f89-e462-47d8-84a1-0ac4ade3ab97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:05:13 user nova-compute[82479]: DEBUG nova.compute.manager [req-582a7004-d5aa-42b5-9fca-74d746c6050b req-e6aaeadf-37db-472f-a9e1-7ae5c3748d19 service nova] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] No waiting events found dispatching network-vif-plugged-4085de4c-cb9e-452b-9504-b7c7f8621213 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:05:13 user nova-compute[82479]: WARNING nova.compute.manager [req-582a7004-d5aa-42b5-9fca-74d746c6050b req-e6aaeadf-37db-472f-a9e1-7ae5c3748d19 service nova] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Received unexpected event network-vif-plugged-4085de4c-cb9e-452b-9504-b7c7f8621213 for instance with vm_state building and task_state spawning.
Apr 14 00:05:13 user nova-compute[82479]: DEBUG nova.compute.manager [req-582a7004-d5aa-42b5-9fca-74d746c6050b req-e6aaeadf-37db-472f-a9e1-7ae5c3748d19 service nova] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Received event network-vif-plugged-43fb1710-4018-42d7-88ad-b5cb3970204a {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:05:13 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-582a7004-d5aa-42b5-9fca-74d746c6050b req-e6aaeadf-37db-472f-a9e1-7ae5c3748d19 service nova] Acquiring lock "cae47769-02cd-4118-af46-0d3521ef7564-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:05:13 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-582a7004-d5aa-42b5-9fca-74d746c6050b req-e6aaeadf-37db-472f-a9e1-7ae5c3748d19 service nova] Lock "cae47769-02cd-4118-af46-0d3521ef7564-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:05:13 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-582a7004-d5aa-42b5-9fca-74d746c6050b req-e6aaeadf-37db-472f-a9e1-7ae5c3748d19 service nova] Lock "cae47769-02cd-4118-af46-0d3521ef7564-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:05:13 user nova-compute[82479]: DEBUG nova.compute.manager [req-582a7004-d5aa-42b5-9fca-74d746c6050b req-e6aaeadf-37db-472f-a9e1-7ae5c3748d19 service nova] [instance: cae47769-02cd-4118-af46-0d3521ef7564] No waiting events found dispatching network-vif-plugged-43fb1710-4018-42d7-88ad-b5cb3970204a {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:05:13 user nova-compute[82479]: WARNING nova.compute.manager [req-582a7004-d5aa-42b5-9fca-74d746c6050b req-e6aaeadf-37db-472f-a9e1-7ae5c3748d19 service nova] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Received unexpected event network-vif-plugged-43fb1710-4018-42d7-88ad-b5cb3970204a for instance with vm_state building and task_state spawning.
Apr 14 00:05:14 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681430714.6161234, cae47769-02cd-4118-af46-0d3521ef7564 => Resumed> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:05:14 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: cae47769-02cd-4118-af46-0d3521ef7564] VM Resumed (Lifecycle Event)
Apr 14 00:05:14 user nova-compute[82479]: DEBUG nova.compute.manager [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Instance event wait completed in 0 seconds for  {{(pid=82479) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 00:05:14 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Guest created on hypervisor {{(pid=82479) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 00:05:14 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Instance spawned successfully.
Apr 14 00:05:14 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 00:05:14 user nova-compute[82479]: DEBUG nova.compute.manager [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Instance event wait completed in 0 seconds for  {{(pid=82479) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 00:05:14 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Guest created on hypervisor {{(pid=82479) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 00:05:14 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:05:14 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:05:14 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82479) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 00:05:14 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T00:02:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 00:05:14 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Flavor limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 00:05:14 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Image limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 00:05:14 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Flavor pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 00:05:14 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Image pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 00:05:14 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 00:05:14 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 00:05:14 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 00:05:14 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Got 1 possible topologies {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 00:05:14 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 00:05:14 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 00:05:14 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:05:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-2144192259',display_name='tempest-ServerActionsTestJSON-server-2144192259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-2144192259',id=6,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD8E1mkrqLo3jsCiJcIvha4CNzW2T6/HQ38hZ5dGaGtUghmrHejTJlAuKgmy6xusLbaAzGTrJCKVkdgQ5v0CqCqGeNMDA89aLJgLl5KHn3gvI39SkbPja84HarSvbQbbXg==',key_name='tempest-keypair-1040271550',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf8663ccad9047f4b11b9ae0646c287a',ramdisk_id='',reservation_id='r-amqn5295',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-948553482',owner_user_name='tempest-ServerActionsTestJSON-948553482-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:05:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d86662f2c7648daad87118b7e9f757c',uuid=b3475e7e-ceb4-452a-a045-dbf43c5944dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "617f05b8-c04e-4abf-b4e5-a0234209624a", "address": "fa:16:3e:f9:fd:1a", "network": {"id": "cb8c9bb1-a885-486d-aa6a-de600bc01c2e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1676259779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8663ccad9047f4b11b9ae0646c287a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617f05b8-c0", "ovs_interfaceid": "617f05b8-c04e-4abf-b4e5-a0234209624a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82479) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 00:05:14 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Converting VIF {"id": "617f05b8-c04e-4abf-b4e5-a0234209624a", "address": "fa:16:3e:f9:fd:1a", "network": {"id": "cb8c9bb1-a885-486d-aa6a-de600bc01c2e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1676259779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8663ccad9047f4b11b9ae0646c287a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617f05b8-c0", "ovs_interfaceid": "617f05b8-c04e-4abf-b4e5-a0234209624a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:05:14 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:fd:1a,bridge_name='br-int',has_traffic_filtering=True,id=617f05b8-c04e-4abf-b4e5-a0234209624a,network=Network(cb8c9bb1-a885-486d-aa6a-de600bc01c2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap617f05b8-c0') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:05:14 user nova-compute[82479]: DEBUG nova.objects.instance [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lazy-loading 'pci_devices' on Instance uuid b3475e7e-ceb4-452a-a045-dbf43c5944dd {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:05:14 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:05:14 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Instance spawned successfully.
Apr 14 00:05:14 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 00:05:14 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] End _get_guest_xml xml=<domain type="kvm">
Apr 14 00:05:14 user nova-compute[82479]:   <uuid>b3475e7e-ceb4-452a-a045-dbf43c5944dd</uuid>
Apr 14 00:05:14 user nova-compute[82479]:   <name>instance-00000006</name>
Apr 14 00:05:14 user nova-compute[82479]:   <memory>131072</memory>
Apr 14 00:05:14 user nova-compute[82479]:   <vcpu>1</vcpu>
Apr 14 00:05:14 user nova-compute[82479]:   <metadata>
Apr 14 00:05:14 user nova-compute[82479]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 00:05:14 user nova-compute[82479]:       <nova:package version="0.0.0"/>
Apr 14 00:05:14 user nova-compute[82479]:       <nova:name>tempest-ServerActionsTestJSON-server-2144192259</nova:name>
Apr 14 00:05:14 user nova-compute[82479]:       <nova:creationTime>2023-04-14 00:05:14</nova:creationTime>
Apr 14 00:05:14 user nova-compute[82479]:       <nova:flavor name="m1.nano">
Apr 14 00:05:14 user nova-compute[82479]:         <nova:memory>128</nova:memory>
Apr 14 00:05:14 user nova-compute[82479]:         <nova:disk>1</nova:disk>
Apr 14 00:05:14 user nova-compute[82479]:         <nova:swap>0</nova:swap>
Apr 14 00:05:14 user nova-compute[82479]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 00:05:14 user nova-compute[82479]:         <nova:vcpus>1</nova:vcpus>
Apr 14 00:05:14 user nova-compute[82479]:       </nova:flavor>
Apr 14 00:05:14 user nova-compute[82479]:       <nova:owner>
Apr 14 00:05:14 user nova-compute[82479]:         <nova:user uuid="3d86662f2c7648daad87118b7e9f757c">tempest-ServerActionsTestJSON-948553482-project-member</nova:user>
Apr 14 00:05:14 user nova-compute[82479]:         <nova:project uuid="bf8663ccad9047f4b11b9ae0646c287a">tempest-ServerActionsTestJSON-948553482</nova:project>
Apr 14 00:05:14 user nova-compute[82479]:       </nova:owner>
Apr 14 00:05:14 user nova-compute[82479]:       <nova:root type="image" uuid="6db62068-7278-4cd8-b41f-d0140d89e199"/>
Apr 14 00:05:14 user nova-compute[82479]:       <nova:ports>
Apr 14 00:05:14 user nova-compute[82479]:         <nova:port uuid="617f05b8-c04e-4abf-b4e5-a0234209624a">
Apr 14 00:05:14 user nova-compute[82479]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 14 00:05:14 user nova-compute[82479]:         </nova:port>
Apr 14 00:05:14 user nova-compute[82479]:       </nova:ports>
Apr 14 00:05:14 user nova-compute[82479]:     </nova:instance>
Apr 14 00:05:14 user nova-compute[82479]:   </metadata>
Apr 14 00:05:14 user nova-compute[82479]:   <sysinfo type="smbios">
Apr 14 00:05:14 user nova-compute[82479]:     <system>
Apr 14 00:05:14 user nova-compute[82479]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 00:05:14 user nova-compute[82479]:       <entry name="product">OpenStack Nova</entry>
Apr 14 00:05:14 user nova-compute[82479]:       <entry name="version">0.0.0</entry>
Apr 14 00:05:14 user nova-compute[82479]:       <entry name="serial">b3475e7e-ceb4-452a-a045-dbf43c5944dd</entry>
Apr 14 00:05:14 user nova-compute[82479]:       <entry name="uuid">b3475e7e-ceb4-452a-a045-dbf43c5944dd</entry>
Apr 14 00:05:14 user nova-compute[82479]:       <entry name="family">Virtual Machine</entry>
Apr 14 00:05:14 user nova-compute[82479]:     </system>
Apr 14 00:05:14 user nova-compute[82479]:   </sysinfo>
Apr 14 00:05:14 user nova-compute[82479]:   <os>
Apr 14 00:05:14 user nova-compute[82479]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 00:05:14 user nova-compute[82479]:     <boot dev="hd"/>
Apr 14 00:05:14 user nova-compute[82479]:     <smbios mode="sysinfo"/>
Apr 14 00:05:14 user nova-compute[82479]:   </os>
Apr 14 00:05:14 user nova-compute[82479]:   <features>
Apr 14 00:05:14 user nova-compute[82479]:     <acpi/>
Apr 14 00:05:14 user nova-compute[82479]:     <apic/>
Apr 14 00:05:14 user nova-compute[82479]:     <vmcoreinfo/>
Apr 14 00:05:14 user nova-compute[82479]:   </features>
Apr 14 00:05:14 user nova-compute[82479]:   <clock offset="utc">
Apr 14 00:05:14 user nova-compute[82479]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 00:05:14 user nova-compute[82479]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 00:05:14 user nova-compute[82479]:     <timer name="hpet" present="no"/>
Apr 14 00:05:14 user nova-compute[82479]:   </clock>
Apr 14 00:05:14 user nova-compute[82479]:   <cpu mode="custom" match="exact">
Apr 14 00:05:14 user nova-compute[82479]:     <model>Nehalem</model>
Apr 14 00:05:14 user nova-compute[82479]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 00:05:14 user nova-compute[82479]:   </cpu>
Apr 14 00:05:14 user nova-compute[82479]:   <devices>
Apr 14 00:05:14 user nova-compute[82479]:     <disk type="file" device="disk">
Apr 14 00:05:14 user nova-compute[82479]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 00:05:14 user nova-compute[82479]:       <source file="/opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk"/>
Apr 14 00:05:14 user nova-compute[82479]:       <target dev="vda" bus="virtio"/>
Apr 14 00:05:14 user nova-compute[82479]:     </disk>
Apr 14 00:05:14 user nova-compute[82479]:     <interface type="ethernet">
Apr 14 00:05:14 user nova-compute[82479]:       <mac address="fa:16:3e:f9:fd:1a"/>
Apr 14 00:05:14 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:05:14 user nova-compute[82479]:       <mtu size="1442"/>
Apr 14 00:05:14 user nova-compute[82479]:       <target dev="tap617f05b8-c0"/>
Apr 14 00:05:14 user nova-compute[82479]:     </interface>
Apr 14 00:05:14 user nova-compute[82479]:     <serial type="pty">
Apr 14 00:05:14 user nova-compute[82479]:       <log file="/opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/console.log" append="off"/>
Apr 14 00:05:14 user nova-compute[82479]:     </serial>
Apr 14 00:05:14 user nova-compute[82479]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 00:05:14 user nova-compute[82479]:     <video>
Apr 14 00:05:14 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:05:14 user nova-compute[82479]:     </video>
Apr 14 00:05:14 user nova-compute[82479]:     <rng model="virtio">
Apr 14 00:05:14 user nova-compute[82479]:       <backend model="random">/dev/urandom</backend>
Apr 14 00:05:14 user nova-compute[82479]:     </rng>
Apr 14 00:05:14 user nova-compute[82479]:     <controller type="usb" index="0" model="none"/>
Apr 14 00:05:14 user nova-compute[82479]:     <memballoon model="virtio">
Apr 14 00:05:14 user nova-compute[82479]:       <stats period="10"/>
Apr 14 00:05:14 user nova-compute[82479]:     </memballoon>
Apr 14 00:05:14 user nova-compute[82479]:   </devices>
Apr 14 00:05:14 user nova-compute[82479]: </domain>
Apr 14 00:05:14 user nova-compute[82479]:  {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 00:05:14 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:05:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-2144192259',display_name='tempest-ServerActionsTestJSON-server-2144192259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-2144192259',id=6,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD8E1mkrqLo3jsCiJcIvha4CNzW2T6/HQ38hZ5dGaGtUghmrHejTJlAuKgmy6xusLbaAzGTrJCKVkdgQ5v0CqCqGeNMDA89aLJgLl5KHn3gvI39SkbPja84HarSvbQbbXg==',key_name='tempest-keypair-1040271550',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf8663ccad9047f4b11b9ae0646c287a',ramdisk_id='',reservation_id='r-amqn5295',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-948553482',owner_user_name='tempest-ServerActionsTestJSON-948553482-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:05:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d86662f2c7648daad87118b7e9f757c',uuid=b3475e7e-ceb4-452a-a045-dbf43c5944dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "617f05b8-c04e-4abf-b4e5-a0234209624a", "address": "fa:16:3e:f9:fd:1a", "network": {"id": "cb8c9bb1-a885-486d-aa6a-de600bc01c2e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1676259779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8663ccad9047f4b11b9ae0646c287a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617f05b8-c0", "ovs_interfaceid": "617f05b8-c04e-4abf-b4e5-a0234209624a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 00:05:14 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Converting VIF {"id": "617f05b8-c04e-4abf-b4e5-a0234209624a", "address": "fa:16:3e:f9:fd:1a", "network": {"id": "cb8c9bb1-a885-486d-aa6a-de600bc01c2e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1676259779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8663ccad9047f4b11b9ae0646c287a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617f05b8-c0", "ovs_interfaceid": "617f05b8-c04e-4abf-b4e5-a0234209624a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:05:14 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:fd:1a,bridge_name='br-int',has_traffic_filtering=True,id=617f05b8-c04e-4abf-b4e5-a0234209624a,network=Network(cb8c9bb1-a885-486d-aa6a-de600bc01c2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap617f05b8-c0') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:05:14 user nova-compute[82479]: DEBUG os_vif [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:fd:1a,bridge_name='br-int',has_traffic_filtering=True,id=617f05b8-c04e-4abf-b4e5-a0234209624a,network=Network(cb8c9bb1-a885-486d-aa6a-de600bc01c2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap617f05b8-c0') {{(pid=82479) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 00:05:14 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:14 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:05:14 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 00:05:14 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:14 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap617f05b8-c0, may_exist=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:05:14 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap617f05b8-c0, col_values=(('external_ids', {'iface-id': '617f05b8-c04e-4abf-b4e5-a0234209624a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:fd:1a', 'vm-uuid': 'b3475e7e-ceb4-452a-a045-dbf43c5944dd'}),)) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:05:14 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Found default for hw_cdrom_bus of ide {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:05:14 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Found default for hw_disk_bus of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:05:14 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Found default for hw_input_bus of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:05:14 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Found default for hw_pointer_model of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:05:14 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Found default for hw_video_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:05:14 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Found default for hw_vif_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:05:14 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:14 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:05:14 user nova-compute[82479]: INFO os_vif [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:fd:1a,bridge_name='br-int',has_traffic_filtering=True,id=617f05b8-c04e-4abf-b4e5-a0234209624a,network=Network(cb8c9bb1-a885-486d-aa6a-de600bc01c2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap617f05b8-c0')
Apr 14 00:05:14 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:05:14 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Found default for hw_cdrom_bus of ide {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:05:14 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Found default for hw_disk_bus of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:05:14 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Found default for hw_input_bus of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:05:14 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Found default for hw_pointer_model of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:05:14 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Found default for hw_video_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:05:14 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Found default for hw_vif_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:05:14 user nova-compute[82479]: INFO nova.compute.manager [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Took 20.27 seconds to spawn the instance on the hypervisor.
Apr 14 00:05:14 user nova-compute[82479]: DEBUG nova.compute.manager [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:05:14 user nova-compute[82479]: DEBUG nova.compute.manager [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Instance event wait completed in 0 seconds for  {{(pid=82479) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 00:05:14 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Guest created on hypervisor {{(pid=82479) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 00:05:14 user nova-compute[82479]: DEBUG nova.compute.manager [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Instance event wait completed in 0 seconds for  {{(pid=82479) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 00:05:14 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Guest created on hypervisor {{(pid=82479) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 00:05:14 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Instance spawned successfully.
Apr 14 00:05:14 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 00:05:14 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Instance spawned successfully.
Apr 14 00:05:14 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 00:05:15 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: cae47769-02cd-4118-af46-0d3521ef7564] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:05:15 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681430714.6364605, cae47769-02cd-4118-af46-0d3521ef7564 => Started> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:05:15 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: cae47769-02cd-4118-af46-0d3521ef7564] VM Started (Lifecycle Event)
Apr 14 00:05:15 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Found default for hw_cdrom_bus of ide {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:05:15 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Found default for hw_disk_bus of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:05:15 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Found default for hw_input_bus of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:05:15 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Found default for hw_pointer_model of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:05:15 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Found default for hw_video_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:05:15 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Found default for hw_vif_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:05:15 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Found default for hw_cdrom_bus of ide {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:05:15 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Found default for hw_disk_bus of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:05:15 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Found default for hw_input_bus of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:05:15 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Found default for hw_pointer_model of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:05:15 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Found default for hw_video_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:05:15 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Found default for hw_vif_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:05:15 user nova-compute[82479]: INFO nova.compute.manager [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Took 20.22 seconds to spawn the instance on the hypervisor.
Apr 14 00:05:15 user nova-compute[82479]: DEBUG nova.compute.manager [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:05:15 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:05:15 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] No VIF found with MAC fa:16:3e:f9:fd:1a, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:05:15 user nova-compute[82479]: INFO nova.compute.manager [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Took 13.92 seconds to spawn the instance on the hypervisor.
Apr 14 00:05:15 user nova-compute[82479]: DEBUG nova.compute.manager [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:05:15 user nova-compute[82479]: DEBUG nova.compute.manager [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Instance event wait completed in 0 seconds for  {{(pid=82479) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 00:05:15 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Guest created on hypervisor {{(pid=82479) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 00:05:15 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:05:15 user nova-compute[82479]: INFO nova.compute.manager [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Took 18.78 seconds to spawn the instance on the hypervisor.
Apr 14 00:05:15 user nova-compute[82479]: DEBUG nova.compute.manager [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:05:15 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:05:15 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Instance spawned successfully.
Apr 14 00:05:15 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 00:05:15 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:15 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: cae47769-02cd-4118-af46-0d3521ef7564] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:05:15 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681430714.6715894, 23718fd0-58b8-47f9-b1ef-a26a90741ecc => Resumed> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:05:15 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] VM Resumed (Lifecycle Event)
Apr 14 00:05:15 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:05:15 user nova-compute[82479]: INFO nova.compute.manager [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Took 21.66 seconds to build instance.
Apr 14 00:05:15 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:05:15 user nova-compute[82479]: INFO nova.compute.manager [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Took 15.14 seconds to build instance.
Apr 14 00:05:15 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-618e6f63-fed0-41e8-89c4-166e3b246d9d tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Lock "cae47769-02cd-4118-af46-0d3521ef7564" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.982s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:05:15 user nova-compute[82479]: INFO nova.compute.manager [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Took 19.79 seconds to build instance.
Apr 14 00:05:15 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Found default for hw_cdrom_bus of ide {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:05:15 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Found default for hw_disk_bus of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:05:15 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Found default for hw_input_bus of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:05:15 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Found default for hw_pointer_model of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:05:15 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Found default for hw_video_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:05:15 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Found default for hw_vif_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:05:15 user nova-compute[82479]: INFO nova.compute.manager [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Took 21.70 seconds to build instance.
Apr 14 00:05:15 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0b3d5ed0-dc30-4fd7-9215-9c81b0f8c2c5 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "3a6b9f89-e462-47d8-84a1-0ac4ade3ab97" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.944s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:05:15 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-5c07c263-bda2-4f24-b97d-34be937c42d5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "01a65362-36ea-4817-8e83-f75d6daf808b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.285s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:05:15 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f6733a76-b35e-4992-b8f1-8a649cc8d614 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "23718fd0-58b8-47f9-b1ef-a26a90741ecc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.969s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:05:15 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681430714.6734529, 23718fd0-58b8-47f9-b1ef-a26a90741ecc => Started> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:05:15 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] VM Started (Lifecycle Event)
Apr 14 00:05:15 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:05:15 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:05:15 user nova-compute[82479]: INFO nova.compute.manager [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Took 15.82 seconds to spawn the instance on the hypervisor.
Apr 14 00:05:15 user nova-compute[82479]: DEBUG nova.compute.manager [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:05:15 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681430714.893617, 01a65362-36ea-4817-8e83-f75d6daf808b => Resumed> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:05:15 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] VM Resumed (Lifecycle Event)
Apr 14 00:05:15 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:05:15 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:05:15 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681430714.9017367, 01a65362-36ea-4817-8e83-f75d6daf808b => Started> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:05:15 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] VM Started (Lifecycle Event)
Apr 14 00:05:16 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:05:16 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:05:16 user nova-compute[82479]: INFO nova.compute.manager [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Took 16.72 seconds to build instance.
Apr 14 00:05:16 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681430714.939492, 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97 => Resumed> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:05:16 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] VM Resumed (Lifecycle Event)
Apr 14 00:05:16 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-9173fd21-023d-47db-89c7-7c19505fab10 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.852s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:05:16 user nova-compute[82479]: DEBUG nova.compute.manager [req-c56749a2-3bd8-407b-8c5b-03bc5ddf60ab req-0fafa8d4-34fd-4bf1-a7da-5832429aa531 service nova] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Received event network-vif-plugged-43fb1710-4018-42d7-88ad-b5cb3970204a {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:05:16 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-c56749a2-3bd8-407b-8c5b-03bc5ddf60ab req-0fafa8d4-34fd-4bf1-a7da-5832429aa531 service nova] Acquiring lock "cae47769-02cd-4118-af46-0d3521ef7564-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:05:16 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-c56749a2-3bd8-407b-8c5b-03bc5ddf60ab req-0fafa8d4-34fd-4bf1-a7da-5832429aa531 service nova] Lock "cae47769-02cd-4118-af46-0d3521ef7564-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:05:16 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-c56749a2-3bd8-407b-8c5b-03bc5ddf60ab req-0fafa8d4-34fd-4bf1-a7da-5832429aa531 service nova] Lock "cae47769-02cd-4118-af46-0d3521ef7564-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:05:16 user nova-compute[82479]: DEBUG nova.compute.manager [req-c56749a2-3bd8-407b-8c5b-03bc5ddf60ab req-0fafa8d4-34fd-4bf1-a7da-5832429aa531 service nova] [instance: cae47769-02cd-4118-af46-0d3521ef7564] No waiting events found dispatching network-vif-plugged-43fb1710-4018-42d7-88ad-b5cb3970204a {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:05:16 user nova-compute[82479]: WARNING nova.compute.manager [req-c56749a2-3bd8-407b-8c5b-03bc5ddf60ab req-0fafa8d4-34fd-4bf1-a7da-5832429aa531 service nova] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Received unexpected event network-vif-plugged-43fb1710-4018-42d7-88ad-b5cb3970204a for instance with vm_state active and task_state None.
Apr 14 00:05:16 user nova-compute[82479]: DEBUG nova.compute.manager [req-b52e6b78-f7a2-41ec-a154-e5ec64ea608f req-db022af1-52e4-4c4a-86cb-ecd58a08e99e service nova] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Received event network-vif-plugged-1b166f8e-a207-48d3-a0a9-2ad6c44774b2 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:05:16 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-b52e6b78-f7a2-41ec-a154-e5ec64ea608f req-db022af1-52e4-4c4a-86cb-ecd58a08e99e service nova] Acquiring lock "1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:05:16 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-b52e6b78-f7a2-41ec-a154-e5ec64ea608f req-db022af1-52e4-4c4a-86cb-ecd58a08e99e service nova] Lock "1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:05:16 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-b52e6b78-f7a2-41ec-a154-e5ec64ea608f req-db022af1-52e4-4c4a-86cb-ecd58a08e99e service nova] Lock "1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:05:16 user nova-compute[82479]: DEBUG nova.compute.manager [req-b52e6b78-f7a2-41ec-a154-e5ec64ea608f req-db022af1-52e4-4c4a-86cb-ecd58a08e99e service nova] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] No waiting events found dispatching network-vif-plugged-1b166f8e-a207-48d3-a0a9-2ad6c44774b2 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:05:16 user nova-compute[82479]: WARNING nova.compute.manager [req-b52e6b78-f7a2-41ec-a154-e5ec64ea608f req-db022af1-52e4-4c4a-86cb-ecd58a08e99e service nova] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Received unexpected event network-vif-plugged-1b166f8e-a207-48d3-a0a9-2ad6c44774b2 for instance with vm_state active and task_state None.
Apr 14 00:05:16 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:05:16 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:05:16 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681430714.9415743, 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97 => Started> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:05:16 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] VM Started (Lifecycle Event)
Apr 14 00:05:16 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:05:16 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:05:16 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681430715.253739, 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a => Resumed> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:05:16 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] VM Resumed (Lifecycle Event)
Apr 14 00:05:16 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:05:16 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:05:16 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681430715.2604752, 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a => Started> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:05:16 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] VM Started (Lifecycle Event)
Apr 14 00:05:16 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:05:16 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:05:16 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:16 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:17 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:17 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:17 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:17 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:18 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:18 user nova-compute[82479]: DEBUG nova.compute.manager [req-66c003fa-6eab-431c-83bd-3e3ef8d9d52e req-f8297a6e-0658-467f-a0ab-ec1076b61562 service nova] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Received event network-vif-plugged-1b166f8e-a207-48d3-a0a9-2ad6c44774b2 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:05:18 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-66c003fa-6eab-431c-83bd-3e3ef8d9d52e req-f8297a6e-0658-467f-a0ab-ec1076b61562 service nova] Acquiring lock "1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:05:18 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-66c003fa-6eab-431c-83bd-3e3ef8d9d52e req-f8297a6e-0658-467f-a0ab-ec1076b61562 service nova] Lock "1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:05:18 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-66c003fa-6eab-431c-83bd-3e3ef8d9d52e req-f8297a6e-0658-467f-a0ab-ec1076b61562 service nova] Lock "1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:05:18 user nova-compute[82479]: DEBUG nova.compute.manager [req-66c003fa-6eab-431c-83bd-3e3ef8d9d52e req-f8297a6e-0658-467f-a0ab-ec1076b61562 service nova] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] No waiting events found dispatching network-vif-plugged-1b166f8e-a207-48d3-a0a9-2ad6c44774b2 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:05:18 user nova-compute[82479]: WARNING nova.compute.manager [req-66c003fa-6eab-431c-83bd-3e3ef8d9d52e req-f8297a6e-0658-467f-a0ab-ec1076b61562 service nova] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Received unexpected event network-vif-plugged-1b166f8e-a207-48d3-a0a9-2ad6c44774b2 for instance with vm_state active and task_state None.
Apr 14 00:05:18 user nova-compute[82479]: DEBUG nova.compute.manager [req-66c003fa-6eab-431c-83bd-3e3ef8d9d52e req-f8297a6e-0658-467f-a0ab-ec1076b61562 service nova] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Received event network-vif-plugged-617f05b8-c04e-4abf-b4e5-a0234209624a {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:05:18 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-66c003fa-6eab-431c-83bd-3e3ef8d9d52e req-f8297a6e-0658-467f-a0ab-ec1076b61562 service nova] Acquiring lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:05:18 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-66c003fa-6eab-431c-83bd-3e3ef8d9d52e req-f8297a6e-0658-467f-a0ab-ec1076b61562 service nova] Lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:05:18 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-66c003fa-6eab-431c-83bd-3e3ef8d9d52e req-f8297a6e-0658-467f-a0ab-ec1076b61562 service nova] Lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:05:18 user nova-compute[82479]: DEBUG nova.compute.manager [req-66c003fa-6eab-431c-83bd-3e3ef8d9d52e req-f8297a6e-0658-467f-a0ab-ec1076b61562 service nova] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] No waiting events found dispatching network-vif-plugged-617f05b8-c04e-4abf-b4e5-a0234209624a {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:05:18 user nova-compute[82479]: WARNING nova.compute.manager [req-66c003fa-6eab-431c-83bd-3e3ef8d9d52e req-f8297a6e-0658-467f-a0ab-ec1076b61562 service nova] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Received unexpected event network-vif-plugged-617f05b8-c04e-4abf-b4e5-a0234209624a for instance with vm_state building and task_state spawning.
Apr 14 00:05:19 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:19 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681430719.9332547, b3475e7e-ceb4-452a-a045-dbf43c5944dd => Resumed> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:05:19 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] VM Resumed (Lifecycle Event)
Apr 14 00:05:19 user nova-compute[82479]: DEBUG nova.compute.manager [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Instance event wait completed in 0 seconds for  {{(pid=82479) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 00:05:19 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Guest created on hypervisor {{(pid=82479) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 00:05:19 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Instance spawned successfully.
Apr 14 00:05:19 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 00:05:19 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:19 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:05:19 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:20 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:20 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:05:20 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Found default for hw_cdrom_bus of ide {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:05:20 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Found default for hw_disk_bus of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:05:20 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Found default for hw_input_bus of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:05:20 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Found default for hw_pointer_model of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:05:20 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Found default for hw_video_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:05:20 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Found default for hw_vif_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:05:20 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:05:20 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681430719.933422, b3475e7e-ceb4-452a-a045-dbf43c5944dd => Started> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:05:20 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] VM Started (Lifecycle Event)
Apr 14 00:05:20 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:05:20 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:05:20 user nova-compute[82479]: INFO nova.compute.manager [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Took 12.57 seconds to spawn the instance on the hypervisor.
Apr 14 00:05:20 user nova-compute[82479]: DEBUG nova.compute.manager [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:05:20 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:05:20 user nova-compute[82479]: INFO nova.compute.manager [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Took 13.67 seconds to build instance.
Apr 14 00:05:20 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-bd4d5ea2-201a-4f1e-80f8-06b2d4e9c376 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.807s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:05:20 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:20 user nova-compute[82479]: DEBUG nova.compute.manager [req-2c8ef80e-b9aa-403e-b27b-95a77545b166 req-ef8c8182-2ecd-4655-8c30-b2011e711daf service nova] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Received event network-vif-plugged-617f05b8-c04e-4abf-b4e5-a0234209624a {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:05:20 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-2c8ef80e-b9aa-403e-b27b-95a77545b166 req-ef8c8182-2ecd-4655-8c30-b2011e711daf service nova] Acquiring lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:05:20 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-2c8ef80e-b9aa-403e-b27b-95a77545b166 req-ef8c8182-2ecd-4655-8c30-b2011e711daf service nova] Lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:05:20 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-2c8ef80e-b9aa-403e-b27b-95a77545b166 req-ef8c8182-2ecd-4655-8c30-b2011e711daf service nova] Lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:05:20 user nova-compute[82479]: DEBUG nova.compute.manager [req-2c8ef80e-b9aa-403e-b27b-95a77545b166 req-ef8c8182-2ecd-4655-8c30-b2011e711daf service nova] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] No waiting events found dispatching network-vif-plugged-617f05b8-c04e-4abf-b4e5-a0234209624a {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:05:20 user nova-compute[82479]: WARNING nova.compute.manager [req-2c8ef80e-b9aa-403e-b27b-95a77545b166 req-ef8c8182-2ecd-4655-8c30-b2011e711daf service nova] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Received unexpected event network-vif-plugged-617f05b8-c04e-4abf-b4e5-a0234209624a for instance with vm_state active and task_state None.
Apr 14 00:05:21 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:21 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:22 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Acquiring lock "e97abae3-f573-48eb-a218-a8fec436ef3b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:05:22 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "e97abae3-f573-48eb-a218-a8fec436ef3b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:05:22 user nova-compute[82479]: DEBUG nova.compute.manager [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Starting instance... {{(pid=82479) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 00:05:22 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:05:22 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:05:22 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82479) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 00:05:22 user nova-compute[82479]: INFO nova.compute.claims [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Claim successful on node user
Apr 14 00:05:22 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:22 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:23 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:05:23 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:05:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.644s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:05:23 user nova-compute[82479]: DEBUG nova.compute.manager [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Start building networks asynchronously for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 00:05:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Acquiring lock "716b5e3f-20c7-40ef-9a45-71be0cfeaeb2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:05:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "716b5e3f-20c7-40ef-9a45-71be0cfeaeb2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:05:23 user nova-compute[82479]: DEBUG nova.compute.manager [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Starting instance... {{(pid=82479) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 00:05:23 user nova-compute[82479]: DEBUG nova.compute.manager [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Allocating IP information in the background. {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 00:05:23 user nova-compute[82479]: DEBUG nova.network.neutron [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] allocate_for_instance() {{(pid=82479) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 00:05:23 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Apr 14 00:05:23 user nova-compute[82479]: DEBUG nova.compute.manager [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Start building block device mappings for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 00:05:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:05:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:05:23 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82479) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 00:05:23 user nova-compute[82479]: INFO nova.compute.claims [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Claim successful on node user
Apr 14 00:05:23 user nova-compute[82479]: DEBUG nova.policy [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b3bff58a90484c5db3f035ab1187080e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccde4d67c2ed45af968e5f219cc8b6c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82479) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 00:05:23 user nova-compute[82479]: DEBUG nova.compute.manager [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Start spawning the instance on the hypervisor. {{(pid=82479) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 00:05:23 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Creating instance directory {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 00:05:23 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Creating image(s)
Apr 14 00:05:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Acquiring lock "/opt/stack/data/nova/instances/e97abae3-f573-48eb-a218-a8fec436ef3b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:05:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "/opt/stack/data/nova/instances/e97abae3-f573-48eb-a218-a8fec436ef3b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:05:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "/opt/stack/data/nova/instances/e97abae3-f573-48eb-a218-a8fec436ef3b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:05:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Acquiring lock "e5212d7ee0db0e10a8cd5cd85caac0b32ffc37cb" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:05:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "e5212d7ee0db0e10a8cd5cd85caac0b32ffc37cb" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:05:24 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:24 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:24 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5212d7ee0db0e10a8cd5cd85caac0b32ffc37cb.part --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:05:24 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:24 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5212d7ee0db0e10a8cd5cd85caac0b32ffc37cb.part --force-share --output=json" returned: 0 in 0.253s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:05:24 user nova-compute[82479]: DEBUG nova.virt.images [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] 24c53b8c-62a8-4f7f-91bc-0a2f07a14dae was qcow2, converting to raw {{(pid=82479) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 00:05:24 user nova-compute[82479]: DEBUG nova.privsep.utils [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82479) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 00:05:24 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e5212d7ee0db0e10a8cd5cd85caac0b32ffc37cb.part /opt/stack/data/nova/instances/_base/e5212d7ee0db0e10a8cd5cd85caac0b32ffc37cb.converted {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:05:25 user nova-compute[82479]: DEBUG nova.network.neutron [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Successfully created port: 28d36b9c-c7e0-4d50-bcf8-afa67f29246d {{(pid=82479) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 00:05:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e5212d7ee0db0e10a8cd5cd85caac0b32ffc37cb.part /opt/stack/data/nova/instances/_base/e5212d7ee0db0e10a8cd5cd85caac0b32ffc37cb.converted" returned: 0 in 0.496s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:05:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5212d7ee0db0e10a8cd5cd85caac0b32ffc37cb.converted --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:05:25 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:25 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:25 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:05:25 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:05:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5212d7ee0db0e10a8cd5cd85caac0b32ffc37cb.converted --force-share --output=json" returned: 0 in 0.225s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:05:25 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "e5212d7ee0db0e10a8cd5cd85caac0b32ffc37cb" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.718s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:05:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5212d7ee0db0e10a8cd5cd85caac0b32ffc37cb --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:05:25 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.984s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:05:25 user nova-compute[82479]: DEBUG nova.compute.manager [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Start building networks asynchronously for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 00:05:25 user nova-compute[82479]: DEBUG nova.compute.manager [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Allocating IP information in the background. {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 00:05:25 user nova-compute[82479]: DEBUG nova.network.neutron [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] allocate_for_instance() {{(pid=82479) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 00:05:25 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 00:05:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5212d7ee0db0e10a8cd5cd85caac0b32ffc37cb --force-share --output=json" returned: 0 in 0.337s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:05:25 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Acquiring lock "e5212d7ee0db0e10a8cd5cd85caac0b32ffc37cb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:05:25 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "e5212d7ee0db0e10a8cd5cd85caac0b32ffc37cb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:05:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5212d7ee0db0e10a8cd5cd85caac0b32ffc37cb --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:05:26 user nova-compute[82479]: DEBUG nova.compute.manager [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Start building block device mappings for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 00:05:26 user nova-compute[82479]: DEBUG nova.policy [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6f81027ba772436092c0b317c3d5895d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '293aba050c0e458a9d05bcbca5b49997', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82479) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 00:05:26 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5212d7ee0db0e10a8cd5cd85caac0b32ffc37cb --force-share --output=json" returned: 0 in 0.228s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:05:26 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5212d7ee0db0e10a8cd5cd85caac0b32ffc37cb,backing_fmt=raw /opt/stack/data/nova/instances/e97abae3-f573-48eb-a218-a8fec436ef3b/disk 1073741824 {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:05:26 user nova-compute[82479]: DEBUG nova.compute.manager [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Start spawning the instance on the hypervisor. {{(pid=82479) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 00:05:26 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Creating instance directory {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 00:05:26 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Creating image(s)
Apr 14 00:05:26 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Acquiring lock "/opt/stack/data/nova/instances/716b5e3f-20c7-40ef-9a45-71be0cfeaeb2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:05:26 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "/opt/stack/data/nova/instances/716b5e3f-20c7-40ef-9a45-71be0cfeaeb2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:05:26 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "/opt/stack/data/nova/instances/716b5e3f-20c7-40ef-9a45-71be0cfeaeb2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:05:26 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:05:26 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5212d7ee0db0e10a8cd5cd85caac0b32ffc37cb,backing_fmt=raw /opt/stack/data/nova/instances/e97abae3-f573-48eb-a218-a8fec436ef3b/disk 1073741824" returned: 0 in 0.129s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:05:26 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "e5212d7ee0db0e10a8cd5cd85caac0b32ffc37cb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.366s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:05:26 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5212d7ee0db0e10a8cd5cd85caac0b32ffc37cb --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:05:26 user nova-compute[82479]: DEBUG nova.network.neutron [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Successfully updated port: 28d36b9c-c7e0-4d50-bcf8-afa67f29246d {{(pid=82479) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 00:05:26 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Acquiring lock "refresh_cache-e97abae3-f573-48eb-a218-a8fec436ef3b" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:05:26 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Acquired lock "refresh_cache-e97abae3-f573-48eb-a218-a8fec436ef3b" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:05:26 user nova-compute[82479]: DEBUG nova.network.neutron [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 00:05:26 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.242s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:05:26 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Acquiring lock "3e200e101633f2016e569ae4c0a352380507d1e4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:05:26 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "3e200e101633f2016e569ae4c0a352380507d1e4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:05:26 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:05:26 user nova-compute[82479]: DEBUG nova.compute.manager [req-30ce48b4-47a5-448d-a8d9-0a7cfb4c5121 req-9f931448-9ad3-4c6a-a442-839ffb169737 service nova] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Received event network-changed-28d36b9c-c7e0-4d50-bcf8-afa67f29246d {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:05:26 user nova-compute[82479]: DEBUG nova.compute.manager [req-30ce48b4-47a5-448d-a8d9-0a7cfb4c5121 req-9f931448-9ad3-4c6a-a442-839ffb169737 service nova] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Refreshing instance network info cache due to event network-changed-28d36b9c-c7e0-4d50-bcf8-afa67f29246d. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:05:26 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-30ce48b4-47a5-448d-a8d9-0a7cfb4c5121 req-9f931448-9ad3-4c6a-a442-839ffb169737 service nova] Acquiring lock "refresh_cache-e97abae3-f573-48eb-a218-a8fec436ef3b" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:05:26 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5212d7ee0db0e10a8cd5cd85caac0b32ffc37cb --force-share --output=json" returned: 0 in 0.265s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:05:26 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e97abae3-f573-48eb-a218-a8fec436ef3b/disk. size=1073741824 {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 00:05:26 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e97abae3-f573-48eb-a218-a8fec436ef3b/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:05:26 user nova-compute[82479]: DEBUG nova.network.neutron [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Instance cache missing network info. {{(pid=82479) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 00:05:26 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.215s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:05:26 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/716b5e3f-20c7-40ef-9a45-71be0cfeaeb2/disk 1073741824 {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:05:26 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/716b5e3f-20c7-40ef-9a45-71be0cfeaeb2/disk 1073741824" returned: 0 in 0.068s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:05:26 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "3e200e101633f2016e569ae4c0a352380507d1e4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.288s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:05:26 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:05:26 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e97abae3-f573-48eb-a218-a8fec436ef3b/disk --force-share --output=json" returned: 0 in 0.297s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:05:26 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Cannot resize image /opt/stack/data/nova/instances/e97abae3-f573-48eb-a218-a8fec436ef3b/disk to a smaller size. {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 00:05:26 user nova-compute[82479]: DEBUG nova.objects.instance [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lazy-loading 'migration_context' on Instance uuid e97abae3-f573-48eb-a218-a8fec436ef3b {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:05:26 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Created local disks {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 00:05:26 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Ensure instance console log exists: /opt/stack/data/nova/instances/e97abae3-f573-48eb-a218-a8fec436ef3b/console.log {{(pid=82479) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 00:05:26 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:05:26 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:05:26 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:05:26 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.172s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:05:26 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Checking if we can resize image /opt/stack/data/nova/instances/716b5e3f-20c7-40ef-9a45-71be0cfeaeb2/disk. size=1073741824 {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 00:05:26 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/716b5e3f-20c7-40ef-9a45-71be0cfeaeb2/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:05:27 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/716b5e3f-20c7-40ef-9a45-71be0cfeaeb2/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:05:27 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Cannot resize image /opt/stack/data/nova/instances/716b5e3f-20c7-40ef-9a45-71be0cfeaeb2/disk to a smaller size. {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 00:05:27 user nova-compute[82479]: DEBUG nova.objects.instance [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lazy-loading 'migration_context' on Instance uuid 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:05:27 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Created local disks {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 00:05:27 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Ensure instance console log exists: /opt/stack/data/nova/instances/716b5e3f-20c7-40ef-9a45-71be0cfeaeb2/console.log {{(pid=82479) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 00:05:27 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:05:27 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.013s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:05:27 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:05:27 user nova-compute[82479]: DEBUG nova.network.neutron [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Successfully created port: e8376395-8a3e-46bf-a137-3e740e4e70ef {{(pid=82479) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 00:05:27 user nova-compute[82479]: DEBUG nova.network.neutron [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Updating instance_info_cache with network_info: [{"id": "28d36b9c-c7e0-4d50-bcf8-afa67f29246d", "address": "fa:16:3e:d8:66:9d", "network": {"id": "4167bd9a-4666-4e4b-8b36-eea1ff220878", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1393009469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccde4d67c2ed45af968e5f219cc8b6c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28d36b9c-c7", "ovs_interfaceid": "28d36b9c-c7e0-4d50-bcf8-afa67f29246d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:05:27 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Releasing lock "refresh_cache-e97abae3-f573-48eb-a218-a8fec436ef3b" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:05:27 user nova-compute[82479]: DEBUG nova.compute.manager [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Instance network_info: |[{"id": "28d36b9c-c7e0-4d50-bcf8-afa67f29246d", "address": "fa:16:3e:d8:66:9d", "network": {"id": "4167bd9a-4666-4e4b-8b36-eea1ff220878", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1393009469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccde4d67c2ed45af968e5f219cc8b6c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28d36b9c-c7", "ovs_interfaceid": "28d36b9c-c7e0-4d50-bcf8-afa67f29246d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 00:05:27 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-30ce48b4-47a5-448d-a8d9-0a7cfb4c5121 req-9f931448-9ad3-4c6a-a442-839ffb169737 service nova] Acquired lock "refresh_cache-e97abae3-f573-48eb-a218-a8fec436ef3b" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:05:27 user nova-compute[82479]: DEBUG nova.network.neutron [req-30ce48b4-47a5-448d-a8d9-0a7cfb4c5121 req-9f931448-9ad3-4c6a-a442-839ffb169737 service nova] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Refreshing network info cache for port 28d36b9c-c7e0-4d50-bcf8-afa67f29246d {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:05:27 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Start _get_guest_xml network_info=[{"id": "28d36b9c-c7e0-4d50-bcf8-afa67f29246d", "address": "fa:16:3e:d8:66:9d", "network": {"id": "4167bd9a-4666-4e4b-8b36-eea1ff220878", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1393009469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccde4d67c2ed45af968e5f219cc8b6c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28d36b9c-c7", "ovs_interfaceid": "28d36b9c-c7e0-4d50-bcf8-afa67f29246d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:05:12Z,direct_url=<?>,disk_format='qcow2',id=24c53b8c-62a8-4f7f-91bc-0a2f07a14dae,min_disk=0,min_ram=0,name='',owner='06632a7c0a5d4c0d9aab61d872b1f943',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:05:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'disk_bus': 'scsi', 'size': 0, 'device_name': '/dev/sda', 'image_id': '24c53b8c-62a8-4f7f-91bc-0a2f07a14dae'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 00:05:27 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:05:27 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:05:27 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82479) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 00:05:27 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T00:02:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:05:12Z,direct_url=<?>,disk_format='qcow2',id=24c53b8c-62a8-4f7f-91bc-0a2f07a14dae,min_disk=0,min_ram=0,name='',owner='06632a7c0a5d4c0d9aab61d872b1f943',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:05:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 00:05:27 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Flavor limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 00:05:27 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Image limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 00:05:27 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Flavor pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 00:05:27 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Image pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 00:05:27 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 00:05:27 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 00:05:27 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 00:05:27 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Got 1 possible topologies {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 00:05:27 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 00:05:27 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 00:05:27 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T00:05:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1350015229',display_name='tempest-AttachSCSIVolumeTestJSON-server-1350015229',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1350015229',id=7,image_ref='24c53b8c-62a8-4f7f-91bc-0a2f07a14dae',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBBRuOZjQvIE5tUmB4tfzvZRoCYk3Hsf5VhCBAOOcUwojgjny9UgepaV8G6SqWjUYPvwtt/SH5yQUW3rdVohRimKNBakqIU+mWsl0P0s23cgMalDbSnHqVnUTBlbtWKWsg==',key_name='tempest-keypair-1590246000',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ccde4d67c2ed45af968e5f219cc8b6c2',ramdisk_id='',reservation_id='r-43f6l1y9',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='24c53b8c-62a8-4f7f-91bc-0a2f07a14dae',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1907301903',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1907301903-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:05:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3bff58a90484c5db3f035ab1187080e',uuid=e97abae3-f573-48eb-a218-a8fec436ef3b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28d36b9c-c7e0-4d50-bcf8-afa67f29246d", "address": "fa:16:3e:d8:66:9d", "network": {"id": "4167bd9a-4666-4e4b-8b36-eea1ff220878", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1393009469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccde4d67c2ed45af968e5f219cc8b6c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28d36b9c-c7", "ovs_interfaceid": "28d36b9c-c7e0-4d50-bcf8-afa67f29246d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82479) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 00:05:27 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Converting VIF {"id": "28d36b9c-c7e0-4d50-bcf8-afa67f29246d", "address": "fa:16:3e:d8:66:9d", "network": {"id": "4167bd9a-4666-4e4b-8b36-eea1ff220878", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1393009469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccde4d67c2ed45af968e5f219cc8b6c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28d36b9c-c7", "ovs_interfaceid": "28d36b9c-c7e0-4d50-bcf8-afa67f29246d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:05:27 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:66:9d,bridge_name='br-int',has_traffic_filtering=True,id=28d36b9c-c7e0-4d50-bcf8-afa67f29246d,network=Network(4167bd9a-4666-4e4b-8b36-eea1ff220878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28d36b9c-c7') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:05:27 user nova-compute[82479]: DEBUG nova.objects.instance [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lazy-loading 'pci_devices' on Instance uuid e97abae3-f573-48eb-a218-a8fec436ef3b {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:05:27 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] End _get_guest_xml xml=<domain type="kvm">
Apr 14 00:05:27 user nova-compute[82479]:   <uuid>e97abae3-f573-48eb-a218-a8fec436ef3b</uuid>
Apr 14 00:05:27 user nova-compute[82479]:   <name>instance-00000007</name>
Apr 14 00:05:27 user nova-compute[82479]:   <memory>131072</memory>
Apr 14 00:05:27 user nova-compute[82479]:   <vcpu>1</vcpu>
Apr 14 00:05:27 user nova-compute[82479]:   <metadata>
Apr 14 00:05:27 user nova-compute[82479]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 00:05:27 user nova-compute[82479]:       <nova:package version="0.0.0"/>
Apr 14 00:05:27 user nova-compute[82479]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1350015229</nova:name>
Apr 14 00:05:27 user nova-compute[82479]:       <nova:creationTime>2023-04-14 00:05:27</nova:creationTime>
Apr 14 00:05:27 user nova-compute[82479]:       <nova:flavor name="m1.nano">
Apr 14 00:05:27 user nova-compute[82479]:         <nova:memory>128</nova:memory>
Apr 14 00:05:27 user nova-compute[82479]:         <nova:disk>1</nova:disk>
Apr 14 00:05:27 user nova-compute[82479]:         <nova:swap>0</nova:swap>
Apr 14 00:05:27 user nova-compute[82479]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 00:05:27 user nova-compute[82479]:         <nova:vcpus>1</nova:vcpus>
Apr 14 00:05:27 user nova-compute[82479]:       </nova:flavor>
Apr 14 00:05:27 user nova-compute[82479]:       <nova:owner>
Apr 14 00:05:27 user nova-compute[82479]:         <nova:user uuid="b3bff58a90484c5db3f035ab1187080e">tempest-AttachSCSIVolumeTestJSON-1907301903-project-member</nova:user>
Apr 14 00:05:27 user nova-compute[82479]:         <nova:project uuid="ccde4d67c2ed45af968e5f219cc8b6c2">tempest-AttachSCSIVolumeTestJSON-1907301903</nova:project>
Apr 14 00:05:27 user nova-compute[82479]:       </nova:owner>
Apr 14 00:05:27 user nova-compute[82479]:       <nova:root type="image" uuid="24c53b8c-62a8-4f7f-91bc-0a2f07a14dae"/>
Apr 14 00:05:27 user nova-compute[82479]:       <nova:ports>
Apr 14 00:05:27 user nova-compute[82479]:         <nova:port uuid="28d36b9c-c7e0-4d50-bcf8-afa67f29246d">
Apr 14 00:05:27 user nova-compute[82479]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 14 00:05:27 user nova-compute[82479]:         </nova:port>
Apr 14 00:05:27 user nova-compute[82479]:       </nova:ports>
Apr 14 00:05:27 user nova-compute[82479]:     </nova:instance>
Apr 14 00:05:27 user nova-compute[82479]:   </metadata>
Apr 14 00:05:27 user nova-compute[82479]:   <sysinfo type="smbios">
Apr 14 00:05:27 user nova-compute[82479]:     <system>
Apr 14 00:05:27 user nova-compute[82479]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 00:05:27 user nova-compute[82479]:       <entry name="product">OpenStack Nova</entry>
Apr 14 00:05:27 user nova-compute[82479]:       <entry name="version">0.0.0</entry>
Apr 14 00:05:27 user nova-compute[82479]:       <entry name="serial">e97abae3-f573-48eb-a218-a8fec436ef3b</entry>
Apr 14 00:05:27 user nova-compute[82479]:       <entry name="uuid">e97abae3-f573-48eb-a218-a8fec436ef3b</entry>
Apr 14 00:05:27 user nova-compute[82479]:       <entry name="family">Virtual Machine</entry>
Apr 14 00:05:27 user nova-compute[82479]:     </system>
Apr 14 00:05:27 user nova-compute[82479]:   </sysinfo>
Apr 14 00:05:27 user nova-compute[82479]:   <os>
Apr 14 00:05:27 user nova-compute[82479]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 00:05:27 user nova-compute[82479]:     <boot dev="hd"/>
Apr 14 00:05:27 user nova-compute[82479]:     <smbios mode="sysinfo"/>
Apr 14 00:05:27 user nova-compute[82479]:   </os>
Apr 14 00:05:27 user nova-compute[82479]:   <features>
Apr 14 00:05:27 user nova-compute[82479]:     <acpi/>
Apr 14 00:05:27 user nova-compute[82479]:     <apic/>
Apr 14 00:05:27 user nova-compute[82479]:     <vmcoreinfo/>
Apr 14 00:05:27 user nova-compute[82479]:   </features>
Apr 14 00:05:27 user nova-compute[82479]:   <clock offset="utc">
Apr 14 00:05:27 user nova-compute[82479]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 00:05:27 user nova-compute[82479]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 00:05:27 user nova-compute[82479]:     <timer name="hpet" present="no"/>
Apr 14 00:05:27 user nova-compute[82479]:   </clock>
Apr 14 00:05:27 user nova-compute[82479]:   <cpu mode="custom" match="exact">
Apr 14 00:05:27 user nova-compute[82479]:     <model>Nehalem</model>
Apr 14 00:05:27 user nova-compute[82479]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 00:05:27 user nova-compute[82479]:   </cpu>
Apr 14 00:05:27 user nova-compute[82479]:   <devices>
Apr 14 00:05:27 user nova-compute[82479]:     <disk type="file" device="disk">
Apr 14 00:05:27 user nova-compute[82479]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 00:05:27 user nova-compute[82479]:       <source file="/opt/stack/data/nova/instances/e97abae3-f573-48eb-a218-a8fec436ef3b/disk"/>
Apr 14 00:05:27 user nova-compute[82479]:       <target dev="sda" bus="scsi"/>
Apr 14 00:05:27 user nova-compute[82479]:       <address type="drive" controller="0" unit="0"/>
Apr 14 00:05:27 user nova-compute[82479]:     </disk>
Apr 14 00:05:27 user nova-compute[82479]:     <disk type="file" device="cdrom">
Apr 14 00:05:27 user nova-compute[82479]:       <driver name="qemu" type="raw" cache="none"/>
Apr 14 00:05:27 user nova-compute[82479]:       <source file="/opt/stack/data/nova/instances/e97abae3-f573-48eb-a218-a8fec436ef3b/disk.config"/>
Apr 14 00:05:27 user nova-compute[82479]:       <target dev="sdb" bus="scsi"/>
Apr 14 00:05:27 user nova-compute[82479]:       <address type="drive" controller="0" unit="1"/>
Apr 14 00:05:27 user nova-compute[82479]:     </disk>
Apr 14 00:05:27 user nova-compute[82479]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Apr 14 00:05:27 user nova-compute[82479]:     <interface type="ethernet">
Apr 14 00:05:27 user nova-compute[82479]:       <mac address="fa:16:3e:d8:66:9d"/>
Apr 14 00:05:27 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:05:27 user nova-compute[82479]:       <mtu size="1442"/>
Apr 14 00:05:27 user nova-compute[82479]:       <target dev="tap28d36b9c-c7"/>
Apr 14 00:05:27 user nova-compute[82479]:     </interface>
Apr 14 00:05:27 user nova-compute[82479]:     <serial type="pty">
Apr 14 00:05:27 user nova-compute[82479]:       <log file="/opt/stack/data/nova/instances/e97abae3-f573-48eb-a218-a8fec436ef3b/console.log" append="off"/>
Apr 14 00:05:27 user nova-compute[82479]:     </serial>
Apr 14 00:05:27 user nova-compute[82479]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 00:05:27 user nova-compute[82479]:     <video>
Apr 14 00:05:27 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:05:27 user nova-compute[82479]:     </video>
Apr 14 00:05:27 user nova-compute[82479]:     <rng model="virtio">
Apr 14 00:05:27 user nova-compute[82479]:       <backend model="random">/dev/urandom</backend>
Apr 14 00:05:27 user nova-compute[82479]:     </rng>
Apr 14 00:05:27 user nova-compute[82479]:     <controller type="usb" index="0" model="none"/>
Apr 14 00:05:27 user nova-compute[82479]:     <memballoon model="virtio">
Apr 14 00:05:27 user nova-compute[82479]:       <stats period="10"/>
Apr 14 00:05:27 user nova-compute[82479]:     </memballoon>
Apr 14 00:05:27 user nova-compute[82479]:   </devices>
Apr 14 00:05:27 user nova-compute[82479]: </domain>
Apr 14 00:05:27 user nova-compute[82479]:  {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 00:05:27 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T00:05:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1350015229',display_name='tempest-AttachSCSIVolumeTestJSON-server-1350015229',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1350015229',id=7,image_ref='24c53b8c-62a8-4f7f-91bc-0a2f07a14dae',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBBRuOZjQvIE5tUmB4tfzvZRoCYk3Hsf5VhCBAOOcUwojgjny9UgepaV8G6SqWjUYPvwtt/SH5yQUW3rdVohRimKNBakqIU+mWsl0P0s23cgMalDbSnHqVnUTBlbtWKWsg==',key_name='tempest-keypair-1590246000',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ccde4d67c2ed45af968e5f219cc8b6c2',ramdisk_id='',reservation_id='r-43f6l1y9',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='24c53b8c-62a8-4f7f-91bc-0a2f07a14dae',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1907301903',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1907301903-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:05:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3bff58a90484c5db3f035ab1187080e',uuid=e97abae3-f573-48eb-a218-a8fec436ef3b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28d36b9c-c7e0-4d50-bcf8-afa67f29246d", "address": "fa:16:3e:d8:66:9d", "network": {"id": "4167bd9a-4666-4e4b-8b36-eea1ff220878", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1393009469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccde4d67c2ed45af968e5f219cc8b6c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28d36b9c-c7", "ovs_interfaceid": "28d36b9c-c7e0-4d50-bcf8-afa67f29246d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 00:05:27 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Converting VIF {"id": "28d36b9c-c7e0-4d50-bcf8-afa67f29246d", "address": "fa:16:3e:d8:66:9d", "network": {"id": "4167bd9a-4666-4e4b-8b36-eea1ff220878", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1393009469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccde4d67c2ed45af968e5f219cc8b6c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28d36b9c-c7", "ovs_interfaceid": "28d36b9c-c7e0-4d50-bcf8-afa67f29246d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:05:27 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:66:9d,bridge_name='br-int',has_traffic_filtering=True,id=28d36b9c-c7e0-4d50-bcf8-afa67f29246d,network=Network(4167bd9a-4666-4e4b-8b36-eea1ff220878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28d36b9c-c7') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:05:27 user nova-compute[82479]: DEBUG os_vif [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:66:9d,bridge_name='br-int',has_traffic_filtering=True,id=28d36b9c-c7e0-4d50-bcf8-afa67f29246d,network=Network(4167bd9a-4666-4e4b-8b36-eea1ff220878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28d36b9c-c7') {{(pid=82479) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 00:05:27 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:27 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:05:27 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 00:05:27 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:27 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap28d36b9c-c7, may_exist=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:05:27 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap28d36b9c-c7, col_values=(('external_ids', {'iface-id': '28d36b9c-c7e0-4d50-bcf8-afa67f29246d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:66:9d', 'vm-uuid': 'e97abae3-f573-48eb-a218-a8fec436ef3b'}),)) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:05:27 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:27 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:05:27 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:27 user nova-compute[82479]: INFO os_vif [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:66:9d,bridge_name='br-int',has_traffic_filtering=True,id=28d36b9c-c7e0-4d50-bcf8-afa67f29246d,network=Network(4167bd9a-4666-4e4b-8b36-eea1ff220878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28d36b9c-c7')
Apr 14 00:05:28 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] No BDM found with device name sda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:05:28 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] No BDM found with device name sdb, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:05:28 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] No VIF found with MAC fa:16:3e:d8:66:9d, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:05:28 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Using config drive
Apr 14 00:05:28 user nova-compute[82479]: DEBUG nova.network.neutron [req-30ce48b4-47a5-448d-a8d9-0a7cfb4c5121 req-9f931448-9ad3-4c6a-a442-839ffb169737 service nova] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Updated VIF entry in instance network info cache for port 28d36b9c-c7e0-4d50-bcf8-afa67f29246d. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:05:28 user nova-compute[82479]: DEBUG nova.network.neutron [req-30ce48b4-47a5-448d-a8d9-0a7cfb4c5121 req-9f931448-9ad3-4c6a-a442-839ffb169737 service nova] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Updating instance_info_cache with network_info: [{"id": "28d36b9c-c7e0-4d50-bcf8-afa67f29246d", "address": "fa:16:3e:d8:66:9d", "network": {"id": "4167bd9a-4666-4e4b-8b36-eea1ff220878", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1393009469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccde4d67c2ed45af968e5f219cc8b6c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28d36b9c-c7", "ovs_interfaceid": "28d36b9c-c7e0-4d50-bcf8-afa67f29246d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:05:28 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-30ce48b4-47a5-448d-a8d9-0a7cfb4c5121 req-9f931448-9ad3-4c6a-a442-839ffb169737 service nova] Releasing lock "refresh_cache-e97abae3-f573-48eb-a218-a8fec436ef3b" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:05:28 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Creating config drive at /opt/stack/data/nova/instances/e97abae3-f573-48eb-a218-a8fec436ef3b/disk.config
Apr 14 00:05:28 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e97abae3-f573-48eb-a218-a8fec436ef3b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpff1ag3rs {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:05:28 user nova-compute[82479]: DEBUG nova.network.neutron [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Successfully updated port: e8376395-8a3e-46bf-a137-3e740e4e70ef {{(pid=82479) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 00:05:28 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e97abae3-f573-48eb-a218-a8fec436ef3b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpff1ag3rs" returned: 0 in 0.081s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:05:28 user nova-compute[82479]: DEBUG nova.compute.manager [req-be4f27b3-60c6-4da5-8357-376e73c11f6f req-d4e4e4a4-4304-477e-9c1e-6a29b0c918a0 service nova] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Received event network-changed-e8376395-8a3e-46bf-a137-3e740e4e70ef {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:05:28 user nova-compute[82479]: DEBUG nova.compute.manager [req-be4f27b3-60c6-4da5-8357-376e73c11f6f req-d4e4e4a4-4304-477e-9c1e-6a29b0c918a0 service nova] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Refreshing instance network info cache due to event network-changed-e8376395-8a3e-46bf-a137-3e740e4e70ef. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:05:28 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-be4f27b3-60c6-4da5-8357-376e73c11f6f req-d4e4e4a4-4304-477e-9c1e-6a29b0c918a0 service nova] Acquiring lock "refresh_cache-716b5e3f-20c7-40ef-9a45-71be0cfeaeb2" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:05:28 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-be4f27b3-60c6-4da5-8357-376e73c11f6f req-d4e4e4a4-4304-477e-9c1e-6a29b0c918a0 service nova] Acquired lock "refresh_cache-716b5e3f-20c7-40ef-9a45-71be0cfeaeb2" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:05:28 user nova-compute[82479]: DEBUG nova.network.neutron [req-be4f27b3-60c6-4da5-8357-376e73c11f6f req-d4e4e4a4-4304-477e-9c1e-6a29b0c918a0 service nova] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Refreshing network info cache for port e8376395-8a3e-46bf-a137-3e740e4e70ef {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:05:28 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Acquiring lock "refresh_cache-716b5e3f-20c7-40ef-9a45-71be0cfeaeb2" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:05:28 user nova-compute[82479]: DEBUG nova.network.neutron [req-be4f27b3-60c6-4da5-8357-376e73c11f6f req-d4e4e4a4-4304-477e-9c1e-6a29b0c918a0 service nova] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Instance cache missing network info. {{(pid=82479) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 00:05:29 user nova-compute[82479]: DEBUG nova.network.neutron [req-be4f27b3-60c6-4da5-8357-376e73c11f6f req-d4e4e4a4-4304-477e-9c1e-6a29b0c918a0 service nova] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Updating instance_info_cache with network_info: [] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:05:29 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-be4f27b3-60c6-4da5-8357-376e73c11f6f req-d4e4e4a4-4304-477e-9c1e-6a29b0c918a0 service nova] Releasing lock "refresh_cache-716b5e3f-20c7-40ef-9a45-71be0cfeaeb2" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:05:29 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Acquired lock "refresh_cache-716b5e3f-20c7-40ef-9a45-71be0cfeaeb2" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:05:29 user nova-compute[82479]: DEBUG nova.network.neutron [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 00:05:29 user nova-compute[82479]: DEBUG nova.network.neutron [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Instance cache missing network info. {{(pid=82479) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 00:05:30 user nova-compute[82479]: DEBUG nova.network.neutron [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Updating instance_info_cache with network_info: [{"id": "e8376395-8a3e-46bf-a137-3e740e4e70ef", "address": "fa:16:3e:1f:f1:73", "network": {"id": "e63d7eb1-1787-415b-bfd6-963171b3a18f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2097939022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "293aba050c0e458a9d05bcbca5b49997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8376395-8a", "ovs_interfaceid": "e8376395-8a3e-46bf-a137-3e740e4e70ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:05:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Releasing lock "refresh_cache-716b5e3f-20c7-40ef-9a45-71be0cfeaeb2" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:05:30 user nova-compute[82479]: DEBUG nova.compute.manager [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Instance network_info: |[{"id": "e8376395-8a3e-46bf-a137-3e740e4e70ef", "address": "fa:16:3e:1f:f1:73", "network": {"id": "e63d7eb1-1787-415b-bfd6-963171b3a18f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2097939022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "293aba050c0e458a9d05bcbca5b49997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8376395-8a", "ovs_interfaceid": "e8376395-8a3e-46bf-a137-3e740e4e70ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 00:05:30 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Start _get_guest_xml network_info=[{"id": "e8376395-8a3e-46bf-a137-3e740e4e70ef", "address": "fa:16:3e:1f:f1:73", "network": {"id": "e63d7eb1-1787-415b-bfd6-963171b3a18f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2097939022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "293aba050c0e458a9d05bcbca5b49997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8376395-8a", "ovs_interfaceid": "e8376395-8a3e-46bf-a137-3e740e4e70ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 00:05:30 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:30 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:05:30 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:05:30 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82479) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 00:05:30 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T00:02:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 00:05:30 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Flavor limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 00:05:30 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Image limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 00:05:30 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Flavor pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 00:05:30 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Image pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 00:05:30 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 00:05:30 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 00:05:30 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 00:05:30 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Got 1 possible topologies {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 00:05:30 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 00:05:30 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 00:05:30 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:05:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1764639886',display_name='tempest-TestVolumeSwap-server-1764639886',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1764639886',id=8,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNlltbtWOxgngd+WOhM2SVJONWIntPB0ReceG24uuEnBxzOjgSZeKMIb99xQeMRz+3+GFOzCkntE3uvUQW5vCgDqEdtuSFgaUNPtz9CZS0JAX7xEqeTQ71l5QNHCs+vY7w==',key_name='tempest-keypair-1602525381',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='293aba050c0e458a9d05bcbca5b49997',ramdisk_id='',reservation_id='r-xz5304l9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-882310266',owner_user_name='tempest-TestVolumeSwap-882310266-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:05:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6f81027ba772436092c0b317c3d5895d',uuid=716b5e3f-20c7-40ef-9a45-71be0cfeaeb2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8376395-8a3e-46bf-a137-3e740e4e70ef", "address": "fa:16:3e:1f:f1:73", "network": {"id": "e63d7eb1-1787-415b-bfd6-963171b3a18f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2097939022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "293aba050c0e458a9d05bcbca5b49997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8376395-8a", "ovs_interfaceid": "e8376395-8a3e-46bf-a137-3e740e4e70ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82479) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 00:05:30 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Converting VIF {"id": "e8376395-8a3e-46bf-a137-3e740e4e70ef", "address": "fa:16:3e:1f:f1:73", "network": {"id": "e63d7eb1-1787-415b-bfd6-963171b3a18f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2097939022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "293aba050c0e458a9d05bcbca5b49997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8376395-8a", "ovs_interfaceid": "e8376395-8a3e-46bf-a137-3e740e4e70ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:05:30 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:f1:73,bridge_name='br-int',has_traffic_filtering=True,id=e8376395-8a3e-46bf-a137-3e740e4e70ef,network=Network(e63d7eb1-1787-415b-bfd6-963171b3a18f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8376395-8a') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:05:30 user nova-compute[82479]: DEBUG nova.objects.instance [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lazy-loading 'pci_devices' on Instance uuid 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:05:30 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:30 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:30 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] End _get_guest_xml xml=<domain type="kvm">
Apr 14 00:05:30 user nova-compute[82479]:   <uuid>716b5e3f-20c7-40ef-9a45-71be0cfeaeb2</uuid>
Apr 14 00:05:30 user nova-compute[82479]:   <name>instance-00000008</name>
Apr 14 00:05:30 user nova-compute[82479]:   <memory>131072</memory>
Apr 14 00:05:30 user nova-compute[82479]:   <vcpu>1</vcpu>
Apr 14 00:05:30 user nova-compute[82479]:   <metadata>
Apr 14 00:05:30 user nova-compute[82479]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 00:05:30 user nova-compute[82479]:       <nova:package version="0.0.0"/>
Apr 14 00:05:30 user nova-compute[82479]:       <nova:name>tempest-TestVolumeSwap-server-1764639886</nova:name>
Apr 14 00:05:30 user nova-compute[82479]:       <nova:creationTime>2023-04-14 00:05:30</nova:creationTime>
Apr 14 00:05:30 user nova-compute[82479]:       <nova:flavor name="m1.nano">
Apr 14 00:05:30 user nova-compute[82479]:         <nova:memory>128</nova:memory>
Apr 14 00:05:30 user nova-compute[82479]:         <nova:disk>1</nova:disk>
Apr 14 00:05:30 user nova-compute[82479]:         <nova:swap>0</nova:swap>
Apr 14 00:05:30 user nova-compute[82479]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 00:05:30 user nova-compute[82479]:         <nova:vcpus>1</nova:vcpus>
Apr 14 00:05:30 user nova-compute[82479]:       </nova:flavor>
Apr 14 00:05:30 user nova-compute[82479]:       <nova:owner>
Apr 14 00:05:30 user nova-compute[82479]:         <nova:user uuid="6f81027ba772436092c0b317c3d5895d">tempest-TestVolumeSwap-882310266-project-member</nova:user>
Apr 14 00:05:30 user nova-compute[82479]:         <nova:project uuid="293aba050c0e458a9d05bcbca5b49997">tempest-TestVolumeSwap-882310266</nova:project>
Apr 14 00:05:30 user nova-compute[82479]:       </nova:owner>
Apr 14 00:05:30 user nova-compute[82479]:       <nova:root type="image" uuid="6db62068-7278-4cd8-b41f-d0140d89e199"/>
Apr 14 00:05:30 user nova-compute[82479]:       <nova:ports>
Apr 14 00:05:30 user nova-compute[82479]:         <nova:port uuid="e8376395-8a3e-46bf-a137-3e740e4e70ef">
Apr 14 00:05:30 user nova-compute[82479]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 14 00:05:30 user nova-compute[82479]:         </nova:port>
Apr 14 00:05:30 user nova-compute[82479]:       </nova:ports>
Apr 14 00:05:30 user nova-compute[82479]:     </nova:instance>
Apr 14 00:05:30 user nova-compute[82479]:   </metadata>
Apr 14 00:05:30 user nova-compute[82479]:   <sysinfo type="smbios">
Apr 14 00:05:30 user nova-compute[82479]:     <system>
Apr 14 00:05:30 user nova-compute[82479]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 00:05:30 user nova-compute[82479]:       <entry name="product">OpenStack Nova</entry>
Apr 14 00:05:30 user nova-compute[82479]:       <entry name="version">0.0.0</entry>
Apr 14 00:05:30 user nova-compute[82479]:       <entry name="serial">716b5e3f-20c7-40ef-9a45-71be0cfeaeb2</entry>
Apr 14 00:05:30 user nova-compute[82479]:       <entry name="uuid">716b5e3f-20c7-40ef-9a45-71be0cfeaeb2</entry>
Apr 14 00:05:30 user nova-compute[82479]:       <entry name="family">Virtual Machine</entry>
Apr 14 00:05:30 user nova-compute[82479]:     </system>
Apr 14 00:05:30 user nova-compute[82479]:   </sysinfo>
Apr 14 00:05:30 user nova-compute[82479]:   <os>
Apr 14 00:05:30 user nova-compute[82479]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 00:05:30 user nova-compute[82479]:     <boot dev="hd"/>
Apr 14 00:05:30 user nova-compute[82479]:     <smbios mode="sysinfo"/>
Apr 14 00:05:30 user nova-compute[82479]:   </os>
Apr 14 00:05:30 user nova-compute[82479]:   <features>
Apr 14 00:05:30 user nova-compute[82479]:     <acpi/>
Apr 14 00:05:30 user nova-compute[82479]:     <apic/>
Apr 14 00:05:30 user nova-compute[82479]:     <vmcoreinfo/>
Apr 14 00:05:30 user nova-compute[82479]:   </features>
Apr 14 00:05:30 user nova-compute[82479]:   <clock offset="utc">
Apr 14 00:05:30 user nova-compute[82479]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 00:05:30 user nova-compute[82479]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 00:05:30 user nova-compute[82479]:     <timer name="hpet" present="no"/>
Apr 14 00:05:30 user nova-compute[82479]:   </clock>
Apr 14 00:05:30 user nova-compute[82479]:   <cpu mode="custom" match="exact">
Apr 14 00:05:30 user nova-compute[82479]:     <model>Nehalem</model>
Apr 14 00:05:30 user nova-compute[82479]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 00:05:30 user nova-compute[82479]:   </cpu>
Apr 14 00:05:30 user nova-compute[82479]:   <devices>
Apr 14 00:05:30 user nova-compute[82479]:     <disk type="file" device="disk">
Apr 14 00:05:30 user nova-compute[82479]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 00:05:30 user nova-compute[82479]:       <source file="/opt/stack/data/nova/instances/716b5e3f-20c7-40ef-9a45-71be0cfeaeb2/disk"/>
Apr 14 00:05:30 user nova-compute[82479]:       <target dev="vda" bus="virtio"/>
Apr 14 00:05:30 user nova-compute[82479]:     </disk>
Apr 14 00:05:30 user nova-compute[82479]:     <interface type="ethernet">
Apr 14 00:05:30 user nova-compute[82479]:       <mac address="fa:16:3e:1f:f1:73"/>
Apr 14 00:05:30 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:05:30 user nova-compute[82479]:       <mtu size="1442"/>
Apr 14 00:05:30 user nova-compute[82479]:       <target dev="tape8376395-8a"/>
Apr 14 00:05:30 user nova-compute[82479]:     </interface>
Apr 14 00:05:30 user nova-compute[82479]:     <serial type="pty">
Apr 14 00:05:30 user nova-compute[82479]:       <log file="/opt/stack/data/nova/instances/716b5e3f-20c7-40ef-9a45-71be0cfeaeb2/console.log" append="off"/>
Apr 14 00:05:30 user nova-compute[82479]:     </serial>
Apr 14 00:05:30 user nova-compute[82479]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 00:05:30 user nova-compute[82479]:     <video>
Apr 14 00:05:30 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:05:30 user nova-compute[82479]:     </video>
Apr 14 00:05:30 user nova-compute[82479]:     <rng model="virtio">
Apr 14 00:05:30 user nova-compute[82479]:       <backend model="random">/dev/urandom</backend>
Apr 14 00:05:30 user nova-compute[82479]:     </rng>
Apr 14 00:05:30 user nova-compute[82479]:     <controller type="usb" index="0" model="none"/>
Apr 14 00:05:30 user nova-compute[82479]:     <memballoon model="virtio">
Apr 14 00:05:30 user nova-compute[82479]:       <stats period="10"/>
Apr 14 00:05:30 user nova-compute[82479]:     </memballoon>
Apr 14 00:05:30 user nova-compute[82479]:   </devices>
Apr 14 00:05:30 user nova-compute[82479]: </domain>
Apr 14 00:05:30 user nova-compute[82479]:  {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 00:05:30 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:05:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1764639886',display_name='tempest-TestVolumeSwap-server-1764639886',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1764639886',id=8,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNlltbtWOxgngd+WOhM2SVJONWIntPB0ReceG24uuEnBxzOjgSZeKMIb99xQeMRz+3+GFOzCkntE3uvUQW5vCgDqEdtuSFgaUNPtz9CZS0JAX7xEqeTQ71l5QNHCs+vY7w==',key_name='tempest-keypair-1602525381',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='293aba050c0e458a9d05bcbca5b49997',ramdisk_id='',reservation_id='r-xz5304l9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-882310266',owner_user_name='tempest-TestVolumeSwap-882310266-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:05:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6f81027ba772436092c0b317c3d5895d',uuid=716b5e3f-20c7-40ef-9a45-71be0cfeaeb2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8376395-8a3e-46bf-a137-3e740e4e70ef", "address": "fa:16:3e:1f:f1:73", "network": {"id": "e63d7eb1-1787-415b-bfd6-963171b3a18f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2097939022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "293aba050c0e458a9d05bcbca5b49997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8376395-8a", "ovs_interfaceid": "e8376395-8a3e-46bf-a137-3e740e4e70ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 00:05:30 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Converting VIF {"id": "e8376395-8a3e-46bf-a137-3e740e4e70ef", "address": "fa:16:3e:1f:f1:73", "network": {"id": "e63d7eb1-1787-415b-bfd6-963171b3a18f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2097939022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "293aba050c0e458a9d05bcbca5b49997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8376395-8a", "ovs_interfaceid": "e8376395-8a3e-46bf-a137-3e740e4e70ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:05:30 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:f1:73,bridge_name='br-int',has_traffic_filtering=True,id=e8376395-8a3e-46bf-a137-3e740e4e70ef,network=Network(e63d7eb1-1787-415b-bfd6-963171b3a18f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8376395-8a') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:05:30 user nova-compute[82479]: DEBUG os_vif [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:f1:73,bridge_name='br-int',has_traffic_filtering=True,id=e8376395-8a3e-46bf-a137-3e740e4e70ef,network=Network(e63d7eb1-1787-415b-bfd6-963171b3a18f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8376395-8a') {{(pid=82479) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 00:05:30 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:30 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:05:30 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 00:05:30 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:30 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape8376395-8a, may_exist=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:05:30 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape8376395-8a, col_values=(('external_ids', {'iface-id': 'e8376395-8a3e-46bf-a137-3e740e4e70ef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:f1:73', 'vm-uuid': '716b5e3f-20c7-40ef-9a45-71be0cfeaeb2'}),)) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:05:30 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:30 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:05:30 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:30 user nova-compute[82479]: INFO os_vif [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:f1:73,bridge_name='br-int',has_traffic_filtering=True,id=e8376395-8a3e-46bf-a137-3e740e4e70ef,network=Network(e63d7eb1-1787-415b-bfd6-963171b3a18f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8376395-8a')
Apr 14 00:05:30 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:05:30 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] No VIF found with MAC fa:16:3e:1f:f1:73, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:05:31 user nova-compute[82479]: DEBUG nova.compute.manager [req-5ea3d3a5-c5b8-477e-a8b9-6fad87f9e1a8 req-e8517d96-4742-4fde-82b7-c43bd4619906 service nova] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Received event network-vif-plugged-28d36b9c-c7e0-4d50-bcf8-afa67f29246d {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:05:31 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-5ea3d3a5-c5b8-477e-a8b9-6fad87f9e1a8 req-e8517d96-4742-4fde-82b7-c43bd4619906 service nova] Acquiring lock "e97abae3-f573-48eb-a218-a8fec436ef3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:05:31 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-5ea3d3a5-c5b8-477e-a8b9-6fad87f9e1a8 req-e8517d96-4742-4fde-82b7-c43bd4619906 service nova] Lock "e97abae3-f573-48eb-a218-a8fec436ef3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:05:31 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-5ea3d3a5-c5b8-477e-a8b9-6fad87f9e1a8 req-e8517d96-4742-4fde-82b7-c43bd4619906 service nova] Lock "e97abae3-f573-48eb-a218-a8fec436ef3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:05:31 user nova-compute[82479]: DEBUG nova.compute.manager [req-5ea3d3a5-c5b8-477e-a8b9-6fad87f9e1a8 req-e8517d96-4742-4fde-82b7-c43bd4619906 service nova] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] No waiting events found dispatching network-vif-plugged-28d36b9c-c7e0-4d50-bcf8-afa67f29246d {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:05:31 user nova-compute[82479]: WARNING nova.compute.manager [req-5ea3d3a5-c5b8-477e-a8b9-6fad87f9e1a8 req-e8517d96-4742-4fde-82b7-c43bd4619906 service nova] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Received unexpected event network-vif-plugged-28d36b9c-c7e0-4d50-bcf8-afa67f29246d for instance with vm_state building and task_state spawning.
Apr 14 00:05:31 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Acquiring lock "b9c6323b-ed7f-4f86-93ad-3ef4726b01ff" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:05:31 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "b9c6323b-ed7f-4f86-93ad-3ef4726b01ff" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:05:31 user nova-compute[82479]: DEBUG nova.compute.manager [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Starting instance... {{(pid=82479) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 00:05:31 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:05:31 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:05:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:31 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82479) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 00:05:31 user nova-compute[82479]: INFO nova.compute.claims [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Claim successful on node user
Apr 14 00:05:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:32 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:05:32 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:05:32 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.846s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:05:32 user nova-compute[82479]: DEBUG nova.compute.manager [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Start building networks asynchronously for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 00:05:32 user nova-compute[82479]: DEBUG nova.compute.manager [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Allocating IP information in the background. {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 00:05:32 user nova-compute[82479]: DEBUG nova.network.neutron [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] allocate_for_instance() {{(pid=82479) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 00:05:32 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 00:05:32 user nova-compute[82479]: DEBUG nova.compute.manager [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Start building block device mappings for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 00:05:32 user nova-compute[82479]: DEBUG nova.policy [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '38f9a13bd3f74842b61b57b2ea8bf025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ee7b5626a14c69aefa86192b6e7bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82479) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 00:05:32 user nova-compute[82479]: DEBUG nova.compute.manager [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Start spawning the instance on the hypervisor. {{(pid=82479) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 00:05:32 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Creating instance directory {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 00:05:32 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Creating image(s)
Apr 14 00:05:32 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Acquiring lock "/opt/stack/data/nova/instances/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:05:32 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "/opt/stack/data/nova/instances/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:05:32 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "/opt/stack/data/nova/instances/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:05:32 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:05:33 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:33 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:33 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:33 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.282s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:05:33 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Acquiring lock "3e200e101633f2016e569ae4c0a352380507d1e4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:05:33 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "3e200e101633f2016e569ae4c0a352380507d1e4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:05:33 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:05:33 user nova-compute[82479]: DEBUG nova.compute.manager [req-0698cc09-57fe-471d-98cd-a0995ef3394e req-8b80942a-21bd-43eb-afcc-fb845e62a706 service nova] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Received event network-vif-plugged-28d36b9c-c7e0-4d50-bcf8-afa67f29246d {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:05:33 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0698cc09-57fe-471d-98cd-a0995ef3394e req-8b80942a-21bd-43eb-afcc-fb845e62a706 service nova] Acquiring lock "e97abae3-f573-48eb-a218-a8fec436ef3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:05:33 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0698cc09-57fe-471d-98cd-a0995ef3394e req-8b80942a-21bd-43eb-afcc-fb845e62a706 service nova] Lock "e97abae3-f573-48eb-a218-a8fec436ef3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.028s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:05:33 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0698cc09-57fe-471d-98cd-a0995ef3394e req-8b80942a-21bd-43eb-afcc-fb845e62a706 service nova] Lock "e97abae3-f573-48eb-a218-a8fec436ef3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.007s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:05:33 user nova-compute[82479]: DEBUG nova.compute.manager [req-0698cc09-57fe-471d-98cd-a0995ef3394e req-8b80942a-21bd-43eb-afcc-fb845e62a706 service nova] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] No waiting events found dispatching network-vif-plugged-28d36b9c-c7e0-4d50-bcf8-afa67f29246d {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:05:33 user nova-compute[82479]: WARNING nova.compute.manager [req-0698cc09-57fe-471d-98cd-a0995ef3394e req-8b80942a-21bd-43eb-afcc-fb845e62a706 service nova] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Received unexpected event network-vif-plugged-28d36b9c-c7e0-4d50-bcf8-afa67f29246d for instance with vm_state building and task_state spawning.
Apr 14 00:05:33 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.330s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:05:33 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff/disk 1073741824 {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:05:33 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff/disk 1073741824" returned: 0 in 0.098s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:05:33 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "3e200e101633f2016e569ae4c0a352380507d1e4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.437s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:05:33 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:05:33 user nova-compute[82479]: DEBUG nova.compute.manager [req-2811e6f2-37ba-4581-a863-c346ef5f23bb req-35b636c3-68b6-45cd-9119-be690ef357fb service nova] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Received event network-vif-plugged-e8376395-8a3e-46bf-a137-3e740e4e70ef {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:05:33 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-2811e6f2-37ba-4581-a863-c346ef5f23bb req-35b636c3-68b6-45cd-9119-be690ef357fb service nova] Acquiring lock "716b5e3f-20c7-40ef-9a45-71be0cfeaeb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:05:33 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-2811e6f2-37ba-4581-a863-c346ef5f23bb req-35b636c3-68b6-45cd-9119-be690ef357fb service nova] Lock "716b5e3f-20c7-40ef-9a45-71be0cfeaeb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:05:33 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-2811e6f2-37ba-4581-a863-c346ef5f23bb req-35b636c3-68b6-45cd-9119-be690ef357fb service nova] Lock "716b5e3f-20c7-40ef-9a45-71be0cfeaeb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:05:33 user nova-compute[82479]: DEBUG nova.compute.manager [req-2811e6f2-37ba-4581-a863-c346ef5f23bb req-35b636c3-68b6-45cd-9119-be690ef357fb service nova] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] No waiting events found dispatching network-vif-plugged-e8376395-8a3e-46bf-a137-3e740e4e70ef {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:05:33 user nova-compute[82479]: WARNING nova.compute.manager [req-2811e6f2-37ba-4581-a863-c346ef5f23bb req-35b636c3-68b6-45cd-9119-be690ef357fb service nova] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Received unexpected event network-vif-plugged-e8376395-8a3e-46bf-a137-3e740e4e70ef for instance with vm_state building and task_state spawning.
Apr 14 00:05:33 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.283s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:05:33 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff/disk. size=1073741824 {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 00:05:33 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:05:34 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:05:34 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Cannot resize image /opt/stack/data/nova/instances/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff/disk to a smaller size. {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 00:05:34 user nova-compute[82479]: DEBUG nova.objects.instance [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lazy-loading 'migration_context' on Instance uuid b9c6323b-ed7f-4f86-93ad-3ef4726b01ff {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:05:34 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Created local disks {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 00:05:34 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Ensure instance console log exists: /opt/stack/data/nova/instances/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff/console.log {{(pid=82479) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 00:05:34 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:05:34 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:05:34 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:05:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:34 user nova-compute[82479]: DEBUG nova.network.neutron [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Successfully created port: dc4fb8de-0fc3-4af8-86d0-94c357627f5f {{(pid=82479) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 00:05:35 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:35 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:35 user nova-compute[82479]: DEBUG nova.network.neutron [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Successfully updated port: dc4fb8de-0fc3-4af8-86d0-94c357627f5f {{(pid=82479) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 00:05:35 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Acquiring lock "refresh_cache-b9c6323b-ed7f-4f86-93ad-3ef4726b01ff" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:05:35 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Acquired lock "refresh_cache-b9c6323b-ed7f-4f86-93ad-3ef4726b01ff" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:05:35 user nova-compute[82479]: DEBUG nova.network.neutron [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 00:05:35 user nova-compute[82479]: DEBUG nova.compute.manager [req-047a8268-bc71-4533-a185-1da299fa45f6 req-d6e87ad6-c524-4945-9af9-d4ebe8b46a39 service nova] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Received event network-changed-dc4fb8de-0fc3-4af8-86d0-94c357627f5f {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:05:35 user nova-compute[82479]: DEBUG nova.compute.manager [req-047a8268-bc71-4533-a185-1da299fa45f6 req-d6e87ad6-c524-4945-9af9-d4ebe8b46a39 service nova] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Refreshing instance network info cache due to event network-changed-dc4fb8de-0fc3-4af8-86d0-94c357627f5f. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:05:35 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-047a8268-bc71-4533-a185-1da299fa45f6 req-d6e87ad6-c524-4945-9af9-d4ebe8b46a39 service nova] Acquiring lock "refresh_cache-b9c6323b-ed7f-4f86-93ad-3ef4726b01ff" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:05:35 user nova-compute[82479]: DEBUG nova.network.neutron [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Instance cache missing network info. {{(pid=82479) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 00:05:35 user nova-compute[82479]: DEBUG nova.compute.manager [req-e0c964a5-18ea-4f82-b5e4-ee6d88578a19 req-da627770-8362-49d6-b855-83993da94eb3 service nova] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Received event network-vif-plugged-e8376395-8a3e-46bf-a137-3e740e4e70ef {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:05:35 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-e0c964a5-18ea-4f82-b5e4-ee6d88578a19 req-da627770-8362-49d6-b855-83993da94eb3 service nova] Acquiring lock "716b5e3f-20c7-40ef-9a45-71be0cfeaeb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:05:35 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-e0c964a5-18ea-4f82-b5e4-ee6d88578a19 req-da627770-8362-49d6-b855-83993da94eb3 service nova] Lock "716b5e3f-20c7-40ef-9a45-71be0cfeaeb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:05:35 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-e0c964a5-18ea-4f82-b5e4-ee6d88578a19 req-da627770-8362-49d6-b855-83993da94eb3 service nova] Lock "716b5e3f-20c7-40ef-9a45-71be0cfeaeb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:05:35 user nova-compute[82479]: DEBUG nova.compute.manager [req-e0c964a5-18ea-4f82-b5e4-ee6d88578a19 req-da627770-8362-49d6-b855-83993da94eb3 service nova] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] No waiting events found dispatching network-vif-plugged-e8376395-8a3e-46bf-a137-3e740e4e70ef {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:05:35 user nova-compute[82479]: WARNING nova.compute.manager [req-e0c964a5-18ea-4f82-b5e4-ee6d88578a19 req-da627770-8362-49d6-b855-83993da94eb3 service nova] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Received unexpected event network-vif-plugged-e8376395-8a3e-46bf-a137-3e740e4e70ef for instance with vm_state building and task_state spawning.
Apr 14 00:05:35 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681430735.838547, e97abae3-f573-48eb-a218-a8fec436ef3b => Resumed> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:05:35 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] VM Resumed (Lifecycle Event)
Apr 14 00:05:35 user nova-compute[82479]: DEBUG nova.compute.manager [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Instance event wait completed in 0 seconds for  {{(pid=82479) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 00:05:35 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Guest created on hypervisor {{(pid=82479) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 00:05:35 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:05:35 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Instance spawned successfully.
Apr 14 00:05:35 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 00:05:35 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:05:35 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Found default for hw_input_bus of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:05:35 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Found default for hw_pointer_model of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:05:35 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Found default for hw_video_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:05:35 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Found default for hw_vif_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:05:35 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:05:35 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681430735.8414972, e97abae3-f573-48eb-a218-a8fec436ef3b => Started> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:05:35 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] VM Started (Lifecycle Event)
Apr 14 00:05:35 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:05:35 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:05:35 user nova-compute[82479]: INFO nova.compute.manager [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Took 12.11 seconds to spawn the instance on the hypervisor.
Apr 14 00:05:36 user nova-compute[82479]: DEBUG nova.compute.manager [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:05:36 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:05:36 user nova-compute[82479]: INFO nova.compute.manager [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Took 13.37 seconds to build instance.
Apr 14 00:05:36 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-26a03463-3490-4a4d-b4b4-922d54a31e94 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "e97abae3-f573-48eb-a218-a8fec436ef3b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.542s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:05:36 user nova-compute[82479]: DEBUG nova.network.neutron [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Updating instance_info_cache with network_info: [{"id": "dc4fb8de-0fc3-4af8-86d0-94c357627f5f", "address": "fa:16:3e:9b:6b:79", "network": {"id": "281dc33c-0ea9-4812-97ed-82652b538fd0", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-521698420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4ee7b5626a14c69aefa86192b6e7bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4fb8de-0f", "ovs_interfaceid": "dc4fb8de-0fc3-4af8-86d0-94c357627f5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:05:36 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Releasing lock "refresh_cache-b9c6323b-ed7f-4f86-93ad-3ef4726b01ff" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:05:36 user nova-compute[82479]: DEBUG nova.compute.manager [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Instance network_info: |[{"id": "dc4fb8de-0fc3-4af8-86d0-94c357627f5f", "address": "fa:16:3e:9b:6b:79", "network": {"id": "281dc33c-0ea9-4812-97ed-82652b538fd0", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-521698420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4ee7b5626a14c69aefa86192b6e7bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4fb8de-0f", "ovs_interfaceid": "dc4fb8de-0fc3-4af8-86d0-94c357627f5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 00:05:36 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-047a8268-bc71-4533-a185-1da299fa45f6 req-d6e87ad6-c524-4945-9af9-d4ebe8b46a39 service nova] Acquired lock "refresh_cache-b9c6323b-ed7f-4f86-93ad-3ef4726b01ff" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:05:36 user nova-compute[82479]: DEBUG nova.network.neutron [req-047a8268-bc71-4533-a185-1da299fa45f6 req-d6e87ad6-c524-4945-9af9-d4ebe8b46a39 service nova] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Refreshing network info cache for port dc4fb8de-0fc3-4af8-86d0-94c357627f5f {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:05:36 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Start _get_guest_xml network_info=[{"id": "dc4fb8de-0fc3-4af8-86d0-94c357627f5f", "address": "fa:16:3e:9b:6b:79", "network": {"id": "281dc33c-0ea9-4812-97ed-82652b538fd0", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-521698420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4ee7b5626a14c69aefa86192b6e7bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4fb8de-0f", "ovs_interfaceid": "dc4fb8de-0fc3-4af8-86d0-94c357627f5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 00:05:36 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681430736.5757854, 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2 => Resumed> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:05:36 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] VM Resumed (Lifecycle Event)
Apr 14 00:05:36 user nova-compute[82479]: DEBUG nova.compute.manager [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Instance event wait completed in 0 seconds for  {{(pid=82479) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 00:05:36 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Guest created on hypervisor {{(pid=82479) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 00:05:36 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:05:36 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:05:36 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82479) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 00:05:36 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T00:02:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 00:05:36 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Flavor limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 00:05:36 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Image limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 00:05:36 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Flavor pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 00:05:36 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Image pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 00:05:36 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 00:05:36 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 00:05:36 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 00:05:36 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Got 1 possible topologies {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 00:05:36 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 00:05:36 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 00:05:36 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T00:05:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1428775386',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1428775386',id=9,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIH5r6nQb46UiVWKMJfMdOVDRbtW2F73ea2D8mxSn1YDz9+bRgJ2nBeDW0+0XBiptqCPYYX6nTAHEycBqQz0FHVyYdWdNoLj8ctiSWD+URcLL8GbP5fneDu/2p/eIfeTqw==',key_name='tempest-keypair-2007231770',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4ee7b5626a14c69aefa86192b6e7bac',ramdisk_id='',reservation_id='r-7dnrqpgh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-694590407',owner_user_name='tempest-TaggedAttachmentsTest-694590407-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:05:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38f9a13bd3f74842b61b57b2ea8bf025',uuid=b9c6323b-ed7f-4f86-93ad-3ef4726b01ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc4fb8de-0fc3-4af8-86d0-94c357627f5f", "address": "fa:16:3e:9b:6b:79", "network": {"id": "281dc33c-0ea9-4812-97ed-82652b538fd0", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-521698420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4ee7b5626a14c69aefa86192b6e7bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4fb8de-0f", "ovs_interfaceid": "dc4fb8de-0fc3-4af8-86d0-94c357627f5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82479) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 00:05:36 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Converting VIF {"id": "dc4fb8de-0fc3-4af8-86d0-94c357627f5f", "address": "fa:16:3e:9b:6b:79", "network": {"id": "281dc33c-0ea9-4812-97ed-82652b538fd0", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-521698420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4ee7b5626a14c69aefa86192b6e7bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4fb8de-0f", "ovs_interfaceid": "dc4fb8de-0fc3-4af8-86d0-94c357627f5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:05:36 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:6b:79,bridge_name='br-int',has_traffic_filtering=True,id=dc4fb8de-0fc3-4af8-86d0-94c357627f5f,network=Network(281dc33c-0ea9-4812-97ed-82652b538fd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc4fb8de-0f') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:05:36 user nova-compute[82479]: DEBUG nova.objects.instance [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lazy-loading 'pci_devices' on Instance uuid b9c6323b-ed7f-4f86-93ad-3ef4726b01ff {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:05:36 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:05:36 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Cleaning up deleted instances {{(pid=82479) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 00:05:36 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:05:36 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] End _get_guest_xml xml=<domain type="kvm">
Apr 14 00:05:36 user nova-compute[82479]:   <uuid>b9c6323b-ed7f-4f86-93ad-3ef4726b01ff</uuid>
Apr 14 00:05:36 user nova-compute[82479]:   <name>instance-00000009</name>
Apr 14 00:05:36 user nova-compute[82479]:   <memory>131072</memory>
Apr 14 00:05:36 user nova-compute[82479]:   <vcpu>1</vcpu>
Apr 14 00:05:36 user nova-compute[82479]:   <metadata>
Apr 14 00:05:36 user nova-compute[82479]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 00:05:36 user nova-compute[82479]:       <nova:package version="0.0.0"/>
Apr 14 00:05:36 user nova-compute[82479]:       <nova:name>tempest-device-tagging-server-1428775386</nova:name>
Apr 14 00:05:36 user nova-compute[82479]:       <nova:creationTime>2023-04-14 00:05:36</nova:creationTime>
Apr 14 00:05:36 user nova-compute[82479]:       <nova:flavor name="m1.nano">
Apr 14 00:05:36 user nova-compute[82479]:         <nova:memory>128</nova:memory>
Apr 14 00:05:36 user nova-compute[82479]:         <nova:disk>1</nova:disk>
Apr 14 00:05:36 user nova-compute[82479]:         <nova:swap>0</nova:swap>
Apr 14 00:05:36 user nova-compute[82479]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 00:05:36 user nova-compute[82479]:         <nova:vcpus>1</nova:vcpus>
Apr 14 00:05:36 user nova-compute[82479]:       </nova:flavor>
Apr 14 00:05:36 user nova-compute[82479]:       <nova:owner>
Apr 14 00:05:36 user nova-compute[82479]:         <nova:user uuid="38f9a13bd3f74842b61b57b2ea8bf025">tempest-TaggedAttachmentsTest-694590407-project-member</nova:user>
Apr 14 00:05:36 user nova-compute[82479]:         <nova:project uuid="c4ee7b5626a14c69aefa86192b6e7bac">tempest-TaggedAttachmentsTest-694590407</nova:project>
Apr 14 00:05:36 user nova-compute[82479]:       </nova:owner>
Apr 14 00:05:36 user nova-compute[82479]:       <nova:root type="image" uuid="6db62068-7278-4cd8-b41f-d0140d89e199"/>
Apr 14 00:05:36 user nova-compute[82479]:       <nova:ports>
Apr 14 00:05:36 user nova-compute[82479]:         <nova:port uuid="dc4fb8de-0fc3-4af8-86d0-94c357627f5f">
Apr 14 00:05:36 user nova-compute[82479]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 00:05:36 user nova-compute[82479]:         </nova:port>
Apr 14 00:05:36 user nova-compute[82479]:       </nova:ports>
Apr 14 00:05:36 user nova-compute[82479]:     </nova:instance>
Apr 14 00:05:36 user nova-compute[82479]:   </metadata>
Apr 14 00:05:36 user nova-compute[82479]:   <sysinfo type="smbios">
Apr 14 00:05:36 user nova-compute[82479]:     <system>
Apr 14 00:05:36 user nova-compute[82479]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 00:05:36 user nova-compute[82479]:       <entry name="product">OpenStack Nova</entry>
Apr 14 00:05:36 user nova-compute[82479]:       <entry name="version">0.0.0</entry>
Apr 14 00:05:36 user nova-compute[82479]:       <entry name="serial">b9c6323b-ed7f-4f86-93ad-3ef4726b01ff</entry>
Apr 14 00:05:36 user nova-compute[82479]:       <entry name="uuid">b9c6323b-ed7f-4f86-93ad-3ef4726b01ff</entry>
Apr 14 00:05:36 user nova-compute[82479]:       <entry name="family">Virtual Machine</entry>
Apr 14 00:05:36 user nova-compute[82479]:     </system>
Apr 14 00:05:36 user nova-compute[82479]:   </sysinfo>
Apr 14 00:05:36 user nova-compute[82479]:   <os>
Apr 14 00:05:36 user nova-compute[82479]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 00:05:36 user nova-compute[82479]:     <boot dev="hd"/>
Apr 14 00:05:36 user nova-compute[82479]:     <smbios mode="sysinfo"/>
Apr 14 00:05:36 user nova-compute[82479]:   </os>
Apr 14 00:05:36 user nova-compute[82479]:   <features>
Apr 14 00:05:36 user nova-compute[82479]:     <acpi/>
Apr 14 00:05:36 user nova-compute[82479]:     <apic/>
Apr 14 00:05:36 user nova-compute[82479]:     <vmcoreinfo/>
Apr 14 00:05:36 user nova-compute[82479]:   </features>
Apr 14 00:05:36 user nova-compute[82479]:   <clock offset="utc">
Apr 14 00:05:36 user nova-compute[82479]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 00:05:36 user nova-compute[82479]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 00:05:36 user nova-compute[82479]:     <timer name="hpet" present="no"/>
Apr 14 00:05:36 user nova-compute[82479]:   </clock>
Apr 14 00:05:36 user nova-compute[82479]:   <cpu mode="custom" match="exact">
Apr 14 00:05:36 user nova-compute[82479]:     <model>Nehalem</model>
Apr 14 00:05:36 user nova-compute[82479]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 00:05:36 user nova-compute[82479]:   </cpu>
Apr 14 00:05:36 user nova-compute[82479]:   <devices>
Apr 14 00:05:36 user nova-compute[82479]:     <disk type="file" device="disk">
Apr 14 00:05:36 user nova-compute[82479]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 00:05:36 user nova-compute[82479]:       <source file="/opt/stack/data/nova/instances/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff/disk"/>
Apr 14 00:05:36 user nova-compute[82479]:       <target dev="vda" bus="virtio"/>
Apr 14 00:05:36 user nova-compute[82479]:     </disk>
Apr 14 00:05:36 user nova-compute[82479]:     <disk type="file" device="cdrom">
Apr 14 00:05:36 user nova-compute[82479]:       <driver name="qemu" type="raw" cache="none"/>
Apr 14 00:05:36 user nova-compute[82479]:       <source file="/opt/stack/data/nova/instances/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff/disk.config"/>
Apr 14 00:05:36 user nova-compute[82479]:       <target dev="hda" bus="ide"/>
Apr 14 00:05:36 user nova-compute[82479]:     </disk>
Apr 14 00:05:36 user nova-compute[82479]:     <interface type="ethernet">
Apr 14 00:05:36 user nova-compute[82479]:       <mac address="fa:16:3e:9b:6b:79"/>
Apr 14 00:05:36 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:05:36 user nova-compute[82479]:       <mtu size="1442"/>
Apr 14 00:05:36 user nova-compute[82479]:       <target dev="tapdc4fb8de-0f"/>
Apr 14 00:05:36 user nova-compute[82479]:     </interface>
Apr 14 00:05:36 user nova-compute[82479]:     <serial type="pty">
Apr 14 00:05:36 user nova-compute[82479]:       <log file="/opt/stack/data/nova/instances/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff/console.log" append="off"/>
Apr 14 00:05:36 user nova-compute[82479]:     </serial>
Apr 14 00:05:36 user nova-compute[82479]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 00:05:36 user nova-compute[82479]:     <video>
Apr 14 00:05:36 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:05:36 user nova-compute[82479]:     </video>
Apr 14 00:05:36 user nova-compute[82479]:     <rng model="virtio">
Apr 14 00:05:36 user nova-compute[82479]:       <backend model="random">/dev/urandom</backend>
Apr 14 00:05:36 user nova-compute[82479]:     </rng>
Apr 14 00:05:36 user nova-compute[82479]:     <controller type="usb" index="0" model="none"/>
Apr 14 00:05:36 user nova-compute[82479]:     <memballoon model="virtio">
Apr 14 00:05:36 user nova-compute[82479]:       <stats period="10"/>
Apr 14 00:05:36 user nova-compute[82479]:     </memballoon>
Apr 14 00:05:36 user nova-compute[82479]:   </devices>
Apr 14 00:05:36 user nova-compute[82479]: </domain>
Apr 14 00:05:36 user nova-compute[82479]:  {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 00:05:36 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T00:05:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1428775386',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1428775386',id=9,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIH5r6nQb46UiVWKMJfMdOVDRbtW2F73ea2D8mxSn1YDz9+bRgJ2nBeDW0+0XBiptqCPYYX6nTAHEycBqQz0FHVyYdWdNoLj8ctiSWD+URcLL8GbP5fneDu/2p/eIfeTqw==',key_name='tempest-keypair-2007231770',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4ee7b5626a14c69aefa86192b6e7bac',ramdisk_id='',reservation_id='r-7dnrqpgh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-694590407',owner_user_name='tempest-TaggedAttachmentsTest-694590407-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:05:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38f9a13bd3f74842b61b57b2ea8bf025',uuid=b9c6323b-ed7f-4f86-93ad-3ef4726b01ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc4fb8de-0fc3-4af8-86d0-94c357627f5f", "address": "fa:16:3e:9b:6b:79", "network": {"id": "281dc33c-0ea9-4812-97ed-82652b538fd0", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-521698420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4ee7b5626a14c69aefa86192b6e7bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4fb8de-0f", "ovs_interfaceid": "dc4fb8de-0fc3-4af8-86d0-94c357627f5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 00:05:36 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Converting VIF {"id": "dc4fb8de-0fc3-4af8-86d0-94c357627f5f", "address": "fa:16:3e:9b:6b:79", "network": {"id": "281dc33c-0ea9-4812-97ed-82652b538fd0", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-521698420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4ee7b5626a14c69aefa86192b6e7bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4fb8de-0f", "ovs_interfaceid": "dc4fb8de-0fc3-4af8-86d0-94c357627f5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:05:36 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:6b:79,bridge_name='br-int',has_traffic_filtering=True,id=dc4fb8de-0fc3-4af8-86d0-94c357627f5f,network=Network(281dc33c-0ea9-4812-97ed-82652b538fd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc4fb8de-0f') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:05:36 user nova-compute[82479]: DEBUG os_vif [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:6b:79,bridge_name='br-int',has_traffic_filtering=True,id=dc4fb8de-0fc3-4af8-86d0-94c357627f5f,network=Network(281dc33c-0ea9-4812-97ed-82652b538fd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc4fb8de-0f') {{(pid=82479) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 00:05:36 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:36 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:05:36 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 00:05:36 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:36 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdc4fb8de-0f, may_exist=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:05:36 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdc4fb8de-0f, col_values=(('external_ids', {'iface-id': 'dc4fb8de-0fc3-4af8-86d0-94c357627f5f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:6b:79', 'vm-uuid': 'b9c6323b-ed7f-4f86-93ad-3ef4726b01ff'}),)) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:05:36 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] There are 0 instances to clean {{(pid=82479) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 00:05:36 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:05:36 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:05:36 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Cleaning up deleted instances with incomplete migration  {{(pid=82479) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 00:05:36 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Instance spawned successfully.
Apr 14 00:05:36 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 00:05:36 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:05:36 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:36 user nova-compute[82479]: INFO os_vif [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:6b:79,bridge_name='br-int',has_traffic_filtering=True,id=dc4fb8de-0fc3-4af8-86d0-94c357627f5f,network=Network(281dc33c-0ea9-4812-97ed-82652b538fd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc4fb8de-0f')
Apr 14 00:05:36 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:05:36 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681430736.5842283, 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2 => Started> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:05:36 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] VM Started (Lifecycle Event)
Apr 14 00:05:36 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:05:36 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Found default for hw_cdrom_bus of ide {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:05:36 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Found default for hw_disk_bus of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:05:36 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Found default for hw_input_bus of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:05:36 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Found default for hw_pointer_model of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:05:36 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Found default for hw_video_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:05:36 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Found default for hw_vif_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:05:36 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:05:36 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:05:36 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:05:36 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] No BDM found with device name hda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:05:36 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] No VIF found with MAC fa:16:3e:9b:6b:79, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:05:36 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Using config drive
Apr 14 00:05:36 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:05:36 user nova-compute[82479]: INFO nova.compute.manager [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Took 10.64 seconds to spawn the instance on the hypervisor.
Apr 14 00:05:36 user nova-compute[82479]: DEBUG nova.compute.manager [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:05:37 user nova-compute[82479]: INFO nova.compute.manager [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Took 13.49 seconds to build instance.
Apr 14 00:05:37 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Creating config drive at /opt/stack/data/nova/instances/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff/disk.config
Apr 14 00:05:37 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpl1vuwc7i {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:05:37 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-515dcbf7-c187-436a-a087-3e47aa00f081 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "716b5e3f-20c7-40ef-9a45-71be0cfeaeb2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.655s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:05:37 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpl1vuwc7i" returned: 0 in 0.079s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:05:37 user nova-compute[82479]: DEBUG nova.network.neutron [req-047a8268-bc71-4533-a185-1da299fa45f6 req-d6e87ad6-c524-4945-9af9-d4ebe8b46a39 service nova] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Updated VIF entry in instance network info cache for port dc4fb8de-0fc3-4af8-86d0-94c357627f5f. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:05:37 user nova-compute[82479]: DEBUG nova.network.neutron [req-047a8268-bc71-4533-a185-1da299fa45f6 req-d6e87ad6-c524-4945-9af9-d4ebe8b46a39 service nova] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Updating instance_info_cache with network_info: [{"id": "dc4fb8de-0fc3-4af8-86d0-94c357627f5f", "address": "fa:16:3e:9b:6b:79", "network": {"id": "281dc33c-0ea9-4812-97ed-82652b538fd0", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-521698420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4ee7b5626a14c69aefa86192b6e7bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4fb8de-0f", "ovs_interfaceid": "dc4fb8de-0fc3-4af8-86d0-94c357627f5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:05:37 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-047a8268-bc71-4533-a185-1da299fa45f6 req-d6e87ad6-c524-4945-9af9-d4ebe8b46a39 service nova] Releasing lock "refresh_cache-b9c6323b-ed7f-4f86-93ad-3ef4726b01ff" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:05:37 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:05:38 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:05:38 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Starting heal instance info cache {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 00:05:38 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Rebuilding the list of instances to heal {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 00:05:38 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Skipping network cache update for instance because it is Building. {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9805}}
Apr 14 00:05:38 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "refresh_cache-cae47769-02cd-4118-af46-0d3521ef7564" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:05:38 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquired lock "refresh_cache-cae47769-02cd-4118-af46-0d3521ef7564" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:05:38 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Forcefully refreshing network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 00:05:38 user nova-compute[82479]: DEBUG nova.objects.instance [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lazy-loading 'info_cache' on Instance uuid cae47769-02cd-4118-af46-0d3521ef7564 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:05:38 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:38 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:38 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:39 user nova-compute[82479]: DEBUG nova.compute.manager [req-535c83e6-445e-4016-9160-ecd4c937ebed req-0581c82e-b46c-442f-9d04-1afa9b4895fc service nova] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Received event network-vif-plugged-dc4fb8de-0fc3-4af8-86d0-94c357627f5f {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:05:39 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-535c83e6-445e-4016-9160-ecd4c937ebed req-0581c82e-b46c-442f-9d04-1afa9b4895fc service nova] Acquiring lock "b9c6323b-ed7f-4f86-93ad-3ef4726b01ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:05:39 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-535c83e6-445e-4016-9160-ecd4c937ebed req-0581c82e-b46c-442f-9d04-1afa9b4895fc service nova] Lock "b9c6323b-ed7f-4f86-93ad-3ef4726b01ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:05:39 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-535c83e6-445e-4016-9160-ecd4c937ebed req-0581c82e-b46c-442f-9d04-1afa9b4895fc service nova] Lock "b9c6323b-ed7f-4f86-93ad-3ef4726b01ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:05:39 user nova-compute[82479]: DEBUG nova.compute.manager [req-535c83e6-445e-4016-9160-ecd4c937ebed req-0581c82e-b46c-442f-9d04-1afa9b4895fc service nova] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] No waiting events found dispatching network-vif-plugged-dc4fb8de-0fc3-4af8-86d0-94c357627f5f {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:05:39 user nova-compute[82479]: WARNING nova.compute.manager [req-535c83e6-445e-4016-9160-ecd4c937ebed req-0581c82e-b46c-442f-9d04-1afa9b4895fc service nova] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Received unexpected event network-vif-plugged-dc4fb8de-0fc3-4af8-86d0-94c357627f5f for instance with vm_state building and task_state spawning.
Apr 14 00:05:39 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Updating instance_info_cache with network_info: [{"id": "43fb1710-4018-42d7-88ad-b5cb3970204a", "address": "fa:16:3e:92:89:19", "network": {"id": "598c3cc3-627d-4abe-beb6-93721d4334a1", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-214699134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "834d867e665a4671a901218d21fa8704", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43fb1710-40", "ovs_interfaceid": "43fb1710-4018-42d7-88ad-b5cb3970204a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:05:39 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Releasing lock "refresh_cache-cae47769-02cd-4118-af46-0d3521ef7564" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:05:39 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Updated the network info_cache for instance {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 00:05:39 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:05:39 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:39 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:39 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:39 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:40 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:40 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:05:40 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:05:40 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:05:40 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:05:40 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:05:40 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:05:40 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Auditing locally available compute resources for user (node: user) {{(pid=82479) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 00:05:41 user nova-compute[82479]: DEBUG nova.compute.manager [req-0ea3832c-fdaf-4af5-816d-8613434ac9a2 req-9ce51361-c4f5-4443-8436-0bc516d68be0 service nova] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Received event network-vif-plugged-dc4fb8de-0fc3-4af8-86d0-94c357627f5f {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:05:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0ea3832c-fdaf-4af5-816d-8613434ac9a2 req-9ce51361-c4f5-4443-8436-0bc516d68be0 service nova] Acquiring lock "b9c6323b-ed7f-4f86-93ad-3ef4726b01ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:05:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0ea3832c-fdaf-4af5-816d-8613434ac9a2 req-9ce51361-c4f5-4443-8436-0bc516d68be0 service nova] Lock "b9c6323b-ed7f-4f86-93ad-3ef4726b01ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:05:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0ea3832c-fdaf-4af5-816d-8613434ac9a2 req-9ce51361-c4f5-4443-8436-0bc516d68be0 service nova] Lock "b9c6323b-ed7f-4f86-93ad-3ef4726b01ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:05:41 user nova-compute[82479]: DEBUG nova.compute.manager [req-0ea3832c-fdaf-4af5-816d-8613434ac9a2 req-9ce51361-c4f5-4443-8436-0bc516d68be0 service nova] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] No waiting events found dispatching network-vif-plugged-dc4fb8de-0fc3-4af8-86d0-94c357627f5f {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:05:41 user nova-compute[82479]: WARNING nova.compute.manager [req-0ea3832c-fdaf-4af5-816d-8613434ac9a2 req-9ce51361-c4f5-4443-8436-0bc516d68be0 service nova] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Received unexpected event network-vif-plugged-dc4fb8de-0fc3-4af8-86d0-94c357627f5f for instance with vm_state building and task_state spawning.
Apr 14 00:05:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:41 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681430741.8177776, b9c6323b-ed7f-4f86-93ad-3ef4726b01ff => Resumed> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:05:41 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] VM Resumed (Lifecycle Event)
Apr 14 00:05:41 user nova-compute[82479]: DEBUG nova.compute.manager [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Instance event wait completed in 0 seconds for  {{(pid=82479) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 00:05:41 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Guest created on hypervisor {{(pid=82479) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 00:05:41 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Instance spawned successfully.
Apr 14 00:05:41 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 00:05:41 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:05:41 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:05:41 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Found default for hw_cdrom_bus of ide {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:05:41 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Found default for hw_disk_bus of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:05:41 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Found default for hw_input_bus of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:05:41 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Found default for hw_pointer_model of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:05:41 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Found default for hw_video_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:05:41 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Found default for hw_vif_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:05:41 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:05:41 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681430741.818323, b9c6323b-ed7f-4f86-93ad-3ef4726b01ff => Started> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:05:41 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] VM Started (Lifecycle Event)
Apr 14 00:05:41 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:05:41 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:05:41 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:05:41 user nova-compute[82479]: INFO nova.compute.manager [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Took 9.06 seconds to spawn the instance on the hypervisor.
Apr 14 00:05:41 user nova-compute[82479]: DEBUG nova.compute.manager [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:05:42 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:05:42 user nova-compute[82479]: INFO nova.compute.manager [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Took 10.58 seconds to build instance.
Apr 14 00:05:42 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ce65a990-2811-4eaa-9360-ce143bd254bb tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "b9c6323b-ed7f-4f86-93ad-3ef4726b01ff" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.781s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:05:42 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:05:42 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:05:42 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:05:42 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e97abae3-f573-48eb-a218-a8fec436ef3b/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:05:42 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e97abae3-f573-48eb-a218-a8fec436ef3b/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:05:42 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e97abae3-f573-48eb-a218-a8fec436ef3b/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:05:42 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e97abae3-f573-48eb-a218-a8fec436ef3b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:05:42 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:05:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:05:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:05:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:05:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae47769-02cd-4118-af46-0d3521ef7564/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:05:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae47769-02cd-4118-af46-0d3521ef7564/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:05:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae47769-02cd-4118-af46-0d3521ef7564/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:05:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae47769-02cd-4118-af46-0d3521ef7564/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:05:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01a65362-36ea-4817-8e83-f75d6daf808b/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:05:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01a65362-36ea-4817-8e83-f75d6daf808b/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:05:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01a65362-36ea-4817-8e83-f75d6daf808b/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:05:44 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01a65362-36ea-4817-8e83-f75d6daf808b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:05:44 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/716b5e3f-20c7-40ef-9a45-71be0cfeaeb2/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:05:44 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/716b5e3f-20c7-40ef-9a45-71be0cfeaeb2/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:05:44 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/716b5e3f-20c7-40ef-9a45-71be0cfeaeb2/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:05:44 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/716b5e3f-20c7-40ef-9a45-71be0cfeaeb2/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:05:44 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:05:44 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:05:44 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:05:44 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:05:44 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:05:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:05:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:05:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:05:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:05:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:05:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:05:45 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:05:46 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:05:46 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:05:46 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Hypervisor/Node resource view: name=user free_ram=7698MB free_disk=26.60934066772461GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=82479) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 00:05:46 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:05:46 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:05:46 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance cae47769-02cd-4118-af46-0d3521ef7564 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:05:46 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 23718fd0-58b8-47f9-b1ef-a26a90741ecc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:05:46 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:05:46 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:05:46 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 01a65362-36ea-4817-8e83-f75d6daf808b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:05:46 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance b3475e7e-ceb4-452a-a045-dbf43c5944dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:05:46 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance e97abae3-f573-48eb-a218-a8fec436ef3b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:05:46 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:05:46 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance b9c6323b-ed7f-4f86-93ad-3ef4726b01ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:05:46 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 00:05:46 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 00:05:46 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Refreshing inventories for resource provider 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 00:05:46 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Updating ProviderTree inventory for provider 3847975a-19aa-4b27-9180-14b5cc49044a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 00:05:46 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Updating inventory in ProviderTree for provider 3847975a-19aa-4b27-9180-14b5cc49044a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 00:05:46 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:46 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Refreshing aggregate associations for resource provider 3847975a-19aa-4b27-9180-14b5cc49044a, aggregates: None {{(pid=82479) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 00:05:46 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Refreshing trait associations for resource provider 3847975a-19aa-4b27-9180-14b5cc49044a, traits: COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,HW_CPU_X86_SSE42,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO {{(pid=82479) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 00:05:47 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:05:47 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:05:47 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Compute_service record updated for user:user {{(pid=82479) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 00:05:47 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.161s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:05:48 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:05:48 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:05:48 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:05:48 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82479) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 00:05:50 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:55 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:05:56 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:06:00 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:06:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:06:05 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:06:06 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:06:09 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:06:10 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:06:11 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:06:11 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:06:15 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:06:15 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:06:16 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:06:18 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:06:20 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:06:21 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:06:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquiring lock "11c3384a-e699-4b10-9f8b-861291e96465" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:06:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "11c3384a-e699-4b10-9f8b-861291e96465" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:06:23 user nova-compute[82479]: DEBUG nova.compute.manager [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Starting instance... {{(pid=82479) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 00:06:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:06:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:06:23 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82479) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 00:06:23 user nova-compute[82479]: INFO nova.compute.claims [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Claim successful on node user
Apr 14 00:06:23 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:06:23 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:06:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.415s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:06:23 user nova-compute[82479]: DEBUG nova.compute.manager [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Start building networks asynchronously for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 00:06:23 user nova-compute[82479]: DEBUG nova.compute.manager [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Allocating IP information in the background. {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 00:06:23 user nova-compute[82479]: DEBUG nova.network.neutron [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] allocate_for_instance() {{(pid=82479) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 00:06:23 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 00:06:23 user nova-compute[82479]: DEBUG nova.compute.manager [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Start building block device mappings for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 00:06:24 user nova-compute[82479]: DEBUG nova.compute.manager [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Start spawning the instance on the hypervisor. {{(pid=82479) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 00:06:24 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Creating instance directory {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 00:06:24 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Creating image(s)
Apr 14 00:06:24 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquiring lock "/opt/stack/data/nova/instances/11c3384a-e699-4b10-9f8b-861291e96465/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:06:24 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "/opt/stack/data/nova/instances/11c3384a-e699-4b10-9f8b-861291e96465/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:06:24 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "/opt/stack/data/nova/instances/11c3384a-e699-4b10-9f8b-861291e96465/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:06:24 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:06:24 user nova-compute[82479]: DEBUG nova.policy [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6fe75acb64a94a2a88d370f43fa6b776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f138770c7b4407d83c449500fc000a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82479) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 00:06:24 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.144s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:06:24 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquiring lock "3e200e101633f2016e569ae4c0a352380507d1e4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:06:24 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "3e200e101633f2016e569ae4c0a352380507d1e4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:06:24 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:06:24 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.146s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:06:24 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/11c3384a-e699-4b10-9f8b-861291e96465/disk 1073741824 {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:06:24 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/11c3384a-e699-4b10-9f8b-861291e96465/disk 1073741824" returned: 0 in 0.053s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:06:24 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "3e200e101633f2016e569ae4c0a352380507d1e4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:06:24 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:06:24 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.150s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:06:24 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Checking if we can resize image /opt/stack/data/nova/instances/11c3384a-e699-4b10-9f8b-861291e96465/disk. size=1073741824 {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 00:06:24 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11c3384a-e699-4b10-9f8b-861291e96465/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:06:24 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11c3384a-e699-4b10-9f8b-861291e96465/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:06:24 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Cannot resize image /opt/stack/data/nova/instances/11c3384a-e699-4b10-9f8b-861291e96465/disk to a smaller size. {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 00:06:24 user nova-compute[82479]: DEBUG nova.objects.instance [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lazy-loading 'migration_context' on Instance uuid 11c3384a-e699-4b10-9f8b-861291e96465 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:06:24 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Created local disks {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 00:06:24 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Ensure instance console log exists: /opt/stack/data/nova/instances/11c3384a-e699-4b10-9f8b-861291e96465/console.log {{(pid=82479) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 00:06:24 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:06:24 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:06:24 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:06:24 user nova-compute[82479]: DEBUG nova.network.neutron [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Successfully created port: cce0e09c-d491-4698-b846-d75a670cc38e {{(pid=82479) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 00:06:25 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:06:25 user nova-compute[82479]: DEBUG nova.network.neutron [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Successfully updated port: cce0e09c-d491-4698-b846-d75a670cc38e {{(pid=82479) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 00:06:25 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquiring lock "refresh_cache-11c3384a-e699-4b10-9f8b-861291e96465" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:06:25 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquired lock "refresh_cache-11c3384a-e699-4b10-9f8b-861291e96465" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:06:25 user nova-compute[82479]: DEBUG nova.network.neutron [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 00:06:25 user nova-compute[82479]: DEBUG nova.compute.manager [req-1f5a3883-3224-4434-b294-3c670fa6f394 req-d78842a9-2513-46a4-8a8a-80b9bc58512d service nova] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Received event network-changed-cce0e09c-d491-4698-b846-d75a670cc38e {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:06:25 user nova-compute[82479]: DEBUG nova.compute.manager [req-1f5a3883-3224-4434-b294-3c670fa6f394 req-d78842a9-2513-46a4-8a8a-80b9bc58512d service nova] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Refreshing instance network info cache due to event network-changed-cce0e09c-d491-4698-b846-d75a670cc38e. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:06:25 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-1f5a3883-3224-4434-b294-3c670fa6f394 req-d78842a9-2513-46a4-8a8a-80b9bc58512d service nova] Acquiring lock "refresh_cache-11c3384a-e699-4b10-9f8b-861291e96465" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:06:25 user nova-compute[82479]: DEBUG nova.network.neutron [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Instance cache missing network info. {{(pid=82479) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 00:06:26 user nova-compute[82479]: DEBUG nova.network.neutron [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Updating instance_info_cache with network_info: [{"id": "cce0e09c-d491-4698-b846-d75a670cc38e", "address": "fa:16:3e:77:7f:4e", "network": {"id": "f185dffe-f180-4107-8752-182e71fc07c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1954392221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f138770c7b4407d83c449500fc000a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcce0e09c-d4", "ovs_interfaceid": "cce0e09c-d491-4698-b846-d75a670cc38e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:06:26 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Releasing lock "refresh_cache-11c3384a-e699-4b10-9f8b-861291e96465" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:06:26 user nova-compute[82479]: DEBUG nova.compute.manager [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Instance network_info: |[{"id": "cce0e09c-d491-4698-b846-d75a670cc38e", "address": "fa:16:3e:77:7f:4e", "network": {"id": "f185dffe-f180-4107-8752-182e71fc07c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1954392221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f138770c7b4407d83c449500fc000a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcce0e09c-d4", "ovs_interfaceid": "cce0e09c-d491-4698-b846-d75a670cc38e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 00:06:26 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-1f5a3883-3224-4434-b294-3c670fa6f394 req-d78842a9-2513-46a4-8a8a-80b9bc58512d service nova] Acquired lock "refresh_cache-11c3384a-e699-4b10-9f8b-861291e96465" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:06:26 user nova-compute[82479]: DEBUG nova.network.neutron [req-1f5a3883-3224-4434-b294-3c670fa6f394 req-d78842a9-2513-46a4-8a8a-80b9bc58512d service nova] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Refreshing network info cache for port cce0e09c-d491-4698-b846-d75a670cc38e {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:06:26 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Start _get_guest_xml network_info=[{"id": "cce0e09c-d491-4698-b846-d75a670cc38e", "address": "fa:16:3e:77:7f:4e", "network": {"id": "f185dffe-f180-4107-8752-182e71fc07c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1954392221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f138770c7b4407d83c449500fc000a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcce0e09c-d4", "ovs_interfaceid": "cce0e09c-d491-4698-b846-d75a670cc38e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 00:06:26 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:06:26 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:06:26 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82479) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 00:06:26 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T00:02:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 00:06:26 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Flavor limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 00:06:26 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Image limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 00:06:26 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Flavor pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 00:06:26 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Image pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 00:06:26 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 00:06:26 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 00:06:26 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 00:06:26 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Got 1 possible topologies {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 00:06:26 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 00:06:26 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 00:06:26 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:06:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-250370213',display_name='tempest-TestStampPattern-server-250370213',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-250370213',id=10,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDlLkyaARZkQB95QySk+2VUQZ09Ejf2MBAGMaTBkstJSwxWK7dIH2obGUK+EG+vNkZ0wlDST0FmsMBpmophXdr02YiHRimuo8UQxusvxIG9HcXOIpUbG3VMNRBCqhYxCUw==',key_name='tempest-TestStampPattern-2105733066',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1f138770c7b4407d83c449500fc000a5',ramdisk_id='',reservation_id='r-adbi2ts2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1381824337',owner_user_name='tempest-TestStampPattern-1381824337-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:06:24Z,user_data=None,user_id='6fe75acb64a94a2a88d370f43fa6b776',uuid=11c3384a-e699-4b10-9f8b-861291e96465,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cce0e09c-d491-4698-b846-d75a670cc38e", "address": "fa:16:3e:77:7f:4e", "network": {"id": "f185dffe-f180-4107-8752-182e71fc07c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1954392221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f138770c7b4407d83c449500fc000a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcce0e09c-d4", "ovs_interfaceid": "cce0e09c-d491-4698-b846-d75a670cc38e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82479) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 00:06:26 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Converting VIF {"id": "cce0e09c-d491-4698-b846-d75a670cc38e", "address": "fa:16:3e:77:7f:4e", "network": {"id": "f185dffe-f180-4107-8752-182e71fc07c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1954392221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f138770c7b4407d83c449500fc000a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcce0e09c-d4", "ovs_interfaceid": "cce0e09c-d491-4698-b846-d75a670cc38e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:06:26 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:7f:4e,bridge_name='br-int',has_traffic_filtering=True,id=cce0e09c-d491-4698-b846-d75a670cc38e,network=Network(f185dffe-f180-4107-8752-182e71fc07c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcce0e09c-d4') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:06:26 user nova-compute[82479]: DEBUG nova.objects.instance [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lazy-loading 'pci_devices' on Instance uuid 11c3384a-e699-4b10-9f8b-861291e96465 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:06:26 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] End _get_guest_xml xml=<domain type="kvm">
Apr 14 00:06:26 user nova-compute[82479]:   <uuid>11c3384a-e699-4b10-9f8b-861291e96465</uuid>
Apr 14 00:06:26 user nova-compute[82479]:   <name>instance-0000000a</name>
Apr 14 00:06:26 user nova-compute[82479]:   <memory>131072</memory>
Apr 14 00:06:26 user nova-compute[82479]:   <vcpu>1</vcpu>
Apr 14 00:06:26 user nova-compute[82479]:   <metadata>
Apr 14 00:06:26 user nova-compute[82479]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 00:06:26 user nova-compute[82479]:       <nova:package version="0.0.0"/>
Apr 14 00:06:26 user nova-compute[82479]:       <nova:name>tempest-TestStampPattern-server-250370213</nova:name>
Apr 14 00:06:26 user nova-compute[82479]:       <nova:creationTime>2023-04-14 00:06:26</nova:creationTime>
Apr 14 00:06:26 user nova-compute[82479]:       <nova:flavor name="m1.nano">
Apr 14 00:06:26 user nova-compute[82479]:         <nova:memory>128</nova:memory>
Apr 14 00:06:26 user nova-compute[82479]:         <nova:disk>1</nova:disk>
Apr 14 00:06:26 user nova-compute[82479]:         <nova:swap>0</nova:swap>
Apr 14 00:06:26 user nova-compute[82479]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 00:06:26 user nova-compute[82479]:         <nova:vcpus>1</nova:vcpus>
Apr 14 00:06:26 user nova-compute[82479]:       </nova:flavor>
Apr 14 00:06:26 user nova-compute[82479]:       <nova:owner>
Apr 14 00:06:26 user nova-compute[82479]:         <nova:user uuid="6fe75acb64a94a2a88d370f43fa6b776">tempest-TestStampPattern-1381824337-project-member</nova:user>
Apr 14 00:06:26 user nova-compute[82479]:         <nova:project uuid="1f138770c7b4407d83c449500fc000a5">tempest-TestStampPattern-1381824337</nova:project>
Apr 14 00:06:26 user nova-compute[82479]:       </nova:owner>
Apr 14 00:06:26 user nova-compute[82479]:       <nova:root type="image" uuid="6db62068-7278-4cd8-b41f-d0140d89e199"/>
Apr 14 00:06:26 user nova-compute[82479]:       <nova:ports>
Apr 14 00:06:26 user nova-compute[82479]:         <nova:port uuid="cce0e09c-d491-4698-b846-d75a670cc38e">
Apr 14 00:06:26 user nova-compute[82479]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 14 00:06:26 user nova-compute[82479]:         </nova:port>
Apr 14 00:06:26 user nova-compute[82479]:       </nova:ports>
Apr 14 00:06:26 user nova-compute[82479]:     </nova:instance>
Apr 14 00:06:26 user nova-compute[82479]:   </metadata>
Apr 14 00:06:26 user nova-compute[82479]:   <sysinfo type="smbios">
Apr 14 00:06:26 user nova-compute[82479]:     <system>
Apr 14 00:06:26 user nova-compute[82479]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 00:06:26 user nova-compute[82479]:       <entry name="product">OpenStack Nova</entry>
Apr 14 00:06:26 user nova-compute[82479]:       <entry name="version">0.0.0</entry>
Apr 14 00:06:26 user nova-compute[82479]:       <entry name="serial">11c3384a-e699-4b10-9f8b-861291e96465</entry>
Apr 14 00:06:26 user nova-compute[82479]:       <entry name="uuid">11c3384a-e699-4b10-9f8b-861291e96465</entry>
Apr 14 00:06:26 user nova-compute[82479]:       <entry name="family">Virtual Machine</entry>
Apr 14 00:06:26 user nova-compute[82479]:     </system>
Apr 14 00:06:26 user nova-compute[82479]:   </sysinfo>
Apr 14 00:06:26 user nova-compute[82479]:   <os>
Apr 14 00:06:26 user nova-compute[82479]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 00:06:26 user nova-compute[82479]:     <boot dev="hd"/>
Apr 14 00:06:26 user nova-compute[82479]:     <smbios mode="sysinfo"/>
Apr 14 00:06:26 user nova-compute[82479]:   </os>
Apr 14 00:06:26 user nova-compute[82479]:   <features>
Apr 14 00:06:26 user nova-compute[82479]:     <acpi/>
Apr 14 00:06:26 user nova-compute[82479]:     <apic/>
Apr 14 00:06:26 user nova-compute[82479]:     <vmcoreinfo/>
Apr 14 00:06:26 user nova-compute[82479]:   </features>
Apr 14 00:06:26 user nova-compute[82479]:   <clock offset="utc">
Apr 14 00:06:26 user nova-compute[82479]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 00:06:26 user nova-compute[82479]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 00:06:26 user nova-compute[82479]:     <timer name="hpet" present="no"/>
Apr 14 00:06:26 user nova-compute[82479]:   </clock>
Apr 14 00:06:26 user nova-compute[82479]:   <cpu mode="custom" match="exact">
Apr 14 00:06:26 user nova-compute[82479]:     <model>Nehalem</model>
Apr 14 00:06:26 user nova-compute[82479]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 00:06:26 user nova-compute[82479]:   </cpu>
Apr 14 00:06:26 user nova-compute[82479]:   <devices>
Apr 14 00:06:26 user nova-compute[82479]:     <disk type="file" device="disk">
Apr 14 00:06:26 user nova-compute[82479]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 00:06:26 user nova-compute[82479]:       <source file="/opt/stack/data/nova/instances/11c3384a-e699-4b10-9f8b-861291e96465/disk"/>
Apr 14 00:06:26 user nova-compute[82479]:       <target dev="vda" bus="virtio"/>
Apr 14 00:06:26 user nova-compute[82479]:     </disk>
Apr 14 00:06:26 user nova-compute[82479]:     <interface type="ethernet">
Apr 14 00:06:26 user nova-compute[82479]:       <mac address="fa:16:3e:77:7f:4e"/>
Apr 14 00:06:26 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:06:26 user nova-compute[82479]:       <mtu size="1442"/>
Apr 14 00:06:26 user nova-compute[82479]:       <target dev="tapcce0e09c-d4"/>
Apr 14 00:06:26 user nova-compute[82479]:     </interface>
Apr 14 00:06:26 user nova-compute[82479]:     <serial type="pty">
Apr 14 00:06:26 user nova-compute[82479]:       <log file="/opt/stack/data/nova/instances/11c3384a-e699-4b10-9f8b-861291e96465/console.log" append="off"/>
Apr 14 00:06:26 user nova-compute[82479]:     </serial>
Apr 14 00:06:26 user nova-compute[82479]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 00:06:26 user nova-compute[82479]:     <video>
Apr 14 00:06:26 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:06:26 user nova-compute[82479]:     </video>
Apr 14 00:06:26 user nova-compute[82479]:     <rng model="virtio">
Apr 14 00:06:26 user nova-compute[82479]:       <backend model="random">/dev/urandom</backend>
Apr 14 00:06:26 user nova-compute[82479]:     </rng>
Apr 14 00:06:26 user nova-compute[82479]:     <controller type="usb" index="0" model="none"/>
Apr 14 00:06:26 user nova-compute[82479]:     <memballoon model="virtio">
Apr 14 00:06:26 user nova-compute[82479]:       <stats period="10"/>
Apr 14 00:06:26 user nova-compute[82479]:     </memballoon>
Apr 14 00:06:26 user nova-compute[82479]:   </devices>
Apr 14 00:06:26 user nova-compute[82479]: </domain>
Apr 14 00:06:26 user nova-compute[82479]:  {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 00:06:26 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:06:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-250370213',display_name='tempest-TestStampPattern-server-250370213',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-250370213',id=10,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDlLkyaARZkQB95QySk+2VUQZ09Ejf2MBAGMaTBkstJSwxWK7dIH2obGUK+EG+vNkZ0wlDST0FmsMBpmophXdr02YiHRimuo8UQxusvxIG9HcXOIpUbG3VMNRBCqhYxCUw==',key_name='tempest-TestStampPattern-2105733066',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1f138770c7b4407d83c449500fc000a5',ramdisk_id='',reservation_id='r-adbi2ts2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1381824337',owner_user_name='tempest-TestStampPattern-1381824337-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:06:24Z,user_data=None,user_id='6fe75acb64a94a2a88d370f43fa6b776',uuid=11c3384a-e699-4b10-9f8b-861291e96465,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cce0e09c-d491-4698-b846-d75a670cc38e", "address": "fa:16:3e:77:7f:4e", "network": {"id": "f185dffe-f180-4107-8752-182e71fc07c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1954392221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f138770c7b4407d83c449500fc000a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcce0e09c-d4", "ovs_interfaceid": "cce0e09c-d491-4698-b846-d75a670cc38e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 00:06:26 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Converting VIF {"id": "cce0e09c-d491-4698-b846-d75a670cc38e", "address": "fa:16:3e:77:7f:4e", "network": {"id": "f185dffe-f180-4107-8752-182e71fc07c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1954392221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f138770c7b4407d83c449500fc000a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcce0e09c-d4", "ovs_interfaceid": "cce0e09c-d491-4698-b846-d75a670cc38e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:06:26 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:7f:4e,bridge_name='br-int',has_traffic_filtering=True,id=cce0e09c-d491-4698-b846-d75a670cc38e,network=Network(f185dffe-f180-4107-8752-182e71fc07c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcce0e09c-d4') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:06:26 user nova-compute[82479]: DEBUG os_vif [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:7f:4e,bridge_name='br-int',has_traffic_filtering=True,id=cce0e09c-d491-4698-b846-d75a670cc38e,network=Network(f185dffe-f180-4107-8752-182e71fc07c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcce0e09c-d4') {{(pid=82479) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 00:06:26 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:06:26 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:06:26 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 00:06:26 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:06:26 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcce0e09c-d4, may_exist=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:06:26 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcce0e09c-d4, col_values=(('external_ids', {'iface-id': 'cce0e09c-d491-4698-b846-d75a670cc38e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:7f:4e', 'vm-uuid': '11c3384a-e699-4b10-9f8b-861291e96465'}),)) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:06:26 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:06:26 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:06:26 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:06:26 user nova-compute[82479]: INFO os_vif [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:7f:4e,bridge_name='br-int',has_traffic_filtering=True,id=cce0e09c-d491-4698-b846-d75a670cc38e,network=Network(f185dffe-f180-4107-8752-182e71fc07c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcce0e09c-d4')
Apr 14 00:06:26 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:06:26 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] No VIF found with MAC fa:16:3e:77:7f:4e, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:06:26 user nova-compute[82479]: DEBUG nova.network.neutron [req-1f5a3883-3224-4434-b294-3c670fa6f394 req-d78842a9-2513-46a4-8a8a-80b9bc58512d service nova] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Updated VIF entry in instance network info cache for port cce0e09c-d491-4698-b846-d75a670cc38e. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:06:26 user nova-compute[82479]: DEBUG nova.network.neutron [req-1f5a3883-3224-4434-b294-3c670fa6f394 req-d78842a9-2513-46a4-8a8a-80b9bc58512d service nova] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Updating instance_info_cache with network_info: [{"id": "cce0e09c-d491-4698-b846-d75a670cc38e", "address": "fa:16:3e:77:7f:4e", "network": {"id": "f185dffe-f180-4107-8752-182e71fc07c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1954392221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f138770c7b4407d83c449500fc000a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcce0e09c-d4", "ovs_interfaceid": "cce0e09c-d491-4698-b846-d75a670cc38e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:06:26 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-1f5a3883-3224-4434-b294-3c670fa6f394 req-d78842a9-2513-46a4-8a8a-80b9bc58512d service nova] Releasing lock "refresh_cache-11c3384a-e699-4b10-9f8b-861291e96465" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:06:27 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:06:27 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:06:27 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:06:28 user nova-compute[82479]: DEBUG nova.compute.manager [req-d23c5268-35d7-47b8-8b6a-403cdd5e793c req-e80d496d-11ef-4fa2-a924-e917b8ebaad3 service nova] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Received event network-vif-plugged-cce0e09c-d491-4698-b846-d75a670cc38e {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:06:28 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-d23c5268-35d7-47b8-8b6a-403cdd5e793c req-e80d496d-11ef-4fa2-a924-e917b8ebaad3 service nova] Acquiring lock "11c3384a-e699-4b10-9f8b-861291e96465-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:06:28 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-d23c5268-35d7-47b8-8b6a-403cdd5e793c req-e80d496d-11ef-4fa2-a924-e917b8ebaad3 service nova] Lock "11c3384a-e699-4b10-9f8b-861291e96465-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:06:28 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-d23c5268-35d7-47b8-8b6a-403cdd5e793c req-e80d496d-11ef-4fa2-a924-e917b8ebaad3 service nova] Lock "11c3384a-e699-4b10-9f8b-861291e96465-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:06:28 user nova-compute[82479]: DEBUG nova.compute.manager [req-d23c5268-35d7-47b8-8b6a-403cdd5e793c req-e80d496d-11ef-4fa2-a924-e917b8ebaad3 service nova] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] No waiting events found dispatching network-vif-plugged-cce0e09c-d491-4698-b846-d75a670cc38e {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:06:28 user nova-compute[82479]: WARNING nova.compute.manager [req-d23c5268-35d7-47b8-8b6a-403cdd5e793c req-e80d496d-11ef-4fa2-a924-e917b8ebaad3 service nova] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Received unexpected event network-vif-plugged-cce0e09c-d491-4698-b846-d75a670cc38e for instance with vm_state building and task_state spawning.
Apr 14 00:06:28 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:06:28 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:06:28 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:06:28 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:06:30 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681430790.0205393, 11c3384a-e699-4b10-9f8b-861291e96465 => Resumed> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:06:30 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] VM Resumed (Lifecycle Event)
Apr 14 00:06:30 user nova-compute[82479]: DEBUG nova.compute.manager [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Instance event wait completed in 0 seconds for  {{(pid=82479) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 00:06:30 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Guest created on hypervisor {{(pid=82479) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 00:06:30 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Instance spawned successfully.
Apr 14 00:06:30 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 00:06:30 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:06:30 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:06:30 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Found default for hw_cdrom_bus of ide {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:06:30 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Found default for hw_disk_bus of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:06:30 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Found default for hw_input_bus of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:06:30 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Found default for hw_pointer_model of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:06:30 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Found default for hw_video_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:06:30 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Found default for hw_vif_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:06:30 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:06:30 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681430790.0261598, 11c3384a-e699-4b10-9f8b-861291e96465 => Started> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:06:30 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] VM Started (Lifecycle Event)
Apr 14 00:06:30 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:06:30 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:06:30 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:06:30 user nova-compute[82479]: DEBUG nova.compute.manager [req-04a285f2-c631-496b-a71c-e609f27a4413 req-576c0c30-6e84-4cbb-9664-8b8523aad637 service nova] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Received event network-vif-plugged-cce0e09c-d491-4698-b846-d75a670cc38e {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:06:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-04a285f2-c631-496b-a71c-e609f27a4413 req-576c0c30-6e84-4cbb-9664-8b8523aad637 service nova] Acquiring lock "11c3384a-e699-4b10-9f8b-861291e96465-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:06:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-04a285f2-c631-496b-a71c-e609f27a4413 req-576c0c30-6e84-4cbb-9664-8b8523aad637 service nova] Lock "11c3384a-e699-4b10-9f8b-861291e96465-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:06:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-04a285f2-c631-496b-a71c-e609f27a4413 req-576c0c30-6e84-4cbb-9664-8b8523aad637 service nova] Lock "11c3384a-e699-4b10-9f8b-861291e96465-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:06:30 user nova-compute[82479]: DEBUG nova.compute.manager [req-04a285f2-c631-496b-a71c-e609f27a4413 req-576c0c30-6e84-4cbb-9664-8b8523aad637 service nova] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] No waiting events found dispatching network-vif-plugged-cce0e09c-d491-4698-b846-d75a670cc38e {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:06:30 user nova-compute[82479]: WARNING nova.compute.manager [req-04a285f2-c631-496b-a71c-e609f27a4413 req-576c0c30-6e84-4cbb-9664-8b8523aad637 service nova] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Received unexpected event network-vif-plugged-cce0e09c-d491-4698-b846-d75a670cc38e for instance with vm_state building and task_state spawning.
Apr 14 00:06:30 user nova-compute[82479]: INFO nova.compute.manager [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Took 6.16 seconds to spawn the instance on the hypervisor.
Apr 14 00:06:30 user nova-compute[82479]: DEBUG nova.compute.manager [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:06:30 user nova-compute[82479]: INFO nova.compute.manager [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Took 6.91 seconds to build instance.
Apr 14 00:06:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0cc811ff-098d-4bc1-97df-bb5e7d1e5817 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "11c3384a-e699-4b10-9f8b-861291e96465" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.018s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:06:30 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:06:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:06:35 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:06:36 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:06:37 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:06:38 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:06:39 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:06:39 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Starting heal instance info cache {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 00:06:39 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "refresh_cache-23718fd0-58b8-47f9-b1ef-a26a90741ecc" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:06:39 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquired lock "refresh_cache-23718fd0-58b8-47f9-b1ef-a26a90741ecc" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:06:39 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Forcefully refreshing network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 00:06:40 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Updating instance_info_cache with network_info: [{"id": "db4fcb1f-e93d-4eee-851d-0c47f24dcdb3", "address": "fa:16:3e:28:8a:3c", "network": {"id": "491696ea-38ef-4c19-9d94-a61223c1fa00", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1323121698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3f111e24414976beddba7ef90c4793", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb4fcb1f-e9", "ovs_interfaceid": "db4fcb1f-e93d-4eee-851d-0c47f24dcdb3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:06:40 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Releasing lock "refresh_cache-23718fd0-58b8-47f9-b1ef-a26a90741ecc" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:06:40 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Updated the network info_cache for instance {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 00:06:40 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:06:40 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:06:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:06:41 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:06:42 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:06:42 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:06:42 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:06:42 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82479) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 00:06:42 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:06:42 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:06:42 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:06:42 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:06:42 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Auditing locally available compute resources for user (node: user) {{(pid=82479) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 00:06:42 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:06:42 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:06:42 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:06:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:06:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11c3384a-e699-4b10-9f8b-861291e96465/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:06:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11c3384a-e699-4b10-9f8b-861291e96465/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:06:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11c3384a-e699-4b10-9f8b-861291e96465/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:06:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11c3384a-e699-4b10-9f8b-861291e96465/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:06:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e97abae3-f573-48eb-a218-a8fec436ef3b/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:06:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e97abae3-f573-48eb-a218-a8fec436ef3b/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:06:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e97abae3-f573-48eb-a218-a8fec436ef3b/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:06:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e97abae3-f573-48eb-a218-a8fec436ef3b/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:06:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:06:44 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:06:44 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:06:44 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:06:44 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae47769-02cd-4118-af46-0d3521ef7564/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:06:44 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae47769-02cd-4118-af46-0d3521ef7564/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:06:44 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae47769-02cd-4118-af46-0d3521ef7564/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:06:44 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cae47769-02cd-4118-af46-0d3521ef7564/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:06:44 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01a65362-36ea-4817-8e83-f75d6daf808b/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:06:44 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01a65362-36ea-4817-8e83-f75d6daf808b/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:06:44 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01a65362-36ea-4817-8e83-f75d6daf808b/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:06:44 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01a65362-36ea-4817-8e83-f75d6daf808b/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:06:44 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/716b5e3f-20c7-40ef-9a45-71be0cfeaeb2/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:06:44 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/716b5e3f-20c7-40ef-9a45-71be0cfeaeb2/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:06:44 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/716b5e3f-20c7-40ef-9a45-71be0cfeaeb2/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:06:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/716b5e3f-20c7-40ef-9a45-71be0cfeaeb2/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:06:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:06:45 user nova-compute[82479]: DEBUG nova.compute.manager [None req-fd0ccfbf-6bd7-4e84-b3e4-394967cf189a tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:06:45 user nova-compute[82479]: INFO nova.compute.manager [None req-fd0ccfbf-6bd7-4e84-b3e4-394967cf189a tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] instance snapshotting
Apr 14 00:06:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:06:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:06:45 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-fd0ccfbf-6bd7-4e84-b3e4-394967cf189a tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Beginning live snapshot process
Apr 14 00:06:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:06:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:06:45 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:06:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:06:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:06:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-fd0ccfbf-6bd7-4e84-b3e4-394967cf189a tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json -f qcow2 {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:06:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:06:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:06:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-fd0ccfbf-6bd7-4e84-b3e4-394967cf189a tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json -f qcow2" returned: 0 in 0.142s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:06:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-fd0ccfbf-6bd7-4e84-b3e4-394967cf189a tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json -f qcow2 {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:06:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:06:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:06:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-fd0ccfbf-6bd7-4e84-b3e4-394967cf189a tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json -f qcow2" returned: 0 in 0.137s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:06:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-fd0ccfbf-6bd7-4e84-b3e4-394967cf189a tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:06:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:06:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-fd0ccfbf-6bd7-4e84-b3e4-394967cf189a tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.612s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:06:46 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:06:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-fd0ccfbf-6bd7-4e84-b3e4-394967cf189a tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp7rtkc1jg/43d9ce06818f4542a3abbbd533a05bb4.delta 1073741824 {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:06:46 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-cac2c424-b423-4f1c-8611-0959c7f24045 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Acquiring lock "cae47769-02cd-4118-af46-0d3521ef7564" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:06:46 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-cac2c424-b423-4f1c-8611-0959c7f24045 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Lock "cae47769-02cd-4118-af46-0d3521ef7564" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.004s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:06:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-fd0ccfbf-6bd7-4e84-b3e4-394967cf189a tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp7rtkc1jg/43d9ce06818f4542a3abbbd533a05bb4.delta 1073741824" returned: 0 in 0.058s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:06:46 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-fd0ccfbf-6bd7-4e84-b3e4-394967cf189a tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 14 00:06:46 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-fd0ccfbf-6bd7-4e84-b3e4-394967cf189a tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Checking UEFI support for host arch (x86_64) {{(pid=82479) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1722}}
Apr 14 00:06:46 user nova-compute[82479]: INFO nova.virt.libvirt.host [None req-fd0ccfbf-6bd7-4e84-b3e4-394967cf189a tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] UEFI support detected
Apr 14 00:06:46 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:06:46 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:06:46 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Hypervisor/Node resource view: name=user free_ram=7329MB free_disk=26.516708374023438GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}] {{(pid=82479) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 00:06:46 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:06:46 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:06:46 user nova-compute[82479]: DEBUG nova.objects.instance [None req-cac2c424-b423-4f1c-8611-0959c7f24045 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Lazy-loading 'flavor' on Instance uuid cae47769-02cd-4118-af46-0d3521ef7564 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:06:46 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-cac2c424-b423-4f1c-8611-0959c7f24045 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Lock "cae47769-02cd-4118-af46-0d3521ef7564" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.097s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:06:46 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance cae47769-02cd-4118-af46-0d3521ef7564 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:06:46 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 23718fd0-58b8-47f9-b1ef-a26a90741ecc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:06:46 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:06:46 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:06:46 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 01a65362-36ea-4817-8e83-f75d6daf808b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:06:46 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance b3475e7e-ceb4-452a-a045-dbf43c5944dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:06:46 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance e97abae3-f573-48eb-a218-a8fec436ef3b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:06:46 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:06:46 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance b9c6323b-ed7f-4f86-93ad-3ef4726b01ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:06:46 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 11c3384a-e699-4b10-9f8b-861291e96465 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:06:46 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 00:06:46 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 00:06:47 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-cac2c424-b423-4f1c-8611-0959c7f24045 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Acquiring lock "cae47769-02cd-4118-af46-0d3521ef7564" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:06:47 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-cac2c424-b423-4f1c-8611-0959c7f24045 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Lock "cae47769-02cd-4118-af46-0d3521ef7564" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:06:47 user nova-compute[82479]: INFO nova.compute.manager [None req-cac2c424-b423-4f1c-8611-0959c7f24045 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Attaching volume 9751d47f-616e-4dc7-b5c5-910ddde3d0af to /dev/vdb
Apr 14 00:06:47 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:06:47 user nova-compute[82479]: DEBUG os_brick.utils [None req-cac2c424-b423-4f1c-8611-0959c7f24045 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:06:47 user nova-compute[82479]: INFO oslo.privsep.daemon [None req-cac2c424-b423-4f1c-8611-0959c7f24045 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpjbkchj9v/privsep.sock']
Apr 14 00:06:47 user sudo[93260]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpjbkchj9v/privsep.sock
Apr 14 00:06:47 user sudo[93260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 14 00:06:47 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:06:47 user nova-compute[82479]: DEBUG nova.compute.manager [req-0becdc22-f01c-46d5-bb73-eda406d3c5d5 req-588e521b-44a9-44b2-8404-eba36b8d717a service nova] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Received event network-changed-4085de4c-cb9e-452b-9504-b7c7f8621213 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:06:47 user nova-compute[82479]: DEBUG nova.compute.manager [req-0becdc22-f01c-46d5-bb73-eda406d3c5d5 req-588e521b-44a9-44b2-8404-eba36b8d717a service nova] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Refreshing instance network info cache due to event network-changed-4085de4c-cb9e-452b-9504-b7c7f8621213. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:06:47 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0becdc22-f01c-46d5-bb73-eda406d3c5d5 req-588e521b-44a9-44b2-8404-eba36b8d717a service nova] Acquiring lock "refresh_cache-3a6b9f89-e462-47d8-84a1-0ac4ade3ab97" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:06:47 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0becdc22-f01c-46d5-bb73-eda406d3c5d5 req-588e521b-44a9-44b2-8404-eba36b8d717a service nova] Acquired lock "refresh_cache-3a6b9f89-e462-47d8-84a1-0ac4ade3ab97" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:06:47 user nova-compute[82479]: DEBUG nova.network.neutron [req-0becdc22-f01c-46d5-bb73-eda406d3c5d5 req-588e521b-44a9-44b2-8404-eba36b8d717a service nova] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Refreshing network info cache for port 4085de4c-cb9e-452b-9504-b7c7f8621213 {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:06:47 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:06:47 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Compute_service record updated for user:user {{(pid=82479) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 00:06:47 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.653s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:06:47 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-fd0ccfbf-6bd7-4e84-b3e4-394967cf189a tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=82479) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 00:06:47 user nova-compute[82479]: DEBUG nova.network.neutron [req-0becdc22-f01c-46d5-bb73-eda406d3c5d5 req-588e521b-44a9-44b2-8404-eba36b8d717a service nova] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Updated VIF entry in instance network info cache for port 4085de4c-cb9e-452b-9504-b7c7f8621213. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:06:47 user nova-compute[82479]: DEBUG nova.network.neutron [req-0becdc22-f01c-46d5-bb73-eda406d3c5d5 req-588e521b-44a9-44b2-8404-eba36b8d717a service nova] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Updating instance_info_cache with network_info: [{"id": "4085de4c-cb9e-452b-9504-b7c7f8621213", "address": "fa:16:3e:2b:ab:7d", "network": {"id": "10c34d1a-edc4-4b0c-96a7-b29a7c292e74", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-573422654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931198e56de4cf08db59bcc40f2a260", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4085de4c-cb", "ovs_interfaceid": "4085de4c-cb9e-452b-9504-b7c7f8621213", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:06:47 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0becdc22-f01c-46d5-bb73-eda406d3c5d5 req-588e521b-44a9-44b2-8404-eba36b8d717a service nova] Releasing lock "refresh_cache-3a6b9f89-e462-47d8-84a1-0ac4ade3ab97" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:06:47 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-fd0ccfbf-6bd7-4e84-b3e4-394967cf189a tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=82479) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 00:06:47 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-fd0ccfbf-6bd7-4e84-b3e4-394967cf189a tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 14 00:06:48 user nova-compute[82479]: DEBUG nova.privsep.utils [None req-fd0ccfbf-6bd7-4e84-b3e4-394967cf189a tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82479) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 00:06:48 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-fd0ccfbf-6bd7-4e84-b3e4-394967cf189a tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp7rtkc1jg/43d9ce06818f4542a3abbbd533a05bb4.delta /opt/stack/data/nova/instances/snapshots/tmp7rtkc1jg/43d9ce06818f4542a3abbbd533a05bb4 {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:06:48 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:06:48 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-fd0ccfbf-6bd7-4e84-b3e4-394967cf189a tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp7rtkc1jg/43d9ce06818f4542a3abbbd533a05bb4.delta /opt/stack/data/nova/instances/snapshots/tmp7rtkc1jg/43d9ce06818f4542a3abbbd533a05bb4" returned: 0 in 0.434s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:06:48 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-fd0ccfbf-6bd7-4e84-b3e4-394967cf189a tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Snapshot extracted, beginning image upload
Apr 14 00:06:48 user nova-compute[82479]: DEBUG nova.compute.manager [None req-73817067-08ad-4383-872b-07199c5ce539 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:06:48 user nova-compute[82479]: INFO nova.compute.manager [None req-73817067-08ad-4383-872b-07199c5ce539 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] instance snapshotting
Apr 14 00:06:48 user sudo[93260]: pam_unix(sudo:session): session closed for user root
Apr 14 00:06:48 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-73817067-08ad-4383-872b-07199c5ce539 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Beginning live snapshot process
Apr 14 00:06:48 user nova-compute[82479]: INFO oslo.privsep.daemon [None req-cac2c424-b423-4f1c-8611-0959c7f24045 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Spawned new privsep daemon via rootwrap
Apr 14 00:06:48 user nova-compute[82479]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 14 00:06:48 user nova-compute[82479]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 14 00:06:48 user nova-compute[82479]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Apr 14 00:06:48 user nova-compute[82479]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 93289
Apr 14 00:06:48 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b416484-8852-4ae0-8667-b70bd73443ce]: (2,) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:06:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:06:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:06:49 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7d6b7e-9119-4678-b753-b43fde7792f1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fec92fcfdd3\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:06:49 user nova-compute[82479]: WARNING os_brick.initiator.connectors.nvmeof [None req-cac2c424-b423-4f1c-8611-0959c7f24045 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Apr 14 00:06:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:06:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:06:49 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[a332c147-46f2-473e-9440-fc8ce41c9172]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:06:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:06:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-73817067-08ad-4383-872b-07199c5ce539 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97/disk --force-share --output=json -f qcow2 {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:06:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:06:49 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[261fbcc2-f627-43a0-95ac-c5609ca6a765]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:06:49 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb93986-d399-49aa-a96c-d3a8832f62bd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:06:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-cac2c424-b423-4f1c-8611-0959c7f24045 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Running cmd (subprocess): nvme version {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:06:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-cac2c424-b423-4f1c-8611-0959c7f24045 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] 'nvme version' failed. Not Retrying. {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:06:49 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cac2c424-b423-4f1c-8611-0959c7f24045 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] nvme not present on system {{(pid=82479) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 00:06:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:06:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:06:49 user nova-compute[82479]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 00:06:49 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31ac452-d1f0-48d3-9f6c-b76596630ed1]: (4, '') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:06:49 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-cac2c424-b423-4f1c-8611-0959c7f24045 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82479) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 00:06:49 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-cac2c424-b423-4f1c-8611-0959c7f24045 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 00:06:49 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-cac2c424-b423-4f1c-8611-0959c7f24045 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] LIGHTOS: no hostnqn found. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 00:06:49 user nova-compute[82479]: DEBUG os_brick.utils [None req-cac2c424-b423-4f1c-8611-0959c7f24045 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] <== get_connector_properties: return (2128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fec92fcfdd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:06:49 user nova-compute[82479]: DEBUG nova.virt.block_device [None req-cac2c424-b423-4f1c-8611-0959c7f24045 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Updating existing volume attachment record: 7dbb1711-7390-4b6c-b65c-c7883e0f33d4 {{(pid=82479) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 00:06:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-73817067-08ad-4383-872b-07199c5ce539 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97/disk --force-share --output=json -f qcow2" returned: 0 in 0.162s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:06:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-73817067-08ad-4383-872b-07199c5ce539 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97/disk --force-share --output=json -f qcow2 {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:06:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-73817067-08ad-4383-872b-07199c5ce539 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97/disk --force-share --output=json -f qcow2" returned: 0 in 0.160s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:06:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-73817067-08ad-4383-872b-07199c5ce539 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:06:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-73817067-08ad-4383-872b-07199c5ce539 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.145s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:06:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-73817067-08ad-4383-872b-07199c5ce539 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpr04h057n/0c71ca1dbc3a4a9f9e861f0c4ec58b8b.delta 1073741824 {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:06:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-73817067-08ad-4383-872b-07199c5ce539 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpr04h057n/0c71ca1dbc3a4a9f9e861f0c4ec58b8b.delta 1073741824" returned: 0 in 0.051s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:06:49 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-73817067-08ad-4383-872b-07199c5ce539 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 14 00:06:50 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:06:50 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-73817067-08ad-4383-872b-07199c5ce539 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=82479) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 00:06:51 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-73817067-08ad-4383-872b-07199c5ce539 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=82479) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 00:06:51 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-73817067-08ad-4383-872b-07199c5ce539 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 14 00:06:51 user nova-compute[82479]: DEBUG nova.privsep.utils [None req-73817067-08ad-4383-872b-07199c5ce539 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82479) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 00:06:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-73817067-08ad-4383-872b-07199c5ce539 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpr04h057n/0c71ca1dbc3a4a9f9e861f0c4ec58b8b.delta /opt/stack/data/nova/instances/snapshots/tmpr04h057n/0c71ca1dbc3a4a9f9e861f0c4ec58b8b {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:06:51 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-fd0ccfbf-6bd7-4e84-b3e4-394967cf189a tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Snapshot image upload complete
Apr 14 00:06:51 user nova-compute[82479]: INFO nova.compute.manager [None req-fd0ccfbf-6bd7-4e84-b3e4-394967cf189a tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Took 6.03 seconds to snapshot the instance on the hypervisor.
Apr 14 00:06:51 user nova-compute[82479]: DEBUG nova.compute.manager [req-eefea1b4-c666-4b12-97dc-37d40360d590 req-599f4394-7a8d-4da2-9cf7-335df377c23e service nova] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Received event network-changed-b5dfa187-0a42-4319-990f-1d3b22691c27 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:06:51 user nova-compute[82479]: DEBUG nova.compute.manager [req-eefea1b4-c666-4b12-97dc-37d40360d590 req-599f4394-7a8d-4da2-9cf7-335df377c23e service nova] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Refreshing instance network info cache due to event network-changed-b5dfa187-0a42-4319-990f-1d3b22691c27. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:06:51 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-eefea1b4-c666-4b12-97dc-37d40360d590 req-599f4394-7a8d-4da2-9cf7-335df377c23e service nova] Acquiring lock "refresh_cache-01a65362-36ea-4817-8e83-f75d6daf808b" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:06:51 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-eefea1b4-c666-4b12-97dc-37d40360d590 req-599f4394-7a8d-4da2-9cf7-335df377c23e service nova] Acquired lock "refresh_cache-01a65362-36ea-4817-8e83-f75d6daf808b" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:06:51 user nova-compute[82479]: DEBUG nova.network.neutron [req-eefea1b4-c666-4b12-97dc-37d40360d590 req-599f4394-7a8d-4da2-9cf7-335df377c23e service nova] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Refreshing network info cache for port b5dfa187-0a42-4319-990f-1d3b22691c27 {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:06:51 user nova-compute[82479]: DEBUG nova.compute.manager [req-a1a771c1-49a9-48a7-aa49-a8b33630c582 req-222d8b46-e81e-4d04-b8e6-f9f283ea7685 service nova] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Received event network-changed-1b166f8e-a207-48d3-a0a9-2ad6c44774b2 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:06:51 user nova-compute[82479]: DEBUG nova.compute.manager [req-a1a771c1-49a9-48a7-aa49-a8b33630c582 req-222d8b46-e81e-4d04-b8e6-f9f283ea7685 service nova] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Refreshing instance network info cache due to event network-changed-1b166f8e-a207-48d3-a0a9-2ad6c44774b2. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:06:51 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-a1a771c1-49a9-48a7-aa49-a8b33630c582 req-222d8b46-e81e-4d04-b8e6-f9f283ea7685 service nova] Acquiring lock "refresh_cache-1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:06:51 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-a1a771c1-49a9-48a7-aa49-a8b33630c582 req-222d8b46-e81e-4d04-b8e6-f9f283ea7685 service nova] Acquired lock "refresh_cache-1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:06:51 user nova-compute[82479]: DEBUG nova.network.neutron [req-a1a771c1-49a9-48a7-aa49-a8b33630c582 req-222d8b46-e81e-4d04-b8e6-f9f283ea7685 service nova] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Refreshing network info cache for port 1b166f8e-a207-48d3-a0a9-2ad6c44774b2 {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:06:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:06:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-73817067-08ad-4383-872b-07199c5ce539 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpr04h057n/0c71ca1dbc3a4a9f9e861f0c4ec58b8b.delta /opt/stack/data/nova/instances/snapshots/tmpr04h057n/0c71ca1dbc3a4a9f9e861f0c4ec58b8b" returned: 0 in 0.547s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:06:51 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-73817067-08ad-4383-872b-07199c5ce539 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Snapshot extracted, beginning image upload
Apr 14 00:06:52 user nova-compute[82479]: DEBUG nova.network.neutron [req-eefea1b4-c666-4b12-97dc-37d40360d590 req-599f4394-7a8d-4da2-9cf7-335df377c23e service nova] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Updated VIF entry in instance network info cache for port b5dfa187-0a42-4319-990f-1d3b22691c27. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:06:52 user nova-compute[82479]: DEBUG nova.network.neutron [req-eefea1b4-c666-4b12-97dc-37d40360d590 req-599f4394-7a8d-4da2-9cf7-335df377c23e service nova] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Updating instance_info_cache with network_info: [{"id": "b5dfa187-0a42-4319-990f-1d3b22691c27", "address": "fa:16:3e:7b:38:3d", "network": {"id": "368d9445-850e-4f74-b5cc-86d1eaa95d63", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374332689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec1aab0338ff4bd195a37a4199a378eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5dfa187-0a", "ovs_interfaceid": "b5dfa187-0a42-4319-990f-1d3b22691c27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:06:52 user nova-compute[82479]: DEBUG nova.network.neutron [req-a1a771c1-49a9-48a7-aa49-a8b33630c582 req-222d8b46-e81e-4d04-b8e6-f9f283ea7685 service nova] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Updated VIF entry in instance network info cache for port 1b166f8e-a207-48d3-a0a9-2ad6c44774b2. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:06:52 user nova-compute[82479]: DEBUG nova.network.neutron [req-a1a771c1-49a9-48a7-aa49-a8b33630c582 req-222d8b46-e81e-4d04-b8e6-f9f283ea7685 service nova] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Updating instance_info_cache with network_info: [{"id": "1b166f8e-a207-48d3-a0a9-2ad6c44774b2", "address": "fa:16:3e:2b:d2:f7", "network": {"id": "66316d10-fed3-4fb9-877e-a01542ca5855", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-93456010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f20caf676a64b9b97027f3fc9bc724c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b166f8e-a2", "ovs_interfaceid": "1b166f8e-a207-48d3-a0a9-2ad6c44774b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:06:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-eefea1b4-c666-4b12-97dc-37d40360d590 req-599f4394-7a8d-4da2-9cf7-335df377c23e service nova] Releasing lock "refresh_cache-01a65362-36ea-4817-8e83-f75d6daf808b" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:06:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-a1a771c1-49a9-48a7-aa49-a8b33630c582 req-222d8b46-e81e-4d04-b8e6-f9f283ea7685 service nova] Releasing lock "refresh_cache-1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:06:53 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "01a65362-36ea-4817-8e83-f75d6daf808b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:06:53 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "01a65362-36ea-4817-8e83-f75d6daf808b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:06:54 user nova-compute[82479]: DEBUG nova.objects.instance [None req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lazy-loading 'flavor' on Instance uuid 01a65362-36ea-4817-8e83-f75d6daf808b {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:06:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "01a65362-36ea-4817-8e83-f75d6daf808b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:06:54 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-73817067-08ad-4383-872b-07199c5ce539 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Snapshot image upload complete
Apr 14 00:06:54 user nova-compute[82479]: INFO nova.compute.manager [None req-73817067-08ad-4383-872b-07199c5ce539 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Took 5.29 seconds to snapshot the instance on the hypervisor.
Apr 14 00:06:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "01a65362-36ea-4817-8e83-f75d6daf808b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:06:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "01a65362-36ea-4817-8e83-f75d6daf808b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:06:54 user nova-compute[82479]: INFO nova.compute.manager [None req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Attaching volume 5021c122-fea0-4125-8b1f-c1ab3c4de5e7 to /dev/vdb
Apr 14 00:06:54 user nova-compute[82479]: DEBUG os_brick.utils [None req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:06:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:06:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:06:54 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[262c3ccc-174f-468a-9682-4ae5bbdb3988]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fec92fcfdd3\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:06:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:06:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:06:54 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe3a772-f5cf-43b9-b7f3-28826ee8a54a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:06:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:06:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:06:54 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb13d9e-5fb0-4bba-88bf-7dd4d56db282]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:06:54 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[b11b5815-ecdf-468c-ab95-6439c2eb4061]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:06:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Running cmd (subprocess): nvme version {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:06:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] 'nvme version' failed. Not Retrying. {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:06:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] nvme not present on system {{(pid=82479) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 00:06:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:06:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:06:54 user nova-compute[82479]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 00:06:54 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f34418-65f7-4d4b-928f-7cc2cde68aa7]: (4, '') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:06:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82479) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 00:06:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 00:06:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] LIGHTOS: no hostnqn found. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 00:06:54 user nova-compute[82479]: DEBUG os_brick.utils [None req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fec92fcfdd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:06:54 user nova-compute[82479]: DEBUG nova.virt.block_device [None req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Updating existing volume attachment record: 3ee3e773-1a7c-47ce-b628-8897d5895513 {{(pid=82479) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 00:06:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-788cfd56-12db-4ecf-90a0-7498ba7cd919 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:06:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-788cfd56-12db-4ecf-90a0-7498ba7cd919 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:06:55 user nova-compute[82479]: INFO nova.compute.manager [None req-788cfd56-12db-4ecf-90a0-7498ba7cd919 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Shelving
Apr 14 00:06:55 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:06:55 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:06:55 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:06:55 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:06:55 user nova-compute[82479]: DEBUG nova.compute.manager [req-641d0cbf-7635-4046-8a8f-f3cc9b67f9f6 req-1399ad23-551f-45c6-8138-9fd0ab6733de service nova] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Received event network-vif-unplugged-1b166f8e-a207-48d3-a0a9-2ad6c44774b2 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:06:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-641d0cbf-7635-4046-8a8f-f3cc9b67f9f6 req-1399ad23-551f-45c6-8138-9fd0ab6733de service nova] Acquiring lock "1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:06:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-641d0cbf-7635-4046-8a8f-f3cc9b67f9f6 req-1399ad23-551f-45c6-8138-9fd0ab6733de service nova] Lock "1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:06:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-641d0cbf-7635-4046-8a8f-f3cc9b67f9f6 req-1399ad23-551f-45c6-8138-9fd0ab6733de service nova] Lock "1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:06:55 user nova-compute[82479]: DEBUG nova.compute.manager [req-641d0cbf-7635-4046-8a8f-f3cc9b67f9f6 req-1399ad23-551f-45c6-8138-9fd0ab6733de service nova] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] No waiting events found dispatching network-vif-unplugged-1b166f8e-a207-48d3-a0a9-2ad6c44774b2 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:06:55 user nova-compute[82479]: WARNING nova.compute.manager [req-641d0cbf-7635-4046-8a8f-f3cc9b67f9f6 req-1399ad23-551f-45c6-8138-9fd0ab6733de service nova] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Received unexpected event network-vif-unplugged-1b166f8e-a207-48d3-a0a9-2ad6c44774b2 for instance with vm_state active and task_state shelving.
Apr 14 00:06:56 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Instance destroyed successfully.
Apr 14 00:06:56 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-788cfd56-12db-4ecf-90a0-7498ba7cd919 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Beginning cold snapshot process
Apr 14 00:06:56 user nova-compute[82479]: DEBUG nova.privsep.utils [None req-788cfd56-12db-4ecf-90a0-7498ba7cd919 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82479) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 00:06:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-788cfd56-12db-4ecf-90a0-7498ba7cd919 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a/disk /opt/stack/data/nova/instances/snapshots/tmp0kf5t9bq/9cf8566c0add4148bac61e12da2f2912 {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:06:56 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-cac2c424-b423-4f1c-8611-0959c7f24045 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:06:56 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-cac2c424-b423-4f1c-8611-0959c7f24045 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.003s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:06:56 user nova-compute[82479]: DEBUG os_brick.initiator.connector [None req-cac2c424-b423-4f1c-8611-0959c7f24045 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Factory for ISCSI on None {{(pid=82479) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Apr 14 00:06:56 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-cac2c424-b423-4f1c-8611-0959c7f24045 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.008s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:06:56 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cac2c424-b423-4f1c-8611-0959c7f24045 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Calling os-brick to attach iSCSI Volume {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 00:06:56 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac2c424-b423-4f1c-8611-0959c7f24045 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BRmkKrYn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:06:56 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-cac2c424-b423-4f1c-8611-0959c7f24045 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:06:56 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-cac2c424-b423-4f1c-8611-0959c7f24045 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:06:56 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-cac2c424-b423-4f1c-8611-0959c7f24045 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:06:56 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-cac2c424-b423-4f1c-8611-0959c7f24045 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:06:56 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-cac2c424-b423-4f1c-8611-0959c7f24045 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:06:56 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-cac2c424-b423-4f1c-8611-0959c7f24045 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:06:56 user nova-compute[82479]: INFO os_brick.initiator.connectors.iscsi [None req-cac2c424-b423-4f1c-8611-0959c7f24045 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 00:06:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af -p 172.16.0.220:3260 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:06:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:06:56 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02eb2d0-8685-4ec7-ad7d-a563d0de94e1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:06:56 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac2c424-b423-4f1c-8611-0959c7f24045 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 00:06:56 user nova-compute[82479]:  {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:06:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af -p 172.16.0.220:3260 --interface default --op new {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:06:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:06:56 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[e729c31e-2372-4efe-9c0f-6b92d5df6c18]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af] added\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:06:56 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac2c424-b423-4f1c-8611-0959c7f24045 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af] added
Apr 14 00:06:56 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:06:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:06:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.040s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:06:56 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[5517c19d-a1ed-4962-8c9a-9f962e6055b6]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:06:56 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac2c424-b423-4f1c-8611-0959c7f24045 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:06:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:06:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:06:56 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a237e24-2233-4a95-bcc9-b4a51c6c7034]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:06:56 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac2c424-b423-4f1c-8611-0959c7f24045 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:06:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BRmkKrYn {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:06:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BRmkKrYn" returned: 0 in 0.069s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:06:56 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2f086a-b0d8-4cb5-986b-0e5d30a09e15]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:06:56 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac2c424-b423-4f1c-8611-0959c7f24045 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BRmkKrYn'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:06:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:06:56 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:06:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:06:56 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37262f0-5ade-4f07-9838-244ff2d473b4]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:06:56 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac2c424-b423-4f1c-8611-0959c7f24045 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:06:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:06:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.024s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:06:56 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[a055f424-5abf-4a43-af85-f0459edba6df]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:06:56 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac2c424-b423-4f1c-8611-0959c7f24045 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 00:06:56 user nova-compute[82479]:  {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:06:56 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac2c424-b423-4f1c-8611-0959c7f24045 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 00:06:56 user nova-compute[82479]:  {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:06:56 user nova-compute[82479]: WARNING os_brick.initiator.connectors.iscsi [None req-cac2c424-b423-4f1c-8611-0959c7f24045 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 00:06:56 user nova-compute[82479]: 
Apr 14 00:06:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af -p 172.16.0.220:3260 --login {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:06:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-788cfd56-12db-4ecf-90a0-7498ba7cd919 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a/disk /opt/stack/data/nova/instances/snapshots/tmp0kf5t9bq/9cf8566c0add4148bac61e12da2f2912" returned: 0 in 0.638s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:06:56 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-788cfd56-12db-4ecf-90a0-7498ba7cd919 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Snapshot extracted, beginning image upload
Apr 14 00:06:57 user nova-compute[82479]: DEBUG nova.compute.manager [req-a95c0973-dcc5-4a3b-afad-0e61e02e81f7 req-a17c4914-6b5b-482f-ac05-00a85291a5b5 service nova] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Received event network-vif-plugged-1b166f8e-a207-48d3-a0a9-2ad6c44774b2 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:06:57 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-a95c0973-dcc5-4a3b-afad-0e61e02e81f7 req-a17c4914-6b5b-482f-ac05-00a85291a5b5 service nova] Acquiring lock "1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:06:57 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-a95c0973-dcc5-4a3b-afad-0e61e02e81f7 req-a17c4914-6b5b-482f-ac05-00a85291a5b5 service nova] Lock "1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:06:57 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-a95c0973-dcc5-4a3b-afad-0e61e02e81f7 req-a17c4914-6b5b-482f-ac05-00a85291a5b5 service nova] Lock "1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:06:57 user nova-compute[82479]: DEBUG nova.compute.manager [req-a95c0973-dcc5-4a3b-afad-0e61e02e81f7 req-a17c4914-6b5b-482f-ac05-00a85291a5b5 service nova] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] No waiting events found dispatching network-vif-plugged-1b166f8e-a207-48d3-a0a9-2ad6c44774b2 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:06:57 user nova-compute[82479]: WARNING nova.compute.manager [req-a95c0973-dcc5-4a3b-afad-0e61e02e81f7 req-a17c4914-6b5b-482f-ac05-00a85291a5b5 service nova] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Received unexpected event network-vif-plugged-1b166f8e-a207-48d3-a0a9-2ad6c44774b2 for instance with vm_state active and task_state shelving_image_uploading.
Apr 14 00:06:57 user nova-compute[82479]: DEBUG nova.compute.manager [req-a95c0973-dcc5-4a3b-afad-0e61e02e81f7 req-a17c4914-6b5b-482f-ac05-00a85291a5b5 service nova] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Received event network-changed-617f05b8-c04e-4abf-b4e5-a0234209624a {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:06:57 user nova-compute[82479]: DEBUG nova.compute.manager [req-a95c0973-dcc5-4a3b-afad-0e61e02e81f7 req-a17c4914-6b5b-482f-ac05-00a85291a5b5 service nova] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Refreshing instance network info cache due to event network-changed-617f05b8-c04e-4abf-b4e5-a0234209624a. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:06:57 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-a95c0973-dcc5-4a3b-afad-0e61e02e81f7 req-a17c4914-6b5b-482f-ac05-00a85291a5b5 service nova] Acquiring lock "refresh_cache-b3475e7e-ceb4-452a-a045-dbf43c5944dd" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:06:57 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-a95c0973-dcc5-4a3b-afad-0e61e02e81f7 req-a17c4914-6b5b-482f-ac05-00a85291a5b5 service nova] Acquired lock "refresh_cache-b3475e7e-ceb4-452a-a045-dbf43c5944dd" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:06:57 user nova-compute[82479]: DEBUG nova.network.neutron [req-a95c0973-dcc5-4a3b-afad-0e61e02e81f7 req-a17c4914-6b5b-482f-ac05-00a85291a5b5 service nova] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Refreshing network info cache for port 617f05b8-c04e-4abf-b4e5-a0234209624a {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:06:57 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af -p 172.16.0.220:3260 --login" returned: 0 in 1.050s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:06:57 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[9877a002-90ca-4a52-a493-6ed66fb3ca1b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:06:57 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac2c424-b423-4f1c-8611-0959c7f24045 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af, portal: 172.16.0.220,3260]
Apr 14 00:06:57 user nova-compute[82479]: Login to [iface: default, target: iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af, portal: 172.16.0.220,3260] successful.
Apr 14 00:06:57 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:06:57 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:06:57 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:06:57 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e735af8-b474-45a1-86d5-94fc78d33068]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:06:57 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac2c424-b423-4f1c-8611-0959c7f24045 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:06:57 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:06:57 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:06:57 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[37292a54-3bbf-487d-8e11-602951f44081]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:06:57 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac2c424-b423-4f1c-8611-0959c7f24045 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af (non-flash)
Apr 14 00:06:57 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:06:57 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac2c424-b423-4f1c-8611-0959c7f24045 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af (non-flash)
Apr 14 00:06:57 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:06:57 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-cac2c424-b423-4f1c-8611-0959c7f24045 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.530s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:06:57 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac2c424-b423-4f1c-8611-0959c7f24045 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Connected to 172.16.0.220:3260 {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 00:06:57 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-cac2c424-b423-4f1c-8611-0959c7f24045 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=82479) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 00:06:57 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-cac2c424-b423-4f1c-8611-0959c7f24045 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82479) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 00:06:57 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:06:57 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:06:57 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d54002-dbfa-41fd-aff9-0b02403630b7]: (4, ('- - 0', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:06:57 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-cac2c424-b423-4f1c-8611-0959c7f24045 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82479) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 00:06:57 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac2c424-b423-4f1c-8611-0959c7f24045 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BRmkKrYn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 00:06:58 user nova-compute[82479]: DEBUG nova.network.neutron [req-a95c0973-dcc5-4a3b-afad-0e61e02e81f7 req-a17c4914-6b5b-482f-ac05-00a85291a5b5 service nova] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Updated VIF entry in instance network info cache for port 617f05b8-c04e-4abf-b4e5-a0234209624a. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:06:58 user nova-compute[82479]: DEBUG nova.network.neutron [req-a95c0973-dcc5-4a3b-afad-0e61e02e81f7 req-a17c4914-6b5b-482f-ac05-00a85291a5b5 service nova] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Updating instance_info_cache with network_info: [{"id": "617f05b8-c04e-4abf-b4e5-a0234209624a", "address": "fa:16:3e:f9:fd:1a", "network": {"id": "cb8c9bb1-a885-486d-aa6a-de600bc01c2e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1676259779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8663ccad9047f4b11b9ae0646c287a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617f05b8-c0", "ovs_interfaceid": "617f05b8-c04e-4abf-b4e5-a0234209624a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:06:58 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-a95c0973-dcc5-4a3b-afad-0e61e02e81f7 req-a17c4914-6b5b-482f-ac05-00a85291a5b5 service nova] Releasing lock "refresh_cache-b3475e7e-ceb4-452a-a045-dbf43c5944dd" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:06:58 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-cac2c424-b423-4f1c-8611-0959c7f24045 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.567s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:06:58 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-cac2c424-b423-4f1c-8611-0959c7f24045 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] <== connect_volume: return (2569ms) {'type': 'block', 'scsi_wwn': '23930636336626539', 'path': '/dev/sdb'} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:06:58 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cac2c424-b423-4f1c-8611-0959c7f24045 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23930636336626539', 'path': '/dev/sdb'} {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 00:06:58 user nova-compute[82479]: DEBUG nova.objects.instance [None req-cac2c424-b423-4f1c-8611-0959c7f24045 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Lazy-loading 'flavor' on Instance uuid cae47769-02cd-4118-af46-0d3521ef7564 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:06:58 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-cac2c424-b423-4f1c-8611-0959c7f24045 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 00:06:58 user nova-compute[82479]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:06:58 user nova-compute[82479]:   <source dev="/dev/sdb"/>
Apr 14 00:06:58 user nova-compute[82479]:   <target dev="vdb" bus="virtio"/>
Apr 14 00:06:58 user nova-compute[82479]:   <serial>9751d47f-616e-4dc7-b5c5-910ddde3d0af</serial>
Apr 14 00:06:58 user nova-compute[82479]: </disk>
Apr 14 00:06:58 user nova-compute[82479]:  {{(pid=82479) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 00:06:59 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Calling os-brick to attach iSCSI Volume {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 00:06:59 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'npILkxwF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:06:59 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:06:59 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:06:59 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:06:59 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:06:59 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:06:59 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:06:59 user nova-compute[82479]: INFO os_brick.initiator.connectors.iscsi [None req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 00:06:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 -p 172.16.0.220:3260 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:06:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:06:59 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbbf5665-02f9-4898-9f31-1cfee50eb5f1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:06:59 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 00:06:59 user nova-compute[82479]:  {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:06:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 -p 172.16.0.220:3260 --interface default --op new {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:06:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:06:59 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa2a30b-4f61-43d6-bb80-df2d578704cb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7] added\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:06:59 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7] added
Apr 14 00:06:59 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:06:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:06:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:06:59 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[d09afb65-3339-4159-b66f-5ad1fc01b9b8]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:06:59 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:06:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:06:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:06:59 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[787bc0b6-ca85-4e0e-9bcc-e23e5e38d0ef]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:06:59 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:06:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v npILkxwF {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:06:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v npILkxwF" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:06:59 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ee585a-b65e-4ddb-9611-2e9d4954da05]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:06:59 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'npILkxwF'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:06:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:06:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:06:59 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[495cf64a-6e6e-4c3c-8a76-32743e8d05ca]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:06:59 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:06:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:06:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:06:59 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c142e46-86cc-47cd-81a9-829ab40a352a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:06:59 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af (non-flash)
Apr 14 00:06:59 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:06:59 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af (non-flash)
Apr 14 00:06:59 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:06:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 -p 172.16.0.220:3260 --login {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:06:59 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-788cfd56-12db-4ecf-90a0-7498ba7cd919 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Snapshot image upload complete
Apr 14 00:06:59 user nova-compute[82479]: DEBUG nova.compute.manager [None req-788cfd56-12db-4ecf-90a0-7498ba7cd919 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:06:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:06:59 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[a018a673-5d1c-41d8-9b21-05d89a994d0b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:06:59 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7, portal: 172.16.0.220,3260]
Apr 14 00:06:59 user nova-compute[82479]: Login to [iface: default, target: iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7, portal: 172.16.0.220,3260] successful.
Apr 14 00:06:59 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:06:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:06:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:06:59 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd18136f-8622-41cb-84c9-c3b7fdc537a7]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:06:59 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:06:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:06:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:06:59 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[0504b29a-fc45-4182-9dd1-218fc4927891]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:06:59 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af (non-flash)
Apr 14 00:06:59 user nova-compute[82479]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:06:59 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:06:59 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af (non-flash)
Apr 14 00:06:59 user nova-compute[82479]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:06:59 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:06:59 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:06:59 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Connected to 172.16.0.220:3260 {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 00:06:59 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=82479) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 00:06:59 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=82479) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 00:06:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:06:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:06:59 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd8dc925-ac90-4564-a3d1-656eb4384bdd]: (4, ('- - 0', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:06:59 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=82479) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 00:06:59 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'npILkxwF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 00:06:59 user nova-compute[82479]: INFO nova.compute.manager [None req-788cfd56-12db-4ecf-90a0-7498ba7cd919 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Shelve offloading
Apr 14 00:06:59 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-cac2c424-b423-4f1c-8611-0959c7f24045 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:06:59 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-cac2c424-b423-4f1c-8611-0959c7f24045 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:06:59 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-cac2c424-b423-4f1c-8611-0959c7f24045 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] No VIF found with MAC fa:16:3e:92:89:19, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:06:59 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Instance destroyed successfully.
Apr 14 00:06:59 user nova-compute[82479]: DEBUG nova.compute.manager [None req-788cfd56-12db-4ecf-90a0-7498ba7cd919 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:06:59 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-788cfd56-12db-4ecf-90a0-7498ba7cd919 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "refresh_cache-1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:06:59 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-788cfd56-12db-4ecf-90a0-7498ba7cd919 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquired lock "refresh_cache-1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:06:59 user nova-compute[82479]: DEBUG nova.network.neutron [None req-788cfd56-12db-4ecf-90a0-7498ba7cd919 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 00:06:59 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-cac2c424-b423-4f1c-8611-0959c7f24045 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Lock "cae47769-02cd-4118-af46-0d3521ef7564" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.587s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:07:00 user nova-compute[82479]: DEBUG nova.network.neutron [None req-788cfd56-12db-4ecf-90a0-7498ba7cd919 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Updating instance_info_cache with network_info: [{"id": "1b166f8e-a207-48d3-a0a9-2ad6c44774b2", "address": "fa:16:3e:2b:d2:f7", "network": {"id": "66316d10-fed3-4fb9-877e-a01542ca5855", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-93456010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f20caf676a64b9b97027f3fc9bc724c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b166f8e-a2", "ovs_interfaceid": "1b166f8e-a207-48d3-a0a9-2ad6c44774b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:07:00 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-788cfd56-12db-4ecf-90a0-7498ba7cd919 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Releasing lock "refresh_cache-1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:07:00 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-17a7504a-6118-4ec8-bf28-393ebe927145 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Acquiring lock "cae47769-02cd-4118-af46-0d3521ef7564" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:07:00 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-17a7504a-6118-4ec8-bf28-393ebe927145 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Lock "cae47769-02cd-4118-af46-0d3521ef7564" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:07:00 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-17a7504a-6118-4ec8-bf28-393ebe927145 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Acquiring lock "cae47769-02cd-4118-af46-0d3521ef7564-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:07:00 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-17a7504a-6118-4ec8-bf28-393ebe927145 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Lock "cae47769-02cd-4118-af46-0d3521ef7564-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:07:00 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-17a7504a-6118-4ec8-bf28-393ebe927145 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Lock "cae47769-02cd-4118-af46-0d3521ef7564-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:07:00 user nova-compute[82479]: INFO nova.compute.manager [None req-17a7504a-6118-4ec8-bf28-393ebe927145 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Terminating instance
Apr 14 00:07:00 user nova-compute[82479]: DEBUG nova.compute.manager [None req-17a7504a-6118-4ec8-bf28-393ebe927145 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Start destroying the instance on the hypervisor. {{(pid=82479) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 00:07:00 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:00 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:00 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:07:00 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '23866316530316134', 'path': '/dev/sdc'} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:07:00 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23866316530316134', 'path': '/dev/sdc'} {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 00:07:00 user nova-compute[82479]: DEBUG nova.objects.instance [None req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lazy-loading 'flavor' on Instance uuid 01a65362-36ea-4817-8e83-f75d6daf808b {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:07:00 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:00 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 00:07:00 user nova-compute[82479]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:07:00 user nova-compute[82479]:   <source dev="/dev/sdc"/>
Apr 14 00:07:00 user nova-compute[82479]:   <target dev="vdb" bus="virtio"/>
Apr 14 00:07:00 user nova-compute[82479]:   <serial>5021c122-fea0-4125-8b1f-c1ab3c4de5e7</serial>
Apr 14 00:07:00 user nova-compute[82479]: </disk>
Apr 14 00:07:00 user nova-compute[82479]:  {{(pid=82479) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 00:07:00 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:00 user nova-compute[82479]: DEBUG nova.compute.manager [req-34fa293f-9904-447b-9368-eb3e113eb984 req-0dc46c8c-5bb6-4008-a9da-e72aef99c6ec service nova] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Received event network-vif-unplugged-43fb1710-4018-42d7-88ad-b5cb3970204a {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:07:00 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-34fa293f-9904-447b-9368-eb3e113eb984 req-0dc46c8c-5bb6-4008-a9da-e72aef99c6ec service nova] Acquiring lock "cae47769-02cd-4118-af46-0d3521ef7564-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:07:00 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-34fa293f-9904-447b-9368-eb3e113eb984 req-0dc46c8c-5bb6-4008-a9da-e72aef99c6ec service nova] Lock "cae47769-02cd-4118-af46-0d3521ef7564-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:07:00 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-34fa293f-9904-447b-9368-eb3e113eb984 req-0dc46c8c-5bb6-4008-a9da-e72aef99c6ec service nova] Lock "cae47769-02cd-4118-af46-0d3521ef7564-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:07:00 user nova-compute[82479]: DEBUG nova.compute.manager [req-34fa293f-9904-447b-9368-eb3e113eb984 req-0dc46c8c-5bb6-4008-a9da-e72aef99c6ec service nova] [instance: cae47769-02cd-4118-af46-0d3521ef7564] No waiting events found dispatching network-vif-unplugged-43fb1710-4018-42d7-88ad-b5cb3970204a {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:07:00 user nova-compute[82479]: DEBUG nova.compute.manager [req-34fa293f-9904-447b-9368-eb3e113eb984 req-0dc46c8c-5bb6-4008-a9da-e72aef99c6ec service nova] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Received event network-vif-unplugged-43fb1710-4018-42d7-88ad-b5cb3970204a for instance with task_state deleting. {{(pid=82479) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 00:07:00 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Instance destroyed successfully.
Apr 14 00:07:00 user nova-compute[82479]: DEBUG nova.objects.instance [None req-788cfd56-12db-4ecf-90a0-7498ba7cd919 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lazy-loading 'resources' on Instance uuid 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:07:00 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-788cfd56-12db-4ecf-90a0-7498ba7cd919 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:04:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-353632356',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-353632356',id=4,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHS95AsHXsHQ5WUo+qNFwgIJLlEtcpS8GwdztFmcvwprZsn2CsvfRn9jDCwGdOGL9HuU0oylsscRpNL9zF0nJQKzqNgC5UVyUERTxALD/prKFHPNrGlE0h48XNBp/faanQ==',key_name='tempest-keypair-138977160',keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:05:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='4f20caf676a64b9b97027f3fc9bc724c',ramdisk_id='',reservation_id='r-0ad3gf97',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1395403129',owner_user_name='tempest-AttachVolumeShelveTestJSON-1395403129-project-member',shelved_at='2023-04-14T00:06:59.307008',shelved_host='user',shelved_image_id='41e32c3a-9146-441b-a88f-b3319bc43f49'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T00:06:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f8b18d40ecd4b4e976cf2018af8220c',uuid=1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "1b166f8e-a207-48d3-a0a9-2ad6c44774b2", "address": "fa:16:3e:2b:d2:f7", "network": {"id": "66316d10-fed3-4fb9-877e-a01542ca5855", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-93456010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f20caf676a64b9b97027f3fc9bc724c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b166f8e-a2", "ovs_interfaceid": "1b166f8e-a207-48d3-a0a9-2ad6c44774b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 00:07:00 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-788cfd56-12db-4ecf-90a0-7498ba7cd919 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Converting VIF {"id": "1b166f8e-a207-48d3-a0a9-2ad6c44774b2", "address": "fa:16:3e:2b:d2:f7", "network": {"id": "66316d10-fed3-4fb9-877e-a01542ca5855", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-93456010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f20caf676a64b9b97027f3fc9bc724c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b166f8e-a2", "ovs_interfaceid": "1b166f8e-a207-48d3-a0a9-2ad6c44774b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:07:00 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-788cfd56-12db-4ecf-90a0-7498ba7cd919 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:d2:f7,bridge_name='br-int',has_traffic_filtering=True,id=1b166f8e-a207-48d3-a0a9-2ad6c44774b2,network=Network(66316d10-fed3-4fb9-877e-a01542ca5855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b166f8e-a2') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:07:00 user nova-compute[82479]: DEBUG os_vif [None req-788cfd56-12db-4ecf-90a0-7498ba7cd919 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:d2:f7,bridge_name='br-int',has_traffic_filtering=True,id=1b166f8e-a207-48d3-a0a9-2ad6c44774b2,network=Network(66316d10-fed3-4fb9-877e-a01542ca5855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b166f8e-a2') {{(pid=82479) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 00:07:00 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:00 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1b166f8e-a2, bridge=br-int, if_exists=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:07:00 user nova-compute[82479]: DEBUG nova.compute.manager [req-75d38841-29a8-4261-8e69-230cb5efd637 req-34e08250-987c-4517-89b8-48f5864b980e service nova] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Received event network-changed-1b166f8e-a207-48d3-a0a9-2ad6c44774b2 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:07:00 user nova-compute[82479]: DEBUG nova.compute.manager [req-75d38841-29a8-4261-8e69-230cb5efd637 req-34e08250-987c-4517-89b8-48f5864b980e service nova] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Refreshing instance network info cache due to event network-changed-1b166f8e-a207-48d3-a0a9-2ad6c44774b2. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:07:00 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-75d38841-29a8-4261-8e69-230cb5efd637 req-34e08250-987c-4517-89b8-48f5864b980e service nova] Acquiring lock "refresh_cache-1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:07:00 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-75d38841-29a8-4261-8e69-230cb5efd637 req-34e08250-987c-4517-89b8-48f5864b980e service nova] Acquired lock "refresh_cache-1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:07:00 user nova-compute[82479]: DEBUG nova.network.neutron [req-75d38841-29a8-4261-8e69-230cb5efd637 req-34e08250-987c-4517-89b8-48f5864b980e service nova] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Refreshing network info cache for port 1b166f8e-a207-48d3-a0a9-2ad6c44774b2 {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:07:00 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:00 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:07:00 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:00 user nova-compute[82479]: INFO os_vif [None req-788cfd56-12db-4ecf-90a0-7498ba7cd919 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:d2:f7,bridge_name='br-int',has_traffic_filtering=True,id=1b166f8e-a207-48d3-a0a9-2ad6c44774b2,network=Network(66316d10-fed3-4fb9-877e-a01542ca5855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b166f8e-a2')
Apr 14 00:07:00 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-788cfd56-12db-4ecf-90a0-7498ba7cd919 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Deleting instance files /opt/stack/data/nova/instances/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a_del
Apr 14 00:07:00 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-788cfd56-12db-4ecf-90a0-7498ba7cd919 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Deletion of /opt/stack/data/nova/instances/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a_del complete
Apr 14 00:07:00 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:07:00 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:07:00 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] No VIF found with MAC fa:16:3e:7b:38:3d, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:07:01 user nova-compute[82479]: INFO nova.scheduler.client.report [None req-788cfd56-12db-4ecf-90a0-7498ba7cd919 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Deleted allocations for instance 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a
Apr 14 00:07:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-788cfd56-12db-4ecf-90a0-7498ba7cd919 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:07:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-788cfd56-12db-4ecf-90a0-7498ba7cd919 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:07:01 user nova-compute[82479]: DEBUG nova.objects.instance [None req-788cfd56-12db-4ecf-90a0-7498ba7cd919 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lazy-loading 'numa_topology' on Instance uuid 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:07:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "01a65362-36ea-4817-8e83-f75d6daf808b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.939s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:07:01 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Instance destroyed successfully.
Apr 14 00:07:01 user nova-compute[82479]: DEBUG nova.objects.instance [None req-17a7504a-6118-4ec8-bf28-393ebe927145 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Lazy-loading 'resources' on Instance uuid cae47769-02cd-4118-af46-0d3521ef7564 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:07:01 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-17a7504a-6118-4ec8-bf28-393ebe927145 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:04:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1972873917',display_name='tempest-DeleteServersTestJSON-server-1972873917',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1972873917',id=1,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:05:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='834d867e665a4671a901218d21fa8704',ramdisk_id='',reservation_id='r-0jntl0mr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1615746799',owner_user_name='tempest-DeleteServersTestJSON-1615746799-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T00:05:15Z,user_data=None,user_id='457273b82bcb4fa6bbee81fdd9e0265c',uuid=cae47769-02cd-4118-af46-0d3521ef7564,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "43fb1710-4018-42d7-88ad-b5cb3970204a", "address": "fa:16:3e:92:89:19", "network": {"id": "598c3cc3-627d-4abe-beb6-93721d4334a1", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-214699134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "834d867e665a4671a901218d21fa8704", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43fb1710-40", "ovs_interfaceid": "43fb1710-4018-42d7-88ad-b5cb3970204a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 00:07:01 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-17a7504a-6118-4ec8-bf28-393ebe927145 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Converting VIF {"id": "43fb1710-4018-42d7-88ad-b5cb3970204a", "address": "fa:16:3e:92:89:19", "network": {"id": "598c3cc3-627d-4abe-beb6-93721d4334a1", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-214699134-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "834d867e665a4671a901218d21fa8704", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43fb1710-40", "ovs_interfaceid": "43fb1710-4018-42d7-88ad-b5cb3970204a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:07:01 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-17a7504a-6118-4ec8-bf28-393ebe927145 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:89:19,bridge_name='br-int',has_traffic_filtering=True,id=43fb1710-4018-42d7-88ad-b5cb3970204a,network=Network(598c3cc3-627d-4abe-beb6-93721d4334a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43fb1710-40') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:07:01 user nova-compute[82479]: DEBUG os_vif [None req-17a7504a-6118-4ec8-bf28-393ebe927145 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:89:19,bridge_name='br-int',has_traffic_filtering=True,id=43fb1710-4018-42d7-88ad-b5cb3970204a,network=Network(598c3cc3-627d-4abe-beb6-93721d4334a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43fb1710-40') {{(pid=82479) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 00:07:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap43fb1710-40, bridge=br-int, if_exists=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:07:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:07:01 user nova-compute[82479]: INFO os_vif [None req-17a7504a-6118-4ec8-bf28-393ebe927145 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:89:19,bridge_name='br-int',has_traffic_filtering=True,id=43fb1710-4018-42d7-88ad-b5cb3970204a,network=Network(598c3cc3-627d-4abe-beb6-93721d4334a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43fb1710-40')
Apr 14 00:07:01 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17a7504a-6118-4ec8-bf28-393ebe927145 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] [instance: cae47769-02cd-4118-af46-0d3521ef7564] calling os-brick to detach iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 00:07:01 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a7504a-6118-4ec8-bf28-393ebe927145 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, {'target_iqn': 'iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BRmkKrYn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:07:01 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-17a7504a-6118-4ec8-bf28-393ebe927145 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:07:01 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-17a7504a-6118-4ec8-bf28-393ebe927145 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:07:01 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-17a7504a-6118-4ec8-bf28-393ebe927145 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:07:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:01 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b82044d-a882-4581-aa2f-b12d28d39b0c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:01 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a7504a-6118-4ec8-bf28-393ebe927145 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 00:07:01 user nova-compute[82479]: No targets found.
Apr 14 00:07:01 user nova-compute[82479]: iSNS:
Apr 14 00:07:01 user nova-compute[82479]: No targets found.
Apr 14 00:07:01 user nova-compute[82479]: STATIC:
Apr 14 00:07:01 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7
Apr 14 00:07:01 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:07:01 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:07:01 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af
Apr 14 00:07:01 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:07:01 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:07:01 user nova-compute[82479]: FIRMWARE:
Apr 14 00:07:01 user nova-compute[82479]: No targets found.
Apr 14 00:07:01 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:07:01 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a7504a-6118-4ec8-bf28-393ebe927145 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 00:07:01 user nova-compute[82479]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 00:07:01 user nova-compute[82479]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82479) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 00:07:01 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a7504a-6118-4ec8-bf28-393ebe927145 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af', 0)] {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 00:07:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:01 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3790eb6-f140-443e-9961-42578cb97d8c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:01 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b5136f-84d7-4364-9c31-4f0cd027e12c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:01 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a7504a-6118-4ec8-bf28-393ebe927145 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af (non-flash)
Apr 14 00:07:01 user nova-compute[82479]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:07:01 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:07:01 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a7504a-6118-4ec8-bf28-393ebe927145 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af (non-flash)
Apr 14 00:07:01 user nova-compute[82479]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:07:01 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:07:01 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a7504a-6118-4ec8-bf28-393ebe927145 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3338219fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af'): ({'sdb'}, set())}) {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 00:07:01 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-17a7504a-6118-4ec8-bf28-393ebe927145 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Removing single pathed devices sdb {{(pid=82479) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 00:07:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:01 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a9d37b-0ddc-416c-87c5-399063d733f8]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:01 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[f18888d3-366e-4d2b-b23a-a80aeae62a48]: (4, ('ok\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:01 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-17a7504a-6118-4ec8-bf28-393ebe927145 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Flushing IO for device /dev/sdb {{(pid=82479) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 00:07:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:01 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-788cfd56-12db-4ecf-90a0-7498ba7cd919 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:07:01 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[098df72a-55a2-4d29-ad2d-9c994758c5e4]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:01 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-17a7504a-6118-4ec8-bf28-393ebe927145 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82479) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 00:07:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:01 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-788cfd56-12db-4ecf-90a0-7498ba7cd919 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:07:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:01 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[783204f5-c8f1-44ae-843d-58cc9eb5cf5a]: (4, ('1', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:01 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-17a7504a-6118-4ec8-bf28-393ebe927145 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 00:07:01 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-17a7504a-6118-4ec8-bf28-393ebe927145 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] SCSI volumes sdb have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 00:07:01 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a7504a-6118-4ec8-bf28-393ebe927145 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af')] {{(pid=82479) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 00:07:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-788cfd56-12db-4ecf-90a0-7498ba7cd919 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.398s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:07:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:01 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a7748d0-3445-4bf3-9c37-91755ed394b0]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:01 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a7504a-6118-4ec8-bf28-393ebe927145 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:07:01 user nova-compute[82479]: DEBUG nova.network.neutron [req-75d38841-29a8-4261-8e69-230cb5efd637 req-34e08250-987c-4517-89b8-48f5864b980e service nova] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Updated VIF entry in instance network info cache for port 1b166f8e-a207-48d3-a0a9-2ad6c44774b2. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:07:01 user nova-compute[82479]: DEBUG nova.network.neutron [req-75d38841-29a8-4261-8e69-230cb5efd637 req-34e08250-987c-4517-89b8-48f5864b980e service nova] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Updating instance_info_cache with network_info: [{"id": "1b166f8e-a207-48d3-a0a9-2ad6c44774b2", "address": "fa:16:3e:2b:d2:f7", "network": {"id": "66316d10-fed3-4fb9-877e-a01542ca5855", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-93456010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f20caf676a64b9b97027f3fc9bc724c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap1b166f8e-a2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:07:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af -p 172.16.0.220:3260 --logout {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-75d38841-29a8-4261-8e69-230cb5efd637 req-34e08250-987c-4517-89b8-48f5864b980e service nova] Releasing lock "refresh_cache-1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:07:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-788cfd56-12db-4ecf-90a0-7498ba7cd919 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.340s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:07:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:01 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5d0b9c-6ac8-4f14-b955-16b0b8c6b8b8]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:01 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a7504a-6118-4ec8-bf28-393ebe927145 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af, portal: 172.16.0.220,3260]
Apr 14 00:07:01 user nova-compute[82479]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af, portal: 172.16.0.220,3260] successful.
Apr 14 00:07:01 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:07:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af -p 172.16.0.220:3260 --op delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:01 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15ab9f3-61d3-450c-80c4-ee837e5245d1]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:01 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a7504a-6118-4ec8-bf28-393ebe927145 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:07:01 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-17a7504a-6118-4ec8-bf28-393ebe927145 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:07:01 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a7504a-6118-4ec8-bf28-393ebe927145 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] <== disconnect_volume: return (328ms) None {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:07:01 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17a7504a-6118-4ec8-bf28-393ebe927145 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Disconnected iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 00:07:01 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-17a7504a-6118-4ec8-bf28-393ebe927145 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Deleting instance files /opt/stack/data/nova/instances/cae47769-02cd-4118-af46-0d3521ef7564_del
Apr 14 00:07:01 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-17a7504a-6118-4ec8-bf28-393ebe927145 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Deletion of /opt/stack/data/nova/instances/cae47769-02cd-4118-af46-0d3521ef7564_del complete
Apr 14 00:07:01 user nova-compute[82479]: INFO nova.compute.manager [None req-17a7504a-6118-4ec8-bf28-393ebe927145 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Took 1.39 seconds to destroy the instance on the hypervisor.
Apr 14 00:07:01 user nova-compute[82479]: DEBUG oslo.service.loopingcall [None req-17a7504a-6118-4ec8-bf28-393ebe927145 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82479) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 00:07:01 user nova-compute[82479]: DEBUG nova.compute.manager [-] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Deallocating network for instance {{(pid=82479) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 00:07:01 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: cae47769-02cd-4118-af46-0d3521ef7564] deallocate_for_instance() {{(pid=82479) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 00:07:02 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-9c707ab0-e24d-443d-b38e-619a38bf0d99 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "01a65362-36ea-4817-8e83-f75d6daf808b" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:07:02 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-9c707ab0-e24d-443d-b38e-619a38bf0d99 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "01a65362-36ea-4817-8e83-f75d6daf808b" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:07:02 user nova-compute[82479]: DEBUG nova.compute.manager [None req-9c707ab0-e24d-443d-b38e-619a38bf0d99 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:07:02 user nova-compute[82479]: DEBUG nova.compute.manager [None req-9c707ab0-e24d-443d-b38e-619a38bf0d99 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=82479) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3323}}
Apr 14 00:07:02 user nova-compute[82479]: DEBUG nova.objects.instance [None req-9c707ab0-e24d-443d-b38e-619a38bf0d99 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lazy-loading 'flavor' on Instance uuid 01a65362-36ea-4817-8e83-f75d6daf808b {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:07:02 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:02 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:02 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:02 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:02 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:02 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Updating instance_info_cache with network_info: [] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:07:02 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Took 0.75 seconds to deallocate network for instance.
Apr 14 00:07:02 user nova-compute[82479]: DEBUG nova.compute.manager [req-6bc976e7-63c5-4fc4-8d34-06f40373c6c4 req-4f0037c4-87c3-453f-8079-a716f367d3b3 service nova] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Received event network-vif-plugged-43fb1710-4018-42d7-88ad-b5cb3970204a {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:07:02 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-6bc976e7-63c5-4fc4-8d34-06f40373c6c4 req-4f0037c4-87c3-453f-8079-a716f367d3b3 service nova] Acquiring lock "cae47769-02cd-4118-af46-0d3521ef7564-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:07:02 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-6bc976e7-63c5-4fc4-8d34-06f40373c6c4 req-4f0037c4-87c3-453f-8079-a716f367d3b3 service nova] Lock "cae47769-02cd-4118-af46-0d3521ef7564-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:07:02 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-6bc976e7-63c5-4fc4-8d34-06f40373c6c4 req-4f0037c4-87c3-453f-8079-a716f367d3b3 service nova] Lock "cae47769-02cd-4118-af46-0d3521ef7564-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:07:02 user nova-compute[82479]: DEBUG nova.compute.manager [req-6bc976e7-63c5-4fc4-8d34-06f40373c6c4 req-4f0037c4-87c3-453f-8079-a716f367d3b3 service nova] [instance: cae47769-02cd-4118-af46-0d3521ef7564] No waiting events found dispatching network-vif-plugged-43fb1710-4018-42d7-88ad-b5cb3970204a {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:07:02 user nova-compute[82479]: WARNING nova.compute.manager [req-6bc976e7-63c5-4fc4-8d34-06f40373c6c4 req-4f0037c4-87c3-453f-8079-a716f367d3b3 service nova] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Received unexpected event network-vif-plugged-43fb1710-4018-42d7-88ad-b5cb3970204a for instance with vm_state active and task_state deleting.
Apr 14 00:07:02 user nova-compute[82479]: DEBUG nova.compute.manager [req-99f029c4-b63c-42f7-a6b7-414b82463b1d req-f4ed2527-a607-4a0c-8074-6846d682c291 service nova] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Received event network-vif-deleted-43fb1710-4018-42d7-88ad-b5cb3970204a {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:07:02 user nova-compute[82479]: DEBUG nova.compute.manager [req-99f029c4-b63c-42f7-a6b7-414b82463b1d req-f4ed2527-a607-4a0c-8074-6846d682c291 service nova] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Received event network-vif-unplugged-b5dfa187-0a42-4319-990f-1d3b22691c27 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:07:02 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-99f029c4-b63c-42f7-a6b7-414b82463b1d req-f4ed2527-a607-4a0c-8074-6846d682c291 service nova] Acquiring lock "01a65362-36ea-4817-8e83-f75d6daf808b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:07:02 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-99f029c4-b63c-42f7-a6b7-414b82463b1d req-f4ed2527-a607-4a0c-8074-6846d682c291 service nova] Lock "01a65362-36ea-4817-8e83-f75d6daf808b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:07:02 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-99f029c4-b63c-42f7-a6b7-414b82463b1d req-f4ed2527-a607-4a0c-8074-6846d682c291 service nova] Lock "01a65362-36ea-4817-8e83-f75d6daf808b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:07:02 user nova-compute[82479]: DEBUG nova.compute.manager [req-99f029c4-b63c-42f7-a6b7-414b82463b1d req-f4ed2527-a607-4a0c-8074-6846d682c291 service nova] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] No waiting events found dispatching network-vif-unplugged-b5dfa187-0a42-4319-990f-1d3b22691c27 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:07:02 user nova-compute[82479]: WARNING nova.compute.manager [req-99f029c4-b63c-42f7-a6b7-414b82463b1d req-f4ed2527-a607-4a0c-8074-6846d682c291 service nova] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Received unexpected event network-vif-unplugged-b5dfa187-0a42-4319-990f-1d3b22691c27 for instance with vm_state active and task_state powering-off.
Apr 14 00:07:02 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Instance destroyed successfully.
Apr 14 00:07:02 user nova-compute[82479]: DEBUG nova.compute.manager [None req-9c707ab0-e24d-443d-b38e-619a38bf0d99 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:07:03 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-9c707ab0-e24d-443d-b38e-619a38bf0d99 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "01a65362-36ea-4817-8e83-f75d6daf808b" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.929s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:07:03 user nova-compute[82479]: INFO nova.compute.manager [None req-17a7504a-6118-4ec8-bf28-393ebe927145 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Took 0.83 seconds to detach 1 volumes for instance.
Apr 14 00:07:03 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-17a7504a-6118-4ec8-bf28-393ebe927145 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:07:03 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-17a7504a-6118-4ec8-bf28-393ebe927145 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:07:03 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-17a7504a-6118-4ec8-bf28-393ebe927145 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:07:03 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-17a7504a-6118-4ec8-bf28-393ebe927145 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:07:03 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-17a7504a-6118-4ec8-bf28-393ebe927145 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.313s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:07:03 user nova-compute[82479]: INFO nova.scheduler.client.report [None req-17a7504a-6118-4ec8-bf28-393ebe927145 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Deleted allocations for instance cae47769-02cd-4118-af46-0d3521ef7564
Apr 14 00:07:03 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-17a7504a-6118-4ec8-bf28-393ebe927145 tempest-DeleteServersTestJSON-1615746799 tempest-DeleteServersTestJSON-1615746799-project-member] Lock "cae47769-02cd-4118-af46-0d3521ef7564" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.485s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:07:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:04 user nova-compute[82479]: DEBUG nova.compute.manager [req-c5d0822a-efe8-4939-aad9-99e5f8591032 req-b44a80a2-1bb4-4875-9c89-7fb289a77fc2 service nova] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Received event network-vif-plugged-b5dfa187-0a42-4319-990f-1d3b22691c27 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:07:04 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-c5d0822a-efe8-4939-aad9-99e5f8591032 req-b44a80a2-1bb4-4875-9c89-7fb289a77fc2 service nova] Acquiring lock "01a65362-36ea-4817-8e83-f75d6daf808b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:07:04 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-c5d0822a-efe8-4939-aad9-99e5f8591032 req-b44a80a2-1bb4-4875-9c89-7fb289a77fc2 service nova] Lock "01a65362-36ea-4817-8e83-f75d6daf808b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:07:04 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-c5d0822a-efe8-4939-aad9-99e5f8591032 req-b44a80a2-1bb4-4875-9c89-7fb289a77fc2 service nova] Lock "01a65362-36ea-4817-8e83-f75d6daf808b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:07:04 user nova-compute[82479]: DEBUG nova.compute.manager [req-c5d0822a-efe8-4939-aad9-99e5f8591032 req-b44a80a2-1bb4-4875-9c89-7fb289a77fc2 service nova] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] No waiting events found dispatching network-vif-plugged-b5dfa187-0a42-4319-990f-1d3b22691c27 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:07:04 user nova-compute[82479]: WARNING nova.compute.manager [req-c5d0822a-efe8-4939-aad9-99e5f8591032 req-b44a80a2-1bb4-4875-9c89-7fb289a77fc2 service nova] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Received unexpected event network-vif-plugged-b5dfa187-0a42-4319-990f-1d3b22691c27 for instance with vm_state stopped and task_state None.
Apr 14 00:07:05 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:06 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:07 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:10 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:11 user nova-compute[82479]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681430816.0227184, 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a => Stopped> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:07:11 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] VM Stopped (Lifecycle Event)
Apr 14 00:07:11 user nova-compute[82479]: DEBUG nova.compute.manager [None req-faf7f588-0e28-47ee-80de-3c8ab8716f8b None None] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:07:11 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:13 user nova-compute[82479]: DEBUG nova.compute.manager [req-8a09a4b5-9aea-4357-b22e-dcdf7adaa0d6 req-5f13c9e7-1dcd-4cb7-87d1-9e549ac62790 service nova] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Received event network-changed-28d36b9c-c7e0-4d50-bcf8-afa67f29246d {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:07:13 user nova-compute[82479]: DEBUG nova.compute.manager [req-8a09a4b5-9aea-4357-b22e-dcdf7adaa0d6 req-5f13c9e7-1dcd-4cb7-87d1-9e549ac62790 service nova] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Refreshing instance network info cache due to event network-changed-28d36b9c-c7e0-4d50-bcf8-afa67f29246d. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:07:13 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-8a09a4b5-9aea-4357-b22e-dcdf7adaa0d6 req-5f13c9e7-1dcd-4cb7-87d1-9e549ac62790 service nova] Acquiring lock "refresh_cache-e97abae3-f573-48eb-a218-a8fec436ef3b" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:07:13 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-8a09a4b5-9aea-4357-b22e-dcdf7adaa0d6 req-5f13c9e7-1dcd-4cb7-87d1-9e549ac62790 service nova] Acquired lock "refresh_cache-e97abae3-f573-48eb-a218-a8fec436ef3b" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:07:13 user nova-compute[82479]: DEBUG nova.network.neutron [req-8a09a4b5-9aea-4357-b22e-dcdf7adaa0d6 req-5f13c9e7-1dcd-4cb7-87d1-9e549ac62790 service nova] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Refreshing network info cache for port 28d36b9c-c7e0-4d50-bcf8-afa67f29246d {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:07:14 user nova-compute[82479]: DEBUG nova.network.neutron [req-8a09a4b5-9aea-4357-b22e-dcdf7adaa0d6 req-5f13c9e7-1dcd-4cb7-87d1-9e549ac62790 service nova] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Updated VIF entry in instance network info cache for port 28d36b9c-c7e0-4d50-bcf8-afa67f29246d. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:07:14 user nova-compute[82479]: DEBUG nova.network.neutron [req-8a09a4b5-9aea-4357-b22e-dcdf7adaa0d6 req-5f13c9e7-1dcd-4cb7-87d1-9e549ac62790 service nova] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Updating instance_info_cache with network_info: [{"id": "28d36b9c-c7e0-4d50-bcf8-afa67f29246d", "address": "fa:16:3e:d8:66:9d", "network": {"id": "4167bd9a-4666-4e4b-8b36-eea1ff220878", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1393009469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccde4d67c2ed45af968e5f219cc8b6c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28d36b9c-c7", "ovs_interfaceid": "28d36b9c-c7e0-4d50-bcf8-afa67f29246d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:07:14 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-8a09a4b5-9aea-4357-b22e-dcdf7adaa0d6 req-5f13c9e7-1dcd-4cb7-87d1-9e549ac62790 service nova] Releasing lock "refresh_cache-e97abae3-f573-48eb-a218-a8fec436ef3b" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:07:14 user nova-compute[82479]: DEBUG nova.compute.manager [req-8d5d7945-1dfc-45db-b8cc-7ef1babb69f0 req-758af7d7-63c4-4660-9749-2efec2e3c9a8 service nova] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Received event network-changed-e8376395-8a3e-46bf-a137-3e740e4e70ef {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:07:14 user nova-compute[82479]: DEBUG nova.compute.manager [req-8d5d7945-1dfc-45db-b8cc-7ef1babb69f0 req-758af7d7-63c4-4660-9749-2efec2e3c9a8 service nova] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Refreshing instance network info cache due to event network-changed-e8376395-8a3e-46bf-a137-3e740e4e70ef. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:07:14 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-8d5d7945-1dfc-45db-b8cc-7ef1babb69f0 req-758af7d7-63c4-4660-9749-2efec2e3c9a8 service nova] Acquiring lock "refresh_cache-716b5e3f-20c7-40ef-9a45-71be0cfeaeb2" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:07:14 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-8d5d7945-1dfc-45db-b8cc-7ef1babb69f0 req-758af7d7-63c4-4660-9749-2efec2e3c9a8 service nova] Acquired lock "refresh_cache-716b5e3f-20c7-40ef-9a45-71be0cfeaeb2" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:07:14 user nova-compute[82479]: DEBUG nova.network.neutron [req-8d5d7945-1dfc-45db-b8cc-7ef1babb69f0 req-758af7d7-63c4-4660-9749-2efec2e3c9a8 service nova] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Refreshing network info cache for port e8376395-8a3e-46bf-a137-3e740e4e70ef {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:07:14 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-6cc42e96-529e-445f-9410-16d761a7d8ef tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Acquiring lock "716b5e3f-20c7-40ef-9a45-71be0cfeaeb2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:07:14 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-6cc42e96-529e-445f-9410-16d761a7d8ef tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "716b5e3f-20c7-40ef-9a45-71be0cfeaeb2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:07:14 user nova-compute[82479]: DEBUG nova.objects.instance [None req-6cc42e96-529e-445f-9410-16d761a7d8ef tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lazy-loading 'flavor' on Instance uuid 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:07:14 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-6cc42e96-529e-445f-9410-16d761a7d8ef tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "716b5e3f-20c7-40ef-9a45-71be0cfeaeb2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.090s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:07:15 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-6cc42e96-529e-445f-9410-16d761a7d8ef tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Acquiring lock "716b5e3f-20c7-40ef-9a45-71be0cfeaeb2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:07:15 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-6cc42e96-529e-445f-9410-16d761a7d8ef tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "716b5e3f-20c7-40ef-9a45-71be0cfeaeb2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:07:15 user nova-compute[82479]: INFO nova.compute.manager [None req-6cc42e96-529e-445f-9410-16d761a7d8ef tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Attaching volume c7267b8e-f20c-4625-b82d-b1a31a337714 to /dev/vdb
Apr 14 00:07:15 user nova-compute[82479]: DEBUG nova.network.neutron [req-8d5d7945-1dfc-45db-b8cc-7ef1babb69f0 req-758af7d7-63c4-4660-9749-2efec2e3c9a8 service nova] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Updated VIF entry in instance network info cache for port e8376395-8a3e-46bf-a137-3e740e4e70ef. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:07:15 user nova-compute[82479]: DEBUG nova.network.neutron [req-8d5d7945-1dfc-45db-b8cc-7ef1babb69f0 req-758af7d7-63c4-4660-9749-2efec2e3c9a8 service nova] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Updating instance_info_cache with network_info: [{"id": "e8376395-8a3e-46bf-a137-3e740e4e70ef", "address": "fa:16:3e:1f:f1:73", "network": {"id": "e63d7eb1-1787-415b-bfd6-963171b3a18f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2097939022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "293aba050c0e458a9d05bcbca5b49997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8376395-8a", "ovs_interfaceid": "e8376395-8a3e-46bf-a137-3e740e4e70ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:07:15 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-8d5d7945-1dfc-45db-b8cc-7ef1babb69f0 req-758af7d7-63c4-4660-9749-2efec2e3c9a8 service nova] Releasing lock "refresh_cache-716b5e3f-20c7-40ef-9a45-71be0cfeaeb2" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:07:15 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Acquiring lock "e97abae3-f573-48eb-a218-a8fec436ef3b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:07:15 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "e97abae3-f573-48eb-a218-a8fec436ef3b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:07:15 user nova-compute[82479]: DEBUG nova.objects.instance [None req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lazy-loading 'flavor' on Instance uuid e97abae3-f573-48eb-a218-a8fec436ef3b {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:07:15 user nova-compute[82479]: DEBUG os_brick.utils [None req-6cc42e96-529e-445f-9410-16d761a7d8ef tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:07:15 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:15 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "e97abae3-f573-48eb-a218-a8fec436ef3b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.082s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:07:15 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:15 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[a603ea10-43d1-48a9-a739-8622eea6a49c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fec92fcfdd3\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:15 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:15 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:15 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3bfc73-405f-40d6-afd6-986655c6aade]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:15 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:15 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:15 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d0d7467-f1ea-4f71-b61e-731e4190704e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:15 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77f14b8-6e2c-4fb1-9582-05b343d3b23f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:15 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-6cc42e96-529e-445f-9410-16d761a7d8ef tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Running cmd (subprocess): nvme version {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:15 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-6cc42e96-529e-445f-9410-16d761a7d8ef tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] 'nvme version' failed. Not Retrying. {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:07:15 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6cc42e96-529e-445f-9410-16d761a7d8ef tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] nvme not present on system {{(pid=82479) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 00:07:15 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:15 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:07:15 user nova-compute[82479]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 00:07:15 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b31355-c74e-41e3-a8b8-f3f15d10d333]: (4, '') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:15 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-6cc42e96-529e-445f-9410-16d761a7d8ef tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82479) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 00:07:15 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-6cc42e96-529e-445f-9410-16d761a7d8ef tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 00:07:15 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-6cc42e96-529e-445f-9410-16d761a7d8ef tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] LIGHTOS: no hostnqn found. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 00:07:15 user nova-compute[82479]: DEBUG os_brick.utils [None req-6cc42e96-529e-445f-9410-16d761a7d8ef tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fec92fcfdd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:07:15 user nova-compute[82479]: DEBUG nova.virt.block_device [None req-6cc42e96-529e-445f-9410-16d761a7d8ef tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Updating existing volume attachment record: d6d7170d-c0b7-44c2-8d8d-e660dfce2da1 {{(pid=82479) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 00:07:15 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:15 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Acquiring lock "e97abae3-f573-48eb-a218-a8fec436ef3b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:07:15 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "e97abae3-f573-48eb-a218-a8fec436ef3b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:07:15 user nova-compute[82479]: INFO nova.compute.manager [None req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Attaching volume 0c69fa38-1485-41bd-922c-993c12dc3b53 to /dev/sdc
Apr 14 00:07:15 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:15 user nova-compute[82479]: DEBUG os_brick.utils [None req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:07:15 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:15 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:15 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[57af2b73-cae6-485b-9538-2e5d33a9e061]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fec92fcfdd3\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:15 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:15 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:15 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe314923-8ed1-4a90-82cf-600df11417d0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:15 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:15 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:15 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dba54ad-1370-433a-8593-0a166e7a002e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:15 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7ca470-10b6-42f4-9beb-b80a72e6c706]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:15 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Running cmd (subprocess): nvme version {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:15 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] 'nvme version' failed. Not Retrying. {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:07:15 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] nvme not present on system {{(pid=82479) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 00:07:15 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:15 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:07:15 user nova-compute[82479]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 00:07:15 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96f704a-ebfc-43f5-af12-99d8cd5b77e2]: (4, '') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:15 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82479) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 00:07:15 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 00:07:15 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] LIGHTOS: no hostnqn found. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 00:07:15 user nova-compute[82479]: DEBUG os_brick.utils [None req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fec92fcfdd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:07:15 user nova-compute[82479]: DEBUG nova.virt.block_device [None req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Updating existing volume attachment record: 4b3e18ed-6891-4d28-847a-0a42d48f6fce {{(pid=82479) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 00:07:16 user nova-compute[82479]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681430821.1980076, cae47769-02cd-4118-af46-0d3521ef7564 => Stopped> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:07:16 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: cae47769-02cd-4118-af46-0d3521ef7564] VM Stopped (Lifecycle Event)
Apr 14 00:07:16 user nova-compute[82479]: DEBUG nova.compute.manager [None req-fc9efde0-f4ce-45e7-95bc-e624a50c1f3d None None] [instance: cae47769-02cd-4118-af46-0d3521ef7564] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:07:16 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:17 user nova-compute[82479]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681430822.9919448, 01a65362-36ea-4817-8e83-f75d6daf808b => Stopped> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:07:17 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] VM Stopped (Lifecycle Event)
Apr 14 00:07:18 user nova-compute[82479]: DEBUG nova.compute.manager [None req-ea37ca2a-131d-4bde-a2c0-1cc57e2d4122 None None] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:07:18 user nova-compute[82479]: DEBUG nova.compute.manager [None req-ea37ca2a-131d-4bde-a2c0-1cc57e2d4122 None None] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:07:18 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:20 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cc42e96-529e-445f-9410-16d761a7d8ef tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Calling os-brick to attach iSCSI Volume {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 00:07:20 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc42e96-529e-445f-9410-16d761a7d8ef tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xEjqaYiH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:07:20 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-6cc42e96-529e-445f-9410-16d761a7d8ef tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:07:20 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-6cc42e96-529e-445f-9410-16d761a7d8ef tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:07:20 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-6cc42e96-529e-445f-9410-16d761a7d8ef tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:07:20 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-6cc42e96-529e-445f-9410-16d761a7d8ef tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:07:20 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-6cc42e96-529e-445f-9410-16d761a7d8ef tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:07:20 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-6cc42e96-529e-445f-9410-16d761a7d8ef tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:07:20 user nova-compute[82479]: INFO os_brick.initiator.connectors.iscsi [None req-6cc42e96-529e-445f-9410-16d761a7d8ef tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 00:07:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 -p 172.16.0.220:3260 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:20 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af26abd-3d0c-409d-86a6-92d556627a65]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:20 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc42e96-529e-445f-9410-16d761a7d8ef tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 00:07:20 user nova-compute[82479]:  {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:07:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 -p 172.16.0.220:3260 --interface default --op new {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:20 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[0907f347-cdc7-41ad-9295-7b7792c79533]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714] added\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:20 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc42e96-529e-445f-9410-16d761a7d8ef tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714] added
Apr 14 00:07:20 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:07:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:20 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[2265db41-7436-4c24-b4a0-338371ea8e32]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:20 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc42e96-529e-445f-9410-16d761a7d8ef tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:07:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:20 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2865a0-0afd-4d00-83c3-e8e2b91e8382]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:20 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc42e96-529e-445f-9410-16d761a7d8ef tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:07:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xEjqaYiH {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xEjqaYiH" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:20 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f014f89-d814-4b4d-bc2f-42784c57bd8f]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:20 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc42e96-529e-445f-9410-16d761a7d8ef tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xEjqaYiH'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:07:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:20 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dad010f-7290-4408-a7ae-360c3acfcab3]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:20 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc42e96-529e-445f-9410-16d761a7d8ef tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:07:20 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Calling os-brick to attach iSCSI Volume {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 00:07:20 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zaiQnIop', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:07:20 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:07:20 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:07:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:20 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d65f10-b9e1-41a5-b6e0-d12cd1711d0c]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:20 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc42e96-529e-445f-9410-16d761a7d8ef tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:07:20 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:07:20 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc42e96-529e-445f-9410-16d761a7d8ef tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:07:20 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:07:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 -p 172.16.0.220:3260 --login {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:20 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[d337eb91-94e9-4f3f-b125-de034ec72a84]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:20 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc42e96-529e-445f-9410-16d761a7d8ef tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714, portal: 172.16.0.220,3260]
Apr 14 00:07:20 user nova-compute[82479]: Login to [iface: default, target: iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714, portal: 172.16.0.220,3260] successful.
Apr 14 00:07:20 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:07:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:20 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[5087fe30-c85b-4280-9485-fe1aa067333b]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:20 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc42e96-529e-445f-9410-16d761a7d8ef tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:07:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:20 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb33e7ee-601a-428b-9b5b-c8c75ea72e4e]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:20 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc42e96-529e-445f-9410-16d761a7d8ef tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:07:20 user nova-compute[82479]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 (non-flash)
Apr 14 00:07:20 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:07:20 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc42e96-529e-445f-9410-16d761a7d8ef tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:07:20 user nova-compute[82479]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 (non-flash)
Apr 14 00:07:20 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:07:20 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-6cc42e96-529e-445f-9410-16d761a7d8ef tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:07:20 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc42e96-529e-445f-9410-16d761a7d8ef tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Connected to 172.16.0.220:3260 {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 00:07:20 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-6cc42e96-529e-445f-9410-16d761a7d8ef tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] HCTL ('33', '-', '-', 0) found on session 4 with lun 0 {{(pid=82479) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 00:07:20 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-6cc42e96-529e-445f-9410-16d761a7d8ef tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82479) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 00:07:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:20 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.025s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:20 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[516dd482-d498-47be-bb2a-ce05e5415ddf]: (4, ('- - 0', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:20 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-6cc42e96-529e-445f-9410-16d761a7d8ef tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Searching for a device in session 4 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82479) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 00:07:20 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc42e96-529e-445f-9410-16d761a7d8ef tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xEjqaYiH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 00:07:21 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:21 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-6cc42e96-529e-445f-9410-16d761a7d8ef tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.705s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:07:21 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc42e96-529e-445f-9410-16d761a7d8ef tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] <== connect_volume: return (1707ms) {'type': 'block', 'scsi_wwn': '23633343366346163', 'path': '/dev/sdb'} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:07:21 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cc42e96-529e-445f-9410-16d761a7d8ef tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23633343366346163', 'path': '/dev/sdb'} {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 00:07:21 user nova-compute[82479]: DEBUG nova.compute.manager [req-8c3abf53-b5a4-4666-a2b4-7aebc357dda0 req-fa9d2558-8831-44c8-ba99-becb97c8a4b6 service nova] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Received event network-changed-dc4fb8de-0fc3-4af8-86d0-94c357627f5f {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:07:21 user nova-compute[82479]: DEBUG nova.compute.manager [req-8c3abf53-b5a4-4666-a2b4-7aebc357dda0 req-fa9d2558-8831-44c8-ba99-becb97c8a4b6 service nova] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Refreshing instance network info cache due to event network-changed-dc4fb8de-0fc3-4af8-86d0-94c357627f5f. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:07:21 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-8c3abf53-b5a4-4666-a2b4-7aebc357dda0 req-fa9d2558-8831-44c8-ba99-becb97c8a4b6 service nova] Acquiring lock "refresh_cache-b9c6323b-ed7f-4f86-93ad-3ef4726b01ff" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:07:21 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-8c3abf53-b5a4-4666-a2b4-7aebc357dda0 req-fa9d2558-8831-44c8-ba99-becb97c8a4b6 service nova] Acquired lock "refresh_cache-b9c6323b-ed7f-4f86-93ad-3ef4726b01ff" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:07:21 user nova-compute[82479]: DEBUG nova.network.neutron [req-8c3abf53-b5a4-4666-a2b4-7aebc357dda0 req-fa9d2558-8831-44c8-ba99-becb97c8a4b6 service nova] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Refreshing network info cache for port dc4fb8de-0fc3-4af8-86d0-94c357627f5f {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:07:21 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.554s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:07:21 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:07:21 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:07:21 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:07:21 user nova-compute[82479]: INFO os_brick.initiator.connectors.iscsi [None req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 00:07:21 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "e3fba4ee-4aae-4ee3-8114-b53510f5442c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:07:21 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "e3fba4ee-4aae-4ee3-8114-b53510f5442c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:07:21 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53 -p 172.16.0.220:3260 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:21 user nova-compute[82479]: DEBUG nova.objects.instance [None req-6cc42e96-529e-445f-9410-16d761a7d8ef tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lazy-loading 'flavor' on Instance uuid 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:07:21 user nova-compute[82479]: DEBUG nova.compute.manager [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Starting instance... {{(pid=82479) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 00:07:21 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53 -p 172.16.0.220:3260" returned: 21 in 0.033s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:21 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[3333b6e6-afb5-4b19-a694-efb5a6a69136]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:21 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 00:07:21 user nova-compute[82479]:  {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:07:21 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-6cc42e96-529e-445f-9410-16d761a7d8ef tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 00:07:21 user nova-compute[82479]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:07:21 user nova-compute[82479]:   <source dev="/dev/sdb"/>
Apr 14 00:07:21 user nova-compute[82479]:   <target dev="vdb" bus="virtio"/>
Apr 14 00:07:21 user nova-compute[82479]:   <serial>c7267b8e-f20c-4625-b82d-b1a31a337714</serial>
Apr 14 00:07:21 user nova-compute[82479]: </disk>
Apr 14 00:07:21 user nova-compute[82479]:  {{(pid=82479) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 00:07:21 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53 -p 172.16.0.220:3260 --interface default --op new {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[613fc6ff-2d2f-40df-aab7-7ae0df233dce]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53] added\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53] added
Apr 14 00:07:22 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f7cb8cbb-8c70-4374-95e3-ae32995ec0cf tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Acquiring lock "interface-b9c6323b-ed7f-4f86-93ad-3ef4726b01ff-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f7cb8cbb-8c70-4374-95e3-ae32995ec0cf tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "interface-b9c6323b-ed7f-4f86-93ad-3ef4726b01ff-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG nova.objects.instance [None req-f7cb8cbb-8c70-4374-95e3-ae32995ec0cf tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lazy-loading 'flavor' on Instance uuid b9c6323b-ed7f-4f86-93ad-3ef4726b01ff {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.035s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b45152-0115-450c-826c-0f06d8c74163]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[40dc5bd2-3790-4ad0-9e82-f909a3481419]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zaiQnIop {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82479) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 00:07:22 user nova-compute[82479]: INFO nova.compute.claims [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Claim successful on node user
Apr 14 00:07:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zaiQnIop" returned: 0 in 0.024s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f944d9-2ddf-4d1a-8090-779c5dd4633a]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zaiQnIop'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace9392d-bb1d-4791-a9c0-4d8ad3b7fba2]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[e254af60-3ec7-41cf-9bd2-ee5755983fa7]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:07:22 user nova-compute[82479]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 (non-flash)
Apr 14 00:07:22 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:07:22 user nova-compute[82479]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 (non-flash)
Apr 14 00:07:22 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53 -p 172.16.0.220:3260 --login {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b1f70a-fa90-425f-a590-288f6a40a034]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53, portal: 172.16.0.220,3260]
Apr 14 00:07:22 user nova-compute[82479]: Login to [iface: default, target: iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53, portal: 172.16.0.220,3260] successful.
Apr 14 00:07:22 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[56aab241-e456-4747-b07c-414bef584d7d]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[172aa402-c183-4783-986a-846ec7f8db47]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:07:22 user nova-compute[82479]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 (non-flash)
Apr 14 00:07:22 user nova-compute[82479]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53 (non-flash)
Apr 14 00:07:22 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:07:22 user nova-compute[82479]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 (non-flash)
Apr 14 00:07:22 user nova-compute[82479]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53 (non-flash)
Apr 14 00:07:22 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.364s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Connected to 172.16.0.220:3260 {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] HCTL ('35', '-', '-', 0) found on session 5 with lun 0 {{(pid=82479) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=82479) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ba0dd9-4a8c-49bd-a411-dea778ae2a8e]: (4, ('- - 0', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Searching for a device in session 5 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=82479) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zaiQnIop', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG nova.objects.instance [None req-f7cb8cbb-8c70-4374-95e3-ae32995ec0cf tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lazy-loading 'pci_requests' on Instance uuid b9c6323b-ed7f-4f86-93ad-3ef4726b01ff {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG nova.network.neutron [None req-f7cb8cbb-8c70-4374-95e3-ae32995ec0cf tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] allocate_for_instance() {{(pid=82479) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-6cc42e96-529e-445f-9410-16d761a7d8ef tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-6cc42e96-529e-445f-9410-16d761a7d8ef tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-6cc42e96-529e-445f-9410-16d761a7d8ef tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] No VIF found with MAC fa:16:3e:1f:f1:73, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG nova.policy [None req-f7cb8cbb-8c70-4374-95e3-ae32995ec0cf tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '38f9a13bd3f74842b61b57b2ea8bf025', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4ee7b5626a14c69aefa86192b6e7bac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82479) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.498s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG nova.compute.manager [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Start building networks asynchronously for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-6cc42e96-529e-445f-9410-16d761a7d8ef tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "716b5e3f-20c7-40ef-9a45-71be0cfeaeb2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.598s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG nova.compute.manager [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Allocating IP information in the background. {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG nova.network.neutron [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] allocate_for_instance() {{(pid=82479) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 00:07:22 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 00:07:22 user nova-compute[82479]: DEBUG nova.compute.manager [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Start building block device mappings for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG nova.policy [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fb293fdfc658466aaa7134269fa46a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9d67ad2fa4cb9ab309b98f8fe051a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82479) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG nova.compute.manager [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Start spawning the instance on the hypervisor. {{(pid=82479) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Creating instance directory {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 00:07:22 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Creating image(s)
Apr 14 00:07:22 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "/opt/stack/data/nova/instances/e3fba4ee-4aae-4ee3-8114-b53510f5442c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "/opt/stack/data/nova/instances/e3fba4ee-4aae-4ee3-8114-b53510f5442c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "/opt/stack/data/nova/instances/e3fba4ee-4aae-4ee3-8114-b53510f5442c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG nova.network.neutron [req-8c3abf53-b5a4-4666-a2b4-7aebc357dda0 req-fa9d2558-8831-44c8-ba99-becb97c8a4b6 service nova] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Updated VIF entry in instance network info cache for port dc4fb8de-0fc3-4af8-86d0-94c357627f5f. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG nova.network.neutron [req-8c3abf53-b5a4-4666-a2b4-7aebc357dda0 req-fa9d2558-8831-44c8-ba99-becb97c8a4b6 service nova] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Updating instance_info_cache with network_info: [{"id": "dc4fb8de-0fc3-4af8-86d0-94c357627f5f", "address": "fa:16:3e:9b:6b:79", "network": {"id": "281dc33c-0ea9-4812-97ed-82652b538fd0", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-521698420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4ee7b5626a14c69aefa86192b6e7bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4fb8de-0f", "ovs_interfaceid": "dc4fb8de-0fc3-4af8-86d0-94c357627f5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-8c3abf53-b5a4-4666-a2b4-7aebc357dda0 req-fa9d2558-8831-44c8-ba99-becb97c8a4b6 service nova] Releasing lock "refresh_cache-b9c6323b-ed7f-4f86-93ad-3ef4726b01ff" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.152s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "3e200e101633f2016e569ae4c0a352380507d1e4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "3e200e101633f2016e569ae4c0a352380507d1e4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:07:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:23 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.144s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:23 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/e3fba4ee-4aae-4ee3-8114-b53510f5442c/disk 1073741824 {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:23 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/e3fba4ee-4aae-4ee3-8114-b53510f5442c/disk 1073741824" returned: 0 in 0.060s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "3e200e101633f2016e569ae4c0a352380507d1e4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.212s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:07:23 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:23 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.159s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:23 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e3fba4ee-4aae-4ee3-8114-b53510f5442c/disk. size=1073741824 {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 00:07:23 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fba4ee-4aae-4ee3-8114-b53510f5442c/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:23 user nova-compute[82479]: DEBUG nova.network.neutron [None req-f7cb8cbb-8c70-4374-95e3-ae32995ec0cf tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Successfully created port: 8d5fc9ab-cbd3-46df-8389-c67fee40f75f {{(pid=82479) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 00:07:23 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.436s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:07:23 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] <== connect_volume: return (2990ms) {'type': 'block', 'scsi_wwn': '26536633238633438', 'path': '/dev/sdd'} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:07:23 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26536633238633438', 'path': '/dev/sdd'} {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 00:07:23 user nova-compute[82479]: DEBUG nova.objects.instance [None req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lazy-loading 'flavor' on Instance uuid e97abae3-f573-48eb-a218-a8fec436ef3b {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:07:23 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 00:07:23 user nova-compute[82479]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:07:23 user nova-compute[82479]:   <source dev="/dev/sdd"/>
Apr 14 00:07:23 user nova-compute[82479]:   <target dev="sdc" bus="scsi"/>
Apr 14 00:07:23 user nova-compute[82479]:   <serial>0c69fa38-1485-41bd-922c-993c12dc3b53</serial>
Apr 14 00:07:23 user nova-compute[82479]:   <address type="drive" controller="0" unit="2"/>
Apr 14 00:07:23 user nova-compute[82479]: </disk>
Apr 14 00:07:23 user nova-compute[82479]:  {{(pid=82479) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 00:07:23 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fba4ee-4aae-4ee3-8114-b53510f5442c/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:23 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Cannot resize image /opt/stack/data/nova/instances/e3fba4ee-4aae-4ee3-8114-b53510f5442c/disk to a smaller size. {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 00:07:23 user nova-compute[82479]: DEBUG nova.objects.instance [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lazy-loading 'migration_context' on Instance uuid e3fba4ee-4aae-4ee3-8114-b53510f5442c {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:07:23 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Created local disks {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 00:07:23 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Ensure instance console log exists: /opt/stack/data/nova/instances/e3fba4ee-4aae-4ee3-8114-b53510f5442c/console.log {{(pid=82479) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 00:07:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:07:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:07:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:07:23 user nova-compute[82479]: DEBUG nova.network.neutron [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Successfully created port: 526b82aa-8f72-4ad7-8c1f-2aac7a4a2111 {{(pid=82479) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 00:07:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] Acquiring lock "716b5e3f-20c7-40ef-9a45-71be0cfeaeb2" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:07:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] Lock "716b5e3f-20c7-40ef-9a45-71be0cfeaeb2" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:07:23 user nova-compute[82479]: DEBUG os_brick.utils [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:07:23 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:23 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:23 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8df21a2-726c-48a9-9402-e7920b51a632]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fec92fcfdd3\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:23 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:23 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:23 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5475226-099f-4c72-afe0-c0c5797bbc58]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:23 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:23 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:23 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8bb9d10-5201-475f-9d63-51bf91253ea1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:23 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ccb0d8f-cdea-434c-9a4a-07e57a4c0dbf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:23 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] Running cmd (subprocess): nvme version {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:23 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] 'nvme version' failed. Not Retrying. {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:07:23 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] nvme not present on system {{(pid=82479) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 00:07:23 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:23 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:07:23 user nova-compute[82479]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 00:07:23 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c00ea05-4c83-4643-acca-3c032153eaf9]: (4, '') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:23 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82479) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 00:07:23 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 00:07:23 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] LIGHTOS: no hostnqn found. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 00:07:23 user nova-compute[82479]: DEBUG os_brick.utils [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fec92fcfdd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:07:23 user nova-compute[82479]: INFO nova.compute.manager [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Swapping volume c7267b8e-f20c-4625-b82d-b1a31a337714 for 2024a461-c307-42e0-976a-bde8b1ef0bed
Apr 14 00:07:23 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] No BDM found with device name sda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:07:23 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] No BDM found with device name sdb, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:07:23 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] No BDM found with device name sdc, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:07:23 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] No VIF found with MAC fa:16:3e:d8:66:9d, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:07:24 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "e97abae3-f573-48eb-a218-a8fec436ef3b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.465s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:07:24 user nova-compute[82479]: DEBUG nova.network.neutron [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Successfully updated port: 526b82aa-8f72-4ad7-8c1f-2aac7a4a2111 {{(pid=82479) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 00:07:24 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "refresh_cache-e3fba4ee-4aae-4ee3-8114-b53510f5442c" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:07:24 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquired lock "refresh_cache-e3fba4ee-4aae-4ee3-8114-b53510f5442c" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:07:24 user nova-compute[82479]: DEBUG nova.network.neutron [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 00:07:24 user nova-compute[82479]: DEBUG nova.compute.manager [req-0e474a32-e43a-47a9-8eec-1a1f3508af45 req-2f1a1b59-631d-4849-b549-2be04f819461 service nova] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Received event network-changed-526b82aa-8f72-4ad7-8c1f-2aac7a4a2111 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:07:24 user nova-compute[82479]: DEBUG nova.compute.manager [req-0e474a32-e43a-47a9-8eec-1a1f3508af45 req-2f1a1b59-631d-4849-b549-2be04f819461 service nova] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Refreshing instance network info cache due to event network-changed-526b82aa-8f72-4ad7-8c1f-2aac7a4a2111. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:07:24 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0e474a32-e43a-47a9-8eec-1a1f3508af45 req-2f1a1b59-631d-4849-b549-2be04f819461 service nova] Acquiring lock "refresh_cache-e3fba4ee-4aae-4ee3-8114-b53510f5442c" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:07:24 user nova-compute[82479]: DEBUG nova.network.neutron [None req-f7cb8cbb-8c70-4374-95e3-ae32995ec0cf tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Successfully updated port: 8d5fc9ab-cbd3-46df-8389-c67fee40f75f {{(pid=82479) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 00:07:24 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f7cb8cbb-8c70-4374-95e3-ae32995ec0cf tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Acquiring lock "refresh_cache-b9c6323b-ed7f-4f86-93ad-3ef4726b01ff" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:07:24 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f7cb8cbb-8c70-4374-95e3-ae32995ec0cf tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Acquired lock "refresh_cache-b9c6323b-ed7f-4f86-93ad-3ef4726b01ff" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:07:24 user nova-compute[82479]: DEBUG nova.network.neutron [None req-f7cb8cbb-8c70-4374-95e3-ae32995ec0cf tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 00:07:24 user nova-compute[82479]: DEBUG nova.network.neutron [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Instance cache missing network info. {{(pid=82479) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 00:07:24 user nova-compute[82479]: DEBUG nova.compute.manager [req-14e5a882-2154-442a-b762-50d91364083b req-5dd3396c-47f2-44ea-a83f-46aed34eef26 service nova] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Received event network-changed-8d5fc9ab-cbd3-46df-8389-c67fee40f75f {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:07:24 user nova-compute[82479]: DEBUG nova.compute.manager [req-14e5a882-2154-442a-b762-50d91364083b req-5dd3396c-47f2-44ea-a83f-46aed34eef26 service nova] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Refreshing instance network info cache due to event network-changed-8d5fc9ab-cbd3-46df-8389-c67fee40f75f. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:07:24 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-14e5a882-2154-442a-b762-50d91364083b req-5dd3396c-47f2-44ea-a83f-46aed34eef26 service nova] Acquiring lock "refresh_cache-b9c6323b-ed7f-4f86-93ad-3ef4726b01ff" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:07:24 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-41e0a092-53e9-4094-8125-45e95d18e564 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Acquiring lock "e97abae3-f573-48eb-a218-a8fec436ef3b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:07:24 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-41e0a092-53e9-4094-8125-45e95d18e564 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "e97abae3-f573-48eb-a218-a8fec436ef3b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:07:24 user nova-compute[82479]: INFO nova.compute.manager [None req-41e0a092-53e9-4094-8125-45e95d18e564 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Detaching volume 0c69fa38-1485-41bd-922c-993c12dc3b53
Apr 14 00:07:24 user nova-compute[82479]: INFO nova.virt.block_device [None req-41e0a092-53e9-4094-8125-45e95d18e564 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Attempting to driver detach volume 0c69fa38-1485-41bd-922c-993c12dc3b53 from mountpoint /dev/sdc
Apr 14 00:07:24 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-41e0a092-53e9-4094-8125-45e95d18e564 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Attempting to detach device sdc from instance e97abae3-f573-48eb-a218-a8fec436ef3b from the persistent domain config. {{(pid=82479) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 00:07:24 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-41e0a092-53e9-4094-8125-45e95d18e564 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 00:07:24 user nova-compute[82479]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:07:24 user nova-compute[82479]:   <source dev="/dev/sdd"/>
Apr 14 00:07:24 user nova-compute[82479]:   <target dev="sdc" bus="scsi"/>
Apr 14 00:07:24 user nova-compute[82479]:   <serial>0c69fa38-1485-41bd-922c-993c12dc3b53</serial>
Apr 14 00:07:24 user nova-compute[82479]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Apr 14 00:07:24 user nova-compute[82479]: </disk>
Apr 14 00:07:24 user nova-compute[82479]:  {{(pid=82479) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 00:07:24 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-41e0a092-53e9-4094-8125-45e95d18e564 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Successfully detached device sdc from instance e97abae3-f573-48eb-a218-a8fec436ef3b from the persistent domain config.
Apr 14 00:07:24 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-41e0a092-53e9-4094-8125-45e95d18e564 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance e97abae3-f573-48eb-a218-a8fec436ef3b from the live domain config. {{(pid=82479) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 00:07:24 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-41e0a092-53e9-4094-8125-45e95d18e564 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 00:07:24 user nova-compute[82479]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:07:24 user nova-compute[82479]:   <source dev="/dev/sdd"/>
Apr 14 00:07:24 user nova-compute[82479]:   <target dev="sdc" bus="scsi"/>
Apr 14 00:07:24 user nova-compute[82479]:   <serial>0c69fa38-1485-41bd-922c-993c12dc3b53</serial>
Apr 14 00:07:24 user nova-compute[82479]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Apr 14 00:07:24 user nova-compute[82479]: </disk>
Apr 14 00:07:24 user nova-compute[82479]:  {{(pid=82479) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG nova.network.neutron [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Updating instance_info_cache with network_info: [{"id": "526b82aa-8f72-4ad7-8c1f-2aac7a4a2111", "address": "fa:16:3e:1f:09:96", "network": {"id": "6d80f923-8aef-45df-921b-f77ed4ff0e75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-696070096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44c9d67ad2fa4cb9ab309b98f8fe051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap526b82aa-8f", "ovs_interfaceid": "526b82aa-8f72-4ad7-8c1f-2aac7a4a2111", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Releasing lock "refresh_cache-e3fba4ee-4aae-4ee3-8114-b53510f5442c" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG nova.compute.manager [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Instance network_info: |[{"id": "526b82aa-8f72-4ad7-8c1f-2aac7a4a2111", "address": "fa:16:3e:1f:09:96", "network": {"id": "6d80f923-8aef-45df-921b-f77ed4ff0e75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-696070096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44c9d67ad2fa4cb9ab309b98f8fe051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap526b82aa-8f", "ovs_interfaceid": "526b82aa-8f72-4ad7-8c1f-2aac7a4a2111", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0e474a32-e43a-47a9-8eec-1a1f3508af45 req-2f1a1b59-631d-4849-b549-2be04f819461 service nova] Acquired lock "refresh_cache-e3fba4ee-4aae-4ee3-8114-b53510f5442c" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG nova.network.neutron [req-0e474a32-e43a-47a9-8eec-1a1f3508af45 req-2f1a1b59-631d-4849-b549-2be04f819461 service nova] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Refreshing network info cache for port 526b82aa-8f72-4ad7-8c1f-2aac7a4a2111 {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Start _get_guest_xml network_info=[{"id": "526b82aa-8f72-4ad7-8c1f-2aac7a4a2111", "address": "fa:16:3e:1f:09:96", "network": {"id": "6d80f923-8aef-45df-921b-f77ed4ff0e75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-696070096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44c9d67ad2fa4cb9ab309b98f8fe051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap526b82aa-8f", "ovs_interfaceid": "526b82aa-8f72-4ad7-8c1f-2aac7a4a2111", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG nova.network.neutron [None req-f7cb8cbb-8c70-4374-95e3-ae32995ec0cf tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Updating instance_info_cache with network_info: [{"id": "dc4fb8de-0fc3-4af8-86d0-94c357627f5f", "address": "fa:16:3e:9b:6b:79", "network": {"id": "281dc33c-0ea9-4812-97ed-82652b538fd0", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-521698420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4ee7b5626a14c69aefa86192b6e7bac", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4fb8de-0f", "ovs_interfaceid": "dc4fb8de-0fc3-4af8-86d0-94c357627f5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8d5fc9ab-cbd3-46df-8389-c67fee40f75f", "address": "fa:16:3e:c4:e1:fd", "network": {"id": "830e35a7-48e9-4584-b507-5bed2f6e6b5d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-506512841", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c4ee7b5626a14c69aefa86192b6e7bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d5fc9ab-cb", "ovs_interfaceid": "8d5fc9ab-cbd3-46df-8389-c67fee40f75f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:07:25 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:07:25 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:07:25 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82479) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T00:02:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Flavor limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Image limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Flavor pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Image pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Got 1 possible topologies {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:07:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-614109817',display_name='tempest-AttachVolumeNegativeTest-server-614109817',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-614109817',id=11,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOVEOzN9EIzsoteVdO36ZxbbHQObkqlbYQQgZP7fHoK8FtNsMR54wb4Xcjl8NdjbV4Y1Ha6eHcMsgRwIH0Ep73QGv8X38xH2qztJvPxXuGkfTuWADRX823xouKZXmw7pw==',key_name='tempest-keypair-911498178',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44c9d67ad2fa4cb9ab309b98f8fe051a',ramdisk_id='',reservation_id='r-1kkgq9es',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-719597397',owner_user_name='tempest-AttachVolumeNegativeTest-719597397-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:07:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb293fdfc658466aaa7134269fa46a7c',uuid=e3fba4ee-4aae-4ee3-8114-b53510f5442c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "526b82aa-8f72-4ad7-8c1f-2aac7a4a2111", "address": "fa:16:3e:1f:09:96", "network": {"id": "6d80f923-8aef-45df-921b-f77ed4ff0e75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-696070096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44c9d67ad2fa4cb9ab309b98f8fe051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap526b82aa-8f", "ovs_interfaceid": "526b82aa-8f72-4ad7-8c1f-2aac7a4a2111", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82479) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Converting VIF {"id": "526b82aa-8f72-4ad7-8c1f-2aac7a4a2111", "address": "fa:16:3e:1f:09:96", "network": {"id": "6d80f923-8aef-45df-921b-f77ed4ff0e75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-696070096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44c9d67ad2fa4cb9ab309b98f8fe051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap526b82aa-8f", "ovs_interfaceid": "526b82aa-8f72-4ad7-8c1f-2aac7a4a2111", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:09:96,bridge_name='br-int',has_traffic_filtering=True,id=526b82aa-8f72-4ad7-8c1f-2aac7a4a2111,network=Network(6d80f923-8aef-45df-921b-f77ed4ff0e75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap526b82aa-8f') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG nova.objects.instance [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lazy-loading 'pci_devices' on Instance uuid e3fba4ee-4aae-4ee3-8114-b53510f5442c {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f7cb8cbb-8c70-4374-95e3-ae32995ec0cf tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Releasing lock "refresh_cache-b9c6323b-ed7f-4f86-93ad-3ef4726b01ff" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-14e5a882-2154-442a-b762-50d91364083b req-5dd3396c-47f2-44ea-a83f-46aed34eef26 service nova] Acquired lock "refresh_cache-b9c6323b-ed7f-4f86-93ad-3ef4726b01ff" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG nova.network.neutron [req-14e5a882-2154-442a-b762-50d91364083b req-5dd3396c-47f2-44ea-a83f-46aed34eef26 service nova] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Refreshing network info cache for port 8d5fc9ab-cbd3-46df-8389-c67fee40f75f {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-f7cb8cbb-8c70-4374-95e3-ae32995ec0cf tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T00:05:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1428775386',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1428775386',id=9,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIH5r6nQb46UiVWKMJfMdOVDRbtW2F73ea2D8mxSn1YDz9+bRgJ2nBeDW0+0XBiptqCPYYX6nTAHEycBqQz0FHVyYdWdNoLj8ctiSWD+URcLL8GbP5fneDu/2p/eIfeTqw==',key_name='tempest-keypair-2007231770',keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:05:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c4ee7b5626a14c69aefa86192b6e7bac',ramdisk_id='',reservation_id='r-7dnrqpgh',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-694590407',owner_user_name='tempest-TaggedAttachmentsTest-694590407-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T00:05:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38f9a13bd3f74842b61b57b2ea8bf025',uuid=b9c6323b-ed7f-4f86-93ad-3ef4726b01ff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8d5fc9ab-cbd3-46df-8389-c67fee40f75f", "address": "fa:16:3e:c4:e1:fd", "network": {"id": "830e35a7-48e9-4584-b507-5bed2f6e6b5d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-506512841", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c4ee7b5626a14c69aefa86192b6e7bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d5fc9ab-cb", "ovs_interfaceid": "8d5fc9ab-cbd3-46df-8389-c67fee40f75f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-f7cb8cbb-8c70-4374-95e3-ae32995ec0cf tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Converting VIF {"id": "8d5fc9ab-cbd3-46df-8389-c67fee40f75f", "address": "fa:16:3e:c4:e1:fd", "network": {"id": "830e35a7-48e9-4584-b507-5bed2f6e6b5d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-506512841", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c4ee7b5626a14c69aefa86192b6e7bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d5fc9ab-cb", "ovs_interfaceid": "8d5fc9ab-cbd3-46df-8389-c67fee40f75f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-f7cb8cbb-8c70-4374-95e3-ae32995ec0cf tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:e1:fd,bridge_name='br-int',has_traffic_filtering=True,id=8d5fc9ab-cbd3-46df-8389-c67fee40f75f,network=Network(830e35a7-48e9-4584-b507-5bed2f6e6b5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d5fc9ab-cb') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG os_vif [None req-f7cb8cbb-8c70-4374-95e3-ae32995ec0cf tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:e1:fd,bridge_name='br-int',has_traffic_filtering=True,id=8d5fc9ab-cbd3-46df-8389-c67fee40f75f,network=Network(830e35a7-48e9-4584-b507-5bed2f6e6b5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d5fc9ab-cb') {{(pid=82479) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] End _get_guest_xml xml=<domain type="kvm">
Apr 14 00:07:25 user nova-compute[82479]:   <uuid>e3fba4ee-4aae-4ee3-8114-b53510f5442c</uuid>
Apr 14 00:07:25 user nova-compute[82479]:   <name>instance-0000000b</name>
Apr 14 00:07:25 user nova-compute[82479]:   <memory>131072</memory>
Apr 14 00:07:25 user nova-compute[82479]:   <vcpu>1</vcpu>
Apr 14 00:07:25 user nova-compute[82479]:   <metadata>
Apr 14 00:07:25 user nova-compute[82479]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 00:07:25 user nova-compute[82479]:       <nova:package version="0.0.0"/>
Apr 14 00:07:25 user nova-compute[82479]:       <nova:name>tempest-AttachVolumeNegativeTest-server-614109817</nova:name>
Apr 14 00:07:25 user nova-compute[82479]:       <nova:creationTime>2023-04-14 00:07:25</nova:creationTime>
Apr 14 00:07:25 user nova-compute[82479]:       <nova:flavor name="m1.nano">
Apr 14 00:07:25 user nova-compute[82479]:         <nova:memory>128</nova:memory>
Apr 14 00:07:25 user nova-compute[82479]:         <nova:disk>1</nova:disk>
Apr 14 00:07:25 user nova-compute[82479]:         <nova:swap>0</nova:swap>
Apr 14 00:07:25 user nova-compute[82479]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 00:07:25 user nova-compute[82479]:         <nova:vcpus>1</nova:vcpus>
Apr 14 00:07:25 user nova-compute[82479]:       </nova:flavor>
Apr 14 00:07:25 user nova-compute[82479]:       <nova:owner>
Apr 14 00:07:25 user nova-compute[82479]:         <nova:user uuid="fb293fdfc658466aaa7134269fa46a7c">tempest-AttachVolumeNegativeTest-719597397-project-member</nova:user>
Apr 14 00:07:25 user nova-compute[82479]:         <nova:project uuid="44c9d67ad2fa4cb9ab309b98f8fe051a">tempest-AttachVolumeNegativeTest-719597397</nova:project>
Apr 14 00:07:25 user nova-compute[82479]:       </nova:owner>
Apr 14 00:07:25 user nova-compute[82479]:       <nova:root type="image" uuid="6db62068-7278-4cd8-b41f-d0140d89e199"/>
Apr 14 00:07:25 user nova-compute[82479]:       <nova:ports>
Apr 14 00:07:25 user nova-compute[82479]:         <nova:port uuid="526b82aa-8f72-4ad7-8c1f-2aac7a4a2111">
Apr 14 00:07:25 user nova-compute[82479]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 14 00:07:25 user nova-compute[82479]:         </nova:port>
Apr 14 00:07:25 user nova-compute[82479]:       </nova:ports>
Apr 14 00:07:25 user nova-compute[82479]:     </nova:instance>
Apr 14 00:07:25 user nova-compute[82479]:   </metadata>
Apr 14 00:07:25 user nova-compute[82479]:   <sysinfo type="smbios">
Apr 14 00:07:25 user nova-compute[82479]:     <system>
Apr 14 00:07:25 user nova-compute[82479]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 00:07:25 user nova-compute[82479]:       <entry name="product">OpenStack Nova</entry>
Apr 14 00:07:25 user nova-compute[82479]:       <entry name="version">0.0.0</entry>
Apr 14 00:07:25 user nova-compute[82479]:       <entry name="serial">e3fba4ee-4aae-4ee3-8114-b53510f5442c</entry>
Apr 14 00:07:25 user nova-compute[82479]:       <entry name="uuid">e3fba4ee-4aae-4ee3-8114-b53510f5442c</entry>
Apr 14 00:07:25 user nova-compute[82479]:       <entry name="family">Virtual Machine</entry>
Apr 14 00:07:25 user nova-compute[82479]:     </system>
Apr 14 00:07:25 user nova-compute[82479]:   </sysinfo>
Apr 14 00:07:25 user nova-compute[82479]:   <os>
Apr 14 00:07:25 user nova-compute[82479]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 00:07:25 user nova-compute[82479]:     <boot dev="hd"/>
Apr 14 00:07:25 user nova-compute[82479]:     <smbios mode="sysinfo"/>
Apr 14 00:07:25 user nova-compute[82479]:   </os>
Apr 14 00:07:25 user nova-compute[82479]:   <features>
Apr 14 00:07:25 user nova-compute[82479]:     <acpi/>
Apr 14 00:07:25 user nova-compute[82479]:     <apic/>
Apr 14 00:07:25 user nova-compute[82479]:     <vmcoreinfo/>
Apr 14 00:07:25 user nova-compute[82479]:   </features>
Apr 14 00:07:25 user nova-compute[82479]:   <clock offset="utc">
Apr 14 00:07:25 user nova-compute[82479]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 00:07:25 user nova-compute[82479]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 00:07:25 user nova-compute[82479]:     <timer name="hpet" present="no"/>
Apr 14 00:07:25 user nova-compute[82479]:   </clock>
Apr 14 00:07:25 user nova-compute[82479]:   <cpu mode="custom" match="exact">
Apr 14 00:07:25 user nova-compute[82479]:     <model>Nehalem</model>
Apr 14 00:07:25 user nova-compute[82479]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 00:07:25 user nova-compute[82479]:   </cpu>
Apr 14 00:07:25 user nova-compute[82479]:   <devices>
Apr 14 00:07:25 user nova-compute[82479]:     <disk type="file" device="disk">
Apr 14 00:07:25 user nova-compute[82479]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 00:07:25 user nova-compute[82479]:       <source file="/opt/stack/data/nova/instances/e3fba4ee-4aae-4ee3-8114-b53510f5442c/disk"/>
Apr 14 00:07:25 user nova-compute[82479]:       <target dev="vda" bus="virtio"/>
Apr 14 00:07:25 user nova-compute[82479]:     </disk>
Apr 14 00:07:25 user nova-compute[82479]:     <interface type="ethernet">
Apr 14 00:07:25 user nova-compute[82479]:       <mac address="fa:16:3e:1f:09:96"/>
Apr 14 00:07:25 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:07:25 user nova-compute[82479]:       <mtu size="1442"/>
Apr 14 00:07:25 user nova-compute[82479]:       <target dev="tap526b82aa-8f"/>
Apr 14 00:07:25 user nova-compute[82479]:     </interface>
Apr 14 00:07:25 user nova-compute[82479]:     <serial type="pty">
Apr 14 00:07:25 user nova-compute[82479]:       <log file="/opt/stack/data/nova/instances/e3fba4ee-4aae-4ee3-8114-b53510f5442c/console.log" append="off"/>
Apr 14 00:07:25 user nova-compute[82479]:     </serial>
Apr 14 00:07:25 user nova-compute[82479]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 00:07:25 user nova-compute[82479]:     <video>
Apr 14 00:07:25 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:07:25 user nova-compute[82479]:     </video>
Apr 14 00:07:25 user nova-compute[82479]:     <rng model="virtio">
Apr 14 00:07:25 user nova-compute[82479]:       <backend model="random">/dev/urandom</backend>
Apr 14 00:07:25 user nova-compute[82479]:     </rng>
Apr 14 00:07:25 user nova-compute[82479]:     <controller type="usb" index="0" model="none"/>
Apr 14 00:07:25 user nova-compute[82479]:     <memballoon model="virtio">
Apr 14 00:07:25 user nova-compute[82479]:       <stats period="10"/>
Apr 14 00:07:25 user nova-compute[82479]:     </memballoon>
Apr 14 00:07:25 user nova-compute[82479]:   </devices>
Apr 14 00:07:25 user nova-compute[82479]: </domain>
Apr 14 00:07:25 user nova-compute[82479]:  {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:07:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-614109817',display_name='tempest-AttachVolumeNegativeTest-server-614109817',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-614109817',id=11,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOVEOzN9EIzsoteVdO36ZxbbHQObkqlbYQQgZP7fHoK8FtNsMR54wb4Xcjl8NdjbV4Y1Ha6eHcMsgRwIH0Ep73QGv8X38xH2qztJvPxXuGkfTuWADRX823xouKZXmw7pw==',key_name='tempest-keypair-911498178',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44c9d67ad2fa4cb9ab309b98f8fe051a',ramdisk_id='',reservation_id='r-1kkgq9es',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-719597397',owner_user_name='tempest-AttachVolumeNegativeTest-719597397-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:07:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb293fdfc658466aaa7134269fa46a7c',uuid=e3fba4ee-4aae-4ee3-8114-b53510f5442c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "526b82aa-8f72-4ad7-8c1f-2aac7a4a2111", "address": "fa:16:3e:1f:09:96", "network": {"id": "6d80f923-8aef-45df-921b-f77ed4ff0e75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-696070096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44c9d67ad2fa4cb9ab309b98f8fe051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap526b82aa-8f", "ovs_interfaceid": "526b82aa-8f72-4ad7-8c1f-2aac7a4a2111", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Converting VIF {"id": "526b82aa-8f72-4ad7-8c1f-2aac7a4a2111", "address": "fa:16:3e:1f:09:96", "network": {"id": "6d80f923-8aef-45df-921b-f77ed4ff0e75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-696070096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44c9d67ad2fa4cb9ab309b98f8fe051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap526b82aa-8f", "ovs_interfaceid": "526b82aa-8f72-4ad7-8c1f-2aac7a4a2111", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:09:96,bridge_name='br-int',has_traffic_filtering=True,id=526b82aa-8f72-4ad7-8c1f-2aac7a4a2111,network=Network(6d80f923-8aef-45df-921b-f77ed4ff0e75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap526b82aa-8f') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG os_vif [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:09:96,bridge_name='br-int',has_traffic_filtering=True,id=526b82aa-8f72-4ad7-8c1f-2aac7a4a2111,network=Network(6d80f923-8aef-45df-921b-f77ed4ff0e75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap526b82aa-8f') {{(pid=82479) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8d5fc9ab-cb, may_exist=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8d5fc9ab-cb, col_values=(('external_ids', {'iface-id': '8d5fc9ab-cbd3-46df-8389-c67fee40f75f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:e1:fd', 'vm-uuid': 'b9c6323b-ed7f-4f86-93ad-3ef4726b01ff'}),)) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Received event <DeviceRemovedEvent: 1681430845.3277583, e97abae3-f573-48eb-a218-a8fec436ef3b => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=82479) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-41e0a092-53e9-4094-8125-45e95d18e564 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance e97abae3-f573-48eb-a218-a8fec436ef3b {{(pid=82479) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:25 user nova-compute[82479]: INFO os_vif [None req-f7cb8cbb-8c70-4374-95e3-ae32995ec0cf tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:e1:fd,bridge_name='br-int',has_traffic_filtering=True,id=8d5fc9ab-cbd3-46df-8389-c67fee40f75f,network=Network(830e35a7-48e9-4584-b507-5bed2f6e6b5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d5fc9ab-cb')
Apr 14 00:07:25 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-f7cb8cbb-8c70-4374-95e3-ae32995ec0cf tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T00:05:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1428775386',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1428775386',id=9,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIH5r6nQb46UiVWKMJfMdOVDRbtW2F73ea2D8mxSn1YDz9+bRgJ2nBeDW0+0XBiptqCPYYX6nTAHEycBqQz0FHVyYdWdNoLj8ctiSWD+URcLL8GbP5fneDu/2p/eIfeTqw==',key_name='tempest-keypair-2007231770',keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:05:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c4ee7b5626a14c69aefa86192b6e7bac',ramdisk_id='',reservation_id='r-7dnrqpgh',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-694590407',owner_user_name='tempest-TaggedAttachmentsTest-694590407-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T00:05:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38f9a13bd3f74842b61b57b2ea8bf025',uuid=b9c6323b-ed7f-4f86-93ad-3ef4726b01ff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8d5fc9ab-cbd3-46df-8389-c67fee40f75f", "address": "fa:16:3e:c4:e1:fd", "network": {"id": "830e35a7-48e9-4584-b507-5bed2f6e6b5d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-506512841", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c4ee7b5626a14c69aefa86192b6e7bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d5fc9ab-cb", "ovs_interfaceid": "8d5fc9ab-cbd3-46df-8389-c67fee40f75f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82479) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-f7cb8cbb-8c70-4374-95e3-ae32995ec0cf tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Converting VIF {"id": "8d5fc9ab-cbd3-46df-8389-c67fee40f75f", "address": "fa:16:3e:c4:e1:fd", "network": {"id": "830e35a7-48e9-4584-b507-5bed2f6e6b5d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-506512841", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c4ee7b5626a14c69aefa86192b6e7bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d5fc9ab-cb", "ovs_interfaceid": "8d5fc9ab-cbd3-46df-8389-c67fee40f75f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-f7cb8cbb-8c70-4374-95e3-ae32995ec0cf tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:e1:fd,bridge_name='br-int',has_traffic_filtering=True,id=8d5fc9ab-cbd3-46df-8389-c67fee40f75f,network=Network(830e35a7-48e9-4584-b507-5bed2f6e6b5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d5fc9ab-cb') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap526b82aa-8f, may_exist=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap526b82aa-8f, col_values=(('external_ids', {'iface-id': '526b82aa-8f72-4ad7-8c1f-2aac7a4a2111', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:09:96', 'vm-uuid': 'e3fba4ee-4aae-4ee3-8114-b53510f5442c'}),)) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:07:25 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-41e0a092-53e9-4094-8125-45e95d18e564 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Successfully detached device sdc from instance e97abae3-f573-48eb-a218-a8fec436ef3b from the live domain config.
Apr 14 00:07:25 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-f7cb8cbb-8c70-4374-95e3-ae32995ec0cf tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] attach device xml: <interface type="ethernet">
Apr 14 00:07:25 user nova-compute[82479]:   <mac address="fa:16:3e:c4:e1:fd"/>
Apr 14 00:07:25 user nova-compute[82479]:   <model type="virtio"/>
Apr 14 00:07:25 user nova-compute[82479]:   <mtu size="1442"/>
Apr 14 00:07:25 user nova-compute[82479]:   <target dev="tap8d5fc9ab-cb"/>
Apr 14 00:07:25 user nova-compute[82479]: </interface>
Apr 14 00:07:25 user nova-compute[82479]:  {{(pid=82479) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41e0a092-53e9-4094-8125-45e95d18e564 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] calling os-brick to detach iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e0a092-53e9-4094-8125-45e95d18e564 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, {'target_iqn': 'iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zaiQnIop', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:07:25 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-41e0a092-53e9-4094-8125-45e95d18e564 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:07:25 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-41e0a092-53e9-4094-8125-45e95d18e564 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-41e0a092-53e9-4094-8125-45e95d18e564 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:25 user nova-compute[82479]: INFO os_vif [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:09:96,bridge_name='br-int',has_traffic_filtering=True,id=526b82aa-8f72-4ad7-8c1f-2aac7a4a2111,network=Network(6d80f923-8aef-45df-921b-f77ed4ff0e75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap526b82aa-8f')
Apr 14 00:07:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[c693e3f8-1fea-445e-9342-3db915d83169]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e0a092-53e9-4094-8125-45e95d18e564 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 00:07:25 user nova-compute[82479]: No targets found.
Apr 14 00:07:25 user nova-compute[82479]: iSNS:
Apr 14 00:07:25 user nova-compute[82479]: No targets found.
Apr 14 00:07:25 user nova-compute[82479]: STATIC:
Apr 14 00:07:25 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714
Apr 14 00:07:25 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:07:25 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:07:25 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7
Apr 14 00:07:25 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:07:25 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:07:25 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53
Apr 14 00:07:25 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:07:25 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:07:25 user nova-compute[82479]: FIRMWARE:
Apr 14 00:07:25 user nova-compute[82479]: No targets found.
Apr 14 00:07:25 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e0a092-53e9-4094-8125-45e95d18e564 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 00:07:25 user nova-compute[82479]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 00:07:25 user nova-compute[82479]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82479) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e0a092-53e9-4094-8125-45e95d18e564 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53', 0)] {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7f714f-727f-4916-837b-d2a1e6a4fc0b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[0804ab1f-fd2a-4e78-9dfd-28dcef734074]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e0a092-53e9-4094-8125-45e95d18e564 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:07:25 user nova-compute[82479]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 (non-flash)
Apr 14 00:07:25 user nova-compute[82479]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53 (non-flash)
Apr 14 00:07:25 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e0a092-53e9-4094-8125-45e95d18e564 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:07:25 user nova-compute[82479]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 (non-flash)
Apr 14 00:07:25 user nova-compute[82479]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53 (non-flash)
Apr 14 00:07:25 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e0a092-53e9-4094-8125-45e95d18e564 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f333830a560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53'): ({'sdd'}, set())}) {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-41e0a092-53e9-4094-8125-45e95d18e564 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Removing single pathed devices sdd {{(pid=82479) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] No VIF found with MAC fa:16:3e:1f:09:96, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[f698e6e7-9735-4011-93f5-efb487501a8e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd7d7a6-5ebe-49b3-9882-b26b2f65b09d]: (4, ('ok\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-41e0a092-53e9-4094-8125-45e95d18e564 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Flushing IO for device /dev/sdd {{(pid=82479) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[7388e2d9-67bb-4efd-ae53-c223947f4a5e]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-41e0a092-53e9-4094-8125-45e95d18e564 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=82479) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.038s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[72644ad2-a496-4064-8663-834a26cb8079]: (4, ('1', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-41e0a092-53e9-4094-8125-45e95d18e564 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-41e0a092-53e9-4094-8125-45e95d18e564 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] SCSI volumes sdd have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e0a092-53e9-4094-8125-45e95d18e564 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53')] {{(pid=82479) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a673d8-0057-4df3-95da-de219d6bd52c]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e0a092-53e9-4094-8125-45e95d18e564 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53 -p 172.16.0.220:3260 --logout {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53 -p 172.16.0.220:3260 --logout" returned: 0 in 0.186s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67db010-7474-4f9e-8a14-610b446bce33]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e0a092-53e9-4094-8125-45e95d18e564 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53, portal: 172.16.0.220,3260]
Apr 14 00:07:25 user nova-compute[82479]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53, portal: 172.16.0.220,3260] successful.
Apr 14 00:07:25 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53 -p 172.16.0.220:3260 --op delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[29980d55-d632-470d-bf9d-addd21732d49]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e0a092-53e9-4094-8125-45e95d18e564 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-41e0a092-53e9-4094-8125-45e95d18e564 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.486s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-41e0a092-53e9-4094-8125-45e95d18e564 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] <== disconnect_volume: return (487ms) None {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41e0a092-53e9-4094-8125-45e95d18e564 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Disconnected iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-f7cb8cbb-8c70-4374-95e3-ae32995ec0cf tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-f7cb8cbb-8c70-4374-95e3-ae32995ec0cf tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] No BDM found with device name hda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-f7cb8cbb-8c70-4374-95e3-ae32995ec0cf tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] No VIF found with MAC fa:16:3e:9b:6b:79, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG nova.compute.manager [req-60929efb-ce51-4250-84bb-486c61e16378 req-f1ab5f87-c6d5-4ac7-b2d8-86468addf5b7 service nova] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Received event network-vif-plugged-8d5fc9ab-cbd3-46df-8389-c67fee40f75f {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-60929efb-ce51-4250-84bb-486c61e16378 req-f1ab5f87-c6d5-4ac7-b2d8-86468addf5b7 service nova] Acquiring lock "b9c6323b-ed7f-4f86-93ad-3ef4726b01ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-60929efb-ce51-4250-84bb-486c61e16378 req-f1ab5f87-c6d5-4ac7-b2d8-86468addf5b7 service nova] Lock "b9c6323b-ed7f-4f86-93ad-3ef4726b01ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-60929efb-ce51-4250-84bb-486c61e16378 req-f1ab5f87-c6d5-4ac7-b2d8-86468addf5b7 service nova] Lock "b9c6323b-ed7f-4f86-93ad-3ef4726b01ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG nova.compute.manager [req-60929efb-ce51-4250-84bb-486c61e16378 req-f1ab5f87-c6d5-4ac7-b2d8-86468addf5b7 service nova] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] No waiting events found dispatching network-vif-plugged-8d5fc9ab-cbd3-46df-8389-c67fee40f75f {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:07:25 user nova-compute[82479]: WARNING nova.compute.manager [req-60929efb-ce51-4250-84bb-486c61e16378 req-f1ab5f87-c6d5-4ac7-b2d8-86468addf5b7 service nova] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Received unexpected event network-vif-plugged-8d5fc9ab-cbd3-46df-8389-c67fee40f75f for instance with vm_state active and task_state None.
Apr 14 00:07:25 user nova-compute[82479]: DEBUG nova.network.neutron [req-14e5a882-2154-442a-b762-50d91364083b req-5dd3396c-47f2-44ea-a83f-46aed34eef26 service nova] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Updated VIF entry in instance network info cache for port 8d5fc9ab-cbd3-46df-8389-c67fee40f75f. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG nova.network.neutron [req-14e5a882-2154-442a-b762-50d91364083b req-5dd3396c-47f2-44ea-a83f-46aed34eef26 service nova] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Updating instance_info_cache with network_info: [{"id": "dc4fb8de-0fc3-4af8-86d0-94c357627f5f", "address": "fa:16:3e:9b:6b:79", "network": {"id": "281dc33c-0ea9-4812-97ed-82652b538fd0", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-521698420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4ee7b5626a14c69aefa86192b6e7bac", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4fb8de-0f", "ovs_interfaceid": "dc4fb8de-0fc3-4af8-86d0-94c357627f5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8d5fc9ab-cbd3-46df-8389-c67fee40f75f", "address": "fa:16:3e:c4:e1:fd", "network": {"id": "830e35a7-48e9-4584-b507-5bed2f6e6b5d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-506512841", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c4ee7b5626a14c69aefa86192b6e7bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d5fc9ab-cb", "ovs_interfaceid": "8d5fc9ab-cbd3-46df-8389-c67fee40f75f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-14e5a882-2154-442a-b762-50d91364083b req-5dd3396c-47f2-44ea-a83f-46aed34eef26 service nova] Releasing lock "refresh_cache-b9c6323b-ed7f-4f86-93ad-3ef4726b01ff" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-f7cb8cbb-8c70-4374-95e3-ae32995ec0cf tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 00:07:25 user nova-compute[82479]:   <nova:package version="0.0.0"/>
Apr 14 00:07:25 user nova-compute[82479]:   <nova:name>tempest-device-tagging-server-1428775386</nova:name>
Apr 14 00:07:25 user nova-compute[82479]:   <nova:creationTime>2023-04-14 00:07:25</nova:creationTime>
Apr 14 00:07:25 user nova-compute[82479]:   <nova:flavor name="m1.nano">
Apr 14 00:07:25 user nova-compute[82479]:     <nova:memory>128</nova:memory>
Apr 14 00:07:25 user nova-compute[82479]:     <nova:disk>1</nova:disk>
Apr 14 00:07:25 user nova-compute[82479]:     <nova:swap>0</nova:swap>
Apr 14 00:07:25 user nova-compute[82479]:     <nova:ephemeral>0</nova:ephemeral>
Apr 14 00:07:25 user nova-compute[82479]:     <nova:vcpus>1</nova:vcpus>
Apr 14 00:07:25 user nova-compute[82479]:   </nova:flavor>
Apr 14 00:07:25 user nova-compute[82479]:   <nova:owner>
Apr 14 00:07:25 user nova-compute[82479]:     <nova:user uuid="38f9a13bd3f74842b61b57b2ea8bf025">tempest-TaggedAttachmentsTest-694590407-project-member</nova:user>
Apr 14 00:07:25 user nova-compute[82479]:     <nova:project uuid="c4ee7b5626a14c69aefa86192b6e7bac">tempest-TaggedAttachmentsTest-694590407</nova:project>
Apr 14 00:07:25 user nova-compute[82479]:   </nova:owner>
Apr 14 00:07:25 user nova-compute[82479]:   <nova:root type="image" uuid="6db62068-7278-4cd8-b41f-d0140d89e199"/>
Apr 14 00:07:25 user nova-compute[82479]:   <nova:ports>
Apr 14 00:07:25 user nova-compute[82479]:     <nova:port uuid="dc4fb8de-0fc3-4af8-86d0-94c357627f5f">
Apr 14 00:07:25 user nova-compute[82479]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 00:07:25 user nova-compute[82479]:     </nova:port>
Apr 14 00:07:25 user nova-compute[82479]:     <nova:port uuid="8d5fc9ab-cbd3-46df-8389-c67fee40f75f">
Apr 14 00:07:25 user nova-compute[82479]:       <nova:ip type="fixed" address="10.10.10.221" ipVersion="4"/>
Apr 14 00:07:25 user nova-compute[82479]:     </nova:port>
Apr 14 00:07:25 user nova-compute[82479]:   </nova:ports>
Apr 14 00:07:25 user nova-compute[82479]: </nova:instance>
Apr 14 00:07:25 user nova-compute[82479]:  {{(pid=82479) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 14 00:07:25 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f7cb8cbb-8c70-4374-95e3-ae32995ec0cf tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "interface-b9c6323b-ed7f-4f86-93ad-3ef4726b01ff-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.934s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:07:26 user nova-compute[82479]: DEBUG nova.network.neutron [req-0e474a32-e43a-47a9-8eec-1a1f3508af45 req-2f1a1b59-631d-4849-b549-2be04f819461 service nova] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Updated VIF entry in instance network info cache for port 526b82aa-8f72-4ad7-8c1f-2aac7a4a2111. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:07:26 user nova-compute[82479]: DEBUG nova.network.neutron [req-0e474a32-e43a-47a9-8eec-1a1f3508af45 req-2f1a1b59-631d-4849-b549-2be04f819461 service nova] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Updating instance_info_cache with network_info: [{"id": "526b82aa-8f72-4ad7-8c1f-2aac7a4a2111", "address": "fa:16:3e:1f:09:96", "network": {"id": "6d80f923-8aef-45df-921b-f77ed4ff0e75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-696070096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44c9d67ad2fa4cb9ab309b98f8fe051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap526b82aa-8f", "ovs_interfaceid": "526b82aa-8f72-4ad7-8c1f-2aac7a4a2111", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:07:26 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0e474a32-e43a-47a9-8eec-1a1f3508af45 req-2f1a1b59-631d-4849-b549-2be04f819461 service nova] Releasing lock "refresh_cache-e3fba4ee-4aae-4ee3-8114-b53510f5442c" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:07:26 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:26 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:26 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:26 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:26 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ad8d0773-6b84-4d51-8fc4-e9664f932131 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Acquiring lock "b9c6323b-ed7f-4f86-93ad-3ef4726b01ff" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:07:26 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ad8d0773-6b84-4d51-8fc4-e9664f932131 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "b9c6323b-ed7f-4f86-93ad-3ef4726b01ff" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:07:26 user nova-compute[82479]: DEBUG nova.objects.instance [None req-ad8d0773-6b84-4d51-8fc4-e9664f932131 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lazy-loading 'flavor' on Instance uuid b9c6323b-ed7f-4f86-93ad-3ef4726b01ff {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:07:26 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ad8d0773-6b84-4d51-8fc4-e9664f932131 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "b9c6323b-ed7f-4f86-93ad-3ef4726b01ff" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:07:26 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ad8d0773-6b84-4d51-8fc4-e9664f932131 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Acquiring lock "b9c6323b-ed7f-4f86-93ad-3ef4726b01ff" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:07:26 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ad8d0773-6b84-4d51-8fc4-e9664f932131 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "b9c6323b-ed7f-4f86-93ad-3ef4726b01ff" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:07:26 user nova-compute[82479]: INFO nova.compute.manager [None req-ad8d0773-6b84-4d51-8fc4-e9664f932131 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Attaching volume 2509f860-ef4a-443f-9fc8-171e0df13a7a to /dev/vdb
Apr 14 00:07:26 user nova-compute[82479]: DEBUG os_brick.utils [None req-ad8d0773-6b84-4d51-8fc4-e9664f932131 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:07:26 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:26 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:26 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[4517020d-b2cd-48a2-bcee-a5029e8d72bc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fec92fcfdd3\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:26 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:26 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:26 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1aa906-2947-48ea-9edc-520e083bbd2b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:26 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:26 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:26 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8816a2-6e71-4f2e-97ae-87a9c1dbc7fb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:26 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c7b5957-2021-4325-bd3f-a50f10cd75d0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:26 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-ad8d0773-6b84-4d51-8fc4-e9664f932131 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Running cmd (subprocess): nvme version {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:26 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-ad8d0773-6b84-4d51-8fc4-e9664f932131 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] 'nvme version' failed. Not Retrying. {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:07:26 user nova-compute[82479]: DEBUG nova.objects.instance [None req-41e0a092-53e9-4094-8125-45e95d18e564 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lazy-loading 'flavor' on Instance uuid e97abae3-f573-48eb-a218-a8fec436ef3b {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:07:26 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ad8d0773-6b84-4d51-8fc4-e9664f932131 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] nvme not present on system {{(pid=82479) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 00:07:26 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:26 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:07:26 user nova-compute[82479]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 00:07:26 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[d337ee33-28d1-4060-ab9b-20300e12533e]: (4, '') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:26 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-ad8d0773-6b84-4d51-8fc4-e9664f932131 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82479) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 00:07:26 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-ad8d0773-6b84-4d51-8fc4-e9664f932131 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 00:07:26 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-ad8d0773-6b84-4d51-8fc4-e9664f932131 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] LIGHTOS: no hostnqn found. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 00:07:26 user nova-compute[82479]: DEBUG os_brick.utils [None req-ad8d0773-6b84-4d51-8fc4-e9664f932131 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fec92fcfdd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:07:26 user nova-compute[82479]: DEBUG nova.virt.block_device [None req-ad8d0773-6b84-4d51-8fc4-e9664f932131 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Updating existing volume attachment record: 0ed1c3f7-2d31-4247-873f-6c44d1a66f6f {{(pid=82479) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 00:07:26 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-41e0a092-53e9-4094-8125-45e95d18e564 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "e97abae3-f573-48eb-a218-a8fec436ef3b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.100s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:07:27 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:27 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:27 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:27 user nova-compute[82479]: DEBUG nova.compute.manager [req-75c11f80-d3ba-4a48-b90f-0e12f3172f2a req-103437eb-4052-4af2-a419-30bd83f264d4 service nova] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Received event network-vif-plugged-526b82aa-8f72-4ad7-8c1f-2aac7a4a2111 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:07:27 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-75c11f80-d3ba-4a48-b90f-0e12f3172f2a req-103437eb-4052-4af2-a419-30bd83f264d4 service nova] Acquiring lock "e3fba4ee-4aae-4ee3-8114-b53510f5442c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:07:27 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-75c11f80-d3ba-4a48-b90f-0e12f3172f2a req-103437eb-4052-4af2-a419-30bd83f264d4 service nova] Lock "e3fba4ee-4aae-4ee3-8114-b53510f5442c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:07:27 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-75c11f80-d3ba-4a48-b90f-0e12f3172f2a req-103437eb-4052-4af2-a419-30bd83f264d4 service nova] Lock "e3fba4ee-4aae-4ee3-8114-b53510f5442c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:07:27 user nova-compute[82479]: DEBUG nova.compute.manager [req-75c11f80-d3ba-4a48-b90f-0e12f3172f2a req-103437eb-4052-4af2-a419-30bd83f264d4 service nova] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] No waiting events found dispatching network-vif-plugged-526b82aa-8f72-4ad7-8c1f-2aac7a4a2111 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:07:27 user nova-compute[82479]: WARNING nova.compute.manager [req-75c11f80-d3ba-4a48-b90f-0e12f3172f2a req-103437eb-4052-4af2-a419-30bd83f264d4 service nova] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Received unexpected event network-vif-plugged-526b82aa-8f72-4ad7-8c1f-2aac7a4a2111 for instance with vm_state building and task_state spawning.
Apr 14 00:07:27 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f20624ad-cc2a-4842-bab9-5fff881cfb53 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Acquiring lock "e97abae3-f573-48eb-a218-a8fec436ef3b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:07:27 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f20624ad-cc2a-4842-bab9-5fff881cfb53 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "e97abae3-f573-48eb-a218-a8fec436ef3b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:07:27 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f20624ad-cc2a-4842-bab9-5fff881cfb53 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Acquiring lock "e97abae3-f573-48eb-a218-a8fec436ef3b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:07:27 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f20624ad-cc2a-4842-bab9-5fff881cfb53 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "e97abae3-f573-48eb-a218-a8fec436ef3b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:07:27 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f20624ad-cc2a-4842-bab9-5fff881cfb53 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "e97abae3-f573-48eb-a218-a8fec436ef3b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:07:27 user nova-compute[82479]: INFO nova.compute.manager [None req-f20624ad-cc2a-4842-bab9-5fff881cfb53 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Terminating instance
Apr 14 00:07:27 user nova-compute[82479]: DEBUG nova.compute.manager [None req-f20624ad-cc2a-4842-bab9-5fff881cfb53 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Start destroying the instance on the hypervisor. {{(pid=82479) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 00:07:27 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:27 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:27 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:27 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:27 user nova-compute[82479]: DEBUG nova.compute.manager [req-422bfb87-91a3-46c5-bbb9-499e4387be8a req-ba08e772-f7e2-4ca9-8ad7-ba7242798b14 service nova] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Received event network-vif-plugged-8d5fc9ab-cbd3-46df-8389-c67fee40f75f {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:07:27 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-422bfb87-91a3-46c5-bbb9-499e4387be8a req-ba08e772-f7e2-4ca9-8ad7-ba7242798b14 service nova] Acquiring lock "b9c6323b-ed7f-4f86-93ad-3ef4726b01ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:07:27 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-422bfb87-91a3-46c5-bbb9-499e4387be8a req-ba08e772-f7e2-4ca9-8ad7-ba7242798b14 service nova] Lock "b9c6323b-ed7f-4f86-93ad-3ef4726b01ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:07:27 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-422bfb87-91a3-46c5-bbb9-499e4387be8a req-ba08e772-f7e2-4ca9-8ad7-ba7242798b14 service nova] Lock "b9c6323b-ed7f-4f86-93ad-3ef4726b01ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:07:27 user nova-compute[82479]: DEBUG nova.compute.manager [req-422bfb87-91a3-46c5-bbb9-499e4387be8a req-ba08e772-f7e2-4ca9-8ad7-ba7242798b14 service nova] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] No waiting events found dispatching network-vif-plugged-8d5fc9ab-cbd3-46df-8389-c67fee40f75f {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:07:27 user nova-compute[82479]: WARNING nova.compute.manager [req-422bfb87-91a3-46c5-bbb9-499e4387be8a req-ba08e772-f7e2-4ca9-8ad7-ba7242798b14 service nova] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Received unexpected event network-vif-plugged-8d5fc9ab-cbd3-46df-8389-c67fee40f75f for instance with vm_state active and task_state None.
Apr 14 00:07:27 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:28 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:28 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:28 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:28 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Instance destroyed successfully.
Apr 14 00:07:28 user nova-compute[82479]: DEBUG nova.objects.instance [None req-f20624ad-cc2a-4842-bab9-5fff881cfb53 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lazy-loading 'resources' on Instance uuid e97abae3-f573-48eb-a218-a8fec436ef3b {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:07:28 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-f20624ad-cc2a-4842-bab9-5fff881cfb53 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T00:05:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1350015229',display_name='tempest-AttachSCSIVolumeTestJSON-server-1350015229',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1350015229',id=7,image_ref='24c53b8c-62a8-4f7f-91bc-0a2f07a14dae',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBBRuOZjQvIE5tUmB4tfzvZRoCYk3Hsf5VhCBAOOcUwojgjny9UgepaV8G6SqWjUYPvwtt/SH5yQUW3rdVohRimKNBakqIU+mWsl0P0s23cgMalDbSnHqVnUTBlbtWKWsg==',key_name='tempest-keypair-1590246000',keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:05:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ccde4d67c2ed45af968e5f219cc8b6c2',ramdisk_id='',reservation_id='r-43f6l1y9',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='24c53b8c-62a8-4f7f-91bc-0a2f07a14dae',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1907301903',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1907301903-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T00:05:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3bff58a90484c5db3f035ab1187080e',uuid=e97abae3-f573-48eb-a218-a8fec436ef3b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "28d36b9c-c7e0-4d50-bcf8-afa67f29246d", "address": "fa:16:3e:d8:66:9d", "network": {"id": "4167bd9a-4666-4e4b-8b36-eea1ff220878", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1393009469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccde4d67c2ed45af968e5f219cc8b6c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28d36b9c-c7", "ovs_interfaceid": "28d36b9c-c7e0-4d50-bcf8-afa67f29246d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 00:07:28 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-f20624ad-cc2a-4842-bab9-5fff881cfb53 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Converting VIF {"id": "28d36b9c-c7e0-4d50-bcf8-afa67f29246d", "address": "fa:16:3e:d8:66:9d", "network": {"id": "4167bd9a-4666-4e4b-8b36-eea1ff220878", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1393009469-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.245", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ccde4d67c2ed45af968e5f219cc8b6c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28d36b9c-c7", "ovs_interfaceid": "28d36b9c-c7e0-4d50-bcf8-afa67f29246d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:07:28 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-f20624ad-cc2a-4842-bab9-5fff881cfb53 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d8:66:9d,bridge_name='br-int',has_traffic_filtering=True,id=28d36b9c-c7e0-4d50-bcf8-afa67f29246d,network=Network(4167bd9a-4666-4e4b-8b36-eea1ff220878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28d36b9c-c7') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:07:28 user nova-compute[82479]: DEBUG os_vif [None req-f20624ad-cc2a-4842-bab9-5fff881cfb53 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:66:9d,bridge_name='br-int',has_traffic_filtering=True,id=28d36b9c-c7e0-4d50-bcf8-afa67f29246d,network=Network(4167bd9a-4666-4e4b-8b36-eea1ff220878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28d36b9c-c7') {{(pid=82479) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 00:07:28 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:28 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap28d36b9c-c7, bridge=br-int, if_exists=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:07:28 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:28 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:07:28 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:28 user nova-compute[82479]: INFO os_vif [None req-f20624ad-cc2a-4842-bab9-5fff881cfb53 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:66:9d,bridge_name='br-int',has_traffic_filtering=True,id=28d36b9c-c7e0-4d50-bcf8-afa67f29246d,network=Network(4167bd9a-4666-4e4b-8b36-eea1ff220878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28d36b9c-c7')
Apr 14 00:07:28 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-f20624ad-cc2a-4842-bab9-5fff881cfb53 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Deleting instance files /opt/stack/data/nova/instances/e97abae3-f573-48eb-a218-a8fec436ef3b_del
Apr 14 00:07:28 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-f20624ad-cc2a-4842-bab9-5fff881cfb53 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Deletion of /opt/stack/data/nova/instances/e97abae3-f573-48eb-a218-a8fec436ef3b_del complete
Apr 14 00:07:28 user nova-compute[82479]: INFO nova.compute.manager [None req-f20624ad-cc2a-4842-bab9-5fff881cfb53 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Took 0.93 seconds to destroy the instance on the hypervisor.
Apr 14 00:07:28 user nova-compute[82479]: DEBUG oslo.service.loopingcall [None req-f20624ad-cc2a-4842-bab9-5fff881cfb53 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82479) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 00:07:28 user nova-compute[82479]: DEBUG nova.compute.manager [-] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Deallocating network for instance {{(pid=82479) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 00:07:28 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] deallocate_for_instance() {{(pid=82479) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 00:07:28 user nova-compute[82479]: DEBUG nova.compute.manager [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WjavJYiu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '716b5e3f-20c7-40ef-9a45-71be0cfeaeb2', 'attached_at': '', 'detached_at': '', 'volume_id': '2024a461-c307-42e0-976a-bde8b1ef0bed', 'serial': '2024a461-c307-42e0-976a-bde8b1ef0bed'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xEjqaYiH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '716b5e3f-20c7-40ef-9a45-71be0cfeaeb2', 'attached_at': '', 'detached_at': '', 'volume_id': 'c7267b8e-f20c-4625-b82d-b1a31a337714', 'serial'} {{(pid=82479) _swap_volume /opt/stack/nova/nova/compute/manager.py:7656}}
Apr 14 00:07:28 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Calling os-brick to attach iSCSI Volume {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 00:07:28 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WjavJYiu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:07:28 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:07:28 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:07:28 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:07:28 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:07:28 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:07:28 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:07:28 user nova-compute[82479]: INFO os_brick.initiator.connectors.iscsi [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 00:07:28 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed -p 172.16.0.220:3260 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:28 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:28 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f2d9d9-b24d-428b-a5ef-1c3b80faca3a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:28 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 00:07:28 user nova-compute[82479]:  {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:07:28 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed -p 172.16.0.220:3260 --interface default --op new {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:28 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:28 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b68c181-726f-4355-85b3-b266011610c1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed] added\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:28 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed] added
Apr 14 00:07:28 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:07:28 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:28 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:28 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[f21e529a-f68c-4cdf-8ace-498ed8ff4801]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:28 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:07:28 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:28 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:28 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a11d4ec-d3a5-44d9-8f68-e3ee387fc652]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:28 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:07:28 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WjavJYiu {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:28 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WjavJYiu" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:28 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76b7113-cd76-443f-9de9-5dcd838229fd]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:28 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WjavJYiu'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:07:28 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:28 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:28 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc5d4a47-4b4f-4cce-89ee-e7e39caa8e5a]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:28 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:07:28 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:28 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:28 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[292808c9-9bed-4b3e-8f5a-7f5702c79b95]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:28 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:07:28 user nova-compute[82479]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 (non-flash)
Apr 14 00:07:28 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:07:28 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:07:28 user nova-compute[82479]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 (non-flash)
Apr 14 00:07:28 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:07:29 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed -p 172.16.0.220:3260 --login {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:29 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:29 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed53319-7f62-4373-b6a8-0fdb703b482f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:29 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed, portal: 172.16.0.220,3260]
Apr 14 00:07:29 user nova-compute[82479]: Login to [iface: default, target: iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed, portal: 172.16.0.220,3260] successful.
Apr 14 00:07:29 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:07:29 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:29 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:29 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[33caabd8-0e39-4ddf-8273-47f9c172c3f8]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:29 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:07:29 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:29 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:29 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[399bdb0f-781e-4928-9066-f0a80367113a]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:29 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:07:29 user nova-compute[82479]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 (non-flash)
Apr 14 00:07:29 user nova-compute[82479]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed (non-flash)
Apr 14 00:07:29 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:07:29 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:07:29 user nova-compute[82479]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 (non-flash)
Apr 14 00:07:29 user nova-compute[82479]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed (non-flash)
Apr 14 00:07:29 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:07:29 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:07:29 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] Connected to 172.16.0.220:3260 {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 00:07:29 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] HCTL ('35', '-', '-', 0) found on session 6 with lun 0 {{(pid=82479) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 00:07:29 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] Scanning host 35 c: -, t: -, l: 0) {{(pid=82479) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 00:07:29 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:29 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:29 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac66257-a85a-415f-95d3-7a667e50087d]: (4, ('- - 0', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:29 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] Searching for a device in session 6 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=82479) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 00:07:29 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WjavJYiu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 00:07:29 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Updating instance_info_cache with network_info: [] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:07:29 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Took 0.86 seconds to deallocate network for instance.
Apr 14 00:07:29 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f20624ad-cc2a-4842-bab9-5fff881cfb53 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:07:29 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f20624ad-cc2a-4842-bab9-5fff881cfb53 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:07:29 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681430849.5788703, e3fba4ee-4aae-4ee3-8114-b53510f5442c => Resumed> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:07:29 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] VM Resumed (Lifecycle Event)
Apr 14 00:07:29 user nova-compute[82479]: DEBUG nova.compute.manager [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Instance event wait completed in 0 seconds for  {{(pid=82479) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 00:07:29 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Guest created on hypervisor {{(pid=82479) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 00:07:29 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Instance spawned successfully.
Apr 14 00:07:29 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 00:07:29 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:07:29 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:07:29 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Found default for hw_cdrom_bus of ide {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:07:29 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Found default for hw_disk_bus of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:07:29 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Found default for hw_input_bus of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:07:29 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Found default for hw_pointer_model of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:07:29 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Found default for hw_video_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:07:29 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Found default for hw_vif_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:07:29 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:07:29 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681430849.5792844, e3fba4ee-4aae-4ee3-8114-b53510f5442c => Started> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:07:29 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] VM Started (Lifecycle Event)
Apr 14 00:07:29 user nova-compute[82479]: DEBUG nova.compute.manager [req-a06aeac2-7c21-48bf-b2d2-1a54e4ff36dd req-ec458ea2-437b-4dca-a774-c8e8b4ef637c service nova] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Received event network-vif-plugged-526b82aa-8f72-4ad7-8c1f-2aac7a4a2111 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:07:29 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-a06aeac2-7c21-48bf-b2d2-1a54e4ff36dd req-ec458ea2-437b-4dca-a774-c8e8b4ef637c service nova] Acquiring lock "e3fba4ee-4aae-4ee3-8114-b53510f5442c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:07:29 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-a06aeac2-7c21-48bf-b2d2-1a54e4ff36dd req-ec458ea2-437b-4dca-a774-c8e8b4ef637c service nova] Lock "e3fba4ee-4aae-4ee3-8114-b53510f5442c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:07:29 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-a06aeac2-7c21-48bf-b2d2-1a54e4ff36dd req-ec458ea2-437b-4dca-a774-c8e8b4ef637c service nova] Lock "e3fba4ee-4aae-4ee3-8114-b53510f5442c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:07:29 user nova-compute[82479]: DEBUG nova.compute.manager [req-a06aeac2-7c21-48bf-b2d2-1a54e4ff36dd req-ec458ea2-437b-4dca-a774-c8e8b4ef637c service nova] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] No waiting events found dispatching network-vif-plugged-526b82aa-8f72-4ad7-8c1f-2aac7a4a2111 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:07:29 user nova-compute[82479]: WARNING nova.compute.manager [req-a06aeac2-7c21-48bf-b2d2-1a54e4ff36dd req-ec458ea2-437b-4dca-a774-c8e8b4ef637c service nova] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Received unexpected event network-vif-plugged-526b82aa-8f72-4ad7-8c1f-2aac7a4a2111 for instance with vm_state building and task_state spawning.
Apr 14 00:07:29 user nova-compute[82479]: DEBUG nova.compute.manager [req-a06aeac2-7c21-48bf-b2d2-1a54e4ff36dd req-ec458ea2-437b-4dca-a774-c8e8b4ef637c service nova] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Received event network-vif-deleted-28d36b9c-c7e0-4d50-bcf8-afa67f29246d {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:07:29 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:07:29 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:07:29 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:07:29 user nova-compute[82479]: INFO nova.compute.manager [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Took 6.92 seconds to spawn the instance on the hypervisor.
Apr 14 00:07:29 user nova-compute[82479]: DEBUG nova.compute.manager [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:07:29 user nova-compute[82479]: INFO nova.compute.manager [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Took 7.74 seconds to build instance.
Apr 14 00:07:29 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-63230dd4-b10f-4467-9a3e-cc918d27e32d tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "e3fba4ee-4aae-4ee3-8114-b53510f5442c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.861s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:07:29 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-f20624ad-cc2a-4842-bab9-5fff881cfb53 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:07:29 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-f20624ad-cc2a-4842-bab9-5fff881cfb53 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:07:29 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f20624ad-cc2a-4842-bab9-5fff881cfb53 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.340s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:07:29 user nova-compute[82479]: INFO nova.scheduler.client.report [None req-f20624ad-cc2a-4842-bab9-5fff881cfb53 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Deleted allocations for instance e97abae3-f573-48eb-a218-a8fec436ef3b
Apr 14 00:07:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f20624ad-cc2a-4842-bab9-5fff881cfb53 tempest-AttachSCSIVolumeTestJSON-1907301903 tempest-AttachSCSIVolumeTestJSON-1907301903-project-member] Lock "e97abae3-f573-48eb-a218-a8fec436ef3b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.349s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:07:30 user nova-compute[82479]: DEBUG nova.compute.manager [req-1335af55-54fa-475c-ad92-b02c691d6725 req-042a0abd-7cc4-40cb-b982-2dd08d63deb8 service nova] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Received event network-vif-unplugged-28d36b9c-c7e0-4d50-bcf8-afa67f29246d {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:07:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-1335af55-54fa-475c-ad92-b02c691d6725 req-042a0abd-7cc4-40cb-b982-2dd08d63deb8 service nova] Acquiring lock "e97abae3-f573-48eb-a218-a8fec436ef3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:07:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-1335af55-54fa-475c-ad92-b02c691d6725 req-042a0abd-7cc4-40cb-b982-2dd08d63deb8 service nova] Lock "e97abae3-f573-48eb-a218-a8fec436ef3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:07:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-1335af55-54fa-475c-ad92-b02c691d6725 req-042a0abd-7cc4-40cb-b982-2dd08d63deb8 service nova] Lock "e97abae3-f573-48eb-a218-a8fec436ef3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:07:30 user nova-compute[82479]: DEBUG nova.compute.manager [req-1335af55-54fa-475c-ad92-b02c691d6725 req-042a0abd-7cc4-40cb-b982-2dd08d63deb8 service nova] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] No waiting events found dispatching network-vif-unplugged-28d36b9c-c7e0-4d50-bcf8-afa67f29246d {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:07:30 user nova-compute[82479]: WARNING nova.compute.manager [req-1335af55-54fa-475c-ad92-b02c691d6725 req-042a0abd-7cc4-40cb-b982-2dd08d63deb8 service nova] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Received unexpected event network-vif-unplugged-28d36b9c-c7e0-4d50-bcf8-afa67f29246d for instance with vm_state deleted and task_state None.
Apr 14 00:07:30 user nova-compute[82479]: DEBUG nova.compute.manager [req-1335af55-54fa-475c-ad92-b02c691d6725 req-042a0abd-7cc4-40cb-b982-2dd08d63deb8 service nova] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Received event network-vif-plugged-28d36b9c-c7e0-4d50-bcf8-afa67f29246d {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:07:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-1335af55-54fa-475c-ad92-b02c691d6725 req-042a0abd-7cc4-40cb-b982-2dd08d63deb8 service nova] Acquiring lock "e97abae3-f573-48eb-a218-a8fec436ef3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:07:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-1335af55-54fa-475c-ad92-b02c691d6725 req-042a0abd-7cc4-40cb-b982-2dd08d63deb8 service nova] Lock "e97abae3-f573-48eb-a218-a8fec436ef3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:07:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-1335af55-54fa-475c-ad92-b02c691d6725 req-042a0abd-7cc4-40cb-b982-2dd08d63deb8 service nova] Lock "e97abae3-f573-48eb-a218-a8fec436ef3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:07:30 user nova-compute[82479]: DEBUG nova.compute.manager [req-1335af55-54fa-475c-ad92-b02c691d6725 req-042a0abd-7cc4-40cb-b982-2dd08d63deb8 service nova] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] No waiting events found dispatching network-vif-plugged-28d36b9c-c7e0-4d50-bcf8-afa67f29246d {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:07:30 user nova-compute[82479]: WARNING nova.compute.manager [req-1335af55-54fa-475c-ad92-b02c691d6725 req-042a0abd-7cc4-40cb-b982-2dd08d63deb8 service nova] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Received unexpected event network-vif-plugged-28d36b9c-c7e0-4d50-bcf8-afa67f29246d for instance with vm_state deleted and task_state None.
Apr 14 00:07:30 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:07:30 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '23633383563333363', 'path': '/dev/sdd'} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:07:30 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23633383563333363', 'path': '/dev/sdd'} {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 00:07:30 user nova-compute[82479]: DEBUG nova.objects.instance [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] Lazy-loading 'flavor' on Instance uuid 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:07:30 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:30 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=82479) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 00:07:31 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] COPY block job progress, current cursor: 84934656 final cursor: 1073741824 {{(pid=82479) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 00:07:31 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] COPY block job progress, current cursor: 144703488 final cursor: 1073741824 {{(pid=82479) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 00:07:31 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad8d0773-6b84-4d51-8fc4-e9664f932131 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Calling os-brick to attach iSCSI Volume {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 00:07:31 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8d0773-6b84-4d51-8fc4-e9664f932131 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KIpsbQYd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:07:31 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-ad8d0773-6b84-4d51-8fc4-e9664f932131 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:07:31 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-ad8d0773-6b84-4d51-8fc4-e9664f932131 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:07:31 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-ad8d0773-6b84-4d51-8fc4-e9664f932131 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:07:31 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-ad8d0773-6b84-4d51-8fc4-e9664f932131 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:07:31 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-ad8d0773-6b84-4d51-8fc4-e9664f932131 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:07:31 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-ad8d0773-6b84-4d51-8fc4-e9664f932131 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:07:31 user nova-compute[82479]: INFO os_brick.initiator.connectors.iscsi [None req-ad8d0773-6b84-4d51-8fc4-e9664f932131 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 00:07:31 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a -p 172.16.0.220:3260 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:31 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:31 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d8bfb8-48a8-4fd3-bccf-47ad4943d8d9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:31 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8d0773-6b84-4d51-8fc4-e9664f932131 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 00:07:31 user nova-compute[82479]:  {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:07:31 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a -p 172.16.0.220:3260 --interface default --op new {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:32 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:32 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcec2b0c-78e9-4057-9798-c5ec2402ff9a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a] added\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:32 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8d0773-6b84-4d51-8fc4-e9664f932131 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a] added
Apr 14 00:07:32 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:07:32 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:32 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.045s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:32 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee6ebc0-8e64-4c35-80fd-628abeb088ec]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:32 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8d0773-6b84-4d51-8fc4-e9664f932131 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:07:32 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:32 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:32 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1b7f91-6644-4ed3-b155-53651ecf2fee]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:32 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8d0773-6b84-4d51-8fc4-e9664f932131 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:07:32 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KIpsbQYd {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:32 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KIpsbQYd" returned: 0 in 0.033s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:32 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[538f60b9-7e4f-482d-b84f-8a02127b9aef]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:32 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8d0773-6b84-4d51-8fc4-e9664f932131 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KIpsbQYd'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:07:32 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:32 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] COPY block job progress, current cursor: 293601280 final cursor: 1073741824 {{(pid=82479) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 00:07:32 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:32 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[8244e016-9fa5-4eed-9acc-0400c7dbaf45]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:32 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8d0773-6b84-4d51-8fc4-e9664f932131 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:07:32 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:32 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:32 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f96ff5-fa3c-4471-b986-10814c77a577]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:32 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8d0773-6b84-4d51-8fc4-e9664f932131 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:07:32 user nova-compute[82479]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 (non-flash)
Apr 14 00:07:32 user nova-compute[82479]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed (non-flash)
Apr 14 00:07:32 user nova-compute[82479]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe (non-flash)
Apr 14 00:07:32 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:07:32 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8d0773-6b84-4d51-8fc4-e9664f932131 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:07:32 user nova-compute[82479]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 (non-flash)
Apr 14 00:07:32 user nova-compute[82479]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed (non-flash)
Apr 14 00:07:32 user nova-compute[82479]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe (non-flash)
Apr 14 00:07:32 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:07:32 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a -p 172.16.0.220:3260 --login {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:32 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a -p 172.16.0.220:3260 --login" returned: 0 in 0.135s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:32 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb8d31d-3811-4ff3-bf08-a7f6da40630c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:32 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8d0773-6b84-4d51-8fc4-e9664f932131 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a, portal: 172.16.0.220,3260]
Apr 14 00:07:32 user nova-compute[82479]: Login to [iface: default, target: iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a, portal: 172.16.0.220,3260] successful.
Apr 14 00:07:32 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:07:32 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:32 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:32 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb97842-4116-4a31-8129-f545587139de]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:32 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8d0773-6b84-4d51-8fc4-e9664f932131 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:07:32 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:32 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.046s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:32 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[b545b9e5-2488-4598-a045-dff9f218d8a1]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:32 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8d0773-6b84-4d51-8fc4-e9664f932131 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:07:32 user nova-compute[82479]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 (non-flash)
Apr 14 00:07:32 user nova-compute[82479]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed (non-flash)
Apr 14 00:07:32 user nova-compute[82479]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe (non-flash)
Apr 14 00:07:32 user nova-compute[82479]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a (non-flash)
Apr 14 00:07:32 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:07:32 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8d0773-6b84-4d51-8fc4-e9664f932131 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:07:32 user nova-compute[82479]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 (non-flash)
Apr 14 00:07:32 user nova-compute[82479]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed (non-flash)
Apr 14 00:07:32 user nova-compute[82479]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe (non-flash)
Apr 14 00:07:32 user nova-compute[82479]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a (non-flash)
Apr 14 00:07:32 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:07:32 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-ad8d0773-6b84-4d51-8fc4-e9664f932131 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.512s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:07:32 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8d0773-6b84-4d51-8fc4-e9664f932131 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Connected to 172.16.0.220:3260 {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 00:07:32 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-ad8d0773-6b84-4d51-8fc4-e9664f932131 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] HCTL ('37', '-', '-', 0) found on session 8 with lun 0 {{(pid=82479) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 00:07:32 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-ad8d0773-6b84-4d51-8fc4-e9664f932131 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=82479) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 00:07:32 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:32 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.027s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:32 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c87303-b6b4-4e94-b005-a4dd9aa1fb2d]: (4, ('- - 0', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:32 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-ad8d0773-6b84-4d51-8fc4-e9664f932131 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Searching for a device in session 8 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=82479) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 00:07:32 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8d0773-6b84-4d51-8fc4-e9664f932131 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KIpsbQYd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 00:07:32 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] COPY block job progress, current cursor: 437256192 final cursor: 1073741824 {{(pid=82479) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 00:07:33 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] COPY block job progress, current cursor: 602931200 final cursor: 1073741824 {{(pid=82479) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 00:07:33 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-ad8d0773-6b84-4d51-8fc4-e9664f932131 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.566s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:07:33 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad8d0773-6b84-4d51-8fc4-e9664f932131 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] <== connect_volume: return (1569ms) {'type': 'block', 'scsi_wwn': '26637633937626537', 'path': '/dev/sdf'} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:07:33 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad8d0773-6b84-4d51-8fc4-e9664f932131 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637633937626537', 'path': '/dev/sdf'} {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 00:07:33 user nova-compute[82479]: DEBUG nova.objects.instance [None req-ad8d0773-6b84-4d51-8fc4-e9664f932131 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lazy-loading 'flavor' on Instance uuid b9c6323b-ed7f-4f86-93ad-3ef4726b01ff {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:07:33 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:33 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-ad8d0773-6b84-4d51-8fc4-e9664f932131 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 00:07:33 user nova-compute[82479]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:07:33 user nova-compute[82479]:   <source dev="/dev/sdf"/>
Apr 14 00:07:33 user nova-compute[82479]:   <target dev="vdb" bus="virtio"/>
Apr 14 00:07:33 user nova-compute[82479]:   <serial>2509f860-ef4a-443f-9fc8-171e0df13a7a</serial>
Apr 14 00:07:33 user nova-compute[82479]: </disk>
Apr 14 00:07:33 user nova-compute[82479]:  {{(pid=82479) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 00:07:33 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] COPY block job progress, current cursor: 765460480 final cursor: 1073741824 {{(pid=82479) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 00:07:34 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] COPY block job progress, current cursor: 912261120 final cursor: 1073741824 {{(pid=82479) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 00:07:34 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ad8d0773-6b84-4d51-8fc4-e9664f932131 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:07:34 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ad8d0773-6b84-4d51-8fc4-e9664f932131 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] No BDM found with device name hda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:07:34 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ad8d0773-6b84-4d51-8fc4-e9664f932131 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] No VIF found with MAC fa:16:3e:9b:6b:79, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:07:34 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ad8d0773-6b84-4d51-8fc4-e9664f932131 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "b9c6323b-ed7f-4f86-93ad-3ef4726b01ff" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.866s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:07:34 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=82479) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 00:07:34 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] calling os-brick to detach iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 00:07:34 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, {'target_iqn': 'iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xEjqaYiH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:07:34 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:07:34 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:07:34 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:07:34 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:34 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:34 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[3749b03c-72d8-48c1-9b98-1ba2040be833]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:34 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 00:07:34 user nova-compute[82479]: No targets found.
Apr 14 00:07:34 user nova-compute[82479]: iSNS:
Apr 14 00:07:34 user nova-compute[82479]: No targets found.
Apr 14 00:07:34 user nova-compute[82479]: STATIC:
Apr 14 00:07:34 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714
Apr 14 00:07:34 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:07:34 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:07:34 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe
Apr 14 00:07:34 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:07:34 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:07:34 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7
Apr 14 00:07:34 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:07:34 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:07:34 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed
Apr 14 00:07:34 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:07:34 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:07:34 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a
Apr 14 00:07:34 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:07:34 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:07:34 user nova-compute[82479]: FIRMWARE:
Apr 14 00:07:34 user nova-compute[82479]: No targets found.
Apr 14 00:07:34 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:07:34 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 00:07:34 user nova-compute[82479]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 00:07:34 user nova-compute[82479]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82479) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 00:07:34 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714', 0)] {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 00:07:34 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:34 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:34 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7623587-c2f4-4644-b17c-92825b02b377]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:34 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:34 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:34 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[2649467e-7983-4903-b922-99096fcb8594]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:34 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:07:34 user nova-compute[82479]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 (non-flash)
Apr 14 00:07:34 user nova-compute[82479]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed (non-flash)
Apr 14 00:07:34 user nova-compute[82479]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe (non-flash)
Apr 14 00:07:34 user nova-compute[82479]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a (non-flash)
Apr 14 00:07:34 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:07:34 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:07:34 user nova-compute[82479]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 (non-flash)
Apr 14 00:07:34 user nova-compute[82479]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed (non-flash)
Apr 14 00:07:34 user nova-compute[82479]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe (non-flash)
Apr 14 00:07:34 user nova-compute[82479]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a (non-flash)
Apr 14 00:07:34 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:07:34 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f333830ae60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714'): ({'sdb'}, set())}) {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 00:07:34 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] Removing single pathed devices sdb {{(pid=82479) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 00:07:34 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:34 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:34 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd34667-f956-4d99-9b53-dedc9c9008b4]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:34 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:34 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:34 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb818119-2167-4fe6-8f65-12ab33d55b46]: (4, ('ok\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:34 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] Flushing IO for device /dev/sdb {{(pid=82479) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 00:07:34 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:35 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:35 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6367616-b19d-4f9a-a7b7-a27979c0db6a]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:35 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82479) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 00:07:35 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:35 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:35 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a31358b-f68e-47f0-85dd-e9fc98116364]: (4, ('1', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:35 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 00:07:35 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] SCSI volumes sdb have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 00:07:35 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714')] {{(pid=82479) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 00:07:35 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:35 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:35 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45cb74a-860e-4eaa-a788-78f45814278f]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:35 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:07:35 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 -p 172.16.0.220:3260 --logout {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:35 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:35 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f9d8a09-4ee5-441d-8153-d5bba7bda27a]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:35 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714, portal: 172.16.0.220,3260]
Apr 14 00:07:35 user nova-compute[82479]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714, portal: 172.16.0.220,3260] successful.
Apr 14 00:07:35 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:07:35 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 -p 172.16.0.220:3260 --op delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:35 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:35 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b02652a-6a6f-4266-81c0-2bd644bb0630]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:35 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:07:35 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:07:35 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] <== disconnect_volume: return (327ms) None {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:07:35 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Disconnected iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 00:07:35 user nova-compute[82479]: DEBUG nova.compute.manager [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WjavJYiu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '716b5e3f-20c7-40ef-9a45-71be0cfeaeb2', 'attached_at': '', 'detached_at': '', 'volume_id': '2024a461-c307-42e0-976a-bde8b1ef0bed', 'serial'} {{(pid=82479) _swap_volume /opt/stack/nova/nova/compute/manager.py:7665}}
Apr 14 00:07:35 user nova-compute[82479]: DEBUG nova.compute.manager [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] swap_volume: removing Cinder connection for volume c7267b8e-f20c-4625-b82d-b1a31a337714 {{(pid=82479) _swap_volume /opt/stack/nova/nova/compute/manager.py:7710}}
Apr 14 00:07:35 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:36 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-875e90a3-d7ec-4722-9566-3313c929882b tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Acquiring lock "b9c6323b-ed7f-4f86-93ad-3ef4726b01ff" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:07:36 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-875e90a3-d7ec-4722-9566-3313c929882b tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "b9c6323b-ed7f-4f86-93ad-3ef4726b01ff" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:07:36 user nova-compute[82479]: INFO nova.compute.manager [None req-875e90a3-d7ec-4722-9566-3313c929882b tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Detaching volume 2509f860-ef4a-443f-9fc8-171e0df13a7a
Apr 14 00:07:36 user nova-compute[82479]: DEBUG nova.compute.manager [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] swap_volume: Updating volume c7267b8e-f20c-4625-b82d-b1a31a337714 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "WjavJYiu", "auth_password": "cIWh4w5LDsd1NV", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdd", "volume_id": "2024a461-c307-42e0-976a-bde8b1ef0bed"}, "status": "reserved", "instance": "716b5e3f-20c7-40ef-9a45-71be0cfeaeb2", "attached_at": "", "detached_at": "", "volume_id": "2024a461-c307-42e0-976a-bde8b1ef0bed", "serial": "2024a461-c307-42e0-976a-bde8b1ef0bed"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '2024a461-c307-42e0-976a-bde8b1ef0bed', 'no_device': None, 'attachment_id': '74bac691-d1f6-43b8-a34c-bed108865e23'} {{(pid=82479) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7858}}
Apr 14 00:07:36 user nova-compute[82479]: INFO nova.virt.block_device [None req-875e90a3-d7ec-4722-9566-3313c929882b tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Attempting to driver detach volume 2509f860-ef4a-443f-9fc8-171e0df13a7a from mountpoint /dev/vdb
Apr 14 00:07:36 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-875e90a3-d7ec-4722-9566-3313c929882b tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Attempting to detach device vdb from instance b9c6323b-ed7f-4f86-93ad-3ef4726b01ff from the persistent domain config. {{(pid=82479) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 00:07:36 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-875e90a3-d7ec-4722-9566-3313c929882b tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 00:07:36 user nova-compute[82479]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:07:36 user nova-compute[82479]:   <source dev="/dev/sdf"/>
Apr 14 00:07:36 user nova-compute[82479]:   <target dev="vdb" bus="virtio"/>
Apr 14 00:07:36 user nova-compute[82479]:   <serial>2509f860-ef4a-443f-9fc8-171e0df13a7a</serial>
Apr 14 00:07:36 user nova-compute[82479]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 14 00:07:36 user nova-compute[82479]: </disk>
Apr 14 00:07:36 user nova-compute[82479]:  {{(pid=82479) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 00:07:36 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-875e90a3-d7ec-4722-9566-3313c929882b tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Successfully detached device vdb from instance b9c6323b-ed7f-4f86-93ad-3ef4726b01ff from the persistent domain config.
Apr 14 00:07:36 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-875e90a3-d7ec-4722-9566-3313c929882b tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b9c6323b-ed7f-4f86-93ad-3ef4726b01ff from the live domain config. {{(pid=82479) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 00:07:36 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-875e90a3-d7ec-4722-9566-3313c929882b tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 00:07:36 user nova-compute[82479]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:07:36 user nova-compute[82479]:   <source dev="/dev/sdf"/>
Apr 14 00:07:36 user nova-compute[82479]:   <target dev="vdb" bus="virtio"/>
Apr 14 00:07:36 user nova-compute[82479]:   <serial>2509f860-ef4a-443f-9fc8-171e0df13a7a</serial>
Apr 14 00:07:36 user nova-compute[82479]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 14 00:07:36 user nova-compute[82479]: </disk>
Apr 14 00:07:36 user nova-compute[82479]:  {{(pid=82479) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 00:07:36 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] Lock "716b5e3f-20c7-40ef-9a45-71be0cfeaeb2" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 12.565s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:07:36 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Received event <DeviceRemovedEvent: 1681430856.6131806, b9c6323b-ed7f-4f86-93ad-3ef4726b01ff => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82479) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 00:07:36 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-875e90a3-d7ec-4722-9566-3313c929882b tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b9c6323b-ed7f-4f86-93ad-3ef4726b01ff {{(pid=82479) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 00:07:36 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-875e90a3-d7ec-4722-9566-3313c929882b tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Successfully detached device vdb from instance b9c6323b-ed7f-4f86-93ad-3ef4726b01ff from the live domain config.
Apr 14 00:07:36 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-875e90a3-d7ec-4722-9566-3313c929882b tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] calling os-brick to detach iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 00:07:36 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-875e90a3-d7ec-4722-9566-3313c929882b tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, {'target_iqn': 'iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KIpsbQYd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:07:36 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-875e90a3-d7ec-4722-9566-3313c929882b tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:07:36 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-875e90a3-d7ec-4722-9566-3313c929882b tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:07:36 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-875e90a3-d7ec-4722-9566-3313c929882b tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:07:36 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:36 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:36 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[80071efd-ced5-4dd4-a4a4-ec6359352dba]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:36 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-875e90a3-d7ec-4722-9566-3313c929882b tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 00:07:36 user nova-compute[82479]: No targets found.
Apr 14 00:07:36 user nova-compute[82479]: iSNS:
Apr 14 00:07:36 user nova-compute[82479]: No targets found.
Apr 14 00:07:36 user nova-compute[82479]: STATIC:
Apr 14 00:07:36 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe
Apr 14 00:07:36 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:07:36 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:07:36 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7
Apr 14 00:07:36 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:07:36 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:07:36 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed
Apr 14 00:07:36 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:07:36 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:07:36 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a
Apr 14 00:07:36 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:07:36 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:07:36 user nova-compute[82479]: FIRMWARE:
Apr 14 00:07:36 user nova-compute[82479]: No targets found.
Apr 14 00:07:36 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:07:36 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-875e90a3-d7ec-4722-9566-3313c929882b tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 00:07:36 user nova-compute[82479]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 00:07:36 user nova-compute[82479]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82479) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 00:07:36 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-875e90a3-d7ec-4722-9566-3313c929882b tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a', 0)] {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 00:07:36 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:36 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:36 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[325f3747-c554-4faa-b37b-b1b7cb08c595]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:36 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:36 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:36 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[86877d2f-0bd6-40a7-b7af-173ed72a7844]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:36 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-875e90a3-d7ec-4722-9566-3313c929882b tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:07:36 user nova-compute[82479]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed (non-flash)
Apr 14 00:07:36 user nova-compute[82479]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe (non-flash)
Apr 14 00:07:36 user nova-compute[82479]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a (non-flash)
Apr 14 00:07:36 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:07:36 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-875e90a3-d7ec-4722-9566-3313c929882b tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:07:36 user nova-compute[82479]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed (non-flash)
Apr 14 00:07:36 user nova-compute[82479]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe (non-flash)
Apr 14 00:07:36 user nova-compute[82479]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a (non-flash)
Apr 14 00:07:36 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:07:36 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-875e90a3-d7ec-4722-9566-3313c929882b tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3344b0e440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a'): ({'sdf'}, set())}) {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 00:07:36 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-875e90a3-d7ec-4722-9566-3313c929882b tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Removing single pathed devices sdf {{(pid=82479) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 00:07:36 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:36 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:36 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeee8c04-40b5-4d6b-a672-b6ba6ecbe422]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:36 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:36 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:36 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[facdb415-9798-48b5-8776-c12e46c94ebe]: (4, ('ok\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:36 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-875e90a3-d7ec-4722-9566-3313c929882b tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Flushing IO for device /dev/sdf {{(pid=82479) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 00:07:36 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:36 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:36 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[85de0b59-734a-4452-b14f-6d9eb63092d7]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:36 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-875e90a3-d7ec-4722-9566-3313c929882b tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=82479) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 00:07:36 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:36 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.042s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:36 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6be81f-4c68-4eea-a931-99ff81c6d4ef]: (4, ('1', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:36 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-875e90a3-d7ec-4722-9566-3313c929882b tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 00:07:36 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-875e90a3-d7ec-4722-9566-3313c929882b tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] SCSI volumes sdf have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 00:07:36 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-875e90a3-d7ec-4722-9566-3313c929882b tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a')] {{(pid=82479) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 00:07:36 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:36 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:36 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[42232fee-e8e2-46bf-ae90-008430c4d81d]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:36 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-875e90a3-d7ec-4722-9566-3313c929882b tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:07:36 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a -p 172.16.0.220:3260 --logout {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:36 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:36 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a71e43f-94c9-4e22-b166-fa75ee5db15b]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:36 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-875e90a3-d7ec-4722-9566-3313c929882b tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a, portal: 172.16.0.220,3260]
Apr 14 00:07:36 user nova-compute[82479]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a, portal: 172.16.0.220,3260] successful.
Apr 14 00:07:36 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:07:36 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a -p 172.16.0.220:3260 --op delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:36 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:36 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3218ba-a994-47e0-92e5-41cd5351283b]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:36 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-875e90a3-d7ec-4722-9566-3313c929882b tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:07:36 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-875e90a3-d7ec-4722-9566-3313c929882b tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:07:36 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-875e90a3-d7ec-4722-9566-3313c929882b tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] <== disconnect_volume: return (327ms) None {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:07:36 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-875e90a3-d7ec-4722-9566-3313c929882b tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Disconnected iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 00:07:37 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] Acquiring lock "716b5e3f-20c7-40ef-9a45-71be0cfeaeb2" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:07:37 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] Lock "716b5e3f-20c7-40ef-9a45-71be0cfeaeb2" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:07:37 user nova-compute[82479]: DEBUG os_brick.utils [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:07:37 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:37 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:37 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d74bb4-25de-4abd-a639-d7452b7f33eb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fec92fcfdd3\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:37 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:37 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:37 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96d53f1-6f33-4f7c-970a-c112f8463974]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:37 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:37 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:37 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[826a0003-770b-43bd-95ae-b4a0314b1704]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:37 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[0080790d-7494-4f3e-b52b-b5f9106d7d64]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:37 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] Running cmd (subprocess): nvme version {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:37 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] 'nvme version' failed. Not Retrying. {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:07:37 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] nvme not present on system {{(pid=82479) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 00:07:37 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:37 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:07:37 user nova-compute[82479]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 00:07:37 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[21784d32-873e-470c-bf74-4c1e36a37416]: (4, '') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:37 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82479) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 00:07:37 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 00:07:37 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] LIGHTOS: no hostnqn found. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 00:07:37 user nova-compute[82479]: DEBUG os_brick.utils [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fec92fcfdd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:07:37 user nova-compute[82479]: INFO nova.compute.manager [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Swapping volume 2024a461-c307-42e0-976a-bde8b1ef0bed for c7267b8e-f20c-4625-b82d-b1a31a337714
Apr 14 00:07:38 user nova-compute[82479]: DEBUG nova.objects.instance [None req-875e90a3-d7ec-4722-9566-3313c929882b tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lazy-loading 'flavor' on Instance uuid b9c6323b-ed7f-4f86-93ad-3ef4726b01ff {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:07:38 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-875e90a3-d7ec-4722-9566-3313c929882b tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "b9c6323b-ed7f-4f86-93ad-3ef4726b01ff" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.257s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:07:38 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:39 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-4ac94033-07d2-4369-9a3a-e5f5f1b214c7 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Acquiring lock "interface-b9c6323b-ed7f-4f86-93ad-3ef4726b01ff-8d5fc9ab-cbd3-46df-8389-c67fee40f75f" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:07:39 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-4ac94033-07d2-4369-9a3a-e5f5f1b214c7 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "interface-b9c6323b-ed7f-4f86-93ad-3ef4726b01ff-8d5fc9ab-cbd3-46df-8389-c67fee40f75f" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:07:39 user nova-compute[82479]: DEBUG nova.objects.instance [None req-4ac94033-07d2-4369-9a3a-e5f5f1b214c7 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lazy-loading 'flavor' on Instance uuid b9c6323b-ed7f-4f86-93ad-3ef4726b01ff {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:07:39 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-4ac94033-07d2-4369-9a3a-e5f5f1b214c7 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T00:05:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1428775386',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1428775386',id=9,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIH5r6nQb46UiVWKMJfMdOVDRbtW2F73ea2D8mxSn1YDz9+bRgJ2nBeDW0+0XBiptqCPYYX6nTAHEycBqQz0FHVyYdWdNoLj8ctiSWD+URcLL8GbP5fneDu/2p/eIfeTqw==',key_name='tempest-keypair-2007231770',keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:05:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c4ee7b5626a14c69aefa86192b6e7bac',ramdisk_id='',reservation_id='r-7dnrqpgh',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-694590407',owner_user_name='tempest-TaggedAttachmentsTest-694590407-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T00:05:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38f9a13bd3f74842b61b57b2ea8bf025',uuid=b9c6323b-ed7f-4f86-93ad-3ef4726b01ff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8d5fc9ab-cbd3-46df-8389-c67fee40f75f", "address": "fa:16:3e:c4:e1:fd", "network": {"id": "830e35a7-48e9-4584-b507-5bed2f6e6b5d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-506512841", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c4ee7b5626a14c69aefa86192b6e7bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d5fc9ab-cb", "ovs_interfaceid": "8d5fc9ab-cbd3-46df-8389-c67fee40f75f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82479) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 00:07:39 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-4ac94033-07d2-4369-9a3a-e5f5f1b214c7 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Converting VIF {"id": "8d5fc9ab-cbd3-46df-8389-c67fee40f75f", "address": "fa:16:3e:c4:e1:fd", "network": {"id": "830e35a7-48e9-4584-b507-5bed2f6e6b5d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-506512841", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c4ee7b5626a14c69aefa86192b6e7bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d5fc9ab-cb", "ovs_interfaceid": "8d5fc9ab-cbd3-46df-8389-c67fee40f75f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:07:39 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-4ac94033-07d2-4369-9a3a-e5f5f1b214c7 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:e1:fd,bridge_name='br-int',has_traffic_filtering=True,id=8d5fc9ab-cbd3-46df-8389-c67fee40f75f,network=Network(830e35a7-48e9-4584-b507-5bed2f6e6b5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d5fc9ab-cb') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:07:39 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-4ac94033-07d2-4369-9a3a-e5f5f1b214c7 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c4:e1:fd"/><model type="virtio"/><mtu size="1442"/><target dev="tap8d5fc9ab-cb"/></interface> {{(pid=82479) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 14 00:07:39 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-4ac94033-07d2-4369-9a3a-e5f5f1b214c7 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c4:e1:fd"/><model type="virtio"/><mtu size="1442"/><target dev="tap8d5fc9ab-cb"/></interface> {{(pid=82479) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 14 00:07:39 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-4ac94033-07d2-4369-9a3a-e5f5f1b214c7 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Attempting to detach device tap8d5fc9ab-cb from instance b9c6323b-ed7f-4f86-93ad-3ef4726b01ff from the persistent domain config. {{(pid=82479) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 00:07:39 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-4ac94033-07d2-4369-9a3a-e5f5f1b214c7 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] detach device xml: <interface type="ethernet">
Apr 14 00:07:39 user nova-compute[82479]:   <mac address="fa:16:3e:c4:e1:fd"/>
Apr 14 00:07:39 user nova-compute[82479]:   <model type="virtio"/>
Apr 14 00:07:39 user nova-compute[82479]:   <mtu size="1442"/>
Apr 14 00:07:39 user nova-compute[82479]:   <target dev="tap8d5fc9ab-cb"/>
Apr 14 00:07:39 user nova-compute[82479]: </interface>
Apr 14 00:07:39 user nova-compute[82479]:  {{(pid=82479) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 00:07:39 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-4ac94033-07d2-4369-9a3a-e5f5f1b214c7 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c4:e1:fd"/><model type="virtio"/><mtu size="1442"/><target dev="tap8d5fc9ab-cb"/></interface> {{(pid=82479) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 14 00:07:39 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-4ac94033-07d2-4369-9a3a-e5f5f1b214c7 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:c4:e1:fd"/><model type="virtio"/><mtu size="1442"/><target dev="tap8d5fc9ab-cb"/></interface>not found in domain: <domain type='kvm' id='9'>
Apr 14 00:07:39 user nova-compute[82479]:   <name>instance-00000009</name>
Apr 14 00:07:39 user nova-compute[82479]:   <uuid>b9c6323b-ed7f-4f86-93ad-3ef4726b01ff</uuid>
Apr 14 00:07:39 user nova-compute[82479]:   <metadata>
Apr 14 00:07:39 user nova-compute[82479]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 00:07:39 user nova-compute[82479]:   <nova:package version="0.0.0"/>
Apr 14 00:07:39 user nova-compute[82479]:   <nova:name>tempest-device-tagging-server-1428775386</nova:name>
Apr 14 00:07:39 user nova-compute[82479]:   <nova:creationTime>2023-04-14 00:07:25</nova:creationTime>
Apr 14 00:07:39 user nova-compute[82479]:   <nova:flavor name="m1.nano">
Apr 14 00:07:39 user nova-compute[82479]:     <nova:memory>128</nova:memory>
Apr 14 00:07:39 user nova-compute[82479]:     <nova:disk>1</nova:disk>
Apr 14 00:07:39 user nova-compute[82479]:     <nova:swap>0</nova:swap>
Apr 14 00:07:39 user nova-compute[82479]:     <nova:ephemeral>0</nova:ephemeral>
Apr 14 00:07:39 user nova-compute[82479]:     <nova:vcpus>1</nova:vcpus>
Apr 14 00:07:39 user nova-compute[82479]:   </nova:flavor>
Apr 14 00:07:39 user nova-compute[82479]:   <nova:owner>
Apr 14 00:07:39 user nova-compute[82479]:     <nova:user uuid="38f9a13bd3f74842b61b57b2ea8bf025">tempest-TaggedAttachmentsTest-694590407-project-member</nova:user>
Apr 14 00:07:39 user nova-compute[82479]:     <nova:project uuid="c4ee7b5626a14c69aefa86192b6e7bac">tempest-TaggedAttachmentsTest-694590407</nova:project>
Apr 14 00:07:39 user nova-compute[82479]:   </nova:owner>
Apr 14 00:07:39 user nova-compute[82479]:   <nova:root type="image" uuid="6db62068-7278-4cd8-b41f-d0140d89e199"/>
Apr 14 00:07:39 user nova-compute[82479]:   <nova:ports>
Apr 14 00:07:39 user nova-compute[82479]:     <nova:port uuid="dc4fb8de-0fc3-4af8-86d0-94c357627f5f">
Apr 14 00:07:39 user nova-compute[82479]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 00:07:39 user nova-compute[82479]:     </nova:port>
Apr 14 00:07:39 user nova-compute[82479]:     <nova:port uuid="8d5fc9ab-cbd3-46df-8389-c67fee40f75f">
Apr 14 00:07:39 user nova-compute[82479]:       <nova:ip type="fixed" address="10.10.10.221" ipVersion="4"/>
Apr 14 00:07:39 user nova-compute[82479]:     </nova:port>
Apr 14 00:07:39 user nova-compute[82479]:   </nova:ports>
Apr 14 00:07:39 user nova-compute[82479]: </nova:instance>
Apr 14 00:07:39 user nova-compute[82479]:   </metadata>
Apr 14 00:07:39 user nova-compute[82479]:   <memory unit='KiB'>131072</memory>
Apr 14 00:07:39 user nova-compute[82479]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 14 00:07:39 user nova-compute[82479]:   <vcpu placement='static'>1</vcpu>
Apr 14 00:07:39 user nova-compute[82479]:   <resource>
Apr 14 00:07:39 user nova-compute[82479]:     <partition>/machine</partition>
Apr 14 00:07:39 user nova-compute[82479]:   </resource>
Apr 14 00:07:39 user nova-compute[82479]:   <sysinfo type='smbios'>
Apr 14 00:07:39 user nova-compute[82479]:     <system>
Apr 14 00:07:39 user nova-compute[82479]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 14 00:07:39 user nova-compute[82479]:       <entry name='product'>OpenStack Nova</entry>
Apr 14 00:07:39 user nova-compute[82479]:       <entry name='version'>0.0.0</entry>
Apr 14 00:07:39 user nova-compute[82479]:       <entry name='serial'>b9c6323b-ed7f-4f86-93ad-3ef4726b01ff</entry>
Apr 14 00:07:39 user nova-compute[82479]:       <entry name='uuid'>b9c6323b-ed7f-4f86-93ad-3ef4726b01ff</entry>
Apr 14 00:07:39 user nova-compute[82479]:       <entry name='family'>Virtual Machine</entry>
Apr 14 00:07:39 user nova-compute[82479]:     </system>
Apr 14 00:07:39 user nova-compute[82479]:   </sysinfo>
Apr 14 00:07:39 user nova-compute[82479]:   <os>
Apr 14 00:07:39 user nova-compute[82479]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 14 00:07:39 user nova-compute[82479]:     <boot dev='hd'/>
Apr 14 00:07:39 user nova-compute[82479]:     <smbios mode='sysinfo'/>
Apr 14 00:07:39 user nova-compute[82479]:   </os>
Apr 14 00:07:39 user nova-compute[82479]:   <features>
Apr 14 00:07:39 user nova-compute[82479]:     <acpi/>
Apr 14 00:07:39 user nova-compute[82479]:     <apic/>
Apr 14 00:07:39 user nova-compute[82479]:     <vmcoreinfo state='on'/>
Apr 14 00:07:39 user nova-compute[82479]:   </features>
Apr 14 00:07:39 user nova-compute[82479]:   <cpu mode='custom' match='exact' check='full'>
Apr 14 00:07:39 user nova-compute[82479]:     <model fallback='forbid'>Nehalem</model>
Apr 14 00:07:39 user nova-compute[82479]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 14 00:07:39 user nova-compute[82479]:     <feature policy='require' name='vme'/>
Apr 14 00:07:39 user nova-compute[82479]:     <feature policy='require' name='x2apic'/>
Apr 14 00:07:39 user nova-compute[82479]:     <feature policy='require' name='hypervisor'/>
Apr 14 00:07:39 user nova-compute[82479]:   </cpu>
Apr 14 00:07:39 user nova-compute[82479]:   <clock offset='utc'>
Apr 14 00:07:39 user nova-compute[82479]:     <timer name='pit' tickpolicy='delay'/>
Apr 14 00:07:39 user nova-compute[82479]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 14 00:07:39 user nova-compute[82479]:     <timer name='hpet' present='no'/>
Apr 14 00:07:39 user nova-compute[82479]:   </clock>
Apr 14 00:07:39 user nova-compute[82479]:   <on_poweroff>destroy</on_poweroff>
Apr 14 00:07:39 user nova-compute[82479]:   <on_reboot>restart</on_reboot>
Apr 14 00:07:39 user nova-compute[82479]:   <on_crash>destroy</on_crash>
Apr 14 00:07:39 user nova-compute[82479]:   <devices>
Apr 14 00:07:39 user nova-compute[82479]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 14 00:07:39 user nova-compute[82479]:     <disk type='file' device='disk'>
Apr 14 00:07:39 user nova-compute[82479]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 14 00:07:39 user nova-compute[82479]:       <source file='/opt/stack/data/nova/instances/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff/disk' index='2'/>
Apr 14 00:07:39 user nova-compute[82479]:       <backingStore type='file' index='3'>
Apr 14 00:07:39 user nova-compute[82479]:         <format type='raw'/>
Apr 14 00:07:39 user nova-compute[82479]:         <source file='/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4'/>
Apr 14 00:07:39 user nova-compute[82479]:         <backingStore/>
Apr 14 00:07:39 user nova-compute[82479]:       </backingStore>
Apr 14 00:07:39 user nova-compute[82479]:       <target dev='vda' bus='virtio'/>
Apr 14 00:07:39 user nova-compute[82479]:       <alias name='virtio-disk0'/>
Apr 14 00:07:39 user nova-compute[82479]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 14 00:07:39 user nova-compute[82479]:     </disk>
Apr 14 00:07:39 user nova-compute[82479]:     <disk type='file' device='cdrom'>
Apr 14 00:07:39 user nova-compute[82479]:       <driver name='qemu' type='raw' cache='none'/>
Apr 14 00:07:39 user nova-compute[82479]:       <source file='/opt/stack/data/nova/instances/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff/disk.config' index='1'/>
Apr 14 00:07:39 user nova-compute[82479]:       <backingStore/>
Apr 14 00:07:39 user nova-compute[82479]:       <target dev='hda' bus='ide'/>
Apr 14 00:07:39 user nova-compute[82479]:       <readonly/>
Apr 14 00:07:39 user nova-compute[82479]:       <alias name='ide0-0-0'/>
Apr 14 00:07:39 user nova-compute[82479]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 14 00:07:39 user nova-compute[82479]:     </disk>
Apr 14 00:07:39 user nova-compute[82479]:     <controller type='usb' index='0' model='none'>
Apr 14 00:07:39 user nova-compute[82479]:       <alias name='usb'/>
Apr 14 00:07:39 user nova-compute[82479]:     </controller>
Apr 14 00:07:39 user nova-compute[82479]:     <controller type='pci' index='0' model='pci-root'>
Apr 14 00:07:39 user nova-compute[82479]:       <alias name='pci.0'/>
Apr 14 00:07:39 user nova-compute[82479]:     </controller>
Apr 14 00:07:39 user nova-compute[82479]:     <controller type='ide' index='0'>
Apr 14 00:07:39 user nova-compute[82479]:       <alias name='ide'/>
Apr 14 00:07:39 user nova-compute[82479]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 14 00:07:39 user nova-compute[82479]:     </controller>
Apr 14 00:07:39 user nova-compute[82479]:     <interface type='ethernet'>
Apr 14 00:07:39 user nova-compute[82479]:       <mac address='fa:16:3e:9b:6b:79'/>
Apr 14 00:07:39 user nova-compute[82479]:       <target dev='tapdc4fb8de-0f'/>
Apr 14 00:07:39 user nova-compute[82479]:       <model type='virtio'/>
Apr 14 00:07:39 user nova-compute[82479]:       <mtu size='1442'/>
Apr 14 00:07:39 user nova-compute[82479]:       <alias name='net0'/>
Apr 14 00:07:39 user nova-compute[82479]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 14 00:07:39 user nova-compute[82479]:     </interface>
Apr 14 00:07:39 user nova-compute[82479]:     <interface type='ethernet'>
Apr 14 00:07:39 user nova-compute[82479]:       <mac address='fa:16:3e:c4:e1:fd'/>
Apr 14 00:07:39 user nova-compute[82479]:       <target dev='tap8d5fc9ab-cb'/>
Apr 14 00:07:39 user nova-compute[82479]:       <model type='virtio'/>
Apr 14 00:07:39 user nova-compute[82479]:       <mtu size='1442'/>
Apr 14 00:07:39 user nova-compute[82479]:       <alias name='net1'/>
Apr 14 00:07:39 user nova-compute[82479]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Apr 14 00:07:39 user nova-compute[82479]:     </interface>
Apr 14 00:07:39 user nova-compute[82479]:     <serial type='pty'>
Apr 14 00:07:39 user nova-compute[82479]:       <source path='/dev/pts/8'/>
Apr 14 00:07:39 user nova-compute[82479]:       <log file='/opt/stack/data/nova/instances/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff/console.log' append='off'/>
Apr 14 00:07:39 user nova-compute[82479]:       <target type='isa-serial' port='0'>
Apr 14 00:07:39 user nova-compute[82479]:         <model name='isa-serial'/>
Apr 14 00:07:39 user nova-compute[82479]:       </target>
Apr 14 00:07:39 user nova-compute[82479]:       <alias name='serial0'/>
Apr 14 00:07:39 user nova-compute[82479]:     </serial>
Apr 14 00:07:39 user nova-compute[82479]:     <console type='pty' tty='/dev/pts/8'>
Apr 14 00:07:39 user nova-compute[82479]:       <source path='/dev/pts/8'/>
Apr 14 00:07:39 user nova-compute[82479]:       <log file='/opt/stack/data/nova/instances/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff/console.log' append='off'/>
Apr 14 00:07:39 user nova-compute[82479]:       <target type='serial' port='0'/>
Apr 14 00:07:39 user nova-compute[82479]:       <alias name='serial0'/>
Apr 14 00:07:39 user nova-compute[82479]:     </console>
Apr 14 00:07:39 user nova-compute[82479]:     <input type='mouse' bus='ps2'>
Apr 14 00:07:39 user nova-compute[82479]:       <alias name='input0'/>
Apr 14 00:07:39 user nova-compute[82479]:     </input>
Apr 14 00:07:39 user nova-compute[82479]:     <input type='keyboard' bus='ps2'>
Apr 14 00:07:39 user nova-compute[82479]:       <alias name='input1'/>
Apr 14 00:07:39 user nova-compute[82479]:     </input>
Apr 14 00:07:39 user nova-compute[82479]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Apr 14 00:07:39 user nova-compute[82479]:       <listen type='address' address='0.0.0.0'/>
Apr 14 00:07:39 user nova-compute[82479]:     </graphics>
Apr 14 00:07:39 user nova-compute[82479]:     <audio id='1' type='none'/>
Apr 14 00:07:39 user nova-compute[82479]:     <video>
Apr 14 00:07:39 user nova-compute[82479]:       <model type='virtio' heads='1' primary='yes'/>
Apr 14 00:07:39 user nova-compute[82479]:       <alias name='video0'/>
Apr 14 00:07:39 user nova-compute[82479]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 14 00:07:39 user nova-compute[82479]:     </video>
Apr 14 00:07:39 user nova-compute[82479]:     <memballoon model='virtio'>
Apr 14 00:07:39 user nova-compute[82479]:       <stats period='10'/>
Apr 14 00:07:39 user nova-compute[82479]:       <alias name='balloon0'/>
Apr 14 00:07:39 user nova-compute[82479]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 14 00:07:39 user nova-compute[82479]:     </memballoon>
Apr 14 00:07:39 user nova-compute[82479]:     <rng model='virtio'>
Apr 14 00:07:39 user nova-compute[82479]:       <backend model='random'>/dev/urandom</backend>
Apr 14 00:07:39 user nova-compute[82479]:       <alias name='rng0'/>
Apr 14 00:07:39 user nova-compute[82479]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 14 00:07:39 user nova-compute[82479]:     </rng>
Apr 14 00:07:39 user nova-compute[82479]:   </devices>
Apr 14 00:07:39 user nova-compute[82479]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 14 00:07:39 user nova-compute[82479]:     <label>libvirt-b9c6323b-ed7f-4f86-93ad-3ef4726b01ff</label>
Apr 14 00:07:39 user nova-compute[82479]:     <imagelabel>libvirt-b9c6323b-ed7f-4f86-93ad-3ef4726b01ff</imagelabel>
Apr 14 00:07:39 user nova-compute[82479]:   </seclabel>
Apr 14 00:07:39 user nova-compute[82479]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 14 00:07:39 user nova-compute[82479]:     <label>+64055:+108</label>
Apr 14 00:07:39 user nova-compute[82479]:     <imagelabel>+64055:+108</imagelabel>
Apr 14 00:07:39 user nova-compute[82479]:   </seclabel>
Apr 14 00:07:39 user nova-compute[82479]: </domain>
Apr 14 00:07:39 user nova-compute[82479]:  {{(pid=82479) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 14 00:07:39 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-4ac94033-07d2-4369-9a3a-e5f5f1b214c7 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Successfully detached device tap8d5fc9ab-cb from instance b9c6323b-ed7f-4f86-93ad-3ef4726b01ff from the persistent domain config.
Apr 14 00:07:39 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-4ac94033-07d2-4369-9a3a-e5f5f1b214c7 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] (1/8): Attempting to detach device tap8d5fc9ab-cb with device alias net1 from instance b9c6323b-ed7f-4f86-93ad-3ef4726b01ff from the live domain config. {{(pid=82479) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 00:07:39 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-4ac94033-07d2-4369-9a3a-e5f5f1b214c7 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] detach device xml: <interface type="ethernet">
Apr 14 00:07:39 user nova-compute[82479]:   <mac address="fa:16:3e:c4:e1:fd"/>
Apr 14 00:07:39 user nova-compute[82479]:   <model type="virtio"/>
Apr 14 00:07:39 user nova-compute[82479]:   <mtu size="1442"/>
Apr 14 00:07:39 user nova-compute[82479]:   <target dev="tap8d5fc9ab-cb"/>
Apr 14 00:07:39 user nova-compute[82479]: </interface>
Apr 14 00:07:39 user nova-compute[82479]:  {{(pid=82479) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 00:07:39 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:39 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:39 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Received event <DeviceRemovedEvent: 1681430859.6793554, b9c6323b-ed7f-4f86-93ad-3ef4726b01ff => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82479) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 00:07:39 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-4ac94033-07d2-4369-9a3a-e5f5f1b214c7 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Start waiting for the detach event from libvirt for device tap8d5fc9ab-cb with device alias net1 for instance b9c6323b-ed7f-4f86-93ad-3ef4726b01ff {{(pid=82479) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 00:07:39 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-4ac94033-07d2-4369-9a3a-e5f5f1b214c7 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c4:e1:fd"/><model type="virtio"/><mtu size="1442"/><target dev="tap8d5fc9ab-cb"/></interface> {{(pid=82479) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 14 00:07:39 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-4ac94033-07d2-4369-9a3a-e5f5f1b214c7 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:c4:e1:fd"/><model type="virtio"/><mtu size="1442"/><target dev="tap8d5fc9ab-cb"/></interface>not found in domain: <domain type='kvm' id='9'>
Apr 14 00:07:39 user nova-compute[82479]:   <name>instance-00000009</name>
Apr 14 00:07:39 user nova-compute[82479]:   <uuid>b9c6323b-ed7f-4f86-93ad-3ef4726b01ff</uuid>
Apr 14 00:07:39 user nova-compute[82479]:   <metadata>
Apr 14 00:07:39 user nova-compute[82479]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 00:07:39 user nova-compute[82479]:   <nova:package version="0.0.0"/>
Apr 14 00:07:39 user nova-compute[82479]:   <nova:name>tempest-device-tagging-server-1428775386</nova:name>
Apr 14 00:07:39 user nova-compute[82479]:   <nova:creationTime>2023-04-14 00:07:25</nova:creationTime>
Apr 14 00:07:39 user nova-compute[82479]:   <nova:flavor name="m1.nano">
Apr 14 00:07:39 user nova-compute[82479]:     <nova:memory>128</nova:memory>
Apr 14 00:07:39 user nova-compute[82479]:     <nova:disk>1</nova:disk>
Apr 14 00:07:39 user nova-compute[82479]:     <nova:swap>0</nova:swap>
Apr 14 00:07:39 user nova-compute[82479]:     <nova:ephemeral>0</nova:ephemeral>
Apr 14 00:07:39 user nova-compute[82479]:     <nova:vcpus>1</nova:vcpus>
Apr 14 00:07:39 user nova-compute[82479]:   </nova:flavor>
Apr 14 00:07:39 user nova-compute[82479]:   <nova:owner>
Apr 14 00:07:39 user nova-compute[82479]:     <nova:user uuid="38f9a13bd3f74842b61b57b2ea8bf025">tempest-TaggedAttachmentsTest-694590407-project-member</nova:user>
Apr 14 00:07:39 user nova-compute[82479]:     <nova:project uuid="c4ee7b5626a14c69aefa86192b6e7bac">tempest-TaggedAttachmentsTest-694590407</nova:project>
Apr 14 00:07:39 user nova-compute[82479]:   </nova:owner>
Apr 14 00:07:39 user nova-compute[82479]:   <nova:root type="image" uuid="6db62068-7278-4cd8-b41f-d0140d89e199"/>
Apr 14 00:07:39 user nova-compute[82479]:   <nova:ports>
Apr 14 00:07:39 user nova-compute[82479]:     <nova:port uuid="dc4fb8de-0fc3-4af8-86d0-94c357627f5f">
Apr 14 00:07:39 user nova-compute[82479]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 00:07:39 user nova-compute[82479]:     </nova:port>
Apr 14 00:07:39 user nova-compute[82479]:     <nova:port uuid="8d5fc9ab-cbd3-46df-8389-c67fee40f75f">
Apr 14 00:07:39 user nova-compute[82479]:       <nova:ip type="fixed" address="10.10.10.221" ipVersion="4"/>
Apr 14 00:07:39 user nova-compute[82479]:     </nova:port>
Apr 14 00:07:39 user nova-compute[82479]:   </nova:ports>
Apr 14 00:07:39 user nova-compute[82479]: </nova:instance>
Apr 14 00:07:39 user nova-compute[82479]:   </metadata>
Apr 14 00:07:39 user nova-compute[82479]:   <memory unit='KiB'>131072</memory>
Apr 14 00:07:39 user nova-compute[82479]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 14 00:07:39 user nova-compute[82479]:   <vcpu placement='static'>1</vcpu>
Apr 14 00:07:39 user nova-compute[82479]:   <resource>
Apr 14 00:07:39 user nova-compute[82479]:     <partition>/machine</partition>
Apr 14 00:07:39 user nova-compute[82479]:   </resource>
Apr 14 00:07:39 user nova-compute[82479]:   <sysinfo type='smbios'>
Apr 14 00:07:39 user nova-compute[82479]:     <system>
Apr 14 00:07:39 user nova-compute[82479]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 14 00:07:39 user nova-compute[82479]:       <entry name='product'>OpenStack Nova</entry>
Apr 14 00:07:39 user nova-compute[82479]:       <entry name='version'>0.0.0</entry>
Apr 14 00:07:39 user nova-compute[82479]:       <entry name='serial'>b9c6323b-ed7f-4f86-93ad-3ef4726b01ff</entry>
Apr 14 00:07:39 user nova-compute[82479]:       <entry name='uuid'>b9c6323b-ed7f-4f86-93ad-3ef4726b01ff</entry>
Apr 14 00:07:39 user nova-compute[82479]:       <entry name='family'>Virtual Machine</entry>
Apr 14 00:07:39 user nova-compute[82479]:     </system>
Apr 14 00:07:39 user nova-compute[82479]:   </sysinfo>
Apr 14 00:07:39 user nova-compute[82479]:   <os>
Apr 14 00:07:39 user nova-compute[82479]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 14 00:07:39 user nova-compute[82479]:     <boot dev='hd'/>
Apr 14 00:07:39 user nova-compute[82479]:     <smbios mode='sysinfo'/>
Apr 14 00:07:39 user nova-compute[82479]:   </os>
Apr 14 00:07:39 user nova-compute[82479]:   <features>
Apr 14 00:07:39 user nova-compute[82479]:     <acpi/>
Apr 14 00:07:39 user nova-compute[82479]:     <apic/>
Apr 14 00:07:39 user nova-compute[82479]:     <vmcoreinfo state='on'/>
Apr 14 00:07:39 user nova-compute[82479]:   </features>
Apr 14 00:07:39 user nova-compute[82479]:   <cpu mode='custom' match='exact' check='full'>
Apr 14 00:07:39 user nova-compute[82479]:     <model fallback='forbid'>Nehalem</model>
Apr 14 00:07:39 user nova-compute[82479]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 14 00:07:39 user nova-compute[82479]:     <feature policy='require' name='vme'/>
Apr 14 00:07:39 user nova-compute[82479]:     <feature policy='require' name='x2apic'/>
Apr 14 00:07:39 user nova-compute[82479]:     <feature policy='require' name='hypervisor'/>
Apr 14 00:07:39 user nova-compute[82479]:   </cpu>
Apr 14 00:07:39 user nova-compute[82479]:   <clock offset='utc'>
Apr 14 00:07:39 user nova-compute[82479]:     <timer name='pit' tickpolicy='delay'/>
Apr 14 00:07:39 user nova-compute[82479]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 14 00:07:39 user nova-compute[82479]:     <timer name='hpet' present='no'/>
Apr 14 00:07:39 user nova-compute[82479]:   </clock>
Apr 14 00:07:39 user nova-compute[82479]:   <on_poweroff>destroy</on_poweroff>
Apr 14 00:07:39 user nova-compute[82479]:   <on_reboot>restart</on_reboot>
Apr 14 00:07:39 user nova-compute[82479]:   <on_crash>destroy</on_crash>
Apr 14 00:07:39 user nova-compute[82479]:   <devices>
Apr 14 00:07:39 user nova-compute[82479]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 14 00:07:39 user nova-compute[82479]:     <disk type='file' device='disk'>
Apr 14 00:07:39 user nova-compute[82479]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 14 00:07:39 user nova-compute[82479]:       <source file='/opt/stack/data/nova/instances/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff/disk' index='2'/>
Apr 14 00:07:39 user nova-compute[82479]:       <backingStore type='file' index='3'>
Apr 14 00:07:39 user nova-compute[82479]:         <format type='raw'/>
Apr 14 00:07:39 user nova-compute[82479]:         <source file='/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4'/>
Apr 14 00:07:39 user nova-compute[82479]:         <backingStore/>
Apr 14 00:07:39 user nova-compute[82479]:       </backingStore>
Apr 14 00:07:39 user nova-compute[82479]:       <target dev='vda' bus='virtio'/>
Apr 14 00:07:39 user nova-compute[82479]:       <alias name='virtio-disk0'/>
Apr 14 00:07:39 user nova-compute[82479]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 14 00:07:39 user nova-compute[82479]:     </disk>
Apr 14 00:07:39 user nova-compute[82479]:     <disk type='file' device='cdrom'>
Apr 14 00:07:39 user nova-compute[82479]:       <driver name='qemu' type='raw' cache='none'/>
Apr 14 00:07:39 user nova-compute[82479]:       <source file='/opt/stack/data/nova/instances/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff/disk.config' index='1'/>
Apr 14 00:07:39 user nova-compute[82479]:       <backingStore/>
Apr 14 00:07:39 user nova-compute[82479]:       <target dev='hda' bus='ide'/>
Apr 14 00:07:39 user nova-compute[82479]:       <readonly/>
Apr 14 00:07:39 user nova-compute[82479]:       <alias name='ide0-0-0'/>
Apr 14 00:07:39 user nova-compute[82479]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 14 00:07:39 user nova-compute[82479]:     </disk>
Apr 14 00:07:39 user nova-compute[82479]:     <controller type='usb' index='0' model='none'>
Apr 14 00:07:39 user nova-compute[82479]:       <alias name='usb'/>
Apr 14 00:07:39 user nova-compute[82479]:     </controller>
Apr 14 00:07:39 user nova-compute[82479]:     <controller type='pci' index='0' model='pci-root'>
Apr 14 00:07:39 user nova-compute[82479]:       <alias name='pci.0'/>
Apr 14 00:07:39 user nova-compute[82479]:     </controller>
Apr 14 00:07:39 user nova-compute[82479]:     <controller type='ide' index='0'>
Apr 14 00:07:39 user nova-compute[82479]:       <alias name='ide'/>
Apr 14 00:07:39 user nova-compute[82479]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 14 00:07:39 user nova-compute[82479]:     </controller>
Apr 14 00:07:39 user nova-compute[82479]:     <interface type='ethernet'>
Apr 14 00:07:39 user nova-compute[82479]:       <mac address='fa:16:3e:9b:6b:79'/>
Apr 14 00:07:39 user nova-compute[82479]:       <target dev='tapdc4fb8de-0f'/>
Apr 14 00:07:39 user nova-compute[82479]:       <model type='virtio'/>
Apr 14 00:07:39 user nova-compute[82479]:       <mtu size='1442'/>
Apr 14 00:07:39 user nova-compute[82479]:       <alias name='net0'/>
Apr 14 00:07:39 user nova-compute[82479]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 14 00:07:39 user nova-compute[82479]:     </interface>
Apr 14 00:07:39 user nova-compute[82479]:     <serial type='pty'>
Apr 14 00:07:39 user nova-compute[82479]:       <source path='/dev/pts/8'/>
Apr 14 00:07:39 user nova-compute[82479]:       <log file='/opt/stack/data/nova/instances/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff/console.log' append='off'/>
Apr 14 00:07:39 user nova-compute[82479]:       <target type='isa-serial' port='0'>
Apr 14 00:07:39 user nova-compute[82479]:         <model name='isa-serial'/>
Apr 14 00:07:39 user nova-compute[82479]:       </target>
Apr 14 00:07:39 user nova-compute[82479]:       <alias name='serial0'/>
Apr 14 00:07:39 user nova-compute[82479]:     </serial>
Apr 14 00:07:39 user nova-compute[82479]:     <console type='pty' tty='/dev/pts/8'>
Apr 14 00:07:39 user nova-compute[82479]:       <source path='/dev/pts/8'/>
Apr 14 00:07:39 user nova-compute[82479]:       <log file='/opt/stack/data/nova/instances/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff/console.log' append='off'/>
Apr 14 00:07:39 user nova-compute[82479]:       <target type='serial' port='0'/>
Apr 14 00:07:39 user nova-compute[82479]:       <alias name='serial0'/>
Apr 14 00:07:39 user nova-compute[82479]:     </console>
Apr 14 00:07:39 user nova-compute[82479]:     <input type='mouse' bus='ps2'>
Apr 14 00:07:39 user nova-compute[82479]:       <alias name='input0'/>
Apr 14 00:07:39 user nova-compute[82479]:     </input>
Apr 14 00:07:39 user nova-compute[82479]:     <input type='keyboard' bus='ps2'>
Apr 14 00:07:39 user nova-compute[82479]:       <alias name='input1'/>
Apr 14 00:07:39 user nova-compute[82479]:     </input>
Apr 14 00:07:39 user nova-compute[82479]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Apr 14 00:07:39 user nova-compute[82479]:       <listen type='address' address='0.0.0.0'/>
Apr 14 00:07:39 user nova-compute[82479]:     </graphics>
Apr 14 00:07:39 user nova-compute[82479]:     <audio id='1' type='none'/>
Apr 14 00:07:39 user nova-compute[82479]:     <video>
Apr 14 00:07:39 user nova-compute[82479]:       <model type='virtio' heads='1' primary='yes'/>
Apr 14 00:07:39 user nova-compute[82479]:       <alias name='video0'/>
Apr 14 00:07:39 user nova-compute[82479]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 14 00:07:39 user nova-compute[82479]:     </video>
Apr 14 00:07:39 user nova-compute[82479]:     <memballoon model='virtio'>
Apr 14 00:07:39 user nova-compute[82479]:       <stats period='10'/>
Apr 14 00:07:39 user nova-compute[82479]:       <alias name='balloon0'/>
Apr 14 00:07:39 user nova-compute[82479]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 14 00:07:39 user nova-compute[82479]:     </memballoon>
Apr 14 00:07:39 user nova-compute[82479]:     <rng model='virtio'>
Apr 14 00:07:39 user nova-compute[82479]:       <backend model='random'>/dev/urandom</backend>
Apr 14 00:07:39 user nova-compute[82479]:       <alias name='rng0'/>
Apr 14 00:07:39 user nova-compute[82479]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 14 00:07:39 user nova-compute[82479]:     </rng>
Apr 14 00:07:39 user nova-compute[82479]:   </devices>
Apr 14 00:07:39 user nova-compute[82479]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 14 00:07:39 user nova-compute[82479]:     <label>libvirt-b9c6323b-ed7f-4f86-93ad-3ef4726b01ff</label>
Apr 14 00:07:39 user nova-compute[82479]:     <imagelabel>libvirt-b9c6323b-ed7f-4f86-93ad-3ef4726b01ff</imagelabel>
Apr 14 00:07:39 user nova-compute[82479]:   </seclabel>
Apr 14 00:07:39 user nova-compute[82479]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 14 00:07:39 user nova-compute[82479]:     <label>+64055:+108</label>
Apr 14 00:07:39 user nova-compute[82479]:     <imagelabel>+64055:+108</imagelabel>
Apr 14 00:07:39 user nova-compute[82479]:   </seclabel>
Apr 14 00:07:39 user nova-compute[82479]: </domain>
Apr 14 00:07:39 user nova-compute[82479]:  {{(pid=82479) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 14 00:07:39 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-4ac94033-07d2-4369-9a3a-e5f5f1b214c7 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Successfully detached device tap8d5fc9ab-cb from instance b9c6323b-ed7f-4f86-93ad-3ef4726b01ff from the live domain config.
Apr 14 00:07:39 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-4ac94033-07d2-4369-9a3a-e5f5f1b214c7 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T00:05:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1428775386',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1428775386',id=9,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIH5r6nQb46UiVWKMJfMdOVDRbtW2F73ea2D8mxSn1YDz9+bRgJ2nBeDW0+0XBiptqCPYYX6nTAHEycBqQz0FHVyYdWdNoLj8ctiSWD+URcLL8GbP5fneDu/2p/eIfeTqw==',key_name='tempest-keypair-2007231770',keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:05:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c4ee7b5626a14c69aefa86192b6e7bac',ramdisk_id='',reservation_id='r-7dnrqpgh',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-694590407',owner_user_name='tempest-TaggedAttachmentsTest-694590407-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T00:05:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38f9a13bd3f74842b61b57b2ea8bf025',uuid=b9c6323b-ed7f-4f86-93ad-3ef4726b01ff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8d5fc9ab-cbd3-46df-8389-c67fee40f75f", "address": "fa:16:3e:c4:e1:fd", "network": {"id": "830e35a7-48e9-4584-b507-5bed2f6e6b5d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-506512841", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c4ee7b5626a14c69aefa86192b6e7bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d5fc9ab-cb", "ovs_interfaceid": "8d5fc9ab-cbd3-46df-8389-c67fee40f75f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 00:07:39 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-4ac94033-07d2-4369-9a3a-e5f5f1b214c7 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Converting VIF {"id": "8d5fc9ab-cbd3-46df-8389-c67fee40f75f", "address": "fa:16:3e:c4:e1:fd", "network": {"id": "830e35a7-48e9-4584-b507-5bed2f6e6b5d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-506512841", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c4ee7b5626a14c69aefa86192b6e7bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d5fc9ab-cb", "ovs_interfaceid": "8d5fc9ab-cbd3-46df-8389-c67fee40f75f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:07:39 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-4ac94033-07d2-4369-9a3a-e5f5f1b214c7 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:e1:fd,bridge_name='br-int',has_traffic_filtering=True,id=8d5fc9ab-cbd3-46df-8389-c67fee40f75f,network=Network(830e35a7-48e9-4584-b507-5bed2f6e6b5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d5fc9ab-cb') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:07:39 user nova-compute[82479]: DEBUG os_vif [None req-4ac94033-07d2-4369-9a3a-e5f5f1b214c7 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:e1:fd,bridge_name='br-int',has_traffic_filtering=True,id=8d5fc9ab-cbd3-46df-8389-c67fee40f75f,network=Network(830e35a7-48e9-4584-b507-5bed2f6e6b5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d5fc9ab-cb') {{(pid=82479) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 00:07:39 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:39 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:39 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8d5fc9ab-cb, bridge=br-int, if_exists=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:07:39 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:39 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:07:39 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:39 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:39 user nova-compute[82479]: INFO os_vif [None req-4ac94033-07d2-4369-9a3a-e5f5f1b214c7 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:e1:fd,bridge_name='br-int',has_traffic_filtering=True,id=8d5fc9ab-cbd3-46df-8389-c67fee40f75f,network=Network(830e35a7-48e9-4584-b507-5bed2f6e6b5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d5fc9ab-cb')
Apr 14 00:07:39 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-4ac94033-07d2-4369-9a3a-e5f5f1b214c7 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 00:07:39 user nova-compute[82479]:   <nova:package version="0.0.0"/>
Apr 14 00:07:39 user nova-compute[82479]:   <nova:name>tempest-device-tagging-server-1428775386</nova:name>
Apr 14 00:07:39 user nova-compute[82479]:   <nova:creationTime>2023-04-14 00:07:39</nova:creationTime>
Apr 14 00:07:39 user nova-compute[82479]:   <nova:flavor name="m1.nano">
Apr 14 00:07:39 user nova-compute[82479]:     <nova:memory>128</nova:memory>
Apr 14 00:07:39 user nova-compute[82479]:     <nova:disk>1</nova:disk>
Apr 14 00:07:39 user nova-compute[82479]:     <nova:swap>0</nova:swap>
Apr 14 00:07:39 user nova-compute[82479]:     <nova:ephemeral>0</nova:ephemeral>
Apr 14 00:07:39 user nova-compute[82479]:     <nova:vcpus>1</nova:vcpus>
Apr 14 00:07:39 user nova-compute[82479]:   </nova:flavor>
Apr 14 00:07:39 user nova-compute[82479]:   <nova:owner>
Apr 14 00:07:39 user nova-compute[82479]:     <nova:user uuid="38f9a13bd3f74842b61b57b2ea8bf025">tempest-TaggedAttachmentsTest-694590407-project-member</nova:user>
Apr 14 00:07:39 user nova-compute[82479]:     <nova:project uuid="c4ee7b5626a14c69aefa86192b6e7bac">tempest-TaggedAttachmentsTest-694590407</nova:project>
Apr 14 00:07:39 user nova-compute[82479]:   </nova:owner>
Apr 14 00:07:39 user nova-compute[82479]:   <nova:root type="image" uuid="6db62068-7278-4cd8-b41f-d0140d89e199"/>
Apr 14 00:07:39 user nova-compute[82479]:   <nova:ports>
Apr 14 00:07:39 user nova-compute[82479]:     <nova:port uuid="dc4fb8de-0fc3-4af8-86d0-94c357627f5f">
Apr 14 00:07:39 user nova-compute[82479]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 00:07:39 user nova-compute[82479]:     </nova:port>
Apr 14 00:07:39 user nova-compute[82479]:   </nova:ports>
Apr 14 00:07:39 user nova-compute[82479]: </nova:instance>
Apr 14 00:07:39 user nova-compute[82479]:  {{(pid=82479) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 14 00:07:39 user nova-compute[82479]: DEBUG nova.compute.manager [req-fdf8a69d-ef23-4ac2-9810-36464dfe9dc4 req-0ab3e177-08f2-4218-853f-8f689c6871d4 service nova] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Received event network-vif-unplugged-8d5fc9ab-cbd3-46df-8389-c67fee40f75f {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:07:39 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-fdf8a69d-ef23-4ac2-9810-36464dfe9dc4 req-0ab3e177-08f2-4218-853f-8f689c6871d4 service nova] Acquiring lock "b9c6323b-ed7f-4f86-93ad-3ef4726b01ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:07:39 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-fdf8a69d-ef23-4ac2-9810-36464dfe9dc4 req-0ab3e177-08f2-4218-853f-8f689c6871d4 service nova] Lock "b9c6323b-ed7f-4f86-93ad-3ef4726b01ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:07:39 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-fdf8a69d-ef23-4ac2-9810-36464dfe9dc4 req-0ab3e177-08f2-4218-853f-8f689c6871d4 service nova] Lock "b9c6323b-ed7f-4f86-93ad-3ef4726b01ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:07:39 user nova-compute[82479]: DEBUG nova.compute.manager [req-fdf8a69d-ef23-4ac2-9810-36464dfe9dc4 req-0ab3e177-08f2-4218-853f-8f689c6871d4 service nova] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] No waiting events found dispatching network-vif-unplugged-8d5fc9ab-cbd3-46df-8389-c67fee40f75f {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:07:39 user nova-compute[82479]: WARNING nova.compute.manager [req-fdf8a69d-ef23-4ac2-9810-36464dfe9dc4 req-0ab3e177-08f2-4218-853f-8f689c6871d4 service nova] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Received unexpected event network-vif-unplugged-8d5fc9ab-cbd3-46df-8389-c67fee40f75f for instance with vm_state active and task_state None.
Apr 14 00:07:40 user nova-compute[82479]: DEBUG nova.compute.manager [req-b255068d-7277-4b75-9007-d0a69f351f16 req-bddda13c-35d4-4f9b-8ae7-1ca030570e8b service nova] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Received event network-vif-deleted-8d5fc9ab-cbd3-46df-8389-c67fee40f75f {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:07:40 user nova-compute[82479]: INFO nova.compute.manager [req-b255068d-7277-4b75-9007-d0a69f351f16 req-bddda13c-35d4-4f9b-8ae7-1ca030570e8b service nova] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Neutron deleted interface 8d5fc9ab-cbd3-46df-8389-c67fee40f75f; detaching it from the instance and deleting it from the info cache
Apr 14 00:07:40 user nova-compute[82479]: DEBUG nova.network.neutron [req-b255068d-7277-4b75-9007-d0a69f351f16 req-bddda13c-35d4-4f9b-8ae7-1ca030570e8b service nova] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Updating instance_info_cache with network_info: [{"id": "dc4fb8de-0fc3-4af8-86d0-94c357627f5f", "address": "fa:16:3e:9b:6b:79", "network": {"id": "281dc33c-0ea9-4812-97ed-82652b538fd0", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-521698420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4ee7b5626a14c69aefa86192b6e7bac", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4fb8de-0f", "ovs_interfaceid": "dc4fb8de-0fc3-4af8-86d0-94c357627f5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:07:40 user nova-compute[82479]: DEBUG nova.objects.instance [req-b255068d-7277-4b75-9007-d0a69f351f16 req-bddda13c-35d4-4f9b-8ae7-1ca030570e8b service nova] Lazy-loading 'system_metadata' on Instance uuid b9c6323b-ed7f-4f86-93ad-3ef4726b01ff {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:07:40 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-4ac94033-07d2-4369-9a3a-e5f5f1b214c7 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Acquiring lock "refresh_cache-b9c6323b-ed7f-4f86-93ad-3ef4726b01ff" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:07:40 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-4ac94033-07d2-4369-9a3a-e5f5f1b214c7 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Acquired lock "refresh_cache-b9c6323b-ed7f-4f86-93ad-3ef4726b01ff" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:07:40 user nova-compute[82479]: DEBUG nova.network.neutron [None req-4ac94033-07d2-4369-9a3a-e5f5f1b214c7 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 00:07:40 user nova-compute[82479]: DEBUG nova.objects.instance [req-b255068d-7277-4b75-9007-d0a69f351f16 req-bddda13c-35d4-4f9b-8ae7-1ca030570e8b service nova] Lazy-loading 'flavor' on Instance uuid b9c6323b-ed7f-4f86-93ad-3ef4726b01ff {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:07:40 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [req-b255068d-7277-4b75-9007-d0a69f351f16 req-bddda13c-35d4-4f9b-8ae7-1ca030570e8b service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T00:05:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1428775386',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1428775386',id=9,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIH5r6nQb46UiVWKMJfMdOVDRbtW2F73ea2D8mxSn1YDz9+bRgJ2nBeDW0+0XBiptqCPYYX6nTAHEycBqQz0FHVyYdWdNoLj8ctiSWD+URcLL8GbP5fneDu/2p/eIfeTqw==',key_name='tempest-keypair-2007231770',keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:05:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c4ee7b5626a14c69aefa86192b6e7bac',ramdisk_id='',reservation_id='r-7dnrqpgh',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-694590407',owner_user_name='tempest-TaggedAttachmentsTest-694590407-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T00:05:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38f9a13bd3f74842b61b57b2ea8bf025',uuid=b9c6323b-ed7f-4f86-93ad-3ef4726b01ff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8d5fc9ab-cbd3-46df-8389-c67fee40f75f", "address": "fa:16:3e:c4:e1:fd", "network": {"id": "830e35a7-48e9-4584-b507-5bed2f6e6b5d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-506512841", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c4ee7b5626a14c69aefa86192b6e7bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d5fc9ab-cb", "ovs_interfaceid": "8d5fc9ab-cbd3-46df-8389-c67fee40f75f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82479) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 00:07:40 user nova-compute[82479]: DEBUG nova.network.os_vif_util [req-b255068d-7277-4b75-9007-d0a69f351f16 req-bddda13c-35d4-4f9b-8ae7-1ca030570e8b service nova] Converting VIF {"id": "8d5fc9ab-cbd3-46df-8389-c67fee40f75f", "address": "fa:16:3e:c4:e1:fd", "network": {"id": "830e35a7-48e9-4584-b507-5bed2f6e6b5d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-506512841", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c4ee7b5626a14c69aefa86192b6e7bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d5fc9ab-cb", "ovs_interfaceid": "8d5fc9ab-cbd3-46df-8389-c67fee40f75f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:07:40 user nova-compute[82479]: DEBUG nova.network.os_vif_util [req-b255068d-7277-4b75-9007-d0a69f351f16 req-bddda13c-35d4-4f9b-8ae7-1ca030570e8b service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:e1:fd,bridge_name='br-int',has_traffic_filtering=True,id=8d5fc9ab-cbd3-46df-8389-c67fee40f75f,network=Network(830e35a7-48e9-4584-b507-5bed2f6e6b5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d5fc9ab-cb') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:07:40 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [req-b255068d-7277-4b75-9007-d0a69f351f16 req-bddda13c-35d4-4f9b-8ae7-1ca030570e8b service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c4:e1:fd"/><model type="virtio"/><mtu size="1442"/><target dev="tap8d5fc9ab-cb"/></interface> {{(pid=82479) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 14 00:07:40 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [req-b255068d-7277-4b75-9007-d0a69f351f16 req-bddda13c-35d4-4f9b-8ae7-1ca030570e8b service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:c4:e1:fd"/><model type="virtio"/><mtu size="1442"/><target dev="tap8d5fc9ab-cb"/></interface>not found in domain: <domain type='kvm' id='9'>
Apr 14 00:07:40 user nova-compute[82479]:   <name>instance-00000009</name>
Apr 14 00:07:40 user nova-compute[82479]:   <uuid>b9c6323b-ed7f-4f86-93ad-3ef4726b01ff</uuid>
Apr 14 00:07:40 user nova-compute[82479]:   <metadata>
Apr 14 00:07:40 user nova-compute[82479]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 00:07:40 user nova-compute[82479]:   <nova:package version="0.0.0"/>
Apr 14 00:07:40 user nova-compute[82479]:   <nova:name>tempest-device-tagging-server-1428775386</nova:name>
Apr 14 00:07:40 user nova-compute[82479]:   <nova:creationTime>2023-04-14 00:07:39</nova:creationTime>
Apr 14 00:07:40 user nova-compute[82479]:   <nova:flavor name="m1.nano">
Apr 14 00:07:40 user nova-compute[82479]:     <nova:memory>128</nova:memory>
Apr 14 00:07:40 user nova-compute[82479]:     <nova:disk>1</nova:disk>
Apr 14 00:07:40 user nova-compute[82479]:     <nova:swap>0</nova:swap>
Apr 14 00:07:40 user nova-compute[82479]:     <nova:ephemeral>0</nova:ephemeral>
Apr 14 00:07:40 user nova-compute[82479]:     <nova:vcpus>1</nova:vcpus>
Apr 14 00:07:40 user nova-compute[82479]:   </nova:flavor>
Apr 14 00:07:40 user nova-compute[82479]:   <nova:owner>
Apr 14 00:07:40 user nova-compute[82479]:     <nova:user uuid="38f9a13bd3f74842b61b57b2ea8bf025">tempest-TaggedAttachmentsTest-694590407-project-member</nova:user>
Apr 14 00:07:40 user nova-compute[82479]:     <nova:project uuid="c4ee7b5626a14c69aefa86192b6e7bac">tempest-TaggedAttachmentsTest-694590407</nova:project>
Apr 14 00:07:40 user nova-compute[82479]:   </nova:owner>
Apr 14 00:07:40 user nova-compute[82479]:   <nova:root type="image" uuid="6db62068-7278-4cd8-b41f-d0140d89e199"/>
Apr 14 00:07:40 user nova-compute[82479]:   <nova:ports>
Apr 14 00:07:40 user nova-compute[82479]:     <nova:port uuid="dc4fb8de-0fc3-4af8-86d0-94c357627f5f">
Apr 14 00:07:40 user nova-compute[82479]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 00:07:40 user nova-compute[82479]:     </nova:port>
Apr 14 00:07:40 user nova-compute[82479]:   </nova:ports>
Apr 14 00:07:40 user nova-compute[82479]: </nova:instance>
Apr 14 00:07:40 user nova-compute[82479]:   </metadata>
Apr 14 00:07:40 user nova-compute[82479]:   <memory unit='KiB'>131072</memory>
Apr 14 00:07:40 user nova-compute[82479]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 14 00:07:40 user nova-compute[82479]:   <vcpu placement='static'>1</vcpu>
Apr 14 00:07:40 user nova-compute[82479]:   <resource>
Apr 14 00:07:40 user nova-compute[82479]:     <partition>/machine</partition>
Apr 14 00:07:40 user nova-compute[82479]:   </resource>
Apr 14 00:07:40 user nova-compute[82479]:   <sysinfo type='smbios'>
Apr 14 00:07:40 user nova-compute[82479]:     <system>
Apr 14 00:07:40 user nova-compute[82479]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 14 00:07:40 user nova-compute[82479]:       <entry name='product'>OpenStack Nova</entry>
Apr 14 00:07:40 user nova-compute[82479]:       <entry name='version'>0.0.0</entry>
Apr 14 00:07:40 user nova-compute[82479]:       <entry name='serial'>b9c6323b-ed7f-4f86-93ad-3ef4726b01ff</entry>
Apr 14 00:07:40 user nova-compute[82479]:       <entry name='uuid'>b9c6323b-ed7f-4f86-93ad-3ef4726b01ff</entry>
Apr 14 00:07:40 user nova-compute[82479]:       <entry name='family'>Virtual Machine</entry>
Apr 14 00:07:40 user nova-compute[82479]:     </system>
Apr 14 00:07:40 user nova-compute[82479]:   </sysinfo>
Apr 14 00:07:40 user nova-compute[82479]:   <os>
Apr 14 00:07:40 user nova-compute[82479]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 14 00:07:40 user nova-compute[82479]:     <boot dev='hd'/>
Apr 14 00:07:40 user nova-compute[82479]:     <smbios mode='sysinfo'/>
Apr 14 00:07:40 user nova-compute[82479]:   </os>
Apr 14 00:07:40 user nova-compute[82479]:   <features>
Apr 14 00:07:40 user nova-compute[82479]:     <acpi/>
Apr 14 00:07:40 user nova-compute[82479]:     <apic/>
Apr 14 00:07:40 user nova-compute[82479]:     <vmcoreinfo state='on'/>
Apr 14 00:07:40 user nova-compute[82479]:   </features>
Apr 14 00:07:40 user nova-compute[82479]:   <cpu mode='custom' match='exact' check='full'>
Apr 14 00:07:40 user nova-compute[82479]:     <model fallback='forbid'>Nehalem</model>
Apr 14 00:07:40 user nova-compute[82479]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 14 00:07:40 user nova-compute[82479]:     <feature policy='require' name='vme'/>
Apr 14 00:07:40 user nova-compute[82479]:     <feature policy='require' name='x2apic'/>
Apr 14 00:07:40 user nova-compute[82479]:     <feature policy='require' name='hypervisor'/>
Apr 14 00:07:40 user nova-compute[82479]:   </cpu>
Apr 14 00:07:40 user nova-compute[82479]:   <clock offset='utc'>
Apr 14 00:07:40 user nova-compute[82479]:     <timer name='pit' tickpolicy='delay'/>
Apr 14 00:07:40 user nova-compute[82479]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 14 00:07:40 user nova-compute[82479]:     <timer name='hpet' present='no'/>
Apr 14 00:07:40 user nova-compute[82479]:   </clock>
Apr 14 00:07:40 user nova-compute[82479]:   <on_poweroff>destroy</on_poweroff>
Apr 14 00:07:40 user nova-compute[82479]:   <on_reboot>restart</on_reboot>
Apr 14 00:07:40 user nova-compute[82479]:   <on_crash>destroy</on_crash>
Apr 14 00:07:40 user nova-compute[82479]:   <devices>
Apr 14 00:07:40 user nova-compute[82479]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 14 00:07:40 user nova-compute[82479]:     <disk type='file' device='disk'>
Apr 14 00:07:40 user nova-compute[82479]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 14 00:07:40 user nova-compute[82479]:       <source file='/opt/stack/data/nova/instances/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff/disk' index='2'/>
Apr 14 00:07:40 user nova-compute[82479]:       <backingStore type='file' index='3'>
Apr 14 00:07:40 user nova-compute[82479]:         <format type='raw'/>
Apr 14 00:07:40 user nova-compute[82479]:         <source file='/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4'/>
Apr 14 00:07:40 user nova-compute[82479]:         <backingStore/>
Apr 14 00:07:40 user nova-compute[82479]:       </backingStore>
Apr 14 00:07:40 user nova-compute[82479]:       <target dev='vda' bus='virtio'/>
Apr 14 00:07:40 user nova-compute[82479]:       <alias name='virtio-disk0'/>
Apr 14 00:07:40 user nova-compute[82479]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 14 00:07:40 user nova-compute[82479]:     </disk>
Apr 14 00:07:40 user nova-compute[82479]:     <disk type='file' device='cdrom'>
Apr 14 00:07:40 user nova-compute[82479]:       <driver name='qemu' type='raw' cache='none'/>
Apr 14 00:07:40 user nova-compute[82479]:       <source file='/opt/stack/data/nova/instances/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff/disk.config' index='1'/>
Apr 14 00:07:40 user nova-compute[82479]:       <backingStore/>
Apr 14 00:07:40 user nova-compute[82479]:       <target dev='hda' bus='ide'/>
Apr 14 00:07:40 user nova-compute[82479]:       <readonly/>
Apr 14 00:07:40 user nova-compute[82479]:       <alias name='ide0-0-0'/>
Apr 14 00:07:40 user nova-compute[82479]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 14 00:07:40 user nova-compute[82479]:     </disk>
Apr 14 00:07:40 user nova-compute[82479]:     <controller type='usb' index='0' model='none'>
Apr 14 00:07:40 user nova-compute[82479]:       <alias name='usb'/>
Apr 14 00:07:40 user nova-compute[82479]:     </controller>
Apr 14 00:07:40 user nova-compute[82479]:     <controller type='pci' index='0' model='pci-root'>
Apr 14 00:07:40 user nova-compute[82479]:       <alias name='pci.0'/>
Apr 14 00:07:40 user nova-compute[82479]:     </controller>
Apr 14 00:07:40 user nova-compute[82479]:     <controller type='ide' index='0'>
Apr 14 00:07:40 user nova-compute[82479]:       <alias name='ide'/>
Apr 14 00:07:40 user nova-compute[82479]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 14 00:07:40 user nova-compute[82479]:     </controller>
Apr 14 00:07:40 user nova-compute[82479]:     <interface type='ethernet'>
Apr 14 00:07:40 user nova-compute[82479]:       <mac address='fa:16:3e:9b:6b:79'/>
Apr 14 00:07:40 user nova-compute[82479]:       <target dev='tapdc4fb8de-0f'/>
Apr 14 00:07:40 user nova-compute[82479]:       <model type='virtio'/>
Apr 14 00:07:40 user nova-compute[82479]:       <mtu size='1442'/>
Apr 14 00:07:40 user nova-compute[82479]:       <alias name='net0'/>
Apr 14 00:07:40 user nova-compute[82479]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 14 00:07:40 user nova-compute[82479]:     </interface>
Apr 14 00:07:40 user nova-compute[82479]:     <serial type='pty'>
Apr 14 00:07:40 user nova-compute[82479]:       <source path='/dev/pts/8'/>
Apr 14 00:07:40 user nova-compute[82479]:       <log file='/opt/stack/data/nova/instances/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff/console.log' append='off'/>
Apr 14 00:07:40 user nova-compute[82479]:       <target type='isa-serial' port='0'>
Apr 14 00:07:40 user nova-compute[82479]:         <model name='isa-serial'/>
Apr 14 00:07:40 user nova-compute[82479]:       </target>
Apr 14 00:07:40 user nova-compute[82479]:       <alias name='serial0'/>
Apr 14 00:07:40 user nova-compute[82479]:     </serial>
Apr 14 00:07:40 user nova-compute[82479]:     <console type='pty' tty='/dev/pts/8'>
Apr 14 00:07:40 user nova-compute[82479]:       <source path='/dev/pts/8'/>
Apr 14 00:07:40 user nova-compute[82479]:       <log file='/opt/stack/data/nova/instances/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff/console.log' append='off'/>
Apr 14 00:07:40 user nova-compute[82479]:       <target type='serial' port='0'/>
Apr 14 00:07:40 user nova-compute[82479]:       <alias name='serial0'/>
Apr 14 00:07:40 user nova-compute[82479]:     </console>
Apr 14 00:07:40 user nova-compute[82479]:     <input type='mouse' bus='ps2'>
Apr 14 00:07:40 user nova-compute[82479]:       <alias name='input0'/>
Apr 14 00:07:40 user nova-compute[82479]:     </input>
Apr 14 00:07:40 user nova-compute[82479]:     <input type='keyboard' bus='ps2'>
Apr 14 00:07:40 user nova-compute[82479]:       <alias name='input1'/>
Apr 14 00:07:40 user nova-compute[82479]:     </input>
Apr 14 00:07:40 user nova-compute[82479]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Apr 14 00:07:40 user nova-compute[82479]:       <listen type='address' address='0.0.0.0'/>
Apr 14 00:07:40 user nova-compute[82479]:     </graphics>
Apr 14 00:07:40 user nova-compute[82479]:     <audio id='1' type='none'/>
Apr 14 00:07:40 user nova-compute[82479]:     <video>
Apr 14 00:07:40 user nova-compute[82479]:       <model type='virtio' heads='1' primary='yes'/>
Apr 14 00:07:40 user nova-compute[82479]:       <alias name='video0'/>
Apr 14 00:07:40 user nova-compute[82479]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 14 00:07:40 user nova-compute[82479]:     </video>
Apr 14 00:07:40 user nova-compute[82479]:     <memballoon model='virtio'>
Apr 14 00:07:40 user nova-compute[82479]:       <stats period='10'/>
Apr 14 00:07:40 user nova-compute[82479]:       <alias name='balloon0'/>
Apr 14 00:07:40 user nova-compute[82479]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 14 00:07:40 user nova-compute[82479]:     </memballoon>
Apr 14 00:07:40 user nova-compute[82479]:     <rng model='virtio'>
Apr 14 00:07:40 user nova-compute[82479]:       <backend model='random'>/dev/urandom</backend>
Apr 14 00:07:40 user nova-compute[82479]:       <alias name='rng0'/>
Apr 14 00:07:40 user nova-compute[82479]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 14 00:07:40 user nova-compute[82479]:     </rng>
Apr 14 00:07:40 user nova-compute[82479]:   </devices>
Apr 14 00:07:40 user nova-compute[82479]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 14 00:07:40 user nova-compute[82479]:     <label>libvirt-b9c6323b-ed7f-4f86-93ad-3ef4726b01ff</label>
Apr 14 00:07:40 user nova-compute[82479]:     <imagelabel>libvirt-b9c6323b-ed7f-4f86-93ad-3ef4726b01ff</imagelabel>
Apr 14 00:07:40 user nova-compute[82479]:   </seclabel>
Apr 14 00:07:40 user nova-compute[82479]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 14 00:07:40 user nova-compute[82479]:     <label>+64055:+108</label>
Apr 14 00:07:40 user nova-compute[82479]:     <imagelabel>+64055:+108</imagelabel>
Apr 14 00:07:40 user nova-compute[82479]:   </seclabel>
Apr 14 00:07:40 user nova-compute[82479]: </domain>
Apr 14 00:07:40 user nova-compute[82479]:  {{(pid=82479) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 14 00:07:40 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [req-b255068d-7277-4b75-9007-d0a69f351f16 req-bddda13c-35d4-4f9b-8ae7-1ca030570e8b service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c4:e1:fd"/><model type="virtio"/><mtu size="1442"/><target dev="tap8d5fc9ab-cb"/></interface> {{(pid=82479) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 14 00:07:40 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [req-b255068d-7277-4b75-9007-d0a69f351f16 req-bddda13c-35d4-4f9b-8ae7-1ca030570e8b service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:c4:e1:fd"/><model type="virtio"/><mtu size="1442"/><target dev="tap8d5fc9ab-cb"/></interface>not found in domain: <domain type='kvm' id='9'>
Apr 14 00:07:40 user nova-compute[82479]:   <name>instance-00000009</name>
Apr 14 00:07:40 user nova-compute[82479]:   <uuid>b9c6323b-ed7f-4f86-93ad-3ef4726b01ff</uuid>
Apr 14 00:07:40 user nova-compute[82479]:   <metadata>
Apr 14 00:07:40 user nova-compute[82479]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 00:07:40 user nova-compute[82479]:   <nova:package version="0.0.0"/>
Apr 14 00:07:40 user nova-compute[82479]:   <nova:name>tempest-device-tagging-server-1428775386</nova:name>
Apr 14 00:07:40 user nova-compute[82479]:   <nova:creationTime>2023-04-14 00:07:39</nova:creationTime>
Apr 14 00:07:40 user nova-compute[82479]:   <nova:flavor name="m1.nano">
Apr 14 00:07:40 user nova-compute[82479]:     <nova:memory>128</nova:memory>
Apr 14 00:07:40 user nova-compute[82479]:     <nova:disk>1</nova:disk>
Apr 14 00:07:40 user nova-compute[82479]:     <nova:swap>0</nova:swap>
Apr 14 00:07:40 user nova-compute[82479]:     <nova:ephemeral>0</nova:ephemeral>
Apr 14 00:07:40 user nova-compute[82479]:     <nova:vcpus>1</nova:vcpus>
Apr 14 00:07:40 user nova-compute[82479]:   </nova:flavor>
Apr 14 00:07:40 user nova-compute[82479]:   <nova:owner>
Apr 14 00:07:40 user nova-compute[82479]:     <nova:user uuid="38f9a13bd3f74842b61b57b2ea8bf025">tempest-TaggedAttachmentsTest-694590407-project-member</nova:user>
Apr 14 00:07:40 user nova-compute[82479]:     <nova:project uuid="c4ee7b5626a14c69aefa86192b6e7bac">tempest-TaggedAttachmentsTest-694590407</nova:project>
Apr 14 00:07:40 user nova-compute[82479]:   </nova:owner>
Apr 14 00:07:40 user nova-compute[82479]:   <nova:root type="image" uuid="6db62068-7278-4cd8-b41f-d0140d89e199"/>
Apr 14 00:07:40 user nova-compute[82479]:   <nova:ports>
Apr 14 00:07:40 user nova-compute[82479]:     <nova:port uuid="dc4fb8de-0fc3-4af8-86d0-94c357627f5f">
Apr 14 00:07:40 user nova-compute[82479]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 00:07:40 user nova-compute[82479]:     </nova:port>
Apr 14 00:07:40 user nova-compute[82479]:   </nova:ports>
Apr 14 00:07:40 user nova-compute[82479]: </nova:instance>
Apr 14 00:07:40 user nova-compute[82479]:   </metadata>
Apr 14 00:07:40 user nova-compute[82479]:   <memory unit='KiB'>131072</memory>
Apr 14 00:07:40 user nova-compute[82479]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 14 00:07:40 user nova-compute[82479]:   <vcpu placement='static'>1</vcpu>
Apr 14 00:07:40 user nova-compute[82479]:   <resource>
Apr 14 00:07:40 user nova-compute[82479]:     <partition>/machine</partition>
Apr 14 00:07:40 user nova-compute[82479]:   </resource>
Apr 14 00:07:40 user nova-compute[82479]:   <sysinfo type='smbios'>
Apr 14 00:07:40 user nova-compute[82479]:     <system>
Apr 14 00:07:40 user nova-compute[82479]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 14 00:07:40 user nova-compute[82479]:       <entry name='product'>OpenStack Nova</entry>
Apr 14 00:07:40 user nova-compute[82479]:       <entry name='version'>0.0.0</entry>
Apr 14 00:07:40 user nova-compute[82479]:       <entry name='serial'>b9c6323b-ed7f-4f86-93ad-3ef4726b01ff</entry>
Apr 14 00:07:40 user nova-compute[82479]:       <entry name='uuid'>b9c6323b-ed7f-4f86-93ad-3ef4726b01ff</entry>
Apr 14 00:07:40 user nova-compute[82479]:       <entry name='family'>Virtual Machine</entry>
Apr 14 00:07:40 user nova-compute[82479]:     </system>
Apr 14 00:07:40 user nova-compute[82479]:   </sysinfo>
Apr 14 00:07:40 user nova-compute[82479]:   <os>
Apr 14 00:07:40 user nova-compute[82479]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 14 00:07:40 user nova-compute[82479]:     <boot dev='hd'/>
Apr 14 00:07:40 user nova-compute[82479]:     <smbios mode='sysinfo'/>
Apr 14 00:07:40 user nova-compute[82479]:   </os>
Apr 14 00:07:40 user nova-compute[82479]:   <features>
Apr 14 00:07:40 user nova-compute[82479]:     <acpi/>
Apr 14 00:07:40 user nova-compute[82479]:     <apic/>
Apr 14 00:07:40 user nova-compute[82479]:     <vmcoreinfo state='on'/>
Apr 14 00:07:40 user nova-compute[82479]:   </features>
Apr 14 00:07:40 user nova-compute[82479]:   <cpu mode='custom' match='exact' check='full'>
Apr 14 00:07:40 user nova-compute[82479]:     <model fallback='forbid'>Nehalem</model>
Apr 14 00:07:40 user nova-compute[82479]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 14 00:07:40 user nova-compute[82479]:     <feature policy='require' name='vme'/>
Apr 14 00:07:40 user nova-compute[82479]:     <feature policy='require' name='x2apic'/>
Apr 14 00:07:40 user nova-compute[82479]:     <feature policy='require' name='hypervisor'/>
Apr 14 00:07:40 user nova-compute[82479]:   </cpu>
Apr 14 00:07:40 user nova-compute[82479]:   <clock offset='utc'>
Apr 14 00:07:40 user nova-compute[82479]:     <timer name='pit' tickpolicy='delay'/>
Apr 14 00:07:40 user nova-compute[82479]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 14 00:07:40 user nova-compute[82479]:     <timer name='hpet' present='no'/>
Apr 14 00:07:40 user nova-compute[82479]:   </clock>
Apr 14 00:07:40 user nova-compute[82479]:   <on_poweroff>destroy</on_poweroff>
Apr 14 00:07:40 user nova-compute[82479]:   <on_reboot>restart</on_reboot>
Apr 14 00:07:40 user nova-compute[82479]:   <on_crash>destroy</on_crash>
Apr 14 00:07:40 user nova-compute[82479]:   <devices>
Apr 14 00:07:40 user nova-compute[82479]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 14 00:07:40 user nova-compute[82479]:     <disk type='file' device='disk'>
Apr 14 00:07:40 user nova-compute[82479]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 14 00:07:40 user nova-compute[82479]:       <source file='/opt/stack/data/nova/instances/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff/disk' index='2'/>
Apr 14 00:07:40 user nova-compute[82479]:       <backingStore type='file' index='3'>
Apr 14 00:07:40 user nova-compute[82479]:         <format type='raw'/>
Apr 14 00:07:40 user nova-compute[82479]:         <source file='/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4'/>
Apr 14 00:07:40 user nova-compute[82479]:         <backingStore/>
Apr 14 00:07:40 user nova-compute[82479]:       </backingStore>
Apr 14 00:07:40 user nova-compute[82479]:       <target dev='vda' bus='virtio'/>
Apr 14 00:07:40 user nova-compute[82479]:       <alias name='virtio-disk0'/>
Apr 14 00:07:40 user nova-compute[82479]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 14 00:07:40 user nova-compute[82479]:     </disk>
Apr 14 00:07:40 user nova-compute[82479]:     <disk type='file' device='cdrom'>
Apr 14 00:07:40 user nova-compute[82479]:       <driver name='qemu' type='raw' cache='none'/>
Apr 14 00:07:40 user nova-compute[82479]:       <source file='/opt/stack/data/nova/instances/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff/disk.config' index='1'/>
Apr 14 00:07:40 user nova-compute[82479]:       <backingStore/>
Apr 14 00:07:40 user nova-compute[82479]:       <target dev='hda' bus='ide'/>
Apr 14 00:07:40 user nova-compute[82479]:       <readonly/>
Apr 14 00:07:40 user nova-compute[82479]:       <alias name='ide0-0-0'/>
Apr 14 00:07:40 user nova-compute[82479]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 14 00:07:40 user nova-compute[82479]:     </disk>
Apr 14 00:07:40 user nova-compute[82479]:     <controller type='usb' index='0' model='none'>
Apr 14 00:07:40 user nova-compute[82479]:       <alias name='usb'/>
Apr 14 00:07:40 user nova-compute[82479]:     </controller>
Apr 14 00:07:40 user nova-compute[82479]:     <controller type='pci' index='0' model='pci-root'>
Apr 14 00:07:40 user nova-compute[82479]:       <alias name='pci.0'/>
Apr 14 00:07:40 user nova-compute[82479]:     </controller>
Apr 14 00:07:40 user nova-compute[82479]:     <controller type='ide' index='0'>
Apr 14 00:07:40 user nova-compute[82479]:       <alias name='ide'/>
Apr 14 00:07:40 user nova-compute[82479]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 14 00:07:40 user nova-compute[82479]:     </controller>
Apr 14 00:07:40 user nova-compute[82479]:     <interface type='ethernet'>
Apr 14 00:07:40 user nova-compute[82479]:       <mac address='fa:16:3e:9b:6b:79'/>
Apr 14 00:07:40 user nova-compute[82479]:       <target dev='tapdc4fb8de-0f'/>
Apr 14 00:07:40 user nova-compute[82479]:       <model type='virtio'/>
Apr 14 00:07:40 user nova-compute[82479]:       <mtu size='1442'/>
Apr 14 00:07:40 user nova-compute[82479]:       <alias name='net0'/>
Apr 14 00:07:40 user nova-compute[82479]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 14 00:07:40 user nova-compute[82479]:     </interface>
Apr 14 00:07:40 user nova-compute[82479]:     <serial type='pty'>
Apr 14 00:07:40 user nova-compute[82479]:       <source path='/dev/pts/8'/>
Apr 14 00:07:40 user nova-compute[82479]:       <log file='/opt/stack/data/nova/instances/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff/console.log' append='off'/>
Apr 14 00:07:40 user nova-compute[82479]:       <target type='isa-serial' port='0'>
Apr 14 00:07:40 user nova-compute[82479]:         <model name='isa-serial'/>
Apr 14 00:07:40 user nova-compute[82479]:       </target>
Apr 14 00:07:40 user nova-compute[82479]:       <alias name='serial0'/>
Apr 14 00:07:40 user nova-compute[82479]:     </serial>
Apr 14 00:07:40 user nova-compute[82479]:     <console type='pty' tty='/dev/pts/8'>
Apr 14 00:07:40 user nova-compute[82479]:       <source path='/dev/pts/8'/>
Apr 14 00:07:40 user nova-compute[82479]:       <log file='/opt/stack/data/nova/instances/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff/console.log' append='off'/>
Apr 14 00:07:40 user nova-compute[82479]:       <target type='serial' port='0'/>
Apr 14 00:07:40 user nova-compute[82479]:       <alias name='serial0'/>
Apr 14 00:07:40 user nova-compute[82479]:     </console>
Apr 14 00:07:40 user nova-compute[82479]:     <input type='mouse' bus='ps2'>
Apr 14 00:07:40 user nova-compute[82479]:       <alias name='input0'/>
Apr 14 00:07:40 user nova-compute[82479]:     </input>
Apr 14 00:07:40 user nova-compute[82479]:     <input type='keyboard' bus='ps2'>
Apr 14 00:07:40 user nova-compute[82479]:       <alias name='input1'/>
Apr 14 00:07:40 user nova-compute[82479]:     </input>
Apr 14 00:07:40 user nova-compute[82479]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Apr 14 00:07:40 user nova-compute[82479]:       <listen type='address' address='0.0.0.0'/>
Apr 14 00:07:40 user nova-compute[82479]:     </graphics>
Apr 14 00:07:40 user nova-compute[82479]:     <audio id='1' type='none'/>
Apr 14 00:07:40 user nova-compute[82479]:     <video>
Apr 14 00:07:40 user nova-compute[82479]:       <model type='virtio' heads='1' primary='yes'/>
Apr 14 00:07:40 user nova-compute[82479]:       <alias name='video0'/>
Apr 14 00:07:40 user nova-compute[82479]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 14 00:07:40 user nova-compute[82479]:     </video>
Apr 14 00:07:40 user nova-compute[82479]:     <memballoon model='virtio'>
Apr 14 00:07:40 user nova-compute[82479]:       <stats period='10'/>
Apr 14 00:07:40 user nova-compute[82479]:       <alias name='balloon0'/>
Apr 14 00:07:40 user nova-compute[82479]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 14 00:07:40 user nova-compute[82479]:     </memballoon>
Apr 14 00:07:40 user nova-compute[82479]:     <rng model='virtio'>
Apr 14 00:07:40 user nova-compute[82479]:       <backend model='random'>/dev/urandom</backend>
Apr 14 00:07:40 user nova-compute[82479]:       <alias name='rng0'/>
Apr 14 00:07:40 user nova-compute[82479]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 14 00:07:40 user nova-compute[82479]:     </rng>
Apr 14 00:07:40 user nova-compute[82479]:   </devices>
Apr 14 00:07:40 user nova-compute[82479]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 14 00:07:40 user nova-compute[82479]:     <label>libvirt-b9c6323b-ed7f-4f86-93ad-3ef4726b01ff</label>
Apr 14 00:07:40 user nova-compute[82479]:     <imagelabel>libvirt-b9c6323b-ed7f-4f86-93ad-3ef4726b01ff</imagelabel>
Apr 14 00:07:40 user nova-compute[82479]:   </seclabel>
Apr 14 00:07:40 user nova-compute[82479]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 14 00:07:40 user nova-compute[82479]:     <label>+64055:+108</label>
Apr 14 00:07:40 user nova-compute[82479]:     <imagelabel>+64055:+108</imagelabel>
Apr 14 00:07:40 user nova-compute[82479]:   </seclabel>
Apr 14 00:07:40 user nova-compute[82479]: </domain>
Apr 14 00:07:40 user nova-compute[82479]:  {{(pid=82479) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 14 00:07:40 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [req-b255068d-7277-4b75-9007-d0a69f351f16 req-bddda13c-35d4-4f9b-8ae7-1ca030570e8b service nova] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Detaching interface fa:16:3e:c4:e1:fd failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap8d5fc9ab-cb' not found.
Apr 14 00:07:40 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [req-b255068d-7277-4b75-9007-d0a69f351f16 req-bddda13c-35d4-4f9b-8ae7-1ca030570e8b service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T00:05:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1428775386',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1428775386',id=9,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIH5r6nQb46UiVWKMJfMdOVDRbtW2F73ea2D8mxSn1YDz9+bRgJ2nBeDW0+0XBiptqCPYYX6nTAHEycBqQz0FHVyYdWdNoLj8ctiSWD+URcLL8GbP5fneDu/2p/eIfeTqw==',key_name='tempest-keypair-2007231770',keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:05:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c4ee7b5626a14c69aefa86192b6e7bac',ramdisk_id='',reservation_id='r-7dnrqpgh',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-694590407',owner_user_name='tempest-TaggedAttachmentsTest-694590407-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T00:05:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38f9a13bd3f74842b61b57b2ea8bf025',uuid=b9c6323b-ed7f-4f86-93ad-3ef4726b01ff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8d5fc9ab-cbd3-46df-8389-c67fee40f75f", "address": "fa:16:3e:c4:e1:fd", "network": {"id": "830e35a7-48e9-4584-b507-5bed2f6e6b5d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-506512841", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c4ee7b5626a14c69aefa86192b6e7bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d5fc9ab-cb", "ovs_interfaceid": "8d5fc9ab-cbd3-46df-8389-c67fee40f75f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 00:07:40 user nova-compute[82479]: DEBUG nova.network.os_vif_util [req-b255068d-7277-4b75-9007-d0a69f351f16 req-bddda13c-35d4-4f9b-8ae7-1ca030570e8b service nova] Converting VIF {"id": "8d5fc9ab-cbd3-46df-8389-c67fee40f75f", "address": "fa:16:3e:c4:e1:fd", "network": {"id": "830e35a7-48e9-4584-b507-5bed2f6e6b5d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-506512841", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c4ee7b5626a14c69aefa86192b6e7bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d5fc9ab-cb", "ovs_interfaceid": "8d5fc9ab-cbd3-46df-8389-c67fee40f75f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:07:40 user nova-compute[82479]: DEBUG nova.network.os_vif_util [req-b255068d-7277-4b75-9007-d0a69f351f16 req-bddda13c-35d4-4f9b-8ae7-1ca030570e8b service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:e1:fd,bridge_name='br-int',has_traffic_filtering=True,id=8d5fc9ab-cbd3-46df-8389-c67fee40f75f,network=Network(830e35a7-48e9-4584-b507-5bed2f6e6b5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d5fc9ab-cb') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:07:40 user nova-compute[82479]: DEBUG os_vif [req-b255068d-7277-4b75-9007-d0a69f351f16 req-bddda13c-35d4-4f9b-8ae7-1ca030570e8b service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:e1:fd,bridge_name='br-int',has_traffic_filtering=True,id=8d5fc9ab-cbd3-46df-8389-c67fee40f75f,network=Network(830e35a7-48e9-4584-b507-5bed2f6e6b5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d5fc9ab-cb') {{(pid=82479) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 00:07:40 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:40 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8d5fc9ab-cb, bridge=br-int, if_exists=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:07:40 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 00:07:40 user nova-compute[82479]: INFO os_vif [req-b255068d-7277-4b75-9007-d0a69f351f16 req-bddda13c-35d4-4f9b-8ae7-1ca030570e8b service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:e1:fd,bridge_name='br-int',has_traffic_filtering=True,id=8d5fc9ab-cbd3-46df-8389-c67fee40f75f,network=Network(830e35a7-48e9-4584-b507-5bed2f6e6b5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d5fc9ab-cb')
Apr 14 00:07:40 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [req-b255068d-7277-4b75-9007-d0a69f351f16 req-bddda13c-35d4-4f9b-8ae7-1ca030570e8b service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 00:07:40 user nova-compute[82479]:   <nova:package version="0.0.0"/>
Apr 14 00:07:40 user nova-compute[82479]:   <nova:name>tempest-device-tagging-server-1428775386</nova:name>
Apr 14 00:07:40 user nova-compute[82479]:   <nova:creationTime>2023-04-14 00:07:40</nova:creationTime>
Apr 14 00:07:40 user nova-compute[82479]:   <nova:flavor name="m1.nano">
Apr 14 00:07:40 user nova-compute[82479]:     <nova:memory>128</nova:memory>
Apr 14 00:07:40 user nova-compute[82479]:     <nova:disk>1</nova:disk>
Apr 14 00:07:40 user nova-compute[82479]:     <nova:swap>0</nova:swap>
Apr 14 00:07:40 user nova-compute[82479]:     <nova:ephemeral>0</nova:ephemeral>
Apr 14 00:07:40 user nova-compute[82479]:     <nova:vcpus>1</nova:vcpus>
Apr 14 00:07:40 user nova-compute[82479]:   </nova:flavor>
Apr 14 00:07:40 user nova-compute[82479]:   <nova:owner>
Apr 14 00:07:40 user nova-compute[82479]:     <nova:user uuid="38f9a13bd3f74842b61b57b2ea8bf025">tempest-TaggedAttachmentsTest-694590407-project-member</nova:user>
Apr 14 00:07:40 user nova-compute[82479]:     <nova:project uuid="c4ee7b5626a14c69aefa86192b6e7bac">tempest-TaggedAttachmentsTest-694590407</nova:project>
Apr 14 00:07:40 user nova-compute[82479]:   </nova:owner>
Apr 14 00:07:40 user nova-compute[82479]:   <nova:root type="image" uuid="6db62068-7278-4cd8-b41f-d0140d89e199"/>
Apr 14 00:07:40 user nova-compute[82479]:   <nova:ports>
Apr 14 00:07:40 user nova-compute[82479]:     <nova:port uuid="dc4fb8de-0fc3-4af8-86d0-94c357627f5f">
Apr 14 00:07:40 user nova-compute[82479]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 00:07:40 user nova-compute[82479]:     </nova:port>
Apr 14 00:07:40 user nova-compute[82479]:   </nova:ports>
Apr 14 00:07:40 user nova-compute[82479]: </nova:instance>
Apr 14 00:07:40 user nova-compute[82479]:  {{(pid=82479) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 14 00:07:40 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:40 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:07:40 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:07:40 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Starting heal instance info cache {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 00:07:40 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "refresh_cache-3a6b9f89-e462-47d8-84a1-0ac4ade3ab97" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:07:40 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquired lock "refresh_cache-3a6b9f89-e462-47d8-84a1-0ac4ade3ab97" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:07:40 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Forcefully refreshing network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 00:07:40 user nova-compute[82479]: DEBUG nova.network.neutron [None req-4ac94033-07d2-4369-9a3a-e5f5f1b214c7 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Updating instance_info_cache with network_info: [{"id": "dc4fb8de-0fc3-4af8-86d0-94c357627f5f", "address": "fa:16:3e:9b:6b:79", "network": {"id": "281dc33c-0ea9-4812-97ed-82652b538fd0", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-521698420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4ee7b5626a14c69aefa86192b6e7bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4fb8de-0f", "ovs_interfaceid": "dc4fb8de-0fc3-4af8-86d0-94c357627f5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:07:40 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-4ac94033-07d2-4369-9a3a-e5f5f1b214c7 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Releasing lock "refresh_cache-b9c6323b-ed7f-4f86-93ad-3ef4726b01ff" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:07:40 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-4ac94033-07d2-4369-9a3a-e5f5f1b214c7 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "interface-b9c6323b-ed7f-4f86-93ad-3ef4726b01ff-8d5fc9ab-cbd3-46df-8389-c67fee40f75f" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 1.573s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:07:41 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Updating instance_info_cache with network_info: [{"id": "4085de4c-cb9e-452b-9504-b7c7f8621213", "address": "fa:16:3e:2b:ab:7d", "network": {"id": "10c34d1a-edc4-4b0c-96a7-b29a7c292e74", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-573422654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931198e56de4cf08db59bcc40f2a260", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4085de4c-cb", "ovs_interfaceid": "4085de4c-cb9e-452b-9504-b7c7f8621213", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:07:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Releasing lock "refresh_cache-3a6b9f89-e462-47d8-84a1-0ac4ade3ab97" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:07:41 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Updated the network info_cache for instance {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 00:07:41 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:07:41 user nova-compute[82479]: DEBUG nova.compute.manager [req-5639c9e0-e4cd-43ca-b121-0d063b15b7ed req-71808985-ae47-462f-890c-bb78fdc95b69 service nova] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Received event network-vif-plugged-8d5fc9ab-cbd3-46df-8389-c67fee40f75f {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:07:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-5639c9e0-e4cd-43ca-b121-0d063b15b7ed req-71808985-ae47-462f-890c-bb78fdc95b69 service nova] Acquiring lock "b9c6323b-ed7f-4f86-93ad-3ef4726b01ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:07:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-5639c9e0-e4cd-43ca-b121-0d063b15b7ed req-71808985-ae47-462f-890c-bb78fdc95b69 service nova] Lock "b9c6323b-ed7f-4f86-93ad-3ef4726b01ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:07:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-5639c9e0-e4cd-43ca-b121-0d063b15b7ed req-71808985-ae47-462f-890c-bb78fdc95b69 service nova] Lock "b9c6323b-ed7f-4f86-93ad-3ef4726b01ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:07:41 user nova-compute[82479]: DEBUG nova.compute.manager [req-5639c9e0-e4cd-43ca-b121-0d063b15b7ed req-71808985-ae47-462f-890c-bb78fdc95b69 service nova] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] No waiting events found dispatching network-vif-plugged-8d5fc9ab-cbd3-46df-8389-c67fee40f75f {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:07:41 user nova-compute[82479]: WARNING nova.compute.manager [req-5639c9e0-e4cd-43ca-b121-0d063b15b7ed req-71808985-ae47-462f-890c-bb78fdc95b69 service nova] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Received unexpected event network-vif-plugged-8d5fc9ab-cbd3-46df-8389-c67fee40f75f for instance with vm_state active and task_state None.
Apr 14 00:07:42 user nova-compute[82479]: DEBUG nova.compute.manager [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xEjqaYiH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '716b5e3f-20c7-40ef-9a45-71be0cfeaeb2', 'attached_at': '', 'detached_at': '', 'volume_id': 'c7267b8e-f20c-4625-b82d-b1a31a337714', 'serial': 'c7267b8e-f20c-4625-b82d-b1a31a337714'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WjavJYiu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'volume_id': '2024a461-c307-42e0-976a-bde8b1ef0bed'}, 'status': 'reserved', 'instance': '716b5e3f-20c7-40ef-9a45-71be0cfeaeb2', 'attached_at': '', 'detached_at': '', 'volume_id': '2024a461-c307-42e0-976a-bde8b1ef0bed', 'serial'} {{(pid=82479) _swap_volume /opt/stack/nova/nova/compute/manager.py:7656}}
Apr 14 00:07:42 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Calling os-brick to attach iSCSI Volume {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 00:07:42 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xEjqaYiH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:07:42 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:07:42 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:07:42 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:07:42 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:07:42 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:07:42 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:07:42 user nova-compute[82479]: INFO os_brick.initiator.connectors.iscsi [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 00:07:42 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 -p 172.16.0.220:3260 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:42 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:42 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[393a7abc-57e0-4ea5-8497-3bcedf742bd0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:42 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 00:07:42 user nova-compute[82479]:  {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:07:42 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 -p 172.16.0.220:3260 --interface default --op new {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:42 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:42 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a044a0-af03-47c0-9cfd-90df483c895b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714] added\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:42 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714] added
Apr 14 00:07:42 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:07:42 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:42 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:42 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df9b1bf-ac9e-4d9a-8255-84199600acf8]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:42 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:07:42 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:42 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:42 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c64a70-21c5-4d46-ad66-fe5f74372756]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:42 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:07:42 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xEjqaYiH {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:42 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xEjqaYiH" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:42 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3fd14a8-4c68-4357-b2c1-e81420d733a4]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:42 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xEjqaYiH'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:07:42 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:42 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:42 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d82bd13-0f93-4494-a35b-3abf30e20d8d]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:42 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:07:42 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:42 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:42 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[77421799-bcf5-40ba-b329-89b258fa2ebc]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:42 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:07:42 user nova-compute[82479]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed (non-flash)
Apr 14 00:07:42 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:07:42 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:07:42 user nova-compute[82479]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed (non-flash)
Apr 14 00:07:42 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:07:42 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 -p 172.16.0.220:3260 --login {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:42 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:42 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ab87b1-847a-4b8d-96e6-7711f398b5bc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:42 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714, portal: 172.16.0.220,3260]
Apr 14 00:07:42 user nova-compute[82479]: Login to [iface: default, target: iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714, portal: 172.16.0.220,3260] successful.
Apr 14 00:07:42 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:07:42 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:42 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:07:42 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:07:42 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82479) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 00:07:42 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:42 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[87daba9d-db9c-4453-a7ab-af7609f2b6ce]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:42 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:07:42 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:42 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:42 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8c585b-1133-4215-bbe1-0817f9b4c066]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:42 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:07:42 user nova-compute[82479]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed (non-flash)
Apr 14 00:07:42 user nova-compute[82479]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 (non-flash)
Apr 14 00:07:42 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:07:42 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:07:42 user nova-compute[82479]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed (non-flash)
Apr 14 00:07:42 user nova-compute[82479]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 (non-flash)
Apr 14 00:07:42 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:07:42 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:07:42 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] Connected to 172.16.0.220:3260 {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 00:07:42 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] HCTL ('33', '-', '-', 0) found on session 9 with lun 0 {{(pid=82479) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 00:07:42 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=82479) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 00:07:42 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:42 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:42 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e2a3cf-7a7f-4d27-b31a-6f0345cd3a30]: (4, ('- - 0', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:42 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] Searching for a device in session 9 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82479) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 00:07:42 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xEjqaYiH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 00:07:43 user nova-compute[82479]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681430848.4961298, e97abae3-f573-48eb-a218-a8fec436ef3b => Stopped> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:07:43 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] VM Stopped (Lifecycle Event)
Apr 14 00:07:43 user nova-compute[82479]: DEBUG nova.compute.manager [None req-a684ac79-e7d6-4755-bb89-d55bb90aa8aa None None] [instance: e97abae3-f573-48eb-a218-a8fec436ef3b] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:07:43 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:07:43 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:07:43 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:07:43 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '23633343366346163', 'path': '/dev/sdb'} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:07:43 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23633343366346163', 'path': '/dev/sdb'} {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 00:07:43 user nova-compute[82479]: DEBUG nova.objects.instance [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] Lazy-loading 'flavor' on Instance uuid 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:07:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] COPY block job progress, current cursor: 6291456 final cursor: 1073741824 {{(pid=82479) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 00:07:44 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:07:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:07:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:07:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:07:44 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Auditing locally available compute resources for user (node: user) {{(pid=82479) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 00:07:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] COPY block job progress, current cursor: 177209344 final cursor: 1073741824 {{(pid=82479) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 00:07:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:44 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:45 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] COPY block job progress, current cursor: 353370112 final cursor: 1073741824 {{(pid=82479) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 00:07:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11c3384a-e699-4b10-9f8b-861291e96465/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11c3384a-e699-4b10-9f8b-861291e96465/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11c3384a-e699-4b10-9f8b-861291e96465/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:45 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11c3384a-e699-4b10-9f8b-861291e96465/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:45 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] COPY block job progress, current cursor: 512753664 final cursor: 1073741824 {{(pid=82479) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 00:07:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01a65362-36ea-4817-8e83-f75d6daf808b/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01a65362-36ea-4817-8e83-f75d6daf808b/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01a65362-36ea-4817-8e83-f75d6daf808b/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:46 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] COPY block job progress, current cursor: 693108736 final cursor: 1073741824 {{(pid=82479) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 00:07:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01a65362-36ea-4817-8e83-f75d6daf808b/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:46 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:07:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/716b5e3f-20c7-40ef-9a45-71be0cfeaeb2/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/716b5e3f-20c7-40ef-9a45-71be0cfeaeb2/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/716b5e3f-20c7-40ef-9a45-71be0cfeaeb2/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/716b5e3f-20c7-40ef-9a45-71be0cfeaeb2/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:46 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:07:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:46 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] COPY block job progress, current cursor: 891289600 final cursor: 1073741824 {{(pid=82479) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 00:07:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:47 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:47 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fba4ee-4aae-4ee3-8114-b53510f5442c/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:47 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fba4ee-4aae-4ee3-8114-b53510f5442c/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:47 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fba4ee-4aae-4ee3-8114-b53510f5442c/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:47 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=82479) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 00:07:47 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fba4ee-4aae-4ee3-8114-b53510f5442c/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:47 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:47 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] calling os-brick to detach iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 00:07:47 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, {'target_iqn': 'iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WjavJYiu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'volume_id': '2024a461-c307-42e0-976a-bde8b1ef0bed': {}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:07:47 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:07:47 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:07:47 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:07:47 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:47 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:47 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[0519e945-33a7-4937-82e5-9dabdd967585]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:47 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 00:07:47 user nova-compute[82479]: No targets found.
Apr 14 00:07:47 user nova-compute[82479]: iSNS:
Apr 14 00:07:47 user nova-compute[82479]: No targets found.
Apr 14 00:07:47 user nova-compute[82479]: STATIC:
Apr 14 00:07:47 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714
Apr 14 00:07:47 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:07:47 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:07:47 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7
Apr 14 00:07:47 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:07:47 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:07:47 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed
Apr 14 00:07:47 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:07:47 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:07:47 user nova-compute[82479]: FIRMWARE:
Apr 14 00:07:47 user nova-compute[82479]: No targets found.
Apr 14 00:07:47 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:07:47 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 00:07:47 user nova-compute[82479]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 00:07:47 user nova-compute[82479]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82479) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 00:07:47 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed', 0)] {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 00:07:47 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:47 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:47 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a25b5b-cb3d-4d63-aa34-b6062255a7ac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:47 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:47 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:47 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[8066007e-d707-4053-85c7-02ff8254d9af]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:47 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:07:47 user nova-compute[82479]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed (non-flash)
Apr 14 00:07:47 user nova-compute[82479]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 (non-flash)
Apr 14 00:07:47 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:07:47 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:07:47 user nova-compute[82479]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed (non-flash)
Apr 14 00:07:47 user nova-compute[82479]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 (non-flash)
Apr 14 00:07:47 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:07:47 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3344b0f9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed'): ({'sdd'}, set())}) {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 00:07:47 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] Removing single pathed devices sdd {{(pid=82479) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 00:07:47 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:47 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:47 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:47 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:47 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[7989807f-fedd-47c2-b49b-5c833c91c0d1]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:47 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:47 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:47 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c14602-34e9-4b5f-91a4-df72096cfe36]: (4, ('ok\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:47 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] Flushing IO for device /dev/sdd {{(pid=82479) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 00:07:47 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:47 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:47 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6fded6-cf25-468a-b729-1b58bb25d3dd]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:47 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=82479) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 00:07:47 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:47 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.055s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:47 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e4a975-742c-4f24-bb67-78ee109f9cc3]: (4, ('1', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:47 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] Checking to see if SCSI volumes sdd have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 00:07:47 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] SCSI volumes sdd have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 00:07:47 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed')] {{(pid=82479) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 00:07:47 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:47 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:47 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:47 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[9739f5d5-7ee4-419b-b793-1326ff2762eb]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:47 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:07:47 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed -p 172.16.0.220:3260 --logout {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:48 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:48 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:48 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f5e884-d570-42b2-aa15-ccacce47c64e]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:48 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed, portal: 172.16.0.220,3260]
Apr 14 00:07:48 user nova-compute[82479]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed, portal: 172.16.0.220,3260] successful.
Apr 14 00:07:48 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:07:48 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed -p 172.16.0.220:3260 --op delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:48 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:07:48 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:07:48 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Hypervisor/Node resource view: name=user free_ram=7779MB free_disk=26.414676666259766GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82479) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 00:07:48 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:07:48 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:07:48 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:48 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d5122b-13e4-4c2e-861a-1340c3d9b4e3]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:48 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:07:48 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.887s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:07:48 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] <== disconnect_volume: return (890ms) None {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:07:48 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Disconnected iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 00:07:48 user nova-compute[82479]: DEBUG nova.compute.manager [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xEjqaYiH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '716b5e3f-20c7-40ef-9a45-71be0cfeaeb2', 'attached_at': '', 'detached_at': '', 'volume_id': 'c7267b8e-f20c-4625-b82d-b1a31a337714', 'serial'} {{(pid=82479) _swap_volume /opt/stack/nova/nova/compute/manager.py:7665}}
Apr 14 00:07:48 user nova-compute[82479]: DEBUG nova.compute.manager [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] swap_volume: removing Cinder connection for volume 2024a461-c307-42e0-976a-bde8b1ef0bed {{(pid=82479) _swap_volume /opt/stack/nova/nova/compute/manager.py:7710}}
Apr 14 00:07:48 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 23718fd0-58b8-47f9-b1ef-a26a90741ecc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:07:48 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:07:48 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 01a65362-36ea-4817-8e83-f75d6daf808b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:07:48 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance b3475e7e-ceb4-452a-a045-dbf43c5944dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:07:48 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:07:48 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance b9c6323b-ed7f-4f86-93ad-3ef4726b01ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:07:48 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 11c3384a-e699-4b10-9f8b-861291e96465 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:07:48 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance e3fba4ee-4aae-4ee3-8114-b53510f5442c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:07:48 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 00:07:48 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 00:07:48 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:07:48 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:07:48 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Compute_service record updated for user:user {{(pid=82479) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 00:07:48 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.406s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:07:49 user nova-compute[82479]: DEBUG nova.compute.manager [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] swap_volume: Updating volume 2024a461-c307-42e0-976a-bde8b1ef0bed BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "xEjqaYiH", "auth_password": "DC6FyeHmOsIU58", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "c7267b8e-f20c-4625-b82d-b1a31a337714"}, "status": "reserved", "instance": "716b5e3f-20c7-40ef-9a45-71be0cfeaeb2", "attached_at": "", "detached_at": "", "volume_id": "c7267b8e-f20c-4625-b82d-b1a31a337714", "serial": "c7267b8e-f20c-4625-b82d-b1a31a337714"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'c7267b8e-f20c-4625-b82d-b1a31a337714', 'no_device': None, 'attachment_id': 'e332173a-e2e2-4550-9444-dcd931408615'} {{(pid=82479) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7858}}
Apr 14 00:07:49 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-dca97c84-7a9e-4752-aa2e-147feefef2b1 tempest-TestVolumeSwap-872962825 tempest-TestVolumeSwap-872962825-project-admin] Lock "716b5e3f-20c7-40ef-9a45-71be0cfeaeb2" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 11.940s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:07:49 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:07:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:50 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:50 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ea2e1591-959d-4a64-bee6-63c97cae3b5f tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Acquiring lock "716b5e3f-20c7-40ef-9a45-71be0cfeaeb2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:07:50 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ea2e1591-959d-4a64-bee6-63c97cae3b5f tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "716b5e3f-20c7-40ef-9a45-71be0cfeaeb2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:07:50 user nova-compute[82479]: INFO nova.compute.manager [None req-ea2e1591-959d-4a64-bee6-63c97cae3b5f tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Detaching volume c7267b8e-f20c-4625-b82d-b1a31a337714
Apr 14 00:07:50 user nova-compute[82479]: INFO nova.virt.block_device [None req-ea2e1591-959d-4a64-bee6-63c97cae3b5f tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Attempting to driver detach volume c7267b8e-f20c-4625-b82d-b1a31a337714 from mountpoint /dev/vdb
Apr 14 00:07:50 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ea2e1591-959d-4a64-bee6-63c97cae3b5f tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Attempting to detach device vdb from instance 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2 from the persistent domain config. {{(pid=82479) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 00:07:50 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-ea2e1591-959d-4a64-bee6-63c97cae3b5f tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 00:07:50 user nova-compute[82479]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:07:50 user nova-compute[82479]:   <source dev="/dev/sdb"/>
Apr 14 00:07:50 user nova-compute[82479]:   <target dev="vdb" bus="virtio"/>
Apr 14 00:07:50 user nova-compute[82479]:   <serial>c7267b8e-f20c-4625-b82d-b1a31a337714</serial>
Apr 14 00:07:50 user nova-compute[82479]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 00:07:50 user nova-compute[82479]: </disk>
Apr 14 00:07:50 user nova-compute[82479]:  {{(pid=82479) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 00:07:50 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-ea2e1591-959d-4a64-bee6-63c97cae3b5f tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Successfully detached device vdb from instance 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2 from the persistent domain config.
Apr 14 00:07:50 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ea2e1591-959d-4a64-bee6-63c97cae3b5f tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2 from the live domain config. {{(pid=82479) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 00:07:50 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-ea2e1591-959d-4a64-bee6-63c97cae3b5f tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 00:07:50 user nova-compute[82479]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:07:50 user nova-compute[82479]:   <source dev="/dev/sdb"/>
Apr 14 00:07:50 user nova-compute[82479]:   <target dev="vdb" bus="virtio"/>
Apr 14 00:07:50 user nova-compute[82479]:   <serial>c7267b8e-f20c-4625-b82d-b1a31a337714</serial>
Apr 14 00:07:50 user nova-compute[82479]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 00:07:50 user nova-compute[82479]: </disk>
Apr 14 00:07:50 user nova-compute[82479]:  {{(pid=82479) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 00:07:51 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Received event <DeviceRemovedEvent: 1681430871.1545029, 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82479) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 00:07:51 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ea2e1591-959d-4a64-bee6-63c97cae3b5f tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2 {{(pid=82479) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 00:07:51 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-ea2e1591-959d-4a64-bee6-63c97cae3b5f tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Successfully detached device vdb from instance 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2 from the live domain config.
Apr 14 00:07:51 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea2e1591-959d-4a64-bee6-63c97cae3b5f tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] calling os-brick to detach iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 00:07:51 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea2e1591-959d-4a64-bee6-63c97cae3b5f tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, {'target_iqn': 'iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xEjqaYiH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': 'c7267b8e-f20c-4625-b82d-b1a31a337714': {}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:07:51 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-ea2e1591-959d-4a64-bee6-63c97cae3b5f tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:07:51 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-ea2e1591-959d-4a64-bee6-63c97cae3b5f tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:07:51 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-ea2e1591-959d-4a64-bee6-63c97cae3b5f tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:07:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:51 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bff7244-30ed-4b31-ba43-f206e70ce0d9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:51 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea2e1591-959d-4a64-bee6-63c97cae3b5f tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 00:07:51 user nova-compute[82479]: No targets found.
Apr 14 00:07:51 user nova-compute[82479]: iSNS:
Apr 14 00:07:51 user nova-compute[82479]: No targets found.
Apr 14 00:07:51 user nova-compute[82479]: STATIC:
Apr 14 00:07:51 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714
Apr 14 00:07:51 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:07:51 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:07:51 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7
Apr 14 00:07:51 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:07:51 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:07:51 user nova-compute[82479]: FIRMWARE:
Apr 14 00:07:51 user nova-compute[82479]: No targets found.
Apr 14 00:07:51 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:07:51 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea2e1591-959d-4a64-bee6-63c97cae3b5f tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 00:07:51 user nova-compute[82479]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 00:07:51 user nova-compute[82479]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82479) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 00:07:51 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea2e1591-959d-4a64-bee6-63c97cae3b5f tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714', 0)] {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 00:07:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:51 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e810a09-b060-4b15-9027-6fb338e78b7e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:51 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[2164182a-0fd1-4b42-875e-7a6a03272065]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:51 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea2e1591-959d-4a64-bee6-63c97cae3b5f tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:07:51 user nova-compute[82479]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 (non-flash)
Apr 14 00:07:51 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:07:51 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea2e1591-959d-4a64-bee6-63c97cae3b5f tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:07:51 user nova-compute[82479]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 (non-flash)
Apr 14 00:07:51 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:07:51 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea2e1591-959d-4a64-bee6-63c97cae3b5f tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3344b0c790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714'): ({'sdb'}, set())}) {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 00:07:51 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-ea2e1591-959d-4a64-bee6-63c97cae3b5f tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Removing single pathed devices sdb {{(pid=82479) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 00:07:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:51 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[d951591b-03cd-4a94-be15-a465856f0214]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:51 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa09850-d870-4475-a8ef-947ac055c712]: (4, ('ok\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:51 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-ea2e1591-959d-4a64-bee6-63c97cae3b5f tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Flushing IO for device /dev/sdb {{(pid=82479) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 00:07:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:51 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[110b1f58-60be-4f12-8a6a-266fc28b0ea6]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:51 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-ea2e1591-959d-4a64-bee6-63c97cae3b5f tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82479) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 00:07:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.033s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:51 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b6147a-e131-4219-8e98-678f54415be8]: (4, ('1', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:51 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-ea2e1591-959d-4a64-bee6-63c97cae3b5f tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 00:07:51 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-ea2e1591-959d-4a64-bee6-63c97cae3b5f tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] SCSI volumes sdb have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 00:07:51 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea2e1591-959d-4a64-bee6-63c97cae3b5f tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714')] {{(pid=82479) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 00:07:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:51 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d07ff3f-595c-4928-8314-e72dfcd6149d]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:51 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea2e1591-959d-4a64-bee6-63c97cae3b5f tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:07:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 -p 172.16.0.220:3260 --logout {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:51 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[a935a8cd-6a57-495a-aa50-07541e3cb70c]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:51 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea2e1591-959d-4a64-bee6-63c97cae3b5f tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714, portal: 172.16.0.220,3260]
Apr 14 00:07:51 user nova-compute[82479]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714, portal: 172.16.0.220,3260] successful.
Apr 14 00:07:51 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:07:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 -p 172.16.0.220:3260 --op delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:07:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:07:51 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[82261a39-9ff4-4e4e-b518-c879c7a30759]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:07:51 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea2e1591-959d-4a64-bee6-63c97cae3b5f tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:07:51 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-ea2e1591-959d-4a64-bee6-63c97cae3b5f tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:07:51 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea2e1591-959d-4a64-bee6-63c97cae3b5f tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] <== disconnect_volume: return (306ms) None {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:07:51 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea2e1591-959d-4a64-bee6-63c97cae3b5f tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Disconnected iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 00:07:52 user nova-compute[82479]: DEBUG nova.objects.instance [None req-ea2e1591-959d-4a64-bee6-63c97cae3b5f tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lazy-loading 'flavor' on Instance uuid 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:07:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ea2e1591-959d-4a64-bee6-63c97cae3b5f tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "716b5e3f-20c7-40ef-9a45-71be0cfeaeb2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.669s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:07:54 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:55 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:56 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:07:59 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:08:09 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:10 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:14 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:15 user nova-compute[82479]: DEBUG nova.compute.manager [req-c1d93a28-9ddf-462d-91dc-32df1a8a71b5 req-11d03756-5287-4195-a191-c9afc5571adf service nova] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Received event network-changed-cce0e09c-d491-4698-b846-d75a670cc38e {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:08:15 user nova-compute[82479]: DEBUG nova.compute.manager [req-c1d93a28-9ddf-462d-91dc-32df1a8a71b5 req-11d03756-5287-4195-a191-c9afc5571adf service nova] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Refreshing instance network info cache due to event network-changed-cce0e09c-d491-4698-b846-d75a670cc38e. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:08:15 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-c1d93a28-9ddf-462d-91dc-32df1a8a71b5 req-11d03756-5287-4195-a191-c9afc5571adf service nova] Acquiring lock "refresh_cache-11c3384a-e699-4b10-9f8b-861291e96465" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:08:15 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-c1d93a28-9ddf-462d-91dc-32df1a8a71b5 req-11d03756-5287-4195-a191-c9afc5571adf service nova] Acquired lock "refresh_cache-11c3384a-e699-4b10-9f8b-861291e96465" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:08:15 user nova-compute[82479]: DEBUG nova.network.neutron [req-c1d93a28-9ddf-462d-91dc-32df1a8a71b5 req-11d03756-5287-4195-a191-c9afc5571adf service nova] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Refreshing network info cache for port cce0e09c-d491-4698-b846-d75a670cc38e {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:08:15 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:15 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-c5e572d1-e002-4beb-a395-a1201bc92489 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquiring lock "11c3384a-e699-4b10-9f8b-861291e96465" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:08:15 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-c5e572d1-e002-4beb-a395-a1201bc92489 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "11c3384a-e699-4b10-9f8b-861291e96465" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:08:15 user nova-compute[82479]: DEBUG nova.objects.instance [None req-c5e572d1-e002-4beb-a395-a1201bc92489 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lazy-loading 'flavor' on Instance uuid 11c3384a-e699-4b10-9f8b-861291e96465 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:08:15 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-c5e572d1-e002-4beb-a395-a1201bc92489 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "11c3384a-e699-4b10-9f8b-861291e96465" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:08:15 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-c5e572d1-e002-4beb-a395-a1201bc92489 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquiring lock "11c3384a-e699-4b10-9f8b-861291e96465" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:08:15 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-c5e572d1-e002-4beb-a395-a1201bc92489 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "11c3384a-e699-4b10-9f8b-861291e96465" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:08:15 user nova-compute[82479]: INFO nova.compute.manager [None req-c5e572d1-e002-4beb-a395-a1201bc92489 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Attaching volume 8e63ed78-ec07-4e8f-8ec4-e81494a415a3 to /dev/vdb
Apr 14 00:08:16 user nova-compute[82479]: DEBUG os_brick.utils [None req-c5e572d1-e002-4beb-a395-a1201bc92489 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:08:16 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:16 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:16 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c77124-5a93-4655-87ac-4ca1ff199cce]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fec92fcfdd3\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:16 user nova-compute[82479]: DEBUG nova.network.neutron [req-c1d93a28-9ddf-462d-91dc-32df1a8a71b5 req-11d03756-5287-4195-a191-c9afc5571adf service nova] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Updated VIF entry in instance network info cache for port cce0e09c-d491-4698-b846-d75a670cc38e. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:08:16 user nova-compute[82479]: DEBUG nova.network.neutron [req-c1d93a28-9ddf-462d-91dc-32df1a8a71b5 req-11d03756-5287-4195-a191-c9afc5571adf service nova] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Updating instance_info_cache with network_info: [{"id": "cce0e09c-d491-4698-b846-d75a670cc38e", "address": "fa:16:3e:77:7f:4e", "network": {"id": "f185dffe-f180-4107-8752-182e71fc07c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1954392221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f138770c7b4407d83c449500fc000a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcce0e09c-d4", "ovs_interfaceid": "cce0e09c-d491-4698-b846-d75a670cc38e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:08:16 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:16 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:16 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[812ee08d-fd53-4e95-a96e-302330994fba]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:16 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:16 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:16 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[27bbf5b2-18bf-4881-a67f-70165d7d59b1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:16 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[daefa0aa-e35c-40b3-a1bc-72179a5b7108]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:16 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-c5e572d1-e002-4beb-a395-a1201bc92489 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Running cmd (subprocess): nvme version {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:16 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-c5e572d1-e002-4beb-a395-a1201bc92489 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] 'nvme version' failed. Not Retrying. {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:08:16 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c5e572d1-e002-4beb-a395-a1201bc92489 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] nvme not present on system {{(pid=82479) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 00:08:16 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-c1d93a28-9ddf-462d-91dc-32df1a8a71b5 req-11d03756-5287-4195-a191-c9afc5571adf service nova] Releasing lock "refresh_cache-11c3384a-e699-4b10-9f8b-861291e96465" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:08:16 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:16 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:08:16 user nova-compute[82479]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 00:08:16 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[2164630e-9671-4098-a2e7-3b941ddb0917]: (4, '') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:16 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-c5e572d1-e002-4beb-a395-a1201bc92489 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82479) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 00:08:16 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-c5e572d1-e002-4beb-a395-a1201bc92489 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 00:08:16 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-c5e572d1-e002-4beb-a395-a1201bc92489 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] LIGHTOS: no hostnqn found. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 00:08:16 user nova-compute[82479]: DEBUG os_brick.utils [None req-c5e572d1-e002-4beb-a395-a1201bc92489 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fec92fcfdd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:08:16 user nova-compute[82479]: DEBUG nova.virt.block_device [None req-c5e572d1-e002-4beb-a395-a1201bc92489 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Updating existing volume attachment record: 70533a79-9e86-4fea-9e41-237c588cdfb8 {{(pid=82479) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 00:08:19 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:20 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5e572d1-e002-4beb-a395-a1201bc92489 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Calling os-brick to attach iSCSI Volume {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 00:08:20 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e572d1-e002-4beb-a395-a1201bc92489 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GtexvRgE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:08:20 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-c5e572d1-e002-4beb-a395-a1201bc92489 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:08:20 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-c5e572d1-e002-4beb-a395-a1201bc92489 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:08:20 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-c5e572d1-e002-4beb-a395-a1201bc92489 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:08:20 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-c5e572d1-e002-4beb-a395-a1201bc92489 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:08:20 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-c5e572d1-e002-4beb-a395-a1201bc92489 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:08:20 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-c5e572d1-e002-4beb-a395-a1201bc92489 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:08:20 user nova-compute[82479]: INFO os_brick.initiator.connectors.iscsi [None req-c5e572d1-e002-4beb-a395-a1201bc92489 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 00:08:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3 -p 172.16.0.220:3260 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:20 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f9e753c-1693-414a-b576-fdf8ac131dc0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:20 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e572d1-e002-4beb-a395-a1201bc92489 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 00:08:20 user nova-compute[82479]:  {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:08:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3 -p 172.16.0.220:3260 --interface default --op new {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:20 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1020ca9-f8c6-4d48-a21b-a8809588c3b2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3] added\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:20 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e572d1-e002-4beb-a395-a1201bc92489 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3] added
Apr 14 00:08:20 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:08:20 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:20 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[132d823e-89bf-4c4a-8344-5cc0d63424a5]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:20 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e572d1-e002-4beb-a395-a1201bc92489 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:08:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:20 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[c862637c-c1d8-41fd-b993-f61bd9b3603c]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:20 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e572d1-e002-4beb-a395-a1201bc92489 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:08:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GtexvRgE {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GtexvRgE" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:20 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41d78ce-0c56-47db-bfd9-183b019869c9]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:20 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e572d1-e002-4beb-a395-a1201bc92489 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GtexvRgE'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:08:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:20 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e3a1d5-1f85-45e5-84b5-572b9f9aa5f9]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:20 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e572d1-e002-4beb-a395-a1201bc92489 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:08:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:20 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[f72b02f1-441a-4b15-b8d3-fa1033dcd6c6]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:20 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e572d1-e002-4beb-a395-a1201bc92489 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:08:20 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:08:20 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e572d1-e002-4beb-a395-a1201bc92489 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:08:20 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:08:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3 -p 172.16.0.220:3260 --login {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:20 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[abfbec59-7b3b-43ab-be68-c597c61c937f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:20 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e572d1-e002-4beb-a395-a1201bc92489 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3, portal: 172.16.0.220,3260]
Apr 14 00:08:20 user nova-compute[82479]: Login to [iface: default, target: iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3, portal: 172.16.0.220,3260] successful.
Apr 14 00:08:20 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:08:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:20 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4b32ab-f0cd-46ab-a99f-37aa4f5a3329]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:20 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e572d1-e002-4beb-a395-a1201bc92489 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:08:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:20 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c64b229-331c-4b41-98f4-14c0223ff673]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:20 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e572d1-e002-4beb-a395-a1201bc92489 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3 (non-flash)
Apr 14 00:08:20 user nova-compute[82479]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:08:20 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:08:20 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e572d1-e002-4beb-a395-a1201bc92489 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3 (non-flash)
Apr 14 00:08:20 user nova-compute[82479]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:08:20 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:08:20 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-c5e572d1-e002-4beb-a395-a1201bc92489 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:08:20 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e572d1-e002-4beb-a395-a1201bc92489 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Connected to 172.16.0.220:3260 {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 00:08:20 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-c5e572d1-e002-4beb-a395-a1201bc92489 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] HCTL ('33', '-', '-', 0) found on session 10 with lun 0 {{(pid=82479) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 00:08:20 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-c5e572d1-e002-4beb-a395-a1201bc92489 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82479) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 00:08:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:20 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec34c8ed-9177-42fb-9d6f-af54769d945d]: (4, ('- - 0', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:20 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-c5e572d1-e002-4beb-a395-a1201bc92489 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Searching for a device in session 10 and hctl ['33', '*', '*', 0] yield: None {{(pid=82479) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 00:08:21 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-c5e572d1-e002-4beb-a395-a1201bc92489 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Searching for a device in session 10 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82479) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 00:08:21 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e572d1-e002-4beb-a395-a1201bc92489 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GtexvRgE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 00:08:21 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-c5e572d1-e002-4beb-a395-a1201bc92489 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:08:21 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5e572d1-e002-4beb-a395-a1201bc92489 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23739613139643865', 'path': '/dev/sdb'} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:08:21 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5e572d1-e002-4beb-a395-a1201bc92489 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23739613139643865', 'path': '/dev/sdb'} {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 00:08:21 user nova-compute[82479]: DEBUG nova.objects.instance [None req-c5e572d1-e002-4beb-a395-a1201bc92489 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lazy-loading 'flavor' on Instance uuid 11c3384a-e699-4b10-9f8b-861291e96465 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:08:21 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-c5e572d1-e002-4beb-a395-a1201bc92489 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 00:08:21 user nova-compute[82479]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:08:21 user nova-compute[82479]:   <source dev="/dev/sdb"/>
Apr 14 00:08:21 user nova-compute[82479]:   <target dev="vdb" bus="virtio"/>
Apr 14 00:08:21 user nova-compute[82479]:   <serial>8e63ed78-ec07-4e8f-8ec4-e81494a415a3</serial>
Apr 14 00:08:21 user nova-compute[82479]: </disk>
Apr 14 00:08:21 user nova-compute[82479]:  {{(pid=82479) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 00:08:22 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-c5e572d1-e002-4beb-a395-a1201bc92489 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:08:22 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-c5e572d1-e002-4beb-a395-a1201bc92489 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:08:22 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-c5e572d1-e002-4beb-a395-a1201bc92489 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] No VIF found with MAC fa:16:3e:77:7f:4e, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:08:22 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-c5e572d1-e002-4beb-a395-a1201bc92489 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "11c3384a-e699-4b10-9f8b-861291e96465" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.540s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:08:24 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:24 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:25 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-3bf613d5-8cd8-41fd-a78b-179a5d948a97 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquiring lock "11c3384a-e699-4b10-9f8b-861291e96465" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:08:25 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-3bf613d5-8cd8-41fd-a78b-179a5d948a97 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "11c3384a-e699-4b10-9f8b-861291e96465" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:08:25 user nova-compute[82479]: INFO nova.compute.manager [None req-3bf613d5-8cd8-41fd-a78b-179a5d948a97 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Detaching volume 8e63ed78-ec07-4e8f-8ec4-e81494a415a3
Apr 14 00:08:25 user nova-compute[82479]: INFO nova.virt.block_device [None req-3bf613d5-8cd8-41fd-a78b-179a5d948a97 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Attempting to driver detach volume 8e63ed78-ec07-4e8f-8ec4-e81494a415a3 from mountpoint /dev/vdb
Apr 14 00:08:25 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-3bf613d5-8cd8-41fd-a78b-179a5d948a97 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Attempting to detach device vdb from instance 11c3384a-e699-4b10-9f8b-861291e96465 from the persistent domain config. {{(pid=82479) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 00:08:25 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-3bf613d5-8cd8-41fd-a78b-179a5d948a97 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 00:08:25 user nova-compute[82479]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:08:25 user nova-compute[82479]:   <source dev="/dev/sdb"/>
Apr 14 00:08:25 user nova-compute[82479]:   <target dev="vdb" bus="virtio"/>
Apr 14 00:08:25 user nova-compute[82479]:   <serial>8e63ed78-ec07-4e8f-8ec4-e81494a415a3</serial>
Apr 14 00:08:25 user nova-compute[82479]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 00:08:25 user nova-compute[82479]: </disk>
Apr 14 00:08:25 user nova-compute[82479]:  {{(pid=82479) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 00:08:25 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-3bf613d5-8cd8-41fd-a78b-179a5d948a97 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Successfully detached device vdb from instance 11c3384a-e699-4b10-9f8b-861291e96465 from the persistent domain config.
Apr 14 00:08:25 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-3bf613d5-8cd8-41fd-a78b-179a5d948a97 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 11c3384a-e699-4b10-9f8b-861291e96465 from the live domain config. {{(pid=82479) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 00:08:25 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-3bf613d5-8cd8-41fd-a78b-179a5d948a97 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 00:08:25 user nova-compute[82479]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:08:25 user nova-compute[82479]:   <source dev="/dev/sdb"/>
Apr 14 00:08:25 user nova-compute[82479]:   <target dev="vdb" bus="virtio"/>
Apr 14 00:08:25 user nova-compute[82479]:   <serial>8e63ed78-ec07-4e8f-8ec4-e81494a415a3</serial>
Apr 14 00:08:25 user nova-compute[82479]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 00:08:25 user nova-compute[82479]: </disk>
Apr 14 00:08:25 user nova-compute[82479]:  {{(pid=82479) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 00:08:25 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:25 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Received event <DeviceRemovedEvent: 1681430905.8323398, 11c3384a-e699-4b10-9f8b-861291e96465 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82479) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 00:08:25 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-3bf613d5-8cd8-41fd-a78b-179a5d948a97 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 11c3384a-e699-4b10-9f8b-861291e96465 {{(pid=82479) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 00:08:25 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-3bf613d5-8cd8-41fd-a78b-179a5d948a97 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Successfully detached device vdb from instance 11c3384a-e699-4b10-9f8b-861291e96465 from the live domain config.
Apr 14 00:08:25 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bf613d5-8cd8-41fd-a78b-179a5d948a97 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] calling os-brick to detach iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 00:08:25 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf613d5-8cd8-41fd-a78b-179a5d948a97 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, {'target_iqn': 'iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GtexvRgE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:08:25 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-3bf613d5-8cd8-41fd-a78b-179a5d948a97 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:08:25 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-3bf613d5-8cd8-41fd-a78b-179a5d948a97 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:08:25 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-3bf613d5-8cd8-41fd-a78b-179a5d948a97 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:08:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:25 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c607c5f-33fe-4f6c-9f4b-c8e19c12c4a7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:25 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf613d5-8cd8-41fd-a78b-179a5d948a97 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 00:08:25 user nova-compute[82479]: No targets found.
Apr 14 00:08:25 user nova-compute[82479]: iSNS:
Apr 14 00:08:25 user nova-compute[82479]: No targets found.
Apr 14 00:08:25 user nova-compute[82479]: STATIC:
Apr 14 00:08:25 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7
Apr 14 00:08:25 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:08:25 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:08:25 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3
Apr 14 00:08:25 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:08:25 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:08:25 user nova-compute[82479]: FIRMWARE:
Apr 14 00:08:25 user nova-compute[82479]: No targets found.
Apr 14 00:08:25 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:08:25 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf613d5-8cd8-41fd-a78b-179a5d948a97 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 00:08:25 user nova-compute[82479]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 00:08:25 user nova-compute[82479]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82479) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 00:08:25 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf613d5-8cd8-41fd-a78b-179a5d948a97 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3', 0)] {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 00:08:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:25 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[779cec3d-382f-48f4-8f0f-e993a5c1aab7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:25 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fef36c0-f622-42a5-a72b-e9db722f0aae]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:25 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf613d5-8cd8-41fd-a78b-179a5d948a97 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3 (non-flash)
Apr 14 00:08:25 user nova-compute[82479]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:08:25 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:08:25 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf613d5-8cd8-41fd-a78b-179a5d948a97 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3 (non-flash)
Apr 14 00:08:25 user nova-compute[82479]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:08:25 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:08:25 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf613d5-8cd8-41fd-a78b-179a5d948a97 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3344cda4d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3'): ({'sdb'}, set())}) {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 00:08:25 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-3bf613d5-8cd8-41fd-a78b-179a5d948a97 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Removing single pathed devices sdb {{(pid=82479) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 00:08:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:25 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[dded465a-7e1d-4b2a-ac3f-e89f2af9fcc7]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:25 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8dac415-560c-4e9b-9e1f-3e0fda326321]: (4, ('ok\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:25 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-3bf613d5-8cd8-41fd-a78b-179a5d948a97 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Flushing IO for device /dev/sdb {{(pid=82479) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 00:08:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:25 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e0f3d8-0264-4cee-ab3c-96396668cbf8]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:25 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-3bf613d5-8cd8-41fd-a78b-179a5d948a97 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82479) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 00:08:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:26 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:26 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d48efe-e16a-44bd-89a3-74cb99486744]: (4, ('1', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:26 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-3bf613d5-8cd8-41fd-a78b-179a5d948a97 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 00:08:26 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-3bf613d5-8cd8-41fd-a78b-179a5d948a97 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] SCSI volumes sdb have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 00:08:26 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf613d5-8cd8-41fd-a78b-179a5d948a97 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3')] {{(pid=82479) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 00:08:26 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:26 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:26 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a1df26-bdd2-4206-a2c4-d9afb1f80c35]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:26 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf613d5-8cd8-41fd-a78b-179a5d948a97 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:08:26 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3 -p 172.16.0.220:3260 --logout {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:26 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:26 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12295a2-231d-4a88-bf9c-41502485d89c]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:26 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf613d5-8cd8-41fd-a78b-179a5d948a97 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3, portal: 172.16.0.220,3260]
Apr 14 00:08:26 user nova-compute[82479]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3, portal: 172.16.0.220,3260] successful.
Apr 14 00:08:26 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:08:26 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3 -p 172.16.0.220:3260 --op delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:26 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:26 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa1ac35-662d-4dae-a42a-75e0a1ca7929]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:26 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf613d5-8cd8-41fd-a78b-179a5d948a97 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:08:26 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-3bf613d5-8cd8-41fd-a78b-179a5d948a97 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:08:26 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-3bf613d5-8cd8-41fd-a78b-179a5d948a97 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] <== disconnect_volume: return (299ms) None {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:08:26 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3bf613d5-8cd8-41fd-a78b-179a5d948a97 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Disconnected iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 00:08:26 user nova-compute[82479]: DEBUG nova.objects.instance [None req-3bf613d5-8cd8-41fd-a78b-179a5d948a97 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lazy-loading 'flavor' on Instance uuid 11c3384a-e699-4b10-9f8b-861291e96465 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:08:27 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-3bf613d5-8cd8-41fd-a78b-179a5d948a97 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "11c3384a-e699-4b10-9f8b-861291e96465" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.777s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:08:27 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Acquiring lock "db291c2f-a72c-46ce-8de8-3956de37ccf8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:08:27 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Lock "db291c2f-a72c-46ce-8de8-3956de37ccf8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:08:27 user nova-compute[82479]: DEBUG nova.compute.manager [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] Starting instance... {{(pid=82479) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 00:08:27 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:08:27 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:08:27 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82479) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 00:08:27 user nova-compute[82479]: INFO nova.compute.claims [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] Claim successful on node user
Apr 14 00:08:27 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:27 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:08:27 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:08:27 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.393s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:08:27 user nova-compute[82479]: DEBUG nova.compute.manager [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] Start building networks asynchronously for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 00:08:27 user nova-compute[82479]: DEBUG nova.compute.manager [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] Allocating IP information in the background. {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 00:08:27 user nova-compute[82479]: DEBUG nova.network.neutron [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] allocate_for_instance() {{(pid=82479) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 00:08:27 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 00:08:27 user nova-compute[82479]: DEBUG nova.compute.manager [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] Start building block device mappings for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 00:08:27 user nova-compute[82479]: DEBUG nova.policy [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f6564746aecb479c8e408df9600222cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d713f06b1714ade81068ed4f9edd035', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82479) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 00:08:28 user nova-compute[82479]: DEBUG nova.compute.manager [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] Start spawning the instance on the hypervisor. {{(pid=82479) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 00:08:28 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] Creating instance directory {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 00:08:28 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] Creating image(s)
Apr 14 00:08:28 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Acquiring lock "/opt/stack/data/nova/instances/db291c2f-a72c-46ce-8de8-3956de37ccf8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:08:28 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Lock "/opt/stack/data/nova/instances/db291c2f-a72c-46ce-8de8-3956de37ccf8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:08:28 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Lock "/opt/stack/data/nova/instances/db291c2f-a72c-46ce-8de8-3956de37ccf8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:08:28 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:28 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.141s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:28 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Acquiring lock "3e200e101633f2016e569ae4c0a352380507d1e4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:08:28 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Lock "3e200e101633f2016e569ae4c0a352380507d1e4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:08:28 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:28 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.139s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:28 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/db291c2f-a72c-46ce-8de8-3956de37ccf8/disk 1073741824 {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:28 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/db291c2f-a72c-46ce-8de8-3956de37ccf8/disk 1073741824" returned: 0 in 0.050s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:28 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Lock "3e200e101633f2016e569ae4c0a352380507d1e4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:08:28 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:28 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.156s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:28 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Checking if we can resize image /opt/stack/data/nova/instances/db291c2f-a72c-46ce-8de8-3956de37ccf8/disk. size=1073741824 {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 00:08:28 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db291c2f-a72c-46ce-8de8-3956de37ccf8/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:28 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db291c2f-a72c-46ce-8de8-3956de37ccf8/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:28 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Cannot resize image /opt/stack/data/nova/instances/db291c2f-a72c-46ce-8de8-3956de37ccf8/disk to a smaller size. {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 00:08:28 user nova-compute[82479]: DEBUG nova.objects.instance [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Lazy-loading 'migration_context' on Instance uuid db291c2f-a72c-46ce-8de8-3956de37ccf8 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:08:28 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] Created local disks {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 00:08:28 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] Ensure instance console log exists: /opt/stack/data/nova/instances/db291c2f-a72c-46ce-8de8-3956de37ccf8/console.log {{(pid=82479) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 00:08:28 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:08:28 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:08:28 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:08:28 user nova-compute[82479]: DEBUG nova.network.neutron [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] Successfully created port: 8916fec3-211a-470f-b70f-8a73690d3466 {{(pid=82479) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 00:08:29 user nova-compute[82479]: DEBUG nova.network.neutron [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] Successfully updated port: 8916fec3-211a-470f-b70f-8a73690d3466 {{(pid=82479) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 00:08:29 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Acquiring lock "refresh_cache-db291c2f-a72c-46ce-8de8-3956de37ccf8" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:08:29 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Acquired lock "refresh_cache-db291c2f-a72c-46ce-8de8-3956de37ccf8" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:08:29 user nova-compute[82479]: DEBUG nova.network.neutron [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 00:08:29 user nova-compute[82479]: DEBUG nova.compute.manager [req-405c069a-f3f2-43b1-b961-46c282814560 req-4979be55-500e-448c-9f72-44f4834acef4 service nova] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] Received event network-changed-8916fec3-211a-470f-b70f-8a73690d3466 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:08:29 user nova-compute[82479]: DEBUG nova.compute.manager [req-405c069a-f3f2-43b1-b961-46c282814560 req-4979be55-500e-448c-9f72-44f4834acef4 service nova] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] Refreshing instance network info cache due to event network-changed-8916fec3-211a-470f-b70f-8a73690d3466. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:08:29 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-405c069a-f3f2-43b1-b961-46c282814560 req-4979be55-500e-448c-9f72-44f4834acef4 service nova] Acquiring lock "refresh_cache-db291c2f-a72c-46ce-8de8-3956de37ccf8" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:08:29 user nova-compute[82479]: DEBUG nova.network.neutron [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] Instance cache missing network info. {{(pid=82479) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 00:08:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:29 user nova-compute[82479]: DEBUG nova.network.neutron [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] Updating instance_info_cache with network_info: [{"id": "8916fec3-211a-470f-b70f-8a73690d3466", "address": "fa:16:3e:ca:fc:59", "network": {"id": "582cbaa2-4fc5-49e5-95d1-fe2749e7c842", "bridge": "br-int", "label": "tempest-VolumesActionsTest-248701522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "8d713f06b1714ade81068ed4f9edd035", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8916fec3-21", "ovs_interfaceid": "8916fec3-211a-470f-b70f-8a73690d3466", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:08:29 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Releasing lock "refresh_cache-db291c2f-a72c-46ce-8de8-3956de37ccf8" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:08:29 user nova-compute[82479]: DEBUG nova.compute.manager [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] Instance network_info: |[{"id": "8916fec3-211a-470f-b70f-8a73690d3466", "address": "fa:16:3e:ca:fc:59", "network": {"id": "582cbaa2-4fc5-49e5-95d1-fe2749e7c842", "bridge": "br-int", "label": "tempest-VolumesActionsTest-248701522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "8d713f06b1714ade81068ed4f9edd035", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8916fec3-21", "ovs_interfaceid": "8916fec3-211a-470f-b70f-8a73690d3466", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 00:08:29 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-405c069a-f3f2-43b1-b961-46c282814560 req-4979be55-500e-448c-9f72-44f4834acef4 service nova] Acquired lock "refresh_cache-db291c2f-a72c-46ce-8de8-3956de37ccf8" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:08:29 user nova-compute[82479]: DEBUG nova.network.neutron [req-405c069a-f3f2-43b1-b961-46c282814560 req-4979be55-500e-448c-9f72-44f4834acef4 service nova] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] Refreshing network info cache for port 8916fec3-211a-470f-b70f-8a73690d3466 {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:08:29 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] Start _get_guest_xml network_info=[{"id": "8916fec3-211a-470f-b70f-8a73690d3466", "address": "fa:16:3e:ca:fc:59", "network": {"id": "582cbaa2-4fc5-49e5-95d1-fe2749e7c842", "bridge": "br-int", "label": "tempest-VolumesActionsTest-248701522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "8d713f06b1714ade81068ed4f9edd035", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8916fec3-21", "ovs_interfaceid": "8916fec3-211a-470f-b70f-8a73690d3466", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 00:08:29 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:08:29 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:08:29 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82479) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 00:08:29 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T00:02:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 00:08:29 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Flavor limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 00:08:29 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Image limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 00:08:29 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Flavor pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 00:08:29 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Image pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 00:08:29 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 00:08:29 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 00:08:29 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 00:08:29 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Got 1 possible topologies {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 00:08:29 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 00:08:29 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 00:08:29 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:08:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1531683904',display_name='tempest-VolumesActionsTest-instance-1531683904',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1531683904',id=12,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d713f06b1714ade81068ed4f9edd035',ramdisk_id='',reservation_id='r-5wspmd2c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-599923376',owner_user_name='tempest-VolumesActionsTest-599923376-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:08:28Z,user_data=None,user_id='f6564746aecb479c8e408df9600222cb',uuid=db291c2f-a72c-46ce-8de8-3956de37ccf8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8916fec3-211a-470f-b70f-8a73690d3466", "address": "fa:16:3e:ca:fc:59", "network": {"id": "582cbaa2-4fc5-49e5-95d1-fe2749e7c842", "bridge": "br-int", "label": "tempest-VolumesActionsTest-248701522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "8d713f06b1714ade81068ed4f9edd035", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8916fec3-21", "ovs_interfaceid": "8916fec3-211a-470f-b70f-8a73690d3466", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82479) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 00:08:29 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Converting VIF {"id": "8916fec3-211a-470f-b70f-8a73690d3466", "address": "fa:16:3e:ca:fc:59", "network": {"id": "582cbaa2-4fc5-49e5-95d1-fe2749e7c842", "bridge": "br-int", "label": "tempest-VolumesActionsTest-248701522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "8d713f06b1714ade81068ed4f9edd035", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8916fec3-21", "ovs_interfaceid": "8916fec3-211a-470f-b70f-8a73690d3466", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:08:29 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:fc:59,bridge_name='br-int',has_traffic_filtering=True,id=8916fec3-211a-470f-b70f-8a73690d3466,network=Network(582cbaa2-4fc5-49e5-95d1-fe2749e7c842),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8916fec3-21') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:08:29 user nova-compute[82479]: DEBUG nova.objects.instance [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Lazy-loading 'pci_devices' on Instance uuid db291c2f-a72c-46ce-8de8-3956de37ccf8 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:08:29 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] End _get_guest_xml xml=<domain type="kvm">
Apr 14 00:08:29 user nova-compute[82479]:   <uuid>db291c2f-a72c-46ce-8de8-3956de37ccf8</uuid>
Apr 14 00:08:29 user nova-compute[82479]:   <name>instance-0000000c</name>
Apr 14 00:08:29 user nova-compute[82479]:   <memory>131072</memory>
Apr 14 00:08:29 user nova-compute[82479]:   <vcpu>1</vcpu>
Apr 14 00:08:29 user nova-compute[82479]:   <metadata>
Apr 14 00:08:29 user nova-compute[82479]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 00:08:29 user nova-compute[82479]:       <nova:package version="0.0.0"/>
Apr 14 00:08:29 user nova-compute[82479]:       <nova:name>tempest-VolumesActionsTest-instance-1531683904</nova:name>
Apr 14 00:08:29 user nova-compute[82479]:       <nova:creationTime>2023-04-14 00:08:29</nova:creationTime>
Apr 14 00:08:29 user nova-compute[82479]:       <nova:flavor name="m1.nano">
Apr 14 00:08:29 user nova-compute[82479]:         <nova:memory>128</nova:memory>
Apr 14 00:08:29 user nova-compute[82479]:         <nova:disk>1</nova:disk>
Apr 14 00:08:29 user nova-compute[82479]:         <nova:swap>0</nova:swap>
Apr 14 00:08:29 user nova-compute[82479]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 00:08:29 user nova-compute[82479]:         <nova:vcpus>1</nova:vcpus>
Apr 14 00:08:29 user nova-compute[82479]:       </nova:flavor>
Apr 14 00:08:29 user nova-compute[82479]:       <nova:owner>
Apr 14 00:08:29 user nova-compute[82479]:         <nova:user uuid="f6564746aecb479c8e408df9600222cb">tempest-VolumesActionsTest-599923376-project-member</nova:user>
Apr 14 00:08:29 user nova-compute[82479]:         <nova:project uuid="8d713f06b1714ade81068ed4f9edd035">tempest-VolumesActionsTest-599923376</nova:project>
Apr 14 00:08:29 user nova-compute[82479]:       </nova:owner>
Apr 14 00:08:29 user nova-compute[82479]:       <nova:root type="image" uuid="6db62068-7278-4cd8-b41f-d0140d89e199"/>
Apr 14 00:08:29 user nova-compute[82479]:       <nova:ports>
Apr 14 00:08:29 user nova-compute[82479]:         <nova:port uuid="8916fec3-211a-470f-b70f-8a73690d3466">
Apr 14 00:08:29 user nova-compute[82479]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 14 00:08:29 user nova-compute[82479]:         </nova:port>
Apr 14 00:08:29 user nova-compute[82479]:       </nova:ports>
Apr 14 00:08:29 user nova-compute[82479]:     </nova:instance>
Apr 14 00:08:29 user nova-compute[82479]:   </metadata>
Apr 14 00:08:29 user nova-compute[82479]:   <sysinfo type="smbios">
Apr 14 00:08:29 user nova-compute[82479]:     <system>
Apr 14 00:08:29 user nova-compute[82479]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 00:08:29 user nova-compute[82479]:       <entry name="product">OpenStack Nova</entry>
Apr 14 00:08:29 user nova-compute[82479]:       <entry name="version">0.0.0</entry>
Apr 14 00:08:29 user nova-compute[82479]:       <entry name="serial">db291c2f-a72c-46ce-8de8-3956de37ccf8</entry>
Apr 14 00:08:29 user nova-compute[82479]:       <entry name="uuid">db291c2f-a72c-46ce-8de8-3956de37ccf8</entry>
Apr 14 00:08:29 user nova-compute[82479]:       <entry name="family">Virtual Machine</entry>
Apr 14 00:08:29 user nova-compute[82479]:     </system>
Apr 14 00:08:29 user nova-compute[82479]:   </sysinfo>
Apr 14 00:08:29 user nova-compute[82479]:   <os>
Apr 14 00:08:29 user nova-compute[82479]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 00:08:29 user nova-compute[82479]:     <boot dev="hd"/>
Apr 14 00:08:29 user nova-compute[82479]:     <smbios mode="sysinfo"/>
Apr 14 00:08:29 user nova-compute[82479]:   </os>
Apr 14 00:08:29 user nova-compute[82479]:   <features>
Apr 14 00:08:29 user nova-compute[82479]:     <acpi/>
Apr 14 00:08:29 user nova-compute[82479]:     <apic/>
Apr 14 00:08:29 user nova-compute[82479]:     <vmcoreinfo/>
Apr 14 00:08:29 user nova-compute[82479]:   </features>
Apr 14 00:08:29 user nova-compute[82479]:   <clock offset="utc">
Apr 14 00:08:29 user nova-compute[82479]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 00:08:29 user nova-compute[82479]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 00:08:29 user nova-compute[82479]:     <timer name="hpet" present="no"/>
Apr 14 00:08:29 user nova-compute[82479]:   </clock>
Apr 14 00:08:29 user nova-compute[82479]:   <cpu mode="custom" match="exact">
Apr 14 00:08:29 user nova-compute[82479]:     <model>Nehalem</model>
Apr 14 00:08:29 user nova-compute[82479]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 00:08:29 user nova-compute[82479]:   </cpu>
Apr 14 00:08:29 user nova-compute[82479]:   <devices>
Apr 14 00:08:29 user nova-compute[82479]:     <disk type="file" device="disk">
Apr 14 00:08:29 user nova-compute[82479]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 00:08:29 user nova-compute[82479]:       <source file="/opt/stack/data/nova/instances/db291c2f-a72c-46ce-8de8-3956de37ccf8/disk"/>
Apr 14 00:08:29 user nova-compute[82479]:       <target dev="vda" bus="virtio"/>
Apr 14 00:08:29 user nova-compute[82479]:     </disk>
Apr 14 00:08:29 user nova-compute[82479]:     <interface type="ethernet">
Apr 14 00:08:29 user nova-compute[82479]:       <mac address="fa:16:3e:ca:fc:59"/>
Apr 14 00:08:29 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:08:29 user nova-compute[82479]:       <mtu size="1442"/>
Apr 14 00:08:29 user nova-compute[82479]:       <target dev="tap8916fec3-21"/>
Apr 14 00:08:29 user nova-compute[82479]:     </interface>
Apr 14 00:08:29 user nova-compute[82479]:     <serial type="pty">
Apr 14 00:08:29 user nova-compute[82479]:       <log file="/opt/stack/data/nova/instances/db291c2f-a72c-46ce-8de8-3956de37ccf8/console.log" append="off"/>
Apr 14 00:08:29 user nova-compute[82479]:     </serial>
Apr 14 00:08:29 user nova-compute[82479]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 00:08:29 user nova-compute[82479]:     <video>
Apr 14 00:08:29 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:08:29 user nova-compute[82479]:     </video>
Apr 14 00:08:29 user nova-compute[82479]:     <rng model="virtio">
Apr 14 00:08:29 user nova-compute[82479]:       <backend model="random">/dev/urandom</backend>
Apr 14 00:08:29 user nova-compute[82479]:     </rng>
Apr 14 00:08:29 user nova-compute[82479]:     <controller type="usb" index="0" model="none"/>
Apr 14 00:08:29 user nova-compute[82479]:     <memballoon model="virtio">
Apr 14 00:08:29 user nova-compute[82479]:       <stats period="10"/>
Apr 14 00:08:29 user nova-compute[82479]:     </memballoon>
Apr 14 00:08:29 user nova-compute[82479]:   </devices>
Apr 14 00:08:29 user nova-compute[82479]: </domain>
Apr 14 00:08:29 user nova-compute[82479]:  {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 00:08:29 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:08:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1531683904',display_name='tempest-VolumesActionsTest-instance-1531683904',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1531683904',id=12,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d713f06b1714ade81068ed4f9edd035',ramdisk_id='',reservation_id='r-5wspmd2c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-599923376',owner_user_name='tempest-VolumesActionsTest-599923376-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:08:28Z,user_data=None,user_id='f6564746aecb479c8e408df9600222cb',uuid=db291c2f-a72c-46ce-8de8-3956de37ccf8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8916fec3-211a-470f-b70f-8a73690d3466", "address": "fa:16:3e:ca:fc:59", "network": {"id": "582cbaa2-4fc5-49e5-95d1-fe2749e7c842", "bridge": "br-int", "label": "tempest-VolumesActionsTest-248701522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "8d713f06b1714ade81068ed4f9edd035", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8916fec3-21", "ovs_interfaceid": "8916fec3-211a-470f-b70f-8a73690d3466", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 00:08:29 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Converting VIF {"id": "8916fec3-211a-470f-b70f-8a73690d3466", "address": "fa:16:3e:ca:fc:59", "network": {"id": "582cbaa2-4fc5-49e5-95d1-fe2749e7c842", "bridge": "br-int", "label": "tempest-VolumesActionsTest-248701522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "8d713f06b1714ade81068ed4f9edd035", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8916fec3-21", "ovs_interfaceid": "8916fec3-211a-470f-b70f-8a73690d3466", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:08:29 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:fc:59,bridge_name='br-int',has_traffic_filtering=True,id=8916fec3-211a-470f-b70f-8a73690d3466,network=Network(582cbaa2-4fc5-49e5-95d1-fe2749e7c842),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8916fec3-21') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:08:29 user nova-compute[82479]: DEBUG os_vif [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:fc:59,bridge_name='br-int',has_traffic_filtering=True,id=8916fec3-211a-470f-b70f-8a73690d3466,network=Network(582cbaa2-4fc5-49e5-95d1-fe2749e7c842),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8916fec3-21') {{(pid=82479) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 00:08:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:08:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 00:08:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8916fec3-21, may_exist=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:08:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8916fec3-21, col_values=(('external_ids', {'iface-id': '8916fec3-211a-470f-b70f-8a73690d3466', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:fc:59', 'vm-uuid': 'db291c2f-a72c-46ce-8de8-3956de37ccf8'}),)) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:08:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:08:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:29 user nova-compute[82479]: INFO os_vif [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:fc:59,bridge_name='br-int',has_traffic_filtering=True,id=8916fec3-211a-470f-b70f-8a73690d3466,network=Network(582cbaa2-4fc5-49e5-95d1-fe2749e7c842),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8916fec3-21')
Apr 14 00:08:30 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:08:30 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] No VIF found with MAC fa:16:3e:ca:fc:59, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:08:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8ea7816c-72b7-46ed-8406-a4223459b5c7 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Acquiring lock "b9c6323b-ed7f-4f86-93ad-3ef4726b01ff" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:08:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8ea7816c-72b7-46ed-8406-a4223459b5c7 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "b9c6323b-ed7f-4f86-93ad-3ef4726b01ff" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:08:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8ea7816c-72b7-46ed-8406-a4223459b5c7 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Acquiring lock "b9c6323b-ed7f-4f86-93ad-3ef4726b01ff-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:08:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8ea7816c-72b7-46ed-8406-a4223459b5c7 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "b9c6323b-ed7f-4f86-93ad-3ef4726b01ff-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:08:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8ea7816c-72b7-46ed-8406-a4223459b5c7 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "b9c6323b-ed7f-4f86-93ad-3ef4726b01ff-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:08:30 user nova-compute[82479]: INFO nova.compute.manager [None req-8ea7816c-72b7-46ed-8406-a4223459b5c7 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Terminating instance
Apr 14 00:08:30 user nova-compute[82479]: DEBUG nova.compute.manager [None req-8ea7816c-72b7-46ed-8406-a4223459b5c7 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Start destroying the instance on the hypervisor. {{(pid=82479) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 00:08:30 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:30 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:30 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:30 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:30 user nova-compute[82479]: DEBUG nova.compute.manager [req-b2bdd2a2-a2d9-4374-af22-b9166771148f req-f585a863-7fa3-45c9-aaec-f539b6487180 service nova] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Received event network-vif-unplugged-dc4fb8de-0fc3-4af8-86d0-94c357627f5f {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:08:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-b2bdd2a2-a2d9-4374-af22-b9166771148f req-f585a863-7fa3-45c9-aaec-f539b6487180 service nova] Acquiring lock "b9c6323b-ed7f-4f86-93ad-3ef4726b01ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:08:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-b2bdd2a2-a2d9-4374-af22-b9166771148f req-f585a863-7fa3-45c9-aaec-f539b6487180 service nova] Lock "b9c6323b-ed7f-4f86-93ad-3ef4726b01ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:08:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-b2bdd2a2-a2d9-4374-af22-b9166771148f req-f585a863-7fa3-45c9-aaec-f539b6487180 service nova] Lock "b9c6323b-ed7f-4f86-93ad-3ef4726b01ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:08:30 user nova-compute[82479]: DEBUG nova.compute.manager [req-b2bdd2a2-a2d9-4374-af22-b9166771148f req-f585a863-7fa3-45c9-aaec-f539b6487180 service nova] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] No waiting events found dispatching network-vif-unplugged-dc4fb8de-0fc3-4af8-86d0-94c357627f5f {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:08:30 user nova-compute[82479]: DEBUG nova.compute.manager [req-b2bdd2a2-a2d9-4374-af22-b9166771148f req-f585a863-7fa3-45c9-aaec-f539b6487180 service nova] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Received event network-vif-unplugged-dc4fb8de-0fc3-4af8-86d0-94c357627f5f for instance with task_state deleting. {{(pid=82479) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 00:08:30 user nova-compute[82479]: DEBUG nova.network.neutron [req-405c069a-f3f2-43b1-b961-46c282814560 req-4979be55-500e-448c-9f72-44f4834acef4 service nova] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] Updated VIF entry in instance network info cache for port 8916fec3-211a-470f-b70f-8a73690d3466. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:08:30 user nova-compute[82479]: DEBUG nova.network.neutron [req-405c069a-f3f2-43b1-b961-46c282814560 req-4979be55-500e-448c-9f72-44f4834acef4 service nova] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] Updating instance_info_cache with network_info: [{"id": "8916fec3-211a-470f-b70f-8a73690d3466", "address": "fa:16:3e:ca:fc:59", "network": {"id": "582cbaa2-4fc5-49e5-95d1-fe2749e7c842", "bridge": "br-int", "label": "tempest-VolumesActionsTest-248701522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "8d713f06b1714ade81068ed4f9edd035", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8916fec3-21", "ovs_interfaceid": "8916fec3-211a-470f-b70f-8a73690d3466", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:08:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-405c069a-f3f2-43b1-b961-46c282814560 req-4979be55-500e-448c-9f72-44f4834acef4 service nova] Releasing lock "refresh_cache-db291c2f-a72c-46ce-8de8-3956de37ccf8" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:08:30 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:31 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Instance destroyed successfully.
Apr 14 00:08:31 user nova-compute[82479]: DEBUG nova.objects.instance [None req-8ea7816c-72b7-46ed-8406-a4223459b5c7 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lazy-loading 'resources' on Instance uuid b9c6323b-ed7f-4f86-93ad-3ef4726b01ff {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:08:31 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-8ea7816c-72b7-46ed-8406-a4223459b5c7 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T00:05:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1428775386',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1428775386',id=9,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIH5r6nQb46UiVWKMJfMdOVDRbtW2F73ea2D8mxSn1YDz9+bRgJ2nBeDW0+0XBiptqCPYYX6nTAHEycBqQz0FHVyYdWdNoLj8ctiSWD+URcLL8GbP5fneDu/2p/eIfeTqw==',key_name='tempest-keypair-2007231770',keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:05:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c4ee7b5626a14c69aefa86192b6e7bac',ramdisk_id='',reservation_id='r-7dnrqpgh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-694590407',owner_user_name='tempest-TaggedAttachmentsTest-694590407-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T00:05:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38f9a13bd3f74842b61b57b2ea8bf025',uuid=b9c6323b-ed7f-4f86-93ad-3ef4726b01ff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dc4fb8de-0fc3-4af8-86d0-94c357627f5f", "address": "fa:16:3e:9b:6b:79", "network": {"id": "281dc33c-0ea9-4812-97ed-82652b538fd0", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-521698420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4ee7b5626a14c69aefa86192b6e7bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4fb8de-0f", "ovs_interfaceid": "dc4fb8de-0fc3-4af8-86d0-94c357627f5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 00:08:31 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-8ea7816c-72b7-46ed-8406-a4223459b5c7 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Converting VIF {"id": "dc4fb8de-0fc3-4af8-86d0-94c357627f5f", "address": "fa:16:3e:9b:6b:79", "network": {"id": "281dc33c-0ea9-4812-97ed-82652b538fd0", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-521698420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4ee7b5626a14c69aefa86192b6e7bac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc4fb8de-0f", "ovs_interfaceid": "dc4fb8de-0fc3-4af8-86d0-94c357627f5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:08:31 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-8ea7816c-72b7-46ed-8406-a4223459b5c7 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9b:6b:79,bridge_name='br-int',has_traffic_filtering=True,id=dc4fb8de-0fc3-4af8-86d0-94c357627f5f,network=Network(281dc33c-0ea9-4812-97ed-82652b538fd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc4fb8de-0f') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:08:31 user nova-compute[82479]: DEBUG os_vif [None req-8ea7816c-72b7-46ed-8406-a4223459b5c7 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:6b:79,bridge_name='br-int',has_traffic_filtering=True,id=dc4fb8de-0fc3-4af8-86d0-94c357627f5f,network=Network(281dc33c-0ea9-4812-97ed-82652b538fd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc4fb8de-0f') {{(pid=82479) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 00:08:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdc4fb8de-0f, bridge=br-int, if_exists=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:08:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:08:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:31 user nova-compute[82479]: INFO os_vif [None req-8ea7816c-72b7-46ed-8406-a4223459b5c7 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:6b:79,bridge_name='br-int',has_traffic_filtering=True,id=dc4fb8de-0fc3-4af8-86d0-94c357627f5f,network=Network(281dc33c-0ea9-4812-97ed-82652b538fd0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc4fb8de-0f')
Apr 14 00:08:31 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-8ea7816c-72b7-46ed-8406-a4223459b5c7 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Deleting instance files /opt/stack/data/nova/instances/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff_del
Apr 14 00:08:31 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-8ea7816c-72b7-46ed-8406-a4223459b5c7 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Deletion of /opt/stack/data/nova/instances/b9c6323b-ed7f-4f86-93ad-3ef4726b01ff_del complete
Apr 14 00:08:31 user nova-compute[82479]: INFO nova.compute.manager [None req-8ea7816c-72b7-46ed-8406-a4223459b5c7 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Took 1.29 seconds to destroy the instance on the hypervisor.
Apr 14 00:08:31 user nova-compute[82479]: DEBUG oslo.service.loopingcall [None req-8ea7816c-72b7-46ed-8406-a4223459b5c7 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82479) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 00:08:31 user nova-compute[82479]: DEBUG nova.compute.manager [-] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Deallocating network for instance {{(pid=82479) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 00:08:31 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] deallocate_for_instance() {{(pid=82479) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 00:08:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:32 user nova-compute[82479]: DEBUG nova.compute.manager [req-1925115b-6163-46ac-ac89-16f1e92d9aef req-eade0f4d-97f1-4370-b261-634a134b4f6d service nova] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Received event network-vif-plugged-dc4fb8de-0fc3-4af8-86d0-94c357627f5f {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:08:32 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-1925115b-6163-46ac-ac89-16f1e92d9aef req-eade0f4d-97f1-4370-b261-634a134b4f6d service nova] Acquiring lock "b9c6323b-ed7f-4f86-93ad-3ef4726b01ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:08:32 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-1925115b-6163-46ac-ac89-16f1e92d9aef req-eade0f4d-97f1-4370-b261-634a134b4f6d service nova] Lock "b9c6323b-ed7f-4f86-93ad-3ef4726b01ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:08:32 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-1925115b-6163-46ac-ac89-16f1e92d9aef req-eade0f4d-97f1-4370-b261-634a134b4f6d service nova] Lock "b9c6323b-ed7f-4f86-93ad-3ef4726b01ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:08:32 user nova-compute[82479]: DEBUG nova.compute.manager [req-1925115b-6163-46ac-ac89-16f1e92d9aef req-eade0f4d-97f1-4370-b261-634a134b4f6d service nova] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] No waiting events found dispatching network-vif-plugged-dc4fb8de-0fc3-4af8-86d0-94c357627f5f {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:08:32 user nova-compute[82479]: WARNING nova.compute.manager [req-1925115b-6163-46ac-ac89-16f1e92d9aef req-eade0f4d-97f1-4370-b261-634a134b4f6d service nova] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Received unexpected event network-vif-plugged-dc4fb8de-0fc3-4af8-86d0-94c357627f5f for instance with vm_state active and task_state deleting.
Apr 14 00:08:33 user nova-compute[82479]: DEBUG nova.compute.manager [req-cd2bf6fe-404f-4432-b848-0c4a178666c7 req-e63c3370-632f-4e5e-97b1-95e3dc778919 service nova] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] Received event network-vif-plugged-8916fec3-211a-470f-b70f-8a73690d3466 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:08:33 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-cd2bf6fe-404f-4432-b848-0c4a178666c7 req-e63c3370-632f-4e5e-97b1-95e3dc778919 service nova] Acquiring lock "db291c2f-a72c-46ce-8de8-3956de37ccf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:08:33 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-cd2bf6fe-404f-4432-b848-0c4a178666c7 req-e63c3370-632f-4e5e-97b1-95e3dc778919 service nova] Lock "db291c2f-a72c-46ce-8de8-3956de37ccf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:08:33 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-cd2bf6fe-404f-4432-b848-0c4a178666c7 req-e63c3370-632f-4e5e-97b1-95e3dc778919 service nova] Lock "db291c2f-a72c-46ce-8de8-3956de37ccf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:08:33 user nova-compute[82479]: DEBUG nova.compute.manager [req-cd2bf6fe-404f-4432-b848-0c4a178666c7 req-e63c3370-632f-4e5e-97b1-95e3dc778919 service nova] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] No waiting events found dispatching network-vif-plugged-8916fec3-211a-470f-b70f-8a73690d3466 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:08:33 user nova-compute[82479]: WARNING nova.compute.manager [req-cd2bf6fe-404f-4432-b848-0c4a178666c7 req-e63c3370-632f-4e5e-97b1-95e3dc778919 service nova] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] Received unexpected event network-vif-plugged-8916fec3-211a-470f-b70f-8a73690d3466 for instance with vm_state building and task_state spawning.
Apr 14 00:08:33 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Updating instance_info_cache with network_info: [] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:08:33 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Took 2.09 seconds to deallocate network for instance.
Apr 14 00:08:33 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8ea7816c-72b7-46ed-8406-a4223459b5c7 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:08:33 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8ea7816c-72b7-46ed-8406-a4223459b5c7 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:08:33 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-8ea7816c-72b7-46ed-8406-a4223459b5c7 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:08:33 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-8ea7816c-72b7-46ed-8406-a4223459b5c7 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:08:33 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8ea7816c-72b7-46ed-8406-a4223459b5c7 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.409s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:08:34 user nova-compute[82479]: INFO nova.scheduler.client.report [None req-8ea7816c-72b7-46ed-8406-a4223459b5c7 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Deleted allocations for instance b9c6323b-ed7f-4f86-93ad-3ef4726b01ff
Apr 14 00:08:34 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8ea7816c-72b7-46ed-8406-a4223459b5c7 tempest-TaggedAttachmentsTest-694590407 tempest-TaggedAttachmentsTest-694590407-project-member] Lock "b9c6323b-ed7f-4f86-93ad-3ef4726b01ff" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.009s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:08:34 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681430914.1789045, db291c2f-a72c-46ce-8de8-3956de37ccf8 => Resumed> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:08:34 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] VM Resumed (Lifecycle Event)
Apr 14 00:08:34 user nova-compute[82479]: DEBUG nova.compute.manager [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] Instance event wait completed in 0 seconds for  {{(pid=82479) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 00:08:34 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] Guest created on hypervisor {{(pid=82479) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 00:08:34 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] Instance spawned successfully.
Apr 14 00:08:34 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 00:08:34 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:08:34 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:08:34 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] Found default for hw_cdrom_bus of ide {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:08:34 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] Found default for hw_disk_bus of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:08:34 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] Found default for hw_input_bus of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:08:34 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] Found default for hw_pointer_model of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:08:34 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] Found default for hw_video_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:08:34 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] Found default for hw_vif_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:08:34 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:08:34 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681430914.183274, db291c2f-a72c-46ce-8de8-3956de37ccf8 => Started> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:08:34 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] VM Started (Lifecycle Event)
Apr 14 00:08:34 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:08:34 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:08:34 user nova-compute[82479]: INFO nova.compute.manager [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] Took 6.30 seconds to spawn the instance on the hypervisor.
Apr 14 00:08:34 user nova-compute[82479]: DEBUG nova.compute.manager [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:08:34 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:08:34 user nova-compute[82479]: INFO nova.compute.manager [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] Took 7.04 seconds to build instance.
Apr 14 00:08:34 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-60e4a038-4bc0-435b-8e32-17734ef9e1f9 tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Lock "db291c2f-a72c-46ce-8de8-3956de37ccf8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.142s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:08:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:35 user nova-compute[82479]: DEBUG nova.compute.manager [req-aaa0f4f0-61cd-4f17-a103-1307e7e947c0 req-182f57f4-8be4-44e6-b68c-93dffc9b32a8 service nova] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Received event network-vif-deleted-dc4fb8de-0fc3-4af8-86d0-94c357627f5f {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:08:35 user nova-compute[82479]: DEBUG nova.compute.manager [req-aaa0f4f0-61cd-4f17-a103-1307e7e947c0 req-182f57f4-8be4-44e6-b68c-93dffc9b32a8 service nova] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] Received event network-vif-plugged-8916fec3-211a-470f-b70f-8a73690d3466 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:08:35 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-aaa0f4f0-61cd-4f17-a103-1307e7e947c0 req-182f57f4-8be4-44e6-b68c-93dffc9b32a8 service nova] Acquiring lock "db291c2f-a72c-46ce-8de8-3956de37ccf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:08:35 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-aaa0f4f0-61cd-4f17-a103-1307e7e947c0 req-182f57f4-8be4-44e6-b68c-93dffc9b32a8 service nova] Lock "db291c2f-a72c-46ce-8de8-3956de37ccf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:08:35 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-aaa0f4f0-61cd-4f17-a103-1307e7e947c0 req-182f57f4-8be4-44e6-b68c-93dffc9b32a8 service nova] Lock "db291c2f-a72c-46ce-8de8-3956de37ccf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:08:35 user nova-compute[82479]: DEBUG nova.compute.manager [req-aaa0f4f0-61cd-4f17-a103-1307e7e947c0 req-182f57f4-8be4-44e6-b68c-93dffc9b32a8 service nova] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] No waiting events found dispatching network-vif-plugged-8916fec3-211a-470f-b70f-8a73690d3466 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:08:35 user nova-compute[82479]: WARNING nova.compute.manager [req-aaa0f4f0-61cd-4f17-a103-1307e7e947c0 req-182f57f4-8be4-44e6-b68c-93dffc9b32a8 service nova] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] Received unexpected event network-vif-plugged-8916fec3-211a-470f-b70f-8a73690d3466 for instance with vm_state active and task_state None.
Apr 14 00:08:35 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:36 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:39 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:08:40 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:08:40 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Starting heal instance info cache {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 00:08:40 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:40 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Skipping network cache update for instance because it has been migrated to another host. {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9836}}
Apr 14 00:08:40 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "refresh_cache-01a65362-36ea-4817-8e83-f75d6daf808b" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:08:40 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquired lock "refresh_cache-01a65362-36ea-4817-8e83-f75d6daf808b" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:08:40 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Forcefully refreshing network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 00:08:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-9ce3e942-dcb2-4e7f-83e2-59f734411886 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Acquiring lock "716b5e3f-20c7-40ef-9a45-71be0cfeaeb2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:08:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-9ce3e942-dcb2-4e7f-83e2-59f734411886 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "716b5e3f-20c7-40ef-9a45-71be0cfeaeb2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:08:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-9ce3e942-dcb2-4e7f-83e2-59f734411886 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Acquiring lock "716b5e3f-20c7-40ef-9a45-71be0cfeaeb2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:08:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-9ce3e942-dcb2-4e7f-83e2-59f734411886 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "716b5e3f-20c7-40ef-9a45-71be0cfeaeb2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:08:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-9ce3e942-dcb2-4e7f-83e2-59f734411886 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "716b5e3f-20c7-40ef-9a45-71be0cfeaeb2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:08:41 user nova-compute[82479]: INFO nova.compute.manager [None req-9ce3e942-dcb2-4e7f-83e2-59f734411886 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Terminating instance
Apr 14 00:08:41 user nova-compute[82479]: DEBUG nova.compute.manager [None req-9ce3e942-dcb2-4e7f-83e2-59f734411886 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Start destroying the instance on the hypervisor. {{(pid=82479) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 00:08:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:41 user nova-compute[82479]: DEBUG nova.compute.manager [req-07a45709-866c-4078-bd0a-ce8b4a6c8949 req-7606cf74-1d7f-4757-9b28-28395ae5c0f0 service nova] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Received event network-vif-unplugged-e8376395-8a3e-46bf-a137-3e740e4e70ef {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:08:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-07a45709-866c-4078-bd0a-ce8b4a6c8949 req-7606cf74-1d7f-4757-9b28-28395ae5c0f0 service nova] Acquiring lock "716b5e3f-20c7-40ef-9a45-71be0cfeaeb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:08:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-07a45709-866c-4078-bd0a-ce8b4a6c8949 req-7606cf74-1d7f-4757-9b28-28395ae5c0f0 service nova] Lock "716b5e3f-20c7-40ef-9a45-71be0cfeaeb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.018s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:08:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-07a45709-866c-4078-bd0a-ce8b4a6c8949 req-7606cf74-1d7f-4757-9b28-28395ae5c0f0 service nova] Lock "716b5e3f-20c7-40ef-9a45-71be0cfeaeb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:08:41 user nova-compute[82479]: DEBUG nova.compute.manager [req-07a45709-866c-4078-bd0a-ce8b4a6c8949 req-7606cf74-1d7f-4757-9b28-28395ae5c0f0 service nova] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] No waiting events found dispatching network-vif-unplugged-e8376395-8a3e-46bf-a137-3e740e4e70ef {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:08:41 user nova-compute[82479]: DEBUG nova.compute.manager [req-07a45709-866c-4078-bd0a-ce8b4a6c8949 req-7606cf74-1d7f-4757-9b28-28395ae5c0f0 service nova] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Received event network-vif-unplugged-e8376395-8a3e-46bf-a137-3e740e4e70ef for instance with task_state deleting. {{(pid=82479) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 00:08:41 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Updating instance_info_cache with network_info: [{"id": "b5dfa187-0a42-4319-990f-1d3b22691c27", "address": "fa:16:3e:7b:38:3d", "network": {"id": "368d9445-850e-4f74-b5cc-86d1eaa95d63", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374332689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec1aab0338ff4bd195a37a4199a378eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5dfa187-0a", "ovs_interfaceid": "b5dfa187-0a42-4319-990f-1d3b22691c27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:08:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Releasing lock "refresh_cache-01a65362-36ea-4817-8e83-f75d6daf808b" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:08:41 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Updated the network info_cache for instance {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 00:08:41 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:08:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:41 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Instance destroyed successfully.
Apr 14 00:08:41 user nova-compute[82479]: DEBUG nova.objects.instance [None req-9ce3e942-dcb2-4e7f-83e2-59f734411886 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lazy-loading 'resources' on Instance uuid 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:08:41 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-9ce3e942-dcb2-4e7f-83e2-59f734411886 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:05:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1764639886',display_name='tempest-TestVolumeSwap-server-1764639886',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1764639886',id=8,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNlltbtWOxgngd+WOhM2SVJONWIntPB0ReceG24uuEnBxzOjgSZeKMIb99xQeMRz+3+GFOzCkntE3uvUQW5vCgDqEdtuSFgaUNPtz9CZS0JAX7xEqeTQ71l5QNHCs+vY7w==',key_name='tempest-keypair-1602525381',keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:05:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='293aba050c0e458a9d05bcbca5b49997',ramdisk_id='',reservation_id='r-xz5304l9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-882310266',owner_user_name='tempest-TestVolumeSwap-882310266-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T00:05:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6f81027ba772436092c0b317c3d5895d',uuid=716b5e3f-20c7-40ef-9a45-71be0cfeaeb2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e8376395-8a3e-46bf-a137-3e740e4e70ef", "address": "fa:16:3e:1f:f1:73", "network": {"id": "e63d7eb1-1787-415b-bfd6-963171b3a18f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2097939022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "293aba050c0e458a9d05bcbca5b49997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8376395-8a", "ovs_interfaceid": "e8376395-8a3e-46bf-a137-3e740e4e70ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 00:08:41 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-9ce3e942-dcb2-4e7f-83e2-59f734411886 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Converting VIF {"id": "e8376395-8a3e-46bf-a137-3e740e4e70ef", "address": "fa:16:3e:1f:f1:73", "network": {"id": "e63d7eb1-1787-415b-bfd6-963171b3a18f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2097939022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "293aba050c0e458a9d05bcbca5b49997", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8376395-8a", "ovs_interfaceid": "e8376395-8a3e-46bf-a137-3e740e4e70ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:08:41 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-9ce3e942-dcb2-4e7f-83e2-59f734411886 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:f1:73,bridge_name='br-int',has_traffic_filtering=True,id=e8376395-8a3e-46bf-a137-3e740e4e70ef,network=Network(e63d7eb1-1787-415b-bfd6-963171b3a18f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8376395-8a') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:08:41 user nova-compute[82479]: DEBUG os_vif [None req-9ce3e942-dcb2-4e7f-83e2-59f734411886 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:f1:73,bridge_name='br-int',has_traffic_filtering=True,id=e8376395-8a3e-46bf-a137-3e740e4e70ef,network=Network(e63d7eb1-1787-415b-bfd6-963171b3a18f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8376395-8a') {{(pid=82479) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 00:08:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape8376395-8a, bridge=br-int, if_exists=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:08:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:08:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:41 user nova-compute[82479]: INFO os_vif [None req-9ce3e942-dcb2-4e7f-83e2-59f734411886 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:f1:73,bridge_name='br-int',has_traffic_filtering=True,id=e8376395-8a3e-46bf-a137-3e740e4e70ef,network=Network(e63d7eb1-1787-415b-bfd6-963171b3a18f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8376395-8a')
Apr 14 00:08:41 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-9ce3e942-dcb2-4e7f-83e2-59f734411886 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Deleting instance files /opt/stack/data/nova/instances/716b5e3f-20c7-40ef-9a45-71be0cfeaeb2_del
Apr 14 00:08:41 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-9ce3e942-dcb2-4e7f-83e2-59f734411886 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Deletion of /opt/stack/data/nova/instances/716b5e3f-20c7-40ef-9a45-71be0cfeaeb2_del complete
Apr 14 00:08:41 user nova-compute[82479]: INFO nova.compute.manager [None req-9ce3e942-dcb2-4e7f-83e2-59f734411886 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Took 0.90 seconds to destroy the instance on the hypervisor.
Apr 14 00:08:41 user nova-compute[82479]: DEBUG oslo.service.loopingcall [None req-9ce3e942-dcb2-4e7f-83e2-59f734411886 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82479) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 00:08:41 user nova-compute[82479]: DEBUG nova.compute.manager [-] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Deallocating network for instance {{(pid=82479) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 00:08:41 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] deallocate_for_instance() {{(pid=82479) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 00:08:42 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-761516d5-28e7-4f2d-b183-22f0470c6fbf tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Acquiring lock "3a6b9f89-e462-47d8-84a1-0ac4ade3ab97" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:08:42 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-761516d5-28e7-4f2d-b183-22f0470c6fbf tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "3a6b9f89-e462-47d8-84a1-0ac4ade3ab97" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:08:42 user nova-compute[82479]: DEBUG nova.objects.instance [None req-761516d5-28e7-4f2d-b183-22f0470c6fbf tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lazy-loading 'flavor' on Instance uuid 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:08:42 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:08:42 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:08:42 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-761516d5-28e7-4f2d-b183-22f0470c6fbf tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "3a6b9f89-e462-47d8-84a1-0ac4ade3ab97" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:08:42 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-761516d5-28e7-4f2d-b183-22f0470c6fbf tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Acquiring lock "3a6b9f89-e462-47d8-84a1-0ac4ade3ab97" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:08:42 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-761516d5-28e7-4f2d-b183-22f0470c6fbf tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "3a6b9f89-e462-47d8-84a1-0ac4ade3ab97" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:08:42 user nova-compute[82479]: INFO nova.compute.manager [None req-761516d5-28e7-4f2d-b183-22f0470c6fbf tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Attaching volume 028eff5c-aa61-4243-985e-5210aedff04a to /dev/vdb
Apr 14 00:08:42 user nova-compute[82479]: DEBUG os_brick.utils [None req-761516d5-28e7-4f2d-b183-22f0470c6fbf tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:08:42 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:42 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:42 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d91ccb1-845e-488f-a872-36ed8ce187c4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fec92fcfdd3\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:42 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:42 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:42 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf8d2ca-44c7-4a41-8d36-937b60105340]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:42 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:42 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:42 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[f59e2c5c-6d36-42da-b6cc-2d9fb8a4b606]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:42 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[670b63eb-53b6-43de-9a1c-4f947b2495b1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:42 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-761516d5-28e7-4f2d-b183-22f0470c6fbf tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Running cmd (subprocess): nvme version {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:42 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-761516d5-28e7-4f2d-b183-22f0470c6fbf tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] 'nvme version' failed. Not Retrying. {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:08:42 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.nvmeof [None req-761516d5-28e7-4f2d-b183-22f0470c6fbf tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] nvme not present on system {{(pid=82479) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 00:08:42 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:42 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:08:42 user nova-compute[82479]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 00:08:42 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[f186c489-b275-4111-9ab9-3138ee7625ff]: (4, '') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:42 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-761516d5-28e7-4f2d-b183-22f0470c6fbf tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82479) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 00:08:42 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-761516d5-28e7-4f2d-b183-22f0470c6fbf tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 00:08:42 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-761516d5-28e7-4f2d-b183-22f0470c6fbf tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] LIGHTOS: no hostnqn found. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 00:08:42 user nova-compute[82479]: DEBUG os_brick.utils [None req-761516d5-28e7-4f2d-b183-22f0470c6fbf tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fec92fcfdd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:08:42 user nova-compute[82479]: DEBUG nova.virt.block_device [None req-761516d5-28e7-4f2d-b183-22f0470c6fbf tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Updating existing volume attachment record: 679e00ff-1e9f-4d7a-83d1-85056920732d {{(pid=82479) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 00:08:43 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Updating instance_info_cache with network_info: [] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:08:43 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Took 1.13 seconds to deallocate network for instance.
Apr 14 00:08:43 user nova-compute[82479]: DEBUG nova.compute.manager [req-d9c967b8-51c2-4aa2-9e45-d7495ebab6d0 req-4af1011e-9596-4dc0-a45d-f11c8d1e5369 service nova] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Received event network-vif-deleted-e8376395-8a3e-46bf-a137-3e740e4e70ef {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:08:43 user nova-compute[82479]: INFO nova.compute.manager [req-d9c967b8-51c2-4aa2-9e45-d7495ebab6d0 req-4af1011e-9596-4dc0-a45d-f11c8d1e5369 service nova] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Neutron deleted interface e8376395-8a3e-46bf-a137-3e740e4e70ef; detaching it from the instance and deleting it from the info cache
Apr 14 00:08:43 user nova-compute[82479]: DEBUG nova.network.neutron [req-d9c967b8-51c2-4aa2-9e45-d7495ebab6d0 req-4af1011e-9596-4dc0-a45d-f11c8d1e5369 service nova] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Updating instance_info_cache with network_info: [] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:08:43 user nova-compute[82479]: DEBUG nova.compute.manager [req-d9c967b8-51c2-4aa2-9e45-d7495ebab6d0 req-4af1011e-9596-4dc0-a45d-f11c8d1e5369 service nova] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Detach interface failed, port_id=e8376395-8a3e-46bf-a137-3e740e4e70ef, reason: Instance 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2 could not be found. {{(pid=82479) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 00:08:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-9ce3e942-dcb2-4e7f-83e2-59f734411886 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:08:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-9ce3e942-dcb2-4e7f-83e2-59f734411886 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:08:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "17c6c147-fb62-4204-a416-792b94d3f7dd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:08:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "17c6c147-fb62-4204-a416-792b94d3f7dd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:08:43 user nova-compute[82479]: DEBUG nova.compute.manager [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Starting instance... {{(pid=82479) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 00:08:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:08:43 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-9ce3e942-dcb2-4e7f-83e2-59f734411886 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:08:43 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-9ce3e942-dcb2-4e7f-83e2-59f734411886 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:08:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-9ce3e942-dcb2-4e7f-83e2-59f734411886 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.404s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:08:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.155s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:08:43 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82479) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 00:08:43 user nova-compute[82479]: INFO nova.compute.claims [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Claim successful on node user
Apr 14 00:08:43 user nova-compute[82479]: DEBUG nova.compute.manager [req-cb8a8967-5eca-4ce8-9f0d-9ff39b69643f req-84facb09-92bf-4f21-80bc-704757c4d4b8 service nova] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Received event network-vif-plugged-e8376395-8a3e-46bf-a137-3e740e4e70ef {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:08:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-cb8a8967-5eca-4ce8-9f0d-9ff39b69643f req-84facb09-92bf-4f21-80bc-704757c4d4b8 service nova] Acquiring lock "716b5e3f-20c7-40ef-9a45-71be0cfeaeb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:08:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-cb8a8967-5eca-4ce8-9f0d-9ff39b69643f req-84facb09-92bf-4f21-80bc-704757c4d4b8 service nova] Lock "716b5e3f-20c7-40ef-9a45-71be0cfeaeb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:08:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-cb8a8967-5eca-4ce8-9f0d-9ff39b69643f req-84facb09-92bf-4f21-80bc-704757c4d4b8 service nova] Lock "716b5e3f-20c7-40ef-9a45-71be0cfeaeb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:08:43 user nova-compute[82479]: DEBUG nova.compute.manager [req-cb8a8967-5eca-4ce8-9f0d-9ff39b69643f req-84facb09-92bf-4f21-80bc-704757c4d4b8 service nova] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] No waiting events found dispatching network-vif-plugged-e8376395-8a3e-46bf-a137-3e740e4e70ef {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:08:43 user nova-compute[82479]: WARNING nova.compute.manager [req-cb8a8967-5eca-4ce8-9f0d-9ff39b69643f req-84facb09-92bf-4f21-80bc-704757c4d4b8 service nova] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Received unexpected event network-vif-plugged-e8376395-8a3e-46bf-a137-3e740e4e70ef for instance with vm_state deleted and task_state None.
Apr 14 00:08:43 user nova-compute[82479]: INFO nova.scheduler.client.report [None req-9ce3e942-dcb2-4e7f-83e2-59f734411886 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Deleted allocations for instance 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2
Apr 14 00:08:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-9ce3e942-dcb2-4e7f-83e2-59f734411886 tempest-TestVolumeSwap-882310266 tempest-TestVolumeSwap-882310266-project-member] Lock "716b5e3f-20c7-40ef-9a45-71be0cfeaeb2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.635s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:08:43 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:08:43 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:08:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.456s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:08:44 user nova-compute[82479]: DEBUG nova.compute.manager [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Start building networks asynchronously for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 00:08:44 user nova-compute[82479]: DEBUG nova.compute.manager [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Allocating IP information in the background. {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 00:08:44 user nova-compute[82479]: DEBUG nova.network.neutron [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] allocate_for_instance() {{(pid=82479) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 00:08:44 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 00:08:44 user nova-compute[82479]: DEBUG nova.compute.manager [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Start building block device mappings for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 00:08:44 user nova-compute[82479]: INFO nova.virt.block_device [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Booting with blank volume at /dev/vda
Apr 14 00:08:44 user nova-compute[82479]: DEBUG nova.policy [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '90bad96535c3453792982c5acab9dbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f111e24414976beddba7ef90c4793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82479) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 00:08:44 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:08:44 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:08:44 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82479) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 00:08:44 user nova-compute[82479]: DEBUG nova.network.neutron [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Successfully created port: 102987de-d5e4-4ccd-b4fd-7ca7c131e379 {{(pid=82479) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 00:08:45 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:08:45 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:08:45 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:08:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:08:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:08:45 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Auditing locally available compute resources for user (node: user) {{(pid=82479) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 00:08:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:45 user nova-compute[82479]: DEBUG nova.network.neutron [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Successfully updated port: 102987de-d5e4-4ccd-b4fd-7ca7c131e379 {{(pid=82479) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 00:08:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "refresh_cache-17c6c147-fb62-4204-a416-792b94d3f7dd" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:08:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquired lock "refresh_cache-17c6c147-fb62-4204-a416-792b94d3f7dd" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:08:45 user nova-compute[82479]: DEBUG nova.network.neutron [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 00:08:45 user nova-compute[82479]: DEBUG nova.compute.manager [req-62a8aec7-f21e-457d-941e-998b031e771a req-fc37d667-7972-4732-b9f6-1fed5432ea9c service nova] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Received event network-changed-102987de-d5e4-4ccd-b4fd-7ca7c131e379 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:08:45 user nova-compute[82479]: DEBUG nova.compute.manager [req-62a8aec7-f21e-457d-941e-998b031e771a req-fc37d667-7972-4732-b9f6-1fed5432ea9c service nova] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Refreshing instance network info cache due to event network-changed-102987de-d5e4-4ccd-b4fd-7ca7c131e379. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:08:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-62a8aec7-f21e-457d-941e-998b031e771a req-fc37d667-7972-4732-b9f6-1fed5432ea9c service nova] Acquiring lock "refresh_cache-17c6c147-fb62-4204-a416-792b94d3f7dd" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:08:45 user nova-compute[82479]: DEBUG nova.network.neutron [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Instance cache missing network info. {{(pid=82479) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 00:08:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11c3384a-e699-4b10-9f8b-861291e96465/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:46 user nova-compute[82479]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681430911.292694, b9c6323b-ed7f-4f86-93ad-3ef4726b01ff => Stopped> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:08:46 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] VM Stopped (Lifecycle Event)
Apr 14 00:08:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11c3384a-e699-4b10-9f8b-861291e96465/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11c3384a-e699-4b10-9f8b-861291e96465/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:46 user nova-compute[82479]: DEBUG nova.network.neutron [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Updating instance_info_cache with network_info: [{"id": "102987de-d5e4-4ccd-b4fd-7ca7c131e379", "address": "fa:16:3e:23:dd:a5", "network": {"id": "491696ea-38ef-4c19-9d94-a61223c1fa00", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1323121698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3f111e24414976beddba7ef90c4793", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap102987de-d5", "ovs_interfaceid": "102987de-d5e4-4ccd-b4fd-7ca7c131e379", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:08:46 user nova-compute[82479]: DEBUG nova.compute.manager [None req-37eb8e7a-653a-483b-b114-fe04356aca86 None None] [instance: b9c6323b-ed7f-4f86-93ad-3ef4726b01ff] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:08:46 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Releasing lock "refresh_cache-17c6c147-fb62-4204-a416-792b94d3f7dd" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:08:46 user nova-compute[82479]: DEBUG nova.compute.manager [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Instance network_info: |[{"id": "102987de-d5e4-4ccd-b4fd-7ca7c131e379", "address": "fa:16:3e:23:dd:a5", "network": {"id": "491696ea-38ef-4c19-9d94-a61223c1fa00", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1323121698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3f111e24414976beddba7ef90c4793", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap102987de-d5", "ovs_interfaceid": "102987de-d5e4-4ccd-b4fd-7ca7c131e379", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 00:08:46 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-62a8aec7-f21e-457d-941e-998b031e771a req-fc37d667-7972-4732-b9f6-1fed5432ea9c service nova] Acquired lock "refresh_cache-17c6c147-fb62-4204-a416-792b94d3f7dd" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:08:46 user nova-compute[82479]: DEBUG nova.network.neutron [req-62a8aec7-f21e-457d-941e-998b031e771a req-fc37d667-7972-4732-b9f6-1fed5432ea9c service nova] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Refreshing network info cache for port 102987de-d5e4-4ccd-b4fd-7ca7c131e379 {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:08:46 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11c3384a-e699-4b10-9f8b-861291e96465/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db291c2f-a72c-46ce-8de8-3956de37ccf8/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:46 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db291c2f-a72c-46ce-8de8-3956de37ccf8/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db291c2f-a72c-46ce-8de8-3956de37ccf8/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:47 user nova-compute[82479]: DEBUG nova.network.neutron [req-62a8aec7-f21e-457d-941e-998b031e771a req-fc37d667-7972-4732-b9f6-1fed5432ea9c service nova] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Updated VIF entry in instance network info cache for port 102987de-d5e4-4ccd-b4fd-7ca7c131e379. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:08:47 user nova-compute[82479]: DEBUG nova.network.neutron [req-62a8aec7-f21e-457d-941e-998b031e771a req-fc37d667-7972-4732-b9f6-1fed5432ea9c service nova] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Updating instance_info_cache with network_info: [{"id": "102987de-d5e4-4ccd-b4fd-7ca7c131e379", "address": "fa:16:3e:23:dd:a5", "network": {"id": "491696ea-38ef-4c19-9d94-a61223c1fa00", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1323121698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3f111e24414976beddba7ef90c4793", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap102987de-d5", "ovs_interfaceid": "102987de-d5e4-4ccd-b4fd-7ca7c131e379", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:08:47 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-62a8aec7-f21e-457d-941e-998b031e771a req-fc37d667-7972-4732-b9f6-1fed5432ea9c service nova] Releasing lock "refresh_cache-17c6c147-fb62-4204-a416-792b94d3f7dd" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:08:47 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db291c2f-a72c-46ce-8de8-3956de37ccf8/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:47 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01a65362-36ea-4817-8e83-f75d6daf808b/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:47 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01a65362-36ea-4817-8e83-f75d6daf808b/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:47 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01a65362-36ea-4817-8e83-f75d6daf808b/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:47 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01a65362-36ea-4817-8e83-f75d6daf808b/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:47 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:08:47 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fba4ee-4aae-4ee3-8114-b53510f5442c/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:47 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fba4ee-4aae-4ee3-8114-b53510f5442c/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:47 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fba4ee-4aae-4ee3-8114-b53510f5442c/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:47 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fba4ee-4aae-4ee3-8114-b53510f5442c/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:47 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:47 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-761516d5-28e7-4f2d-b183-22f0470c6fbf tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Calling os-brick to attach iSCSI Volume {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 00:08:47 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-761516d5-28e7-4f2d-b183-22f0470c6fbf tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iVbjylRT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:08:47 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-761516d5-28e7-4f2d-b183-22f0470c6fbf tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:08:47 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-761516d5-28e7-4f2d-b183-22f0470c6fbf tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:08:47 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-761516d5-28e7-4f2d-b183-22f0470c6fbf tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:08:47 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-761516d5-28e7-4f2d-b183-22f0470c6fbf tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:08:47 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-761516d5-28e7-4f2d-b183-22f0470c6fbf tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:08:47 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-761516d5-28e7-4f2d-b183-22f0470c6fbf tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:08:47 user nova-compute[82479]: INFO os_brick.initiator.connectors.iscsi [None req-761516d5-28e7-4f2d-b183-22f0470c6fbf tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 00:08:47 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a -p 172.16.0.220:3260 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:47 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:47 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6781e92-0cd4-4507-a9e9-d8aef0d1211b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:47 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-761516d5-28e7-4f2d-b183-22f0470c6fbf tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 00:08:47 user nova-compute[82479]:  {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:08:47 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a -p 172.16.0.220:3260 --interface default --op new {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:47 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:47 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[029ef670-9a18-4d78-a28d-2366789da224]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a] added\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:47 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-761516d5-28e7-4f2d-b183-22f0470c6fbf tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a] added
Apr 14 00:08:47 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:08:47 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:47 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:47 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:47 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:47 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c67e063-da70-4ef5-a1ef-963abda389ee]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:47 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-761516d5-28e7-4f2d-b183-22f0470c6fbf tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:08:47 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:47 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:47 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[9020df82-b2e9-41a6-a9c4-dceff362be1f]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:47 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-761516d5-28e7-4f2d-b183-22f0470c6fbf tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:08:47 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iVbjylRT {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:47 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iVbjylRT" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:47 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[650b2652-9d5a-4679-8906-d9a4b2a779e9]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:47 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-761516d5-28e7-4f2d-b183-22f0470c6fbf tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iVbjylRT'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:08:47 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:47 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:08:47 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:08:47 user nova-compute[82479]: INFO nova.compute.manager [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Unshelving
Apr 14 00:08:47 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:47 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[5423fc68-9eae-4ee4-b3db-7b65b3187c4b]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:47 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-761516d5-28e7-4f2d-b183-22f0470c6fbf tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:08:47 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:48 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:48 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:48 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c0dcaf-4320-416f-9dd0-179d6129554f]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:48 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-761516d5-28e7-4f2d-b183-22f0470c6fbf tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:08:48 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:08:48 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-761516d5-28e7-4f2d-b183-22f0470c6fbf tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:08:48 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:08:48 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a -p 172.16.0.220:3260 --login {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:48 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:48 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[54413126-666b-4e8e-9742-37303e7b6d55]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:48 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-761516d5-28e7-4f2d-b183-22f0470c6fbf tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a, portal: 172.16.0.220,3260]
Apr 14 00:08:48 user nova-compute[82479]: Login to [iface: default, target: iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a, portal: 172.16.0.220,3260] successful.
Apr 14 00:08:48 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:08:48 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:48 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:08:48 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:08:48 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Hypervisor/Node resource view: name=user free_ram=7968MB free_disk=26.470054626464844GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82479) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 00:08:48 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:08:48 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:08:48 user nova-compute[82479]: INFO nova.virt.block_device [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Booting with volume af1b05d2-717a-489c-8bdf-160d00ebd122 at /dev/vdc
Apr 14 00:08:48 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:48 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dea8b22-91ab-4256-bcf3-deb904474c60]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:48 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-761516d5-28e7-4f2d-b183-22f0470c6fbf tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:08:48 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:48 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:48 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[7123a59b-ca65-49bb-8d38-cc118d1afe1b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:48 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-761516d5-28e7-4f2d-b183-22f0470c6fbf tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)
Apr 14 00:08:48 user nova-compute[82479]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:08:48 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:08:48 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-761516d5-28e7-4f2d-b183-22f0470c6fbf tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)
Apr 14 00:08:48 user nova-compute[82479]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:08:48 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:08:48 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-761516d5-28e7-4f2d-b183-22f0470c6fbf tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.723s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:08:48 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-761516d5-28e7-4f2d-b183-22f0470c6fbf tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Connected to 172.16.0.220:3260 {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 00:08:48 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-761516d5-28e7-4f2d-b183-22f0470c6fbf tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] HCTL ('33', '-', '-', 0) found on session 11 with lun 0 {{(pid=82479) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 00:08:48 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-761516d5-28e7-4f2d-b183-22f0470c6fbf tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82479) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 00:08:48 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:48 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:48 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[3197a786-0c24-43b9-b29d-821242c2d700]: (4, ('- - 0', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:48 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-761516d5-28e7-4f2d-b183-22f0470c6fbf tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Searching for a device in session 11 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82479) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 00:08:48 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-761516d5-28e7-4f2d-b183-22f0470c6fbf tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iVbjylRT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 00:08:48 user nova-compute[82479]: DEBUG os_brick.utils [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:08:48 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:48 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:48 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa3df091-0cc9-444f-932f-18a07132f3ec]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fec92fcfdd3\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:48 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:48 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 23718fd0-58b8-47f9-b1ef-a26a90741ecc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:08:48 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:08:48 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 01a65362-36ea-4817-8e83-f75d6daf808b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:08:48 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance b3475e7e-ceb4-452a-a045-dbf43c5944dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:08:48 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 11c3384a-e699-4b10-9f8b-861291e96465 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:08:48 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance e3fba4ee-4aae-4ee3-8114-b53510f5442c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:08:48 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance db291c2f-a72c-46ce-8de8-3956de37ccf8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:08:48 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 17c6c147-fb62-4204-a416-792b94d3f7dd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:08:48 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:48 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[9423ecc0-6585-4216-9fda-e5a076677d31]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:48 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:48 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1689}}
Apr 14 00:08:48 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 00:08:48 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 00:08:48 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:48 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[247db1b2-d02b-48a5-8c72-815b49704a05]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:48 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba482491-326b-4862-b466-1be7864331c6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:48 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Running cmd (subprocess): nvme version {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:48 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] 'nvme version' failed. Not Retrying. {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:08:48 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] nvme not present on system {{(pid=82479) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 00:08:48 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:48 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:08:48 user nova-compute[82479]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 00:08:48 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e67bcb-ca3f-4bad-bab2-fb211f1f64bf]: (4, '') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:48 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82479) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 00:08:48 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 00:08:48 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] LIGHTOS: no hostnqn found. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 00:08:48 user nova-compute[82479]: DEBUG os_brick.utils [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fec92fcfdd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:08:48 user nova-compute[82479]: DEBUG nova.virt.block_device [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Updating existing volume attachment record: 355a8c10-71ab-4aed-9e38-b43ec2211c2a {{(pid=82479) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 00:08:48 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:08:48 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:08:48 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Compute_service record updated for user:user {{(pid=82479) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 00:08:48 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.500s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:08:49 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-761516d5-28e7-4f2d-b183-22f0470c6fbf tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.761s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:08:49 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-761516d5-28e7-4f2d-b183-22f0470c6fbf tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] <== connect_volume: return (1763ms) {'type': 'block', 'scsi_wwn': '23931393631306436', 'path': '/dev/sdb'} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:08:49 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-761516d5-28e7-4f2d-b183-22f0470c6fbf tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23931393631306436', 'path': '/dev/sdb'} {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 00:08:49 user nova-compute[82479]: DEBUG nova.objects.instance [None req-761516d5-28e7-4f2d-b183-22f0470c6fbf tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lazy-loading 'flavor' on Instance uuid 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:08:49 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-761516d5-28e7-4f2d-b183-22f0470c6fbf tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 00:08:49 user nova-compute[82479]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:08:49 user nova-compute[82479]:   <source dev="/dev/sdb"/>
Apr 14 00:08:49 user nova-compute[82479]:   <target dev="vdb" bus="virtio"/>
Apr 14 00:08:49 user nova-compute[82479]:   <serial>028eff5c-aa61-4243-985e-5210aedff04a</serial>
Apr 14 00:08:49 user nova-compute[82479]: </disk>
Apr 14 00:08:49 user nova-compute[82479]:  {{(pid=82479) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 00:08:49 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Acquiring lock "8feba40a-03c7-4c60-b862-ee14fb8c9b05" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:08:49 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "8feba40a-03c7-4c60-b862-ee14fb8c9b05" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:08:49 user nova-compute[82479]: DEBUG nova.compute.manager [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Starting instance... {{(pid=82479) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 00:08:49 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:08:49 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:08:49 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82479) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 00:08:49 user nova-compute[82479]: INFO nova.compute.claims [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Claim successful on node user
Apr 14 00:08:49 user nova-compute[82479]: DEBUG os_brick.utils [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:08:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:49 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0b0fbf-bf1c-411e-ba71-0f6f90dba2c3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fec92fcfdd3\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:49 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[26da978b-b58f-4ff5-af1b-3af5f0bde665]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:49 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6903a85-0917-49cd-a04f-de5a7e746af8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:49 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb506baf-3aa6-4f2f-ac77-22766a7ea75c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Running cmd (subprocess): nvme version {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] 'nvme version' failed. Not Retrying. {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:08:50 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:08:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] nvme not present on system {{(pid=82479) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 00:08:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:08:50 user nova-compute[82479]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 00:08:50 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4916df8-9e82-48ad-a170-648efb7cfd3c]: (4, '') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82479) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 00:08:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 00:08:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] LIGHTOS: no hostnqn found. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 00:08:50 user nova-compute[82479]: DEBUG os_brick.utils [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fec92fcfdd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:08:50 user nova-compute[82479]: DEBUG nova.virt.block_device [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Updating existing volume attachment record: c83af900-31a1-488d-a8b4-ff896990a329 {{(pid=82479) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 00:08:50 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-761516d5-28e7-4f2d-b183-22f0470c6fbf tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:08:50 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-761516d5-28e7-4f2d-b183-22f0470c6fbf tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:08:50 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-761516d5-28e7-4f2d-b183-22f0470c6fbf tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] No VIF found with MAC fa:16:3e:2b:ab:7d, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:08:50 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:08:50 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-761516d5-28e7-4f2d-b183-22f0470c6fbf tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "3a6b9f89-e462-47d8-84a1-0ac4ade3ab97" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.499s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:08:50 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:08:50 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.479s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:08:50 user nova-compute[82479]: DEBUG nova.compute.manager [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Start building networks asynchronously for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 00:08:50 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:08:50 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:08:50 user nova-compute[82479]: DEBUG nova.objects.instance [None req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lazy-loading 'flavor' on Instance uuid b3475e7e-ceb4-452a-a045-dbf43c5944dd {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:08:50 user nova-compute[82479]: DEBUG nova.compute.manager [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Allocating IP information in the background. {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 00:08:50 user nova-compute[82479]: DEBUG nova.network.neutron [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] allocate_for_instance() {{(pid=82479) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 00:08:50 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:08:50 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 00:08:50 user nova-compute[82479]: DEBUG nova.compute.manager [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Start building block device mappings for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 00:08:50 user nova-compute[82479]: DEBUG nova.policy [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '74d7e3d598e74c288e6a44996303b85e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffbe999e60a4add9f23c83f9b0a4252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82479) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 00:08:50 user nova-compute[82479]: DEBUG nova.compute.manager [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Start spawning the instance on the hypervisor. {{(pid=82479) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 00:08:50 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Creating instance directory {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 00:08:50 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Creating image(s)
Apr 14 00:08:50 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Acquiring lock "/opt/stack/data/nova/instances/8feba40a-03c7-4c60-b862-ee14fb8c9b05/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:08:50 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "/opt/stack/data/nova/instances/8feba40a-03c7-4c60-b862-ee14fb8c9b05/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:08:50 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "/opt/stack/data/nova/instances/8feba40a-03c7-4c60-b862-ee14fb8c9b05/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:08:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:50 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:50 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:08:50 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:08:50 user nova-compute[82479]: INFO nova.compute.manager [None req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Attaching volume 49172d5a-2944-486a-a080-04548e55ac0d to /dev/vdb
Apr 14 00:08:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.194s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:50 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Acquiring lock "3e200e101633f2016e569ae4c0a352380507d1e4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:08:50 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "3e200e101633f2016e569ae4c0a352380507d1e4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:08:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:50 user nova-compute[82479]: DEBUG os_brick.utils [None req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:08:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:50 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[314c662a-e92e-48a9-80c1-0e956182e9a2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fec92fcfdd3\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.134s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:50 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c229320-fa31-46d2-a039-fc542858f0bf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:51 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f6b699-17e4-4642-8dd6-6f9904c08e26]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:51 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd3847e0-133b-4754-9c8b-7897cafd9e83]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Running cmd (subprocess): nvme version {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] 'nvme version' failed. Not Retrying. {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:08:51 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] nvme not present on system {{(pid=82479) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 00:08:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:08:51 user nova-compute[82479]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 00:08:51 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd88c35-23d7-479f-abf5-fbfd523c0eb7]: (4, '') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:51 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82479) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 00:08:51 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 00:08:51 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] LIGHTOS: no hostnqn found. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 00:08:51 user nova-compute[82479]: DEBUG os_brick.utils [None req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] <== get_connector_properties: return (258ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fec92fcfdd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:08:51 user nova-compute[82479]: DEBUG nova.virt.block_device [None req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Updating existing volume attachment record: 9dba4460-e1ac-4b84-94e0-f27800eb6e2f {{(pid=82479) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 00:08:51 user nova-compute[82479]: INFO nova.compute.manager [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Rescuing
Apr 14 00:08:51 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Acquiring lock "refresh_cache-3a6b9f89-e462-47d8-84a1-0ac4ade3ab97" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:08:51 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Acquired lock "refresh_cache-3a6b9f89-e462-47d8-84a1-0ac4ade3ab97" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:08:51 user nova-compute[82479]: DEBUG nova.network.neutron [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 00:08:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.369s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/8feba40a-03c7-4c60-b862-ee14fb8c9b05/disk 1073741824 {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/8feba40a-03c7-4c60-b862-ee14fb8c9b05/disk 1073741824" returned: 0 in 0.056s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:51 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "3e200e101633f2016e569ae4c0a352380507d1e4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.431s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:08:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.147s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:51 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8feba40a-03c7-4c60-b862-ee14fb8c9b05/disk. size=1073741824 {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 00:08:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8feba40a-03c7-4c60-b862-ee14fb8c9b05/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8feba40a-03c7-4c60-b862-ee14fb8c9b05/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:51 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Cannot resize image /opt/stack/data/nova/instances/8feba40a-03c7-4c60-b862-ee14fb8c9b05/disk to a smaller size. {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 00:08:51 user nova-compute[82479]: DEBUG nova.objects.instance [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lazy-loading 'migration_context' on Instance uuid 8feba40a-03c7-4c60-b862-ee14fb8c9b05 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:08:51 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Created local disks {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 00:08:51 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Ensure instance console log exists: /opt/stack/data/nova/instances/8feba40a-03c7-4c60-b862-ee14fb8c9b05/console.log {{(pid=82479) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 00:08:51 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:08:51 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:08:51 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:08:51 user nova-compute[82479]: DEBUG nova.network.neutron [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Successfully created port: 53562eeb-b1fd-47f1-896e-cacd277abf24 {{(pid=82479) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 00:08:51 user nova-compute[82479]: DEBUG nova.network.neutron [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Updating instance_info_cache with network_info: [{"id": "4085de4c-cb9e-452b-9504-b7c7f8621213", "address": "fa:16:3e:2b:ab:7d", "network": {"id": "10c34d1a-edc4-4b0c-96a7-b29a7c292e74", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-573422654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931198e56de4cf08db59bcc40f2a260", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4085de4c-cb", "ovs_interfaceid": "4085de4c-cb9e-452b-9504-b7c7f8621213", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:08:51 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Releasing lock "refresh_cache-3a6b9f89-e462-47d8-84a1-0ac4ade3ab97" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:08:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:52 user nova-compute[82479]: DEBUG nova.compute.manager [req-14eeb7e7-2fa4-47b0-b6ed-91dcd8d19805 req-a44975c3-6090-4d18-9b07-10c01955a11e service nova] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Received event network-vif-unplugged-4085de4c-cb9e-452b-9504-b7c7f8621213 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:08:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-14eeb7e7-2fa4-47b0-b6ed-91dcd8d19805 req-a44975c3-6090-4d18-9b07-10c01955a11e service nova] Acquiring lock "3a6b9f89-e462-47d8-84a1-0ac4ade3ab97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:08:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-14eeb7e7-2fa4-47b0-b6ed-91dcd8d19805 req-a44975c3-6090-4d18-9b07-10c01955a11e service nova] Lock "3a6b9f89-e462-47d8-84a1-0ac4ade3ab97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:08:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-14eeb7e7-2fa4-47b0-b6ed-91dcd8d19805 req-a44975c3-6090-4d18-9b07-10c01955a11e service nova] Lock "3a6b9f89-e462-47d8-84a1-0ac4ade3ab97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:08:52 user nova-compute[82479]: DEBUG nova.compute.manager [req-14eeb7e7-2fa4-47b0-b6ed-91dcd8d19805 req-a44975c3-6090-4d18-9b07-10c01955a11e service nova] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] No waiting events found dispatching network-vif-unplugged-4085de4c-cb9e-452b-9504-b7c7f8621213 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:08:52 user nova-compute[82479]: WARNING nova.compute.manager [req-14eeb7e7-2fa4-47b0-b6ed-91dcd8d19805 req-a44975c3-6090-4d18-9b07-10c01955a11e service nova] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Received unexpected event network-vif-unplugged-4085de4c-cb9e-452b-9504-b7c7f8621213 for instance with vm_state active and task_state rescuing.
Apr 14 00:08:52 user nova-compute[82479]: DEBUG nova.network.neutron [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Successfully updated port: 53562eeb-b1fd-47f1-896e-cacd277abf24 {{(pid=82479) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 00:08:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Acquiring lock "refresh_cache-8feba40a-03c7-4c60-b862-ee14fb8c9b05" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:08:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Acquired lock "refresh_cache-8feba40a-03c7-4c60-b862-ee14fb8c9b05" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:08:52 user nova-compute[82479]: DEBUG nova.network.neutron [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 00:08:52 user nova-compute[82479]: DEBUG nova.compute.manager [req-31a4fd4c-d4eb-46bd-a9dd-bb6e887af761 req-90e383e3-5542-439c-ac27-e50672f06266 service nova] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Received event network-changed-53562eeb-b1fd-47f1-896e-cacd277abf24 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:08:52 user nova-compute[82479]: DEBUG nova.compute.manager [req-31a4fd4c-d4eb-46bd-a9dd-bb6e887af761 req-90e383e3-5542-439c-ac27-e50672f06266 service nova] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Refreshing instance network info cache due to event network-changed-53562eeb-b1fd-47f1-896e-cacd277abf24. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:08:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-31a4fd4c-d4eb-46bd-a9dd-bb6e887af761 req-90e383e3-5542-439c-ac27-e50672f06266 service nova] Acquiring lock "refresh_cache-8feba40a-03c7-4c60-b862-ee14fb8c9b05" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:08:52 user nova-compute[82479]: DEBUG nova.network.neutron [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Instance cache missing network info. {{(pid=82479) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 00:08:52 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:52 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Instance destroyed successfully.
Apr 14 00:08:52 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Attempting a stable device rescue
Apr 14 00:08:52 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=82479) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 14 00:08:52 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Instance directory exists: not creating {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 00:08:52 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Creating image(s)
Apr 14 00:08:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Acquiring lock "/opt/stack/data/nova/instances/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:08:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "/opt/stack/data/nova/instances/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:08:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "/opt/stack/data/nova/instances/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:08:52 user nova-compute[82479]: DEBUG nova.objects.instance [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:08:52 user nova-compute[82479]: DEBUG nova.objects.instance [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lazy-loading 'flavor' on Instance uuid 01a65362-36ea-4817-8e83-f75d6daf808b {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:08:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Acquiring lock "848691fef127d924018cc71228374edf26f59158" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:08:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "848691fef127d924018cc71228374edf26f59158" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:08:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "refresh_cache-01a65362-36ea-4817-8e83-f75d6daf808b" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:08:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquired lock "refresh_cache-01a65362-36ea-4817-8e83-f75d6daf808b" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:08:52 user nova-compute[82479]: DEBUG nova.network.neutron [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 00:08:52 user nova-compute[82479]: DEBUG nova.objects.instance [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lazy-loading 'info_cache' on Instance uuid 01a65362-36ea-4817-8e83-f75d6daf808b {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:08:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/848691fef127d924018cc71228374edf26f59158.part --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:53 user nova-compute[82479]: DEBUG nova.network.neutron [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Updating instance_info_cache with network_info: [{"id": "53562eeb-b1fd-47f1-896e-cacd277abf24", "address": "fa:16:3e:e2:4e:ff", "network": {"id": "49f71fbc-7d65-4cc6-9efe-3918d5dbd51a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2079147315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dffbe999e60a4add9f23c83f9b0a4252", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53562eeb-b1", "ovs_interfaceid": "53562eeb-b1fd-47f1-896e-cacd277abf24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:08:53 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Releasing lock "refresh_cache-8feba40a-03c7-4c60-b862-ee14fb8c9b05" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:08:53 user nova-compute[82479]: DEBUG nova.compute.manager [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Instance network_info: |[{"id": "53562eeb-b1fd-47f1-896e-cacd277abf24", "address": "fa:16:3e:e2:4e:ff", "network": {"id": "49f71fbc-7d65-4cc6-9efe-3918d5dbd51a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2079147315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dffbe999e60a4add9f23c83f9b0a4252", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53562eeb-b1", "ovs_interfaceid": "53562eeb-b1fd-47f1-896e-cacd277abf24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 00:08:53 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-31a4fd4c-d4eb-46bd-a9dd-bb6e887af761 req-90e383e3-5542-439c-ac27-e50672f06266 service nova] Acquired lock "refresh_cache-8feba40a-03c7-4c60-b862-ee14fb8c9b05" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:08:53 user nova-compute[82479]: DEBUG nova.network.neutron [req-31a4fd4c-d4eb-46bd-a9dd-bb6e887af761 req-90e383e3-5542-439c-ac27-e50672f06266 service nova] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Refreshing network info cache for port 53562eeb-b1fd-47f1-896e-cacd277abf24 {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:08:53 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Start _get_guest_xml network_info=[{"id": "53562eeb-b1fd-47f1-896e-cacd277abf24", "address": "fa:16:3e:e2:4e:ff", "network": {"id": "49f71fbc-7d65-4cc6-9efe-3918d5dbd51a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2079147315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dffbe999e60a4add9f23c83f9b0a4252", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53562eeb-b1", "ovs_interfaceid": "53562eeb-b1fd-47f1-896e-cacd277abf24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 00:08:53 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:08:53 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:08:53 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82479) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 00:08:53 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T00:02:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 00:08:53 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Flavor limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 00:08:53 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Image limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 00:08:53 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Flavor pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 00:08:53 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Image pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 00:08:53 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 00:08:53 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 00:08:53 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 00:08:53 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Got 1 possible topologies {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 00:08:53 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 00:08:53 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 00:08:53 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:08:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1922236850',display_name='tempest-VolumesAdminNegativeTest-server-1922236850',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1922236850',id=14,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAzgAnzYZDrHRSOtHVv/zz9Jq59yqHCgj+XUAspYSe7CuNpSWviw5YD7t1g/w4+Yy6KXGWPMGPWkh09BzPQ7qv26QIE2Xeb9uqZ1VE97Ta+wjygIDmM6CU+6ySBTktY5UA==',key_name='tempest-keypair-1912277882',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dffbe999e60a4add9f23c83f9b0a4252',ramdisk_id='',reservation_id='r-ae2uaapr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1377720460',owner_user_name='tempest-VolumesAdminNegativeTest-1377720460-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:08:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74d7e3d598e74c288e6a44996303b85e',uuid=8feba40a-03c7-4c60-b862-ee14fb8c9b05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53562eeb-b1fd-47f1-896e-cacd277abf24", "address": "fa:16:3e:e2:4e:ff", "network": {"id": "49f71fbc-7d65-4cc6-9efe-3918d5dbd51a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2079147315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dffbe999e60a4add9f23c83f9b0a4252", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53562eeb-b1", "ovs_interfaceid": "53562eeb-b1fd-47f1-896e-cacd277abf24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82479) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 00:08:53 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Converting VIF {"id": "53562eeb-b1fd-47f1-896e-cacd277abf24", "address": "fa:16:3e:e2:4e:ff", "network": {"id": "49f71fbc-7d65-4cc6-9efe-3918d5dbd51a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2079147315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dffbe999e60a4add9f23c83f9b0a4252", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53562eeb-b1", "ovs_interfaceid": "53562eeb-b1fd-47f1-896e-cacd277abf24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:08:53 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:4e:ff,bridge_name='br-int',has_traffic_filtering=True,id=53562eeb-b1fd-47f1-896e-cacd277abf24,network=Network(49f71fbc-7d65-4cc6-9efe-3918d5dbd51a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53562eeb-b1') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:08:53 user nova-compute[82479]: DEBUG nova.objects.instance [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lazy-loading 'pci_devices' on Instance uuid 8feba40a-03c7-4c60-b862-ee14fb8c9b05 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:08:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/848691fef127d924018cc71228374edf26f59158.part --force-share --output=json" returned: 0 in 0.157s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:53 user nova-compute[82479]: DEBUG nova.virt.images [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] b55f3d04-4ac0-4525-8efe-35fed088afe1 was qcow2, converting to raw {{(pid=82479) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 00:08:53 user nova-compute[82479]: DEBUG nova.privsep.utils [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82479) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 00:08:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/848691fef127d924018cc71228374edf26f59158.part /opt/stack/data/nova/instances/_base/848691fef127d924018cc71228374edf26f59158.converted {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:53 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] End _get_guest_xml xml=<domain type="kvm">
Apr 14 00:08:53 user nova-compute[82479]:   <uuid>8feba40a-03c7-4c60-b862-ee14fb8c9b05</uuid>
Apr 14 00:08:53 user nova-compute[82479]:   <name>instance-0000000e</name>
Apr 14 00:08:53 user nova-compute[82479]:   <memory>131072</memory>
Apr 14 00:08:53 user nova-compute[82479]:   <vcpu>1</vcpu>
Apr 14 00:08:53 user nova-compute[82479]:   <metadata>
Apr 14 00:08:53 user nova-compute[82479]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 00:08:53 user nova-compute[82479]:       <nova:package version="0.0.0"/>
Apr 14 00:08:53 user nova-compute[82479]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1922236850</nova:name>
Apr 14 00:08:53 user nova-compute[82479]:       <nova:creationTime>2023-04-14 00:08:53</nova:creationTime>
Apr 14 00:08:53 user nova-compute[82479]:       <nova:flavor name="m1.nano">
Apr 14 00:08:53 user nova-compute[82479]:         <nova:memory>128</nova:memory>
Apr 14 00:08:53 user nova-compute[82479]:         <nova:disk>1</nova:disk>
Apr 14 00:08:53 user nova-compute[82479]:         <nova:swap>0</nova:swap>
Apr 14 00:08:53 user nova-compute[82479]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 00:08:53 user nova-compute[82479]:         <nova:vcpus>1</nova:vcpus>
Apr 14 00:08:53 user nova-compute[82479]:       </nova:flavor>
Apr 14 00:08:53 user nova-compute[82479]:       <nova:owner>
Apr 14 00:08:53 user nova-compute[82479]:         <nova:user uuid="74d7e3d598e74c288e6a44996303b85e">tempest-VolumesAdminNegativeTest-1377720460-project-member</nova:user>
Apr 14 00:08:53 user nova-compute[82479]:         <nova:project uuid="dffbe999e60a4add9f23c83f9b0a4252">tempest-VolumesAdminNegativeTest-1377720460</nova:project>
Apr 14 00:08:53 user nova-compute[82479]:       </nova:owner>
Apr 14 00:08:53 user nova-compute[82479]:       <nova:root type="image" uuid="6db62068-7278-4cd8-b41f-d0140d89e199"/>
Apr 14 00:08:53 user nova-compute[82479]:       <nova:ports>
Apr 14 00:08:53 user nova-compute[82479]:         <nova:port uuid="53562eeb-b1fd-47f1-896e-cacd277abf24">
Apr 14 00:08:53 user nova-compute[82479]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 14 00:08:53 user nova-compute[82479]:         </nova:port>
Apr 14 00:08:53 user nova-compute[82479]:       </nova:ports>
Apr 14 00:08:53 user nova-compute[82479]:     </nova:instance>
Apr 14 00:08:53 user nova-compute[82479]:   </metadata>
Apr 14 00:08:53 user nova-compute[82479]:   <sysinfo type="smbios">
Apr 14 00:08:53 user nova-compute[82479]:     <system>
Apr 14 00:08:53 user nova-compute[82479]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 00:08:53 user nova-compute[82479]:       <entry name="product">OpenStack Nova</entry>
Apr 14 00:08:53 user nova-compute[82479]:       <entry name="version">0.0.0</entry>
Apr 14 00:08:53 user nova-compute[82479]:       <entry name="serial">8feba40a-03c7-4c60-b862-ee14fb8c9b05</entry>
Apr 14 00:08:53 user nova-compute[82479]:       <entry name="uuid">8feba40a-03c7-4c60-b862-ee14fb8c9b05</entry>
Apr 14 00:08:53 user nova-compute[82479]:       <entry name="family">Virtual Machine</entry>
Apr 14 00:08:53 user nova-compute[82479]:     </system>
Apr 14 00:08:53 user nova-compute[82479]:   </sysinfo>
Apr 14 00:08:53 user nova-compute[82479]:   <os>
Apr 14 00:08:53 user nova-compute[82479]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 00:08:53 user nova-compute[82479]:     <boot dev="hd"/>
Apr 14 00:08:53 user nova-compute[82479]:     <smbios mode="sysinfo"/>
Apr 14 00:08:53 user nova-compute[82479]:   </os>
Apr 14 00:08:53 user nova-compute[82479]:   <features>
Apr 14 00:08:53 user nova-compute[82479]:     <acpi/>
Apr 14 00:08:53 user nova-compute[82479]:     <apic/>
Apr 14 00:08:53 user nova-compute[82479]:     <vmcoreinfo/>
Apr 14 00:08:53 user nova-compute[82479]:   </features>
Apr 14 00:08:53 user nova-compute[82479]:   <clock offset="utc">
Apr 14 00:08:53 user nova-compute[82479]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 00:08:53 user nova-compute[82479]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 00:08:53 user nova-compute[82479]:     <timer name="hpet" present="no"/>
Apr 14 00:08:53 user nova-compute[82479]:   </clock>
Apr 14 00:08:53 user nova-compute[82479]:   <cpu mode="custom" match="exact">
Apr 14 00:08:53 user nova-compute[82479]:     <model>Nehalem</model>
Apr 14 00:08:53 user nova-compute[82479]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 00:08:53 user nova-compute[82479]:   </cpu>
Apr 14 00:08:53 user nova-compute[82479]:   <devices>
Apr 14 00:08:53 user nova-compute[82479]:     <disk type="file" device="disk">
Apr 14 00:08:53 user nova-compute[82479]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 00:08:53 user nova-compute[82479]:       <source file="/opt/stack/data/nova/instances/8feba40a-03c7-4c60-b862-ee14fb8c9b05/disk"/>
Apr 14 00:08:53 user nova-compute[82479]:       <target dev="vda" bus="virtio"/>
Apr 14 00:08:53 user nova-compute[82479]:     </disk>
Apr 14 00:08:53 user nova-compute[82479]:     <interface type="ethernet">
Apr 14 00:08:53 user nova-compute[82479]:       <mac address="fa:16:3e:e2:4e:ff"/>
Apr 14 00:08:53 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:08:53 user nova-compute[82479]:       <mtu size="1442"/>
Apr 14 00:08:53 user nova-compute[82479]:       <target dev="tap53562eeb-b1"/>
Apr 14 00:08:53 user nova-compute[82479]:     </interface>
Apr 14 00:08:53 user nova-compute[82479]:     <serial type="pty">
Apr 14 00:08:53 user nova-compute[82479]:       <log file="/opt/stack/data/nova/instances/8feba40a-03c7-4c60-b862-ee14fb8c9b05/console.log" append="off"/>
Apr 14 00:08:53 user nova-compute[82479]:     </serial>
Apr 14 00:08:53 user nova-compute[82479]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 00:08:53 user nova-compute[82479]:     <video>
Apr 14 00:08:53 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:08:53 user nova-compute[82479]:     </video>
Apr 14 00:08:53 user nova-compute[82479]:     <rng model="virtio">
Apr 14 00:08:53 user nova-compute[82479]:       <backend model="random">/dev/urandom</backend>
Apr 14 00:08:53 user nova-compute[82479]:     </rng>
Apr 14 00:08:53 user nova-compute[82479]:     <controller type="usb" index="0" model="none"/>
Apr 14 00:08:53 user nova-compute[82479]:     <memballoon model="virtio">
Apr 14 00:08:53 user nova-compute[82479]:       <stats period="10"/>
Apr 14 00:08:53 user nova-compute[82479]:     </memballoon>
Apr 14 00:08:53 user nova-compute[82479]:   </devices>
Apr 14 00:08:53 user nova-compute[82479]: </domain>
Apr 14 00:08:53 user nova-compute[82479]:  {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 00:08:53 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:08:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1922236850',display_name='tempest-VolumesAdminNegativeTest-server-1922236850',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1922236850',id=14,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAzgAnzYZDrHRSOtHVv/zz9Jq59yqHCgj+XUAspYSe7CuNpSWviw5YD7t1g/w4+Yy6KXGWPMGPWkh09BzPQ7qv26QIE2Xeb9uqZ1VE97Ta+wjygIDmM6CU+6ySBTktY5UA==',key_name='tempest-keypair-1912277882',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dffbe999e60a4add9f23c83f9b0a4252',ramdisk_id='',reservation_id='r-ae2uaapr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1377720460',owner_user_name='tempest-VolumesAdminNegativeTest-1377720460-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:08:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74d7e3d598e74c288e6a44996303b85e',uuid=8feba40a-03c7-4c60-b862-ee14fb8c9b05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53562eeb-b1fd-47f1-896e-cacd277abf24", "address": "fa:16:3e:e2:4e:ff", "network": {"id": "49f71fbc-7d65-4cc6-9efe-3918d5dbd51a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2079147315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dffbe999e60a4add9f23c83f9b0a4252", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53562eeb-b1", "ovs_interfaceid": "53562eeb-b1fd-47f1-896e-cacd277abf24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 00:08:53 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Converting VIF {"id": "53562eeb-b1fd-47f1-896e-cacd277abf24", "address": "fa:16:3e:e2:4e:ff", "network": {"id": "49f71fbc-7d65-4cc6-9efe-3918d5dbd51a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2079147315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dffbe999e60a4add9f23c83f9b0a4252", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53562eeb-b1", "ovs_interfaceid": "53562eeb-b1fd-47f1-896e-cacd277abf24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:08:53 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:4e:ff,bridge_name='br-int',has_traffic_filtering=True,id=53562eeb-b1fd-47f1-896e-cacd277abf24,network=Network(49f71fbc-7d65-4cc6-9efe-3918d5dbd51a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53562eeb-b1') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:08:53 user nova-compute[82479]: DEBUG os_vif [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:4e:ff,bridge_name='br-int',has_traffic_filtering=True,id=53562eeb-b1fd-47f1-896e-cacd277abf24,network=Network(49f71fbc-7d65-4cc6-9efe-3918d5dbd51a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53562eeb-b1') {{(pid=82479) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 00:08:53 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:53 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:08:53 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 00:08:53 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:53 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap53562eeb-b1, may_exist=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:08:53 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap53562eeb-b1, col_values=(('external_ids', {'iface-id': '53562eeb-b1fd-47f1-896e-cacd277abf24', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:4e:ff', 'vm-uuid': '8feba40a-03c7-4c60-b862-ee14fb8c9b05'}),)) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:08:53 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:53 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:08:53 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:08:53 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:08:53 user nova-compute[82479]: DEBUG nova.objects.instance [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lazy-loading 'pci_requests' on Instance uuid 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:08:53 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:53 user nova-compute[82479]: INFO os_vif [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:4e:ff,bridge_name='br-int',has_traffic_filtering=True,id=53562eeb-b1fd-47f1-896e-cacd277abf24,network=Network(49f71fbc-7d65-4cc6-9efe-3918d5dbd51a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53562eeb-b1')
Apr 14 00:08:53 user nova-compute[82479]: DEBUG nova.objects.instance [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lazy-loading 'numa_topology' on Instance uuid 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:08:53 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82479) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 00:08:53 user nova-compute[82479]: INFO nova.compute.claims [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Claim successful on node user
Apr 14 00:08:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/848691fef127d924018cc71228374edf26f59158.part /opt/stack/data/nova/instances/_base/848691fef127d924018cc71228374edf26f59158.converted" returned: 0 in 0.178s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/848691fef127d924018cc71228374edf26f59158.converted --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] No VIF found with MAC fa:16:3e:e2:4e:ff, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/848691fef127d924018cc71228374edf26f59158.converted --force-share --output=json" returned: 0 in 0.159s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "848691fef127d924018cc71228374edf26f59158" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.349s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Acquiring lock "848691fef127d924018cc71228374edf26f59158" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "848691fef127d924018cc71228374edf26f59158" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/848691fef127d924018cc71228374edf26f59158 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/848691fef127d924018cc71228374edf26f59158 --force-share --output=json" returned: 0 in 0.142s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/848691fef127d924018cc71228374edf26f59158,backing_fmt=raw /opt/stack/data/nova/instances/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97/disk.rescue {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/848691fef127d924018cc71228374edf26f59158,backing_fmt=raw /opt/stack/data/nova/instances/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97/disk.rescue" returned: 0 in 0.054s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "848691fef127d924018cc71228374edf26f59158" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG nova.objects.instance [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lazy-loading 'migration_context' on Instance uuid 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Created local disks {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Start _get_guest_xml network_info=[{"id": "4085de4c-cb9e-452b-9504-b7c7f8621213", "address": "fa:16:3e:2b:ab:7d", "network": {"id": "10c34d1a-edc4-4b0c-96a7-b29a7c292e74", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-573422654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-573422654-network", "vif_mac": "fa:16:3e:2b:ab:7d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931198e56de4cf08db59bcc40f2a260", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4085de4c-cb", "ovs_interfaceid": "4085de4c-cb9e-452b-9504-b7c7f8621213", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'b55f3d04-4ac0-4525-8efe-35fed088afe1', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': None, 'device_type': 'disk', 'delete_on_termination': False, 'attachment_id': '679e00ff-1e9f-4d7a-83d1-85056920732d', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iVbjylRT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '3a6b9f89-e462-47d8-84a1-0ac4ade3ab97', 'attached_at': '', 'detached_at': '', 'volume_id': '028eff5c-aa61-4243-985e-5210aedff04a', 'serial': '028eff5c-aa61-4243-985e-5210aedff04a'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG nova.objects.instance [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lazy-loading 'resources' on Instance uuid 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG nova.objects.instance [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lazy-loading 'numa_topology' on Instance uuid 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG nova.compute.manager [req-be0e5210-1960-49c4-9715-e8ee66f7bb24 req-1244a3a5-994d-4879-a130-966e0f44c294 service nova] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Received event network-vif-plugged-4085de4c-cb9e-452b-9504-b7c7f8621213 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-be0e5210-1960-49c4-9715-e8ee66f7bb24 req-1244a3a5-994d-4879-a130-966e0f44c294 service nova] Acquiring lock "3a6b9f89-e462-47d8-84a1-0ac4ade3ab97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-be0e5210-1960-49c4-9715-e8ee66f7bb24 req-1244a3a5-994d-4879-a130-966e0f44c294 service nova] Lock "3a6b9f89-e462-47d8-84a1-0ac4ade3ab97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-be0e5210-1960-49c4-9715-e8ee66f7bb24 req-1244a3a5-994d-4879-a130-966e0f44c294 service nova] Lock "3a6b9f89-e462-47d8-84a1-0ac4ade3ab97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG nova.compute.manager [req-be0e5210-1960-49c4-9715-e8ee66f7bb24 req-1244a3a5-994d-4879-a130-966e0f44c294 service nova] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] No waiting events found dispatching network-vif-plugged-4085de4c-cb9e-452b-9504-b7c7f8621213 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:08:54 user nova-compute[82479]: WARNING nova.compute.manager [req-be0e5210-1960-49c4-9715-e8ee66f7bb24 req-1244a3a5-994d-4879-a130-966e0f44c294 service nova] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Received unexpected event network-vif-plugged-4085de4c-cb9e-452b-9504-b7c7f8621213 for instance with vm_state active and task_state rescuing.
Apr 14 00:08:54 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:08:54 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:08:54 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82479) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T00:02:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Flavor limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Image limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Flavor pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Image pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Got 1 possible topologies {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG nova.objects.instance [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG nova.network.neutron [req-31a4fd4c-d4eb-46bd-a9dd-bb6e887af761 req-90e383e3-5542-439c-ac27-e50672f06266 service nova] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Updated VIF entry in instance network info cache for port 53562eeb-b1fd-47f1-896e-cacd277abf24. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG nova.network.neutron [req-31a4fd4c-d4eb-46bd-a9dd-bb6e887af761 req-90e383e3-5542-439c-ac27-e50672f06266 service nova] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Updating instance_info_cache with network_info: [{"id": "53562eeb-b1fd-47f1-896e-cacd277abf24", "address": "fa:16:3e:e2:4e:ff", "network": {"id": "49f71fbc-7d65-4cc6-9efe-3918d5dbd51a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2079147315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dffbe999e60a4add9f23c83f9b0a4252", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53562eeb-b1", "ovs_interfaceid": "53562eeb-b1fd-47f1-896e-cacd277abf24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-31a4fd4c-d4eb-46bd-a9dd-bb6e887af761 req-90e383e3-5542-439c-ac27-e50672f06266 service nova] Releasing lock "refresh_cache-8feba40a-03c7-4c60-b862-ee14fb8c9b05" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Calling os-brick to attach iSCSI Volume {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iVbjylRT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:08:54 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:08:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:08:54 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:08:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:08:54 user nova-compute[82479]: INFO os_brick.initiator.connectors.iscsi [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 00:08:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a -p 172.16.0.220:3260 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a322137-3845-47be-a3c3-902c3ba0c1f3]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = iVbjylRT\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 14 00:08:54 user nova-compute[82479]: node.name = iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a
Apr 14 00:08:54 user nova-compute[82479]: node.tpgt = -1
Apr 14 00:08:54 user nova-compute[82479]: node.startup = automatic
Apr 14 00:08:54 user nova-compute[82479]: node.leading_login = No
Apr 14 00:08:54 user nova-compute[82479]: iface.iscsi_ifacename = default
Apr 14 00:08:54 user nova-compute[82479]: iface.net_ifacename = <empty>
Apr 14 00:08:54 user nova-compute[82479]: iface.ipaddress = <empty>
Apr 14 00:08:54 user nova-compute[82479]: iface.prefix_len = 0
Apr 14 00:08:54 user nova-compute[82479]: iface.hwaddress = <empty>
Apr 14 00:08:54 user nova-compute[82479]: iface.transport_name = tcp
Apr 14 00:08:54 user nova-compute[82479]: iface.initiatorname = <empty>
Apr 14 00:08:54 user nova-compute[82479]: iface.state = <empty>
Apr 14 00:08:54 user nova-compute[82479]: iface.vlan_id = 0
Apr 14 00:08:54 user nova-compute[82479]: iface.vlan_priority = 0
Apr 14 00:08:54 user nova-compute[82479]: iface.vlan_state = <empty>
Apr 14 00:08:54 user nova-compute[82479]: iface.iface_num = 0
Apr 14 00:08:54 user nova-compute[82479]: iface.mtu = 0
Apr 14 00:08:54 user nova-compute[82479]: iface.port = 0
Apr 14 00:08:54 user nova-compute[82479]: iface.bootproto = <empty>
Apr 14 00:08:54 user nova-compute[82479]: iface.subnet_mask = <empty>
Apr 14 00:08:54 user nova-compute[82479]: iface.gateway = <empty>
Apr 14 00:08:54 user nova-compute[82479]: iface.dhcp_alt_client_id_state = <empty>
Apr 14 00:08:54 user nova-compute[82479]: iface.dhcp_alt_client_id = <empty>
Apr 14 00:08:54 user nova-compute[82479]: iface.dhcp_dns = <empty>
Apr 14 00:08:54 user nova-compute[82479]: iface.dhcp_learn_iqn = <empty>
Apr 14 00:08:54 user nova-compute[82479]: iface.dhcp_req_vendor_id_state = <empty>
Apr 14 00:08:54 user nova-compute[82479]: iface.dhcp_vendor_id_state = <empty>
Apr 14 00:08:54 user nova-compute[82479]: iface.dhcp_vendor_id = <empty>
Apr 14 00:08:54 user nova-compute[82479]: iface.dhcp_slp_da = <empty>
Apr 14 00:08:54 user nova-compute[82479]: iface.fragmentation = <empty>
Apr 14 00:08:54 user nova-compute[82479]: iface.gratuitous_arp = <empty>
Apr 14 00:08:54 user nova-compute[82479]: iface.incoming_forwarding = <empty>
Apr 14 00:08:54 user nova-compute[82479]: iface.tos_state = <empty>
Apr 14 00:08:54 user nova-compute[82479]: iface.tos = 0
Apr 14 00:08:54 user nova-compute[82479]: iface.ttl = 0
Apr 14 00:08:54 user nova-compute[82479]: iface.delayed_ack = <empty>
Apr 14 00:08:54 user nova-compute[82479]: iface.tcp_nagle = <empty>
Apr 14 00:08:54 user nova-compute[82479]: iface.tcp_wsf_state = <empty>
Apr 14 00:08:54 user nova-compute[82479]: iface.tcp_wsf = 0
Apr 14 00:08:54 user nova-compute[82479]: iface.tcp_timer_scale = 0
Apr 14 00:08:54 user nova-compute[82479]: iface.tcp_timestamp = <empty>
Apr 14 00:08:54 user nova-compute[82479]: iface.redirect = <empty>
Apr 14 00:08:54 user nova-compute[82479]: iface.def_task_mgmt_timeout = 0
Apr 14 00:08:54 user nova-compute[82479]: iface.header_digest = <empty>
Apr 14 00:08:54 user nova-compute[82479]: iface.data_digest = <empty>
Apr 14 00:08:54 user nova-compute[82479]: iface.immediate_data = <empty>
Apr 14 00:08:54 user nova-compute[82479]: iface.initial_r2t = <empty>
Apr 14 00:08:54 user nova-compute[82479]: iface.data_seq_inorder = <empty>
Apr 14 00:08:54 user nova-compute[82479]: iface.data_pdu_inorder = <empty>
Apr 14 00:08:54 user nova-compute[82479]: iface.erl = 0
Apr 14 00:08:54 user nova-compute[82479]: iface.max_receive_data_len = 0
Apr 14 00:08:54 user nova-compute[82479]: iface.first_burst_len = 0
Apr 14 00:08:54 user nova-compute[82479]: iface.max_outstanding_r2t = 0
Apr 14 00:08:54 user nova-compute[82479]: iface.max_burst_len = 0
Apr 14 00:08:54 user nova-compute[82479]: iface.chap_auth = <empty>
Apr 14 00:08:54 user nova-compute[82479]: iface.bidi_chap = <empty>
Apr 14 00:08:54 user nova-compute[82479]: iface.strict_login_compliance = <empty>
Apr 14 00:08:54 user nova-compute[82479]: iface.discovery_auth = <empty>
Apr 14 00:08:54 user nova-compute[82479]: iface.discovery_logout = <empty>
Apr 14 00:08:54 user nova-compute[82479]: node.discovery_address = <empty>
Apr 14 00:08:54 user nova-compute[82479]: node.discovery_port = 0
Apr 14 00:08:54 user nova-compute[82479]: node.discovery_type = static
Apr 14 00:08:54 user nova-compute[82479]: node.session.initial_cmdsn = 0
Apr 14 00:08:54 user nova-compute[82479]: node.session.initial_login_retry_max = 8
Apr 14 00:08:54 user nova-compute[82479]: node.session.xmit_thread_priority = -20
Apr 14 00:08:54 user nova-compute[82479]: node.session.cmds_max = 128
Apr 14 00:08:54 user nova-compute[82479]: node.session.queue_depth = 32
Apr 14 00:08:54 user nova-compute[82479]: node.session.nr_sessions = 1
Apr 14 00:08:54 user nova-compute[82479]: node.session.auth.authmethod = CHAP
Apr 14 00:08:54 user nova-compute[82479]: node.session.auth.username = iVbjylRT
Apr 14 00:08:54 user nova-compute[82479]: node.session.auth.password = ***
Apr 14 00:08:54 user nova-compute[82479]: node.session.auth.username_in = <empty>
Apr 14 00:08:54 user nova-compute[82479]: node.session.auth.password_in = <empty>
Apr 14 00:08:54 user nova-compute[82479]: node.session.auth.chap_algs = MD5
Apr 14 00:08:54 user nova-compute[82479]: node.session.timeo.replacement_timeout = 120
Apr 14 00:08:54 user nova-compute[82479]: node.session.err_timeo.abort_timeout = 15
Apr 14 00:08:54 user nova-compute[82479]: node.session.err_timeo.lu_reset_timeout = 30
Apr 14 00:08:54 user nova-compute[82479]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 14 00:08:54 user nova-compute[82479]: node.session.err_timeo.host_reset_timeout = 60
Apr 14 00:08:54 user nova-compute[82479]: node.session.iscsi.FastAbort = Yes
Apr 14 00:08:54 user nova-compute[82479]: node.session.iscsi.InitialR2T = No
Apr 14 00:08:54 user nova-compute[82479]: node.session.iscsi.ImmediateData = Yes
Apr 14 00:08:54 user nova-compute[82479]: node.session.iscsi.FirstBurstLength = 262144
Apr 14 00:08:54 user nova-compute[82479]: node.session.iscsi.MaxBurstLength = 16776192
Apr 14 00:08:54 user nova-compute[82479]: node.session.iscsi.DefaultTime2Retain = 0
Apr 14 00:08:54 user nova-compute[82479]: node.session.iscsi.DefaultTime2Wait = 2
Apr 14 00:08:54 user nova-compute[82479]: node.session.iscsi.MaxConnections = 1
Apr 14 00:08:54 user nova-compute[82479]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 14 00:08:54 user nova-compute[82479]: node.session.iscsi.ERL = 0
Apr 14 00:08:54 user nova-compute[82479]: node.session.scan = manual
Apr 14 00:08:54 user nova-compute[82479]: node.session.reopen_max = 0
Apr 14 00:08:54 user nova-compute[82479]: node.conn[0].address = 172.16.0.220
Apr 14 00:08:54 user nova-compute[82479]: node.conn[0].port = 3260
Apr 14 00:08:54 user nova-compute[82479]: node.conn[0].startup = manual
Apr 14 00:08:54 user nova-compute[82479]: node.conn[0].tcp.window_size = 524288
Apr 14 00:08:54 user nova-compute[82479]: node.conn[0].tcp.type_of_service = 0
Apr 14 00:08:54 user nova-compute[82479]: node.conn[0].timeo.logout_timeout = 15
Apr 14 00:08:54 user nova-compute[82479]: node.conn[0].timeo.login_timeout = 15
Apr 14 00:08:54 user nova-compute[82479]: node.conn[0].timeo.auth_timeout = 45
Apr 14 00:08:54 user nova-compute[82479]: node.conn[0].timeo.noop_out_interval = 5
Apr 14 00:08:54 user nova-compute[82479]: node.conn[0].timeo.noop_out_timeout = 5
Apr 14 00:08:54 user nova-compute[82479]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 14 00:08:54 user nova-compute[82479]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 14 00:08:54 user nova-compute[82479]: node.conn[0].iscsi.HeaderDigest = None
Apr 14 00:08:54 user nova-compute[82479]: node.conn[0].iscsi.DataDigest = None
Apr 14 00:08:54 user nova-compute[82479]: node.conn[0].iscsi.IFMarker = No
Apr 14 00:08:54 user nova-compute[82479]: node.conn[0].iscsi.OFMarker = No
Apr 14 00:08:54 user nova-compute[82479]: # END RECORD
Apr 14 00:08:54 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[f796088d-923a-400a-b74f-afa1fe1f6569]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[20cc3a23-a4cc-40f5-9e1d-3c4b32ab3312]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iVbjylRT {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG nova.network.neutron [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Updating instance_info_cache with network_info: [{"id": "b5dfa187-0a42-4319-990f-1d3b22691c27", "address": "fa:16:3e:7b:38:3d", "network": {"id": "368d9445-850e-4f74-b5cc-86d1eaa95d63", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374332689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec1aab0338ff4bd195a37a4199a378eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5dfa187-0a", "ovs_interfaceid": "b5dfa187-0a42-4319-990f-1d3b22691c27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iVbjylRT" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94c4d67-4f02-4303-a388-b826ac5006b8]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iVbjylRT'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.748s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Releasing lock "refresh_cache-01a65362-36ea-4817-8e83-f75d6daf808b" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f43743-a805-4d22-9e19-dfe4a8fd4813]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c24ea4d-4b1b-474a-9f31-0c8be2e80e25]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)
Apr 14 00:08:54 user nova-compute[82479]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:08:54 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)
Apr 14 00:08:54 user nova-compute[82479]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:08:54 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.152s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Connected to 172.16.0.220:3260 {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] HCTL ('33', '0', '0', 0) found on session 11 with lun 0 {{(pid=82479) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=82479) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:54 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Instance destroyed successfully.
Apr 14 00:08:54 user nova-compute[82479]: DEBUG nova.objects.instance [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lazy-loading 'resources' on Instance uuid 01a65362-36ea-4817-8e83-f75d6daf808b {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec2521b-95ec-408d-91e6-8f536220a78a]: (4, ('0 0 0', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Searching for a device in session 11 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=82479) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iVbjylRT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.178s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] <== connect_volume: return (179ms) {'type': 'block', 'scsi_wwn': '23931393631306436', 'path': '/dev/sdb'} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23931393631306436', 'path': '/dev/sdb'} {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:04:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-874047723',display_name='tempest-AttachVolumeTestJSON-server-874047723',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-874047723',id=5,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFj5BOE0cuvlxZawRQVfnfugrJsq+vAMk/RiiLDSf3KCRmtu0WTqB0nwANMnYIuDZO4AsUPttsoe/j3WMHFiNDVdBMIPFOCGE/kkjYyw9NwqNVOKFmKjVIZ3x8l2xusRtg==',key_name='tempest-keypair-608426082',keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:05:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='ec1aab0338ff4bd195a37a4199a378eb',ramdisk_id='',reservation_id='r-n5aqf0fe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1885059489',owner_user_name='tempest-AttachVolumeTestJSON-1885059489-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T00:07:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44530987616b417d87ce5909d8de1871',uuid=01a65362-36ea-4817-8e83-f75d6daf808b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "b5dfa187-0a42-4319-990f-1d3b22691c27", "address": "fa:16:3e:7b:38:3d", "network": {"id": "368d9445-850e-4f74-b5cc-86d1eaa95d63", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374332689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec1aab0338ff4bd195a37a4199a378eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5dfa187-0a", "ovs_interfaceid": "b5dfa187-0a42-4319-990f-1d3b22691c27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Converting VIF {"id": "b5dfa187-0a42-4319-990f-1d3b22691c27", "address": "fa:16:3e:7b:38:3d", "network": {"id": "368d9445-850e-4f74-b5cc-86d1eaa95d63", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374332689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec1aab0338ff4bd195a37a4199a378eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5dfa187-0a", "ovs_interfaceid": "b5dfa187-0a42-4319-990f-1d3b22691c27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:38:3d,bridge_name='br-int',has_traffic_filtering=True,id=b5dfa187-0a42-4319-990f-1d3b22691c27,network=Network(368d9445-850e-4f74-b5cc-86d1eaa95d63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5dfa187-0a') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG os_vif [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:38:3d,bridge_name='br-int',has_traffic_filtering=True,id=b5dfa187-0a42-4319-990f-1d3b22691c27,network=Network(368d9445-850e-4f74-b5cc-86d1eaa95d63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5dfa187-0a') {{(pid=82479) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 00:08:54 user nova-compute[82479]: INFO nova.network.neutron [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Updating port 1b166f8e-a207-48d3-a0a9-2ad6c44774b2 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb5dfa187-0a, bridge=br-int, if_exists=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:54 user nova-compute[82479]: INFO os_vif [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:38:3d,bridge_name='br-int',has_traffic_filtering=True,id=b5dfa187-0a42-4319-990f-1d3b22691c27,network=Network(368d9445-850e-4f74-b5cc-86d1eaa95d63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5dfa187-0a')
Apr 14 00:08:54 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] calling os-brick to detach iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, {'target_iqn': 'iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'npILkxwF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:08:54 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:08:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:04:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1358925619',display_name='tempest-ServerStableDeviceRescueTest-server-1358925619',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1358925619',id=3,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZuJ+sB897ViN2VTH0JXlcH9ndfvRNhk01+KgyuP9jwhkZ5ef42HmlxNSsq22e8Y5akz0iE7TkYd8Z+WgwsB4uFLI7jFktxjc9ufhBjq2ACCm1woK6wgYMrlECKBNQ8fA==',key_name='tempest-keypair-1540032684',keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:05:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c931198e56de4cf08db59bcc40f2a260',ramdisk_id='',reservation_id='r-g35xdtri',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-481368698',owner_user_name='tempest-ServerStableDeviceRescueTest-481368698-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:06:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97374cd3cdc448cd8710561d44756ead',uuid=3a6b9f89-e462-47d8-84a1-0ac4ade3ab97,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4085de4c-cb9e-452b-9504-b7c7f8621213", "address": "fa:16:3e:2b:ab:7d", "network": {"id": "10c34d1a-edc4-4b0c-96a7-b29a7c292e74", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-573422654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-573422654-network", "vif_mac": "fa:16:3e:2b:ab:7d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931198e56de4cf08db59bcc40f2a260", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4085de4c-cb", "ovs_interfaceid": "4085de4c-cb9e-452b-9504-b7c7f8621213", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82479) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Converting VIF {"id": "4085de4c-cb9e-452b-9504-b7c7f8621213", "address": "fa:16:3e:2b:ab:7d", "network": {"id": "10c34d1a-edc4-4b0c-96a7-b29a7c292e74", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-573422654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-573422654-network", "vif_mac": "fa:16:3e:2b:ab:7d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931198e56de4cf08db59bcc40f2a260", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4085de4c-cb", "ovs_interfaceid": "4085de4c-cb9e-452b-9504-b7c7f8621213", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2b:ab:7d,bridge_name='br-int',has_traffic_filtering=True,id=4085de4c-cb9e-452b-9504-b7c7f8621213,network=Network(10c34d1a-edc4-4b0c-96a7-b29a7c292e74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4085de4c-cb') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG nova.objects.instance [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lazy-loading 'pci_devices' on Instance uuid 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] End _get_guest_xml xml=<domain type="kvm">
Apr 14 00:08:54 user nova-compute[82479]:   <uuid>3a6b9f89-e462-47d8-84a1-0ac4ade3ab97</uuid>
Apr 14 00:08:54 user nova-compute[82479]:   <name>instance-00000003</name>
Apr 14 00:08:54 user nova-compute[82479]:   <memory>131072</memory>
Apr 14 00:08:54 user nova-compute[82479]:   <vcpu>1</vcpu>
Apr 14 00:08:54 user nova-compute[82479]:   <metadata>
Apr 14 00:08:54 user nova-compute[82479]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 00:08:54 user nova-compute[82479]:       <nova:package version="0.0.0"/>
Apr 14 00:08:54 user nova-compute[82479]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1358925619</nova:name>
Apr 14 00:08:54 user nova-compute[82479]:       <nova:creationTime>2023-04-14 00:08:54</nova:creationTime>
Apr 14 00:08:54 user nova-compute[82479]:       <nova:flavor name="m1.nano">
Apr 14 00:08:54 user nova-compute[82479]:         <nova:memory>128</nova:memory>
Apr 14 00:08:54 user nova-compute[82479]:         <nova:disk>1</nova:disk>
Apr 14 00:08:54 user nova-compute[82479]:         <nova:swap>0</nova:swap>
Apr 14 00:08:54 user nova-compute[82479]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 00:08:54 user nova-compute[82479]:         <nova:vcpus>1</nova:vcpus>
Apr 14 00:08:54 user nova-compute[82479]:       </nova:flavor>
Apr 14 00:08:54 user nova-compute[82479]:       <nova:owner>
Apr 14 00:08:54 user nova-compute[82479]:         <nova:user uuid="97374cd3cdc448cd8710561d44756ead">tempest-ServerStableDeviceRescueTest-481368698-project-member</nova:user>
Apr 14 00:08:54 user nova-compute[82479]:         <nova:project uuid="c931198e56de4cf08db59bcc40f2a260">tempest-ServerStableDeviceRescueTest-481368698</nova:project>
Apr 14 00:08:54 user nova-compute[82479]:       </nova:owner>
Apr 14 00:08:54 user nova-compute[82479]:       <nova:root type="image" uuid="6db62068-7278-4cd8-b41f-d0140d89e199"/>
Apr 14 00:08:54 user nova-compute[82479]:       <nova:ports>
Apr 14 00:08:54 user nova-compute[82479]:         <nova:port uuid="4085de4c-cb9e-452b-9504-b7c7f8621213">
Apr 14 00:08:54 user nova-compute[82479]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 00:08:54 user nova-compute[82479]:         </nova:port>
Apr 14 00:08:54 user nova-compute[82479]:       </nova:ports>
Apr 14 00:08:54 user nova-compute[82479]:     </nova:instance>
Apr 14 00:08:54 user nova-compute[82479]:   </metadata>
Apr 14 00:08:54 user nova-compute[82479]:   <sysinfo type="smbios">
Apr 14 00:08:54 user nova-compute[82479]:     <system>
Apr 14 00:08:54 user nova-compute[82479]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 00:08:54 user nova-compute[82479]:       <entry name="product">OpenStack Nova</entry>
Apr 14 00:08:54 user nova-compute[82479]:       <entry name="version">0.0.0</entry>
Apr 14 00:08:54 user nova-compute[82479]:       <entry name="serial">3a6b9f89-e462-47d8-84a1-0ac4ade3ab97</entry>
Apr 14 00:08:54 user nova-compute[82479]:       <entry name="uuid">3a6b9f89-e462-47d8-84a1-0ac4ade3ab97</entry>
Apr 14 00:08:54 user nova-compute[82479]:       <entry name="family">Virtual Machine</entry>
Apr 14 00:08:54 user nova-compute[82479]:     </system>
Apr 14 00:08:54 user nova-compute[82479]:   </sysinfo>
Apr 14 00:08:54 user nova-compute[82479]:   <os>
Apr 14 00:08:54 user nova-compute[82479]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 00:08:54 user nova-compute[82479]:     <smbios mode="sysinfo"/>
Apr 14 00:08:54 user nova-compute[82479]:   </os>
Apr 14 00:08:54 user nova-compute[82479]:   <features>
Apr 14 00:08:54 user nova-compute[82479]:     <acpi/>
Apr 14 00:08:54 user nova-compute[82479]:     <apic/>
Apr 14 00:08:54 user nova-compute[82479]:     <vmcoreinfo/>
Apr 14 00:08:54 user nova-compute[82479]:   </features>
Apr 14 00:08:54 user nova-compute[82479]:   <clock offset="utc">
Apr 14 00:08:54 user nova-compute[82479]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 00:08:54 user nova-compute[82479]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 00:08:54 user nova-compute[82479]:     <timer name="hpet" present="no"/>
Apr 14 00:08:54 user nova-compute[82479]:   </clock>
Apr 14 00:08:54 user nova-compute[82479]:   <cpu mode="custom" match="exact">
Apr 14 00:08:54 user nova-compute[82479]:     <model>Nehalem</model>
Apr 14 00:08:54 user nova-compute[82479]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 00:08:54 user nova-compute[82479]:   </cpu>
Apr 14 00:08:54 user nova-compute[82479]:   <devices>
Apr 14 00:08:54 user nova-compute[82479]:     <disk type="file" device="disk">
Apr 14 00:08:54 user nova-compute[82479]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 00:08:54 user nova-compute[82479]:       <source file="/opt/stack/data/nova/instances/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97/disk"/>
Apr 14 00:08:54 user nova-compute[82479]:       <target dev="vda" bus="virtio"/>
Apr 14 00:08:54 user nova-compute[82479]:     </disk>
Apr 14 00:08:54 user nova-compute[82479]:     <disk type="block" device="disk">
Apr 14 00:08:54 user nova-compute[82479]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:08:54 user nova-compute[82479]:       <source dev="/dev/sdb"/>
Apr 14 00:08:54 user nova-compute[82479]:       <target dev="vdb" bus="virtio"/>
Apr 14 00:08:54 user nova-compute[82479]:       <serial>028eff5c-aa61-4243-985e-5210aedff04a</serial>
Apr 14 00:08:54 user nova-compute[82479]:     </disk>
Apr 14 00:08:54 user nova-compute[82479]:     <disk type="file" device="disk">
Apr 14 00:08:54 user nova-compute[82479]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 00:08:54 user nova-compute[82479]:       <source file="/opt/stack/data/nova/instances/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97/disk.rescue"/>
Apr 14 00:08:54 user nova-compute[82479]:       <target dev="vdc" bus="virtio"/>
Apr 14 00:08:54 user nova-compute[82479]:       <boot order="1"/>
Apr 14 00:08:54 user nova-compute[82479]:     </disk>
Apr 14 00:08:54 user nova-compute[82479]:     <interface type="ethernet">
Apr 14 00:08:54 user nova-compute[82479]:       <mac address="fa:16:3e:2b:ab:7d"/>
Apr 14 00:08:54 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:08:54 user nova-compute[82479]:       <mtu size="1442"/>
Apr 14 00:08:54 user nova-compute[82479]:       <target dev="tap4085de4c-cb"/>
Apr 14 00:08:54 user nova-compute[82479]:     </interface>
Apr 14 00:08:54 user nova-compute[82479]:     <serial type="pty">
Apr 14 00:08:54 user nova-compute[82479]:       <log file="/opt/stack/data/nova/instances/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97/console.log" append="off"/>
Apr 14 00:08:54 user nova-compute[82479]:     </serial>
Apr 14 00:08:54 user nova-compute[82479]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 00:08:54 user nova-compute[82479]:     <video>
Apr 14 00:08:54 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:08:54 user nova-compute[82479]:     </video>
Apr 14 00:08:54 user nova-compute[82479]:     <rng model="virtio">
Apr 14 00:08:54 user nova-compute[82479]:       <backend model="random">/dev/urandom</backend>
Apr 14 00:08:54 user nova-compute[82479]:     </rng>
Apr 14 00:08:54 user nova-compute[82479]:     <controller type="usb" index="0" model="none"/>
Apr 14 00:08:54 user nova-compute[82479]:     <memballoon model="virtio">
Apr 14 00:08:54 user nova-compute[82479]:       <stats period="10"/>
Apr 14 00:08:54 user nova-compute[82479]:     </memballoon>
Apr 14 00:08:54 user nova-compute[82479]:   </devices>
Apr 14 00:08:54 user nova-compute[82479]: </domain>
Apr 14 00:08:54 user nova-compute[82479]:  {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba90f77b-5fff-421e-935c-38655a19d3c8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 00:08:54 user nova-compute[82479]: No targets found.
Apr 14 00:08:54 user nova-compute[82479]: iSNS:
Apr 14 00:08:54 user nova-compute[82479]: No targets found.
Apr 14 00:08:54 user nova-compute[82479]: STATIC:
Apr 14 00:08:54 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7
Apr 14 00:08:54 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:08:54 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:08:54 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a
Apr 14 00:08:54 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:08:54 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:08:54 user nova-compute[82479]: FIRMWARE:
Apr 14 00:08:54 user nova-compute[82479]: No targets found.
Apr 14 00:08:54 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 00:08:54 user nova-compute[82479]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 00:08:54 user nova-compute[82479]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82479) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7', 0)] {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:54 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Instance destroyed successfully.
Apr 14 00:08:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ca98ce-bda9-4f6a-93cf-4f79d9e452b3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e6c373b-6779-47f1-a6a1-24aba80d021d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)
Apr 14 00:08:54 user nova-compute[82479]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:08:54 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)
Apr 14 00:08:54 user nova-compute[82479]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:08:54 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3344c79bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7'): ({'sdc'}, set())}) {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Removing single pathed devices sdc {{(pid=82479) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] No BDM found with device name vdc, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] No VIF found with MAC fa:16:3e:2b:ab:7d, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d1336b7-22c3-4598-a5b7-ae725fdae9f9]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a53e831-a3f5-4124-b9fa-ce15958d0c7f]: (4, ('ok\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Flushing IO for device /dev/sdc {{(pid=82479) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG nova.compute.manager [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Start spawning the instance on the hypervisor. {{(pid=82479) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Creating instance directory {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 00:08:54 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Creating image(s)
Apr 14 00:08:54 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Did not create local disks {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Ensure instance console log exists: /opt/stack/data/nova/instances/17c6c147-fb62-4204-a416-792b94d3f7dd/console.log {{(pid=82479) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Start _get_guest_xml network_info=[{"id": "102987de-d5e4-4ccd-b4fd-7ca7c131e379", "address": "fa:16:3e:23:dd:a5", "network": {"id": "491696ea-38ef-4c19-9d94-a61223c1fa00", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1323121698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3f111e24414976beddba7ef90c4793", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap102987de-d5", "ovs_interfaceid": "102987de-d5e4-4ccd-b4fd-7ca7c131e379", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': False, 'attachment_id': 'c83af900-31a1-488d-a8b4-ff896990a329', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DXAVYghe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '17c6c147-fb62-4204-a416-792b94d3f7dd', 'attached_at': '', 'detached_at': '', 'volume_id': 'c3cfdf84-a3e1-41e3-85ec-481f5ba478cc', 'serial': 'c3cfdf84-a3e1-41e3-85ec-481f5ba478cc'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba6991d-17e9-468c-b208-d056f1f6a3e3]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=82479) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:54 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:08:54 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:08:54 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82479) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T00:02:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Flavor limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Image limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Flavor pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Image pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Got 1 possible topologies {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Calling os-brick to attach iSCSI Volume {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DXAVYghe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:08:54 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:08:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.034s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0151ad8-2b64-4826-9755-211108e3f7d6]: (4, ('1', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] SCSI volumes sdc have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7')] {{(pid=82479) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 00:08:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f352ac-18a4-4b71-9847-114f5f87ea39]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 -p 172.16.0.220:3260 --logout {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e1c5435-8afa-44e7-8590-3002c1af4a42]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7, portal: 172.16.0.220,3260]
Apr 14 00:08:55 user nova-compute[82479]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7, portal: 172.16.0.220,3260] successful.
Apr 14 00:08:55 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 -p 172.16.0.220:3260 --op delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd9aeaf-973f-427c-9633-59d156152c98]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] <== disconnect_volume: return (320ms) None {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Disconnected iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.115s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:08:55 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:08:55 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:08:55 user nova-compute[82479]: INFO os_brick.initiator.connectors.iscsi [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 00:08:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc -p 172.16.0.220:3260 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Start _get_guest_xml network_info=[{"id": "b5dfa187-0a42-4319-990f-1d3b22691c27", "address": "fa:16:3e:7b:38:3d", "network": {"id": "368d9445-850e-4f74-b5cc-86d1eaa95d63", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374332689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec1aab0338ff4bd195a37a4199a378eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5dfa187-0a", "ovs_interfaceid": "b5dfa187-0a42-4319-990f-1d3b22691c27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': None, 'device_type': 'disk', 'delete_on_termination': False, 'attachment_id': '3ee3e773-1a7c-47ce-b628-8897d5895513', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'npILkxwF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '01a65362-36ea-4817-8e83-f75d6daf808b', 'attached_at': '', 'detached_at': '', 'volume_id': '5021c122-fea0-4125-8b1f-c1ab3c4de5e7', 'serial': '5021c122-fea0-4125-8b1f-c1ab3c4de5e7'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG nova.objects.instance [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lazy-loading 'numa_topology' on Instance uuid 01a65362-36ea-4817-8e83-f75d6daf808b {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aae985f-4d92-4a98-9216-64fd872df4fe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 00:08:55 user nova-compute[82479]:  {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc -p 172.16.0.220:3260 --interface default --op new {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:55 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:08:55 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:08:55 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82479) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T00:02:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Flavor limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Image limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Flavor pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Image pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Got 1 possible topologies {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG nova.objects.instance [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lazy-loading 'vcpu_model' on Instance uuid 01a65362-36ea-4817-8e83-f75d6daf808b {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d0d645-0112-486a-8c32-88610ef614d9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc] added\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc] added
Apr 14 00:08:55 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Calling os-brick to attach iSCSI Volume {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'npILkxwF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:08:55 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:08:55 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96437d9-0fba-4f53-b109-9fff130b9cfa]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f2af8f-f979-497e-b222-84394161dad7]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DXAVYghe {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DXAVYghe" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b2afe5-1ac1-4fce-a34e-0cf22f586b07]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DXAVYghe'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38e9ba6-c0a2-4d4c-85b6-c410bb24a9c7]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fbbfaf6-485e-4058-a508-4a39828dc089]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)
Apr 14 00:08:55 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)
Apr 14 00:08:55 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc -p 172.16.0.220:3260 --login {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf536df-eb4f-4345-9df3-a19eb5bfb255]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc, portal: 172.16.0.220,3260]
Apr 14 00:08:55 user nova-compute[82479]: Login to [iface: default, target: iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc, portal: 172.16.0.220,3260] successful.
Apr 14 00:08:55 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef945a5e-6a64-4ae1-99bf-7e4c80177284]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[681299ca-f9fd-43f8-a9b5-b3d001885482]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)
Apr 14 00:08:55 user nova-compute[82479]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:08:55 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)
Apr 14 00:08:55 user nova-compute[82479]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:08:55 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Connected to 172.16.0.220:3260 {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] HCTL ('34', '-', '-', 0) found on session 12 with lun 0 {{(pid=82479) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=82479) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05bc48a-ab85-4fa5-8b25-562c8b771345]: (4, ('- - 0', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Searching for a device in session 12 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=82479) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DXAVYghe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "refresh_cache-1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquired lock "refresh_cache-1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG nova.network.neutron [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG nova.compute.manager [req-b2a4e554-8e5c-4875-b99a-ea6e61d89139 req-994d7188-eebf-4c8f-8b4c-2dc69a61adaf service nova] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Received event network-changed-1b166f8e-a207-48d3-a0a9-2ad6c44774b2 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG nova.compute.manager [req-b2a4e554-8e5c-4875-b99a-ea6e61d89139 req-994d7188-eebf-4c8f-8b4c-2dc69a61adaf service nova] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Refreshing instance network info cache due to event network-changed-1b166f8e-a207-48d3-a0a9-2ad6c44774b2. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-b2a4e554-8e5c-4875-b99a-ea6e61d89139 req-994d7188-eebf-4c8f-8b4c-2dc69a61adaf service nova] Acquiring lock "refresh_cache-1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG nova.network.neutron [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Updating instance_info_cache with network_info: [{"id": "1b166f8e-a207-48d3-a0a9-2ad6c44774b2", "address": "fa:16:3e:2b:d2:f7", "network": {"id": "66316d10-fed3-4fb9-877e-a01542ca5855", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-93456010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f20caf676a64b9b97027f3fc9bc724c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b166f8e-a2", "ovs_interfaceid": "1b166f8e-a207-48d3-a0a9-2ad6c44774b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Releasing lock "refresh_cache-1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Creating instance directory {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 00:08:55 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Creating image(s)
Apr 14 00:08:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "/opt/stack/data/nova/instances/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "/opt/stack/data/nova/instances/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "/opt/stack/data/nova/instances/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG nova.objects.instance [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-b2a4e554-8e5c-4875-b99a-ea6e61d89139 req-994d7188-eebf-4c8f-8b4c-2dc69a61adaf service nova] Acquired lock "refresh_cache-1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG nova.network.neutron [req-b2a4e554-8e5c-4875-b99a-ea6e61d89139 req-994d7188-eebf-4c8f-8b4c-2dc69a61adaf service nova] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Refreshing network info cache for port 1b166f8e-a207-48d3-a0a9-2ad6c44774b2 {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "a32c52384e5fdec946cb243a19fafeb83db04cd9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "a32c52384e5fdec946cb243a19fafeb83db04cd9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Calling os-brick to attach iSCSI Volume {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 00:08:55 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mpSjLhaD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:08:55 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:08:55 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a32c52384e5fdec946cb243a19fafeb83db04cd9.part --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.488s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] <== connect_volume: return (1605ms) {'type': 'block', 'scsi_wwn': '23630323661303463', 'path': '/dev/sdc'} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630323661303463', 'path': '/dev/sdc'} {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG nova.compute.manager [req-0e716706-a49e-4e49-8847-9856b8e292a9 req-ee1fe628-6f80-4484-956e-9ca633bebadf service nova] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Received event network-vif-plugged-53562eeb-b1fd-47f1-896e-cacd277abf24 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0e716706-a49e-4e49-8847-9856b8e292a9 req-ee1fe628-6f80-4484-956e-9ca633bebadf service nova] Acquiring lock "8feba40a-03c7-4c60-b862-ee14fb8c9b05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0e716706-a49e-4e49-8847-9856b8e292a9 req-ee1fe628-6f80-4484-956e-9ca633bebadf service nova] Lock "8feba40a-03c7-4c60-b862-ee14fb8c9b05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0e716706-a49e-4e49-8847-9856b8e292a9 req-ee1fe628-6f80-4484-956e-9ca633bebadf service nova] Lock "8feba40a-03c7-4c60-b862-ee14fb8c9b05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG nova.compute.manager [req-0e716706-a49e-4e49-8847-9856b8e292a9 req-ee1fe628-6f80-4484-956e-9ca633bebadf service nova] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] No waiting events found dispatching network-vif-plugged-53562eeb-b1fd-47f1-896e-cacd277abf24 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:08:56 user nova-compute[82479]: WARNING nova.compute.manager [req-0e716706-a49e-4e49-8847-9856b8e292a9 req-ee1fe628-6f80-4484-956e-9ca633bebadf service nova] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Received unexpected event network-vif-plugged-53562eeb-b1fd-47f1-896e-cacd277abf24 for instance with vm_state building and task_state spawning.
Apr 14 00:08:56 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.416s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:08:56 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:08:56 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:08:56 user nova-compute[82479]: INFO os_brick.initiator.connectors.iscsi [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 00:08:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 -p 172.16.0.220:3260 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4cc7779-af8c-41e8-83ab-85bbffc8697f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 00:08:56 user nova-compute[82479]:  {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 -p 172.16.0.220:3260 --interface default --op new {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:08:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1240439258',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1240439258',id=13,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba3f111e24414976beddba7ef90c4793',ramdisk_id='',reservation_id='r-uxopaibn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1545234843',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:08:44Z,user_data=None,user_id='90bad96535c3453792982c5acab9dbc6',uuid=17c6c147-fb62-4204-a416-792b94d3f7dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "102987de-d5e4-4ccd-b4fd-7ca7c131e379", "address": "fa:16:3e:23:dd:a5", "network": {"id": "491696ea-38ef-4c19-9d94-a61223c1fa00", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1323121698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3f111e24414976beddba7ef90c4793", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap102987de-d5", "ovs_interfaceid": "102987de-d5e4-4ccd-b4fd-7ca7c131e379", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82479) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Converting VIF {"id": "102987de-d5e4-4ccd-b4fd-7ca7c131e379", "address": "fa:16:3e:23:dd:a5", "network": {"id": "491696ea-38ef-4c19-9d94-a61223c1fa00", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1323121698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3f111e24414976beddba7ef90c4793", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap102987de-d5", "ovs_interfaceid": "102987de-d5e4-4ccd-b4fd-7ca7c131e379", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:dd:a5,bridge_name='br-int',has_traffic_filtering=True,id=102987de-d5e4-4ccd-b4fd-7ca7c131e379,network=Network(491696ea-38ef-4c19-9d94-a61223c1fa00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap102987de-d5') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG nova.objects.instance [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lazy-loading 'pci_devices' on Instance uuid 17c6c147-fb62-4204-a416-792b94d3f7dd {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[f203b422-9486-4496-afa6-b6ec09eb9ed0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7] added\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7] added
Apr 14 00:08:56 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] End _get_guest_xml xml=<domain type="kvm">
Apr 14 00:08:56 user nova-compute[82479]:   <uuid>17c6c147-fb62-4204-a416-792b94d3f7dd</uuid>
Apr 14 00:08:56 user nova-compute[82479]:   <name>instance-0000000d</name>
Apr 14 00:08:56 user nova-compute[82479]:   <memory>131072</memory>
Apr 14 00:08:56 user nova-compute[82479]:   <vcpu>1</vcpu>
Apr 14 00:08:56 user nova-compute[82479]:   <metadata>
Apr 14 00:08:56 user nova-compute[82479]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 00:08:56 user nova-compute[82479]:       <nova:package version="0.0.0"/>
Apr 14 00:08:56 user nova-compute[82479]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1240439258</nova:name>
Apr 14 00:08:56 user nova-compute[82479]:       <nova:creationTime>2023-04-14 00:08:54</nova:creationTime>
Apr 14 00:08:56 user nova-compute[82479]:       <nova:flavor name="m1.nano">
Apr 14 00:08:56 user nova-compute[82479]:         <nova:memory>128</nova:memory>
Apr 14 00:08:56 user nova-compute[82479]:         <nova:disk>1</nova:disk>
Apr 14 00:08:56 user nova-compute[82479]:         <nova:swap>0</nova:swap>
Apr 14 00:08:56 user nova-compute[82479]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 00:08:56 user nova-compute[82479]:         <nova:vcpus>1</nova:vcpus>
Apr 14 00:08:56 user nova-compute[82479]:       </nova:flavor>
Apr 14 00:08:56 user nova-compute[82479]:       <nova:owner>
Apr 14 00:08:56 user nova-compute[82479]:         <nova:user uuid="90bad96535c3453792982c5acab9dbc6">tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member</nova:user>
Apr 14 00:08:56 user nova-compute[82479]:         <nova:project uuid="ba3f111e24414976beddba7ef90c4793">tempest-ServerBootFromVolumeStableRescueTest-1545234843</nova:project>
Apr 14 00:08:56 user nova-compute[82479]:       </nova:owner>
Apr 14 00:08:56 user nova-compute[82479]:       <nova:root type="image" uuid="6db62068-7278-4cd8-b41f-d0140d89e199"/>
Apr 14 00:08:56 user nova-compute[82479]:       <nova:ports>
Apr 14 00:08:56 user nova-compute[82479]:         <nova:port uuid="102987de-d5e4-4ccd-b4fd-7ca7c131e379">
Apr 14 00:08:56 user nova-compute[82479]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 14 00:08:56 user nova-compute[82479]:         </nova:port>
Apr 14 00:08:56 user nova-compute[82479]:       </nova:ports>
Apr 14 00:08:56 user nova-compute[82479]:     </nova:instance>
Apr 14 00:08:56 user nova-compute[82479]:   </metadata>
Apr 14 00:08:56 user nova-compute[82479]:   <sysinfo type="smbios">
Apr 14 00:08:56 user nova-compute[82479]:     <system>
Apr 14 00:08:56 user nova-compute[82479]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 00:08:56 user nova-compute[82479]:       <entry name="product">OpenStack Nova</entry>
Apr 14 00:08:56 user nova-compute[82479]:       <entry name="version">0.0.0</entry>
Apr 14 00:08:56 user nova-compute[82479]:       <entry name="serial">17c6c147-fb62-4204-a416-792b94d3f7dd</entry>
Apr 14 00:08:56 user nova-compute[82479]:       <entry name="uuid">17c6c147-fb62-4204-a416-792b94d3f7dd</entry>
Apr 14 00:08:56 user nova-compute[82479]:       <entry name="family">Virtual Machine</entry>
Apr 14 00:08:56 user nova-compute[82479]:     </system>
Apr 14 00:08:56 user nova-compute[82479]:   </sysinfo>
Apr 14 00:08:56 user nova-compute[82479]:   <os>
Apr 14 00:08:56 user nova-compute[82479]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 00:08:56 user nova-compute[82479]:     <boot dev="hd"/>
Apr 14 00:08:56 user nova-compute[82479]:     <smbios mode="sysinfo"/>
Apr 14 00:08:56 user nova-compute[82479]:   </os>
Apr 14 00:08:56 user nova-compute[82479]:   <features>
Apr 14 00:08:56 user nova-compute[82479]:     <acpi/>
Apr 14 00:08:56 user nova-compute[82479]:     <apic/>
Apr 14 00:08:56 user nova-compute[82479]:     <vmcoreinfo/>
Apr 14 00:08:56 user nova-compute[82479]:   </features>
Apr 14 00:08:56 user nova-compute[82479]:   <clock offset="utc">
Apr 14 00:08:56 user nova-compute[82479]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 00:08:56 user nova-compute[82479]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 00:08:56 user nova-compute[82479]:     <timer name="hpet" present="no"/>
Apr 14 00:08:56 user nova-compute[82479]:   </clock>
Apr 14 00:08:56 user nova-compute[82479]:   <cpu mode="custom" match="exact">
Apr 14 00:08:56 user nova-compute[82479]:     <model>Nehalem</model>
Apr 14 00:08:56 user nova-compute[82479]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 00:08:56 user nova-compute[82479]:   </cpu>
Apr 14 00:08:56 user nova-compute[82479]:   <devices>
Apr 14 00:08:56 user nova-compute[82479]:     <disk type="block" device="disk">
Apr 14 00:08:56 user nova-compute[82479]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:08:56 user nova-compute[82479]:       <source dev="/dev/sdc"/>
Apr 14 00:08:56 user nova-compute[82479]:       <target dev="vda" bus="virtio"/>
Apr 14 00:08:56 user nova-compute[82479]:       <serial>c3cfdf84-a3e1-41e3-85ec-481f5ba478cc</serial>
Apr 14 00:08:56 user nova-compute[82479]:     </disk>
Apr 14 00:08:56 user nova-compute[82479]:     <interface type="ethernet">
Apr 14 00:08:56 user nova-compute[82479]:       <mac address="fa:16:3e:23:dd:a5"/>
Apr 14 00:08:56 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:08:56 user nova-compute[82479]:       <mtu size="1442"/>
Apr 14 00:08:56 user nova-compute[82479]:       <target dev="tap102987de-d5"/>
Apr 14 00:08:56 user nova-compute[82479]:     </interface>
Apr 14 00:08:56 user nova-compute[82479]:     <serial type="pty">
Apr 14 00:08:56 user nova-compute[82479]:       <log file="/opt/stack/data/nova/instances/17c6c147-fb62-4204-a416-792b94d3f7dd/console.log" append="off"/>
Apr 14 00:08:56 user nova-compute[82479]:     </serial>
Apr 14 00:08:56 user nova-compute[82479]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 00:08:56 user nova-compute[82479]:     <video>
Apr 14 00:08:56 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:08:56 user nova-compute[82479]:     </video>
Apr 14 00:08:56 user nova-compute[82479]:     <rng model="virtio">
Apr 14 00:08:56 user nova-compute[82479]:       <backend model="random">/dev/urandom</backend>
Apr 14 00:08:56 user nova-compute[82479]:     </rng>
Apr 14 00:08:56 user nova-compute[82479]:     <controller type="usb" index="0" model="none"/>
Apr 14 00:08:56 user nova-compute[82479]:     <memballoon model="virtio">
Apr 14 00:08:56 user nova-compute[82479]:       <stats period="10"/>
Apr 14 00:08:56 user nova-compute[82479]:     </memballoon>
Apr 14 00:08:56 user nova-compute[82479]:   </devices>
Apr 14 00:08:56 user nova-compute[82479]: </domain>
Apr 14 00:08:56 user nova-compute[82479]:  {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:08:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1240439258',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1240439258',id=13,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba3f111e24414976beddba7ef90c4793',ramdisk_id='',reservation_id='r-uxopaibn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1545234843',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:08:44Z,user_data=None,user_id='90bad96535c3453792982c5acab9dbc6',uuid=17c6c147-fb62-4204-a416-792b94d3f7dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "102987de-d5e4-4ccd-b4fd-7ca7c131e379", "address": "fa:16:3e:23:dd:a5", "network": {"id": "491696ea-38ef-4c19-9d94-a61223c1fa00", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1323121698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3f111e24414976beddba7ef90c4793", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap102987de-d5", "ovs_interfaceid": "102987de-d5e4-4ccd-b4fd-7ca7c131e379", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Converting VIF {"id": "102987de-d5e4-4ccd-b4fd-7ca7c131e379", "address": "fa:16:3e:23:dd:a5", "network": {"id": "491696ea-38ef-4c19-9d94-a61223c1fa00", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1323121698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3f111e24414976beddba7ef90c4793", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap102987de-d5", "ovs_interfaceid": "102987de-d5e4-4ccd-b4fd-7ca7c131e379", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:dd:a5,bridge_name='br-int',has_traffic_filtering=True,id=102987de-d5e4-4ccd-b4fd-7ca7c131e379,network=Network(491696ea-38ef-4c19-9d94-a61223c1fa00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap102987de-d5') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG os_vif [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:dd:a5,bridge_name='br-int',has_traffic_filtering=True,id=102987de-d5e4-4ccd-b4fd-7ca7c131e379,network=Network(491696ea-38ef-4c19-9d94-a61223c1fa00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap102987de-d5') {{(pid=82479) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[af0de24b-5114-4574-ac8b-11845f0bf268]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a32c52384e5fdec946cb243a19fafeb83db04cd9.part --force-share --output=json" returned: 0 in 0.161s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG nova.virt.images [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] 41e32c3a-9146-441b-a88f-b3319bc43f49 was qcow2, converting to raw {{(pid=82479) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG nova.privsep.utils [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82479) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a32c52384e5fdec946cb243a19fafeb83db04cd9.part /opt/stack/data/nova/instances/_base/a32c52384e5fdec946cb243a19fafeb83db04cd9.converted {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d34b624-ef27-4696-99f1-e53488727850]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap102987de-d5, may_exist=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap102987de-d5, col_values=(('external_ids', {'iface-id': '102987de-d5e4-4ccd-b4fd-7ca7c131e379', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:dd:a5', 'vm-uuid': '17c6c147-fb62-4204-a416-792b94d3f7dd'}),)) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v npILkxwF {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v npILkxwF" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[736da88a-8463-47a7-91a9-53a268f5ab1e]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'npILkxwF'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:56 user nova-compute[82479]: INFO os_vif [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:dd:a5,bridge_name='br-int',has_traffic_filtering=True,id=102987de-d5e4-4ccd-b4fd-7ca7c131e379,network=Network(491696ea-38ef-4c19-9d94-a61223c1fa00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap102987de-d5')
Apr 14 00:08:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[4262a559-d59d-464a-b113-dd2bb2d1bd09]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681430921.8250363, 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2 => Stopped> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:08:56 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] VM Stopped (Lifecycle Event)
Apr 14 00:08:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[efdc3e54-a394-4b74-8eee-9d9da7737697]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)
Apr 14 00:08:56 user nova-compute[82479]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:08:56 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)
Apr 14 00:08:56 user nova-compute[82479]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:08:56 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 -p 172.16.0.220:3260 --login {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG nova.compute.manager [None req-ea85c51e-c4f7-4ce0-a23b-1e8899dca900 None None] [instance: 716b5e3f-20c7-40ef-9a45-71be0cfeaeb2] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a32c52384e5fdec946cb243a19fafeb83db04cd9.part /opt/stack/data/nova/instances/_base/a32c52384e5fdec946cb243a19fafeb83db04cd9.converted" returned: 0 in 0.181s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a32c52384e5fdec946cb243a19fafeb83db04cd9.converted --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2573b12-5d11-456e-86fb-897e7380e926]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7, portal: 172.16.0.220,3260]
Apr 14 00:08:56 user nova-compute[82479]: Login to [iface: default, target: iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7, portal: 172.16.0.220,3260] successful.
Apr 14 00:08:56 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] No VIF found with MAC fa:16:3e:23:dd:a5, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8c0db6-6b18-4655-9143-a6bb22538399]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:08:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:57 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:57 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25475e4-a00f-4c63-aba9-b282e8998679]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:57 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)
Apr 14 00:08:57 user nova-compute[82479]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:08:57 user nova-compute[82479]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:08:57 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:08:57 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)
Apr 14 00:08:57 user nova-compute[82479]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:08:57 user nova-compute[82479]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:08:57 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:08:57 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.399s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:08:57 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Connected to 172.16.0.220:3260 {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 00:08:57 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] HCTL ('35', '-', '-', 0) found on session 13 with lun 0 {{(pid=82479) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 00:08:57 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=82479) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 00:08:57 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:57 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a32c52384e5fdec946cb243a19fafeb83db04cd9.converted --force-share --output=json" returned: 0 in 0.130s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:57 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "a32c52384e5fdec946cb243a19fafeb83db04cd9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.119s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:08:57 user nova-compute[82479]: DEBUG nova.network.neutron [req-b2a4e554-8e5c-4875-b99a-ea6e61d89139 req-994d7188-eebf-4c8f-8b4c-2dc69a61adaf service nova] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Updated VIF entry in instance network info cache for port 1b166f8e-a207-48d3-a0a9-2ad6c44774b2. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:08:57 user nova-compute[82479]: DEBUG nova.network.neutron [req-b2a4e554-8e5c-4875-b99a-ea6e61d89139 req-994d7188-eebf-4c8f-8b4c-2dc69a61adaf service nova] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Updating instance_info_cache with network_info: [{"id": "1b166f8e-a207-48d3-a0a9-2ad6c44774b2", "address": "fa:16:3e:2b:d2:f7", "network": {"id": "66316d10-fed3-4fb9-877e-a01542ca5855", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-93456010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f20caf676a64b9b97027f3fc9bc724c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b166f8e-a2", "ovs_interfaceid": "1b166f8e-a207-48d3-a0a9-2ad6c44774b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:08:57 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:57 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[9adc3b98-b5e6-409a-b662-c634b011315a]: (4, ('- - 0', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:57 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Searching for a device in session 13 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=82479) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 00:08:57 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'npILkxwF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 00:08:57 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a32c52384e5fdec946cb243a19fafeb83db04cd9 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:57 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-b2a4e554-8e5c-4875-b99a-ea6e61d89139 req-994d7188-eebf-4c8f-8b4c-2dc69a61adaf service nova] Releasing lock "refresh_cache-1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:08:57 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:57 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:57 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:57 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:57 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a32c52384e5fdec946cb243a19fafeb83db04cd9 --force-share --output=json" returned: 0 in 0.142s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:57 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "a32c52384e5fdec946cb243a19fafeb83db04cd9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:08:57 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "a32c52384e5fdec946cb243a19fafeb83db04cd9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:08:57 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a32c52384e5fdec946cb243a19fafeb83db04cd9 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:57 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a32c52384e5fdec946cb243a19fafeb83db04cd9 --force-share --output=json" returned: 0 in 0.178s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:57 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a32c52384e5fdec946cb243a19fafeb83db04cd9,backing_fmt=raw /opt/stack/data/nova/instances/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a/disk 1073741824 {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:57 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a32c52384e5fdec946cb243a19fafeb83db04cd9,backing_fmt=raw /opt/stack/data/nova/instances/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a/disk 1073741824" returned: 0 in 0.059s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:57 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "a32c52384e5fdec946cb243a19fafeb83db04cd9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:08:57 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a32c52384e5fdec946cb243a19fafeb83db04cd9 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:57 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a32c52384e5fdec946cb243a19fafeb83db04cd9 --force-share --output=json" returned: 0 in 0.164s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:57 user nova-compute[82479]: DEBUG nova.objects.instance [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lazy-loading 'migration_context' on Instance uuid 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:08:57 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Rebasing disk image.
Apr 14 00:08:57 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:57 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:57 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.134s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:57 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 -F raw /opt/stack/data/nova/instances/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a/disk {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:57 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.441s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] <== connect_volume: return (2857ms) {'type': 'block', 'scsi_wwn': '23866316530316134', 'path': '/dev/sdd'} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23866316530316134', 'path': '/dev/sdd'} {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.086s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:08:58 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:08:58 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:08:58 user nova-compute[82479]: INFO os_brick.initiator.connectors.iscsi [None req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 00:08:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d -p 172.16.0.220:3260 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[36859237-f4ee-458d-adc7-b70b647c16fb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 00:08:58 user nova-compute[82479]:  {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d -p 172.16.0.220:3260 --interface default --op new {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:04:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-874047723',display_name='tempest-AttachVolumeTestJSON-server-874047723',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-874047723',id=5,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFj5BOE0cuvlxZawRQVfnfugrJsq+vAMk/RiiLDSf3KCRmtu0WTqB0nwANMnYIuDZO4AsUPttsoe/j3WMHFiNDVdBMIPFOCGE/kkjYyw9NwqNVOKFmKjVIZ3x8l2xusRtg==',key_name='tempest-keypair-608426082',keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:05:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='ec1aab0338ff4bd195a37a4199a378eb',ramdisk_id='',reservation_id='r-n5aqf0fe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1885059489',owner_user_name='tempest-AttachVolumeTestJSON-1885059489-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T00:07:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44530987616b417d87ce5909d8de1871',uuid=01a65362-36ea-4817-8e83-f75d6daf808b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "b5dfa187-0a42-4319-990f-1d3b22691c27", "address": "fa:16:3e:7b:38:3d", "network": {"id": "368d9445-850e-4f74-b5cc-86d1eaa95d63", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374332689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec1aab0338ff4bd195a37a4199a378eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5dfa187-0a", "ovs_interfaceid": "b5dfa187-0a42-4319-990f-1d3b22691c27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82479) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Converting VIF {"id": "b5dfa187-0a42-4319-990f-1d3b22691c27", "address": "fa:16:3e:7b:38:3d", "network": {"id": "368d9445-850e-4f74-b5cc-86d1eaa95d63", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374332689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec1aab0338ff4bd195a37a4199a378eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5dfa187-0a", "ovs_interfaceid": "b5dfa187-0a42-4319-990f-1d3b22691c27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:38:3d,bridge_name='br-int',has_traffic_filtering=True,id=b5dfa187-0a42-4319-990f-1d3b22691c27,network=Network(368d9445-850e-4f74-b5cc-86d1eaa95d63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5dfa187-0a') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG nova.objects.instance [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lazy-loading 'pci_devices' on Instance uuid 01a65362-36ea-4817-8e83-f75d6daf808b {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5964ed-b72e-4778-ae44-2161d4c03b6a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d] added\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d] added
Apr 14 00:08:58 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] End _get_guest_xml xml=<domain type="kvm">
Apr 14 00:08:58 user nova-compute[82479]:   <uuid>01a65362-36ea-4817-8e83-f75d6daf808b</uuid>
Apr 14 00:08:58 user nova-compute[82479]:   <name>instance-00000005</name>
Apr 14 00:08:58 user nova-compute[82479]:   <memory>131072</memory>
Apr 14 00:08:58 user nova-compute[82479]:   <vcpu>1</vcpu>
Apr 14 00:08:58 user nova-compute[82479]:   <metadata>
Apr 14 00:08:58 user nova-compute[82479]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 00:08:58 user nova-compute[82479]:       <nova:package version="0.0.0"/>
Apr 14 00:08:58 user nova-compute[82479]:       <nova:name>tempest-AttachVolumeTestJSON-server-874047723</nova:name>
Apr 14 00:08:58 user nova-compute[82479]:       <nova:creationTime>2023-04-14 00:08:55</nova:creationTime>
Apr 14 00:08:58 user nova-compute[82479]:       <nova:flavor name="m1.nano">
Apr 14 00:08:58 user nova-compute[82479]:         <nova:memory>128</nova:memory>
Apr 14 00:08:58 user nova-compute[82479]:         <nova:disk>1</nova:disk>
Apr 14 00:08:58 user nova-compute[82479]:         <nova:swap>0</nova:swap>
Apr 14 00:08:58 user nova-compute[82479]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 00:08:58 user nova-compute[82479]:         <nova:vcpus>1</nova:vcpus>
Apr 14 00:08:58 user nova-compute[82479]:       </nova:flavor>
Apr 14 00:08:58 user nova-compute[82479]:       <nova:owner>
Apr 14 00:08:58 user nova-compute[82479]:         <nova:user uuid="44530987616b417d87ce5909d8de1871">tempest-AttachVolumeTestJSON-1885059489-project-member</nova:user>
Apr 14 00:08:58 user nova-compute[82479]:         <nova:project uuid="ec1aab0338ff4bd195a37a4199a378eb">tempest-AttachVolumeTestJSON-1885059489</nova:project>
Apr 14 00:08:58 user nova-compute[82479]:       </nova:owner>
Apr 14 00:08:58 user nova-compute[82479]:       <nova:root type="image" uuid="6db62068-7278-4cd8-b41f-d0140d89e199"/>
Apr 14 00:08:58 user nova-compute[82479]:       <nova:ports>
Apr 14 00:08:58 user nova-compute[82479]:         <nova:port uuid="b5dfa187-0a42-4319-990f-1d3b22691c27">
Apr 14 00:08:58 user nova-compute[82479]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 14 00:08:58 user nova-compute[82479]:         </nova:port>
Apr 14 00:08:58 user nova-compute[82479]:       </nova:ports>
Apr 14 00:08:58 user nova-compute[82479]:     </nova:instance>
Apr 14 00:08:58 user nova-compute[82479]:   </metadata>
Apr 14 00:08:58 user nova-compute[82479]:   <sysinfo type="smbios">
Apr 14 00:08:58 user nova-compute[82479]:     <system>
Apr 14 00:08:58 user nova-compute[82479]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 00:08:58 user nova-compute[82479]:       <entry name="product">OpenStack Nova</entry>
Apr 14 00:08:58 user nova-compute[82479]:       <entry name="version">0.0.0</entry>
Apr 14 00:08:58 user nova-compute[82479]:       <entry name="serial">01a65362-36ea-4817-8e83-f75d6daf808b</entry>
Apr 14 00:08:58 user nova-compute[82479]:       <entry name="uuid">01a65362-36ea-4817-8e83-f75d6daf808b</entry>
Apr 14 00:08:58 user nova-compute[82479]:       <entry name="family">Virtual Machine</entry>
Apr 14 00:08:58 user nova-compute[82479]:     </system>
Apr 14 00:08:58 user nova-compute[82479]:   </sysinfo>
Apr 14 00:08:58 user nova-compute[82479]:   <os>
Apr 14 00:08:58 user nova-compute[82479]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 00:08:58 user nova-compute[82479]:     <boot dev="hd"/>
Apr 14 00:08:58 user nova-compute[82479]:     <smbios mode="sysinfo"/>
Apr 14 00:08:58 user nova-compute[82479]:   </os>
Apr 14 00:08:58 user nova-compute[82479]:   <features>
Apr 14 00:08:58 user nova-compute[82479]:     <acpi/>
Apr 14 00:08:58 user nova-compute[82479]:     <apic/>
Apr 14 00:08:58 user nova-compute[82479]:     <vmcoreinfo/>
Apr 14 00:08:58 user nova-compute[82479]:   </features>
Apr 14 00:08:58 user nova-compute[82479]:   <clock offset="utc">
Apr 14 00:08:58 user nova-compute[82479]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 00:08:58 user nova-compute[82479]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 00:08:58 user nova-compute[82479]:     <timer name="hpet" present="no"/>
Apr 14 00:08:58 user nova-compute[82479]:   </clock>
Apr 14 00:08:58 user nova-compute[82479]:   <cpu mode="custom" match="exact">
Apr 14 00:08:58 user nova-compute[82479]:     <model>Nehalem</model>
Apr 14 00:08:58 user nova-compute[82479]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 00:08:58 user nova-compute[82479]:   </cpu>
Apr 14 00:08:58 user nova-compute[82479]:   <devices>
Apr 14 00:08:58 user nova-compute[82479]:     <disk type="file" device="disk">
Apr 14 00:08:58 user nova-compute[82479]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 00:08:58 user nova-compute[82479]:       <source file="/opt/stack/data/nova/instances/01a65362-36ea-4817-8e83-f75d6daf808b/disk"/>
Apr 14 00:08:58 user nova-compute[82479]:       <target dev="vda" bus="virtio"/>
Apr 14 00:08:58 user nova-compute[82479]:     </disk>
Apr 14 00:08:58 user nova-compute[82479]:     <disk type="block" device="disk">
Apr 14 00:08:58 user nova-compute[82479]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:08:58 user nova-compute[82479]:       <source dev="/dev/sdd"/>
Apr 14 00:08:58 user nova-compute[82479]:       <target dev="vdb" bus="virtio"/>
Apr 14 00:08:58 user nova-compute[82479]:       <serial>5021c122-fea0-4125-8b1f-c1ab3c4de5e7</serial>
Apr 14 00:08:58 user nova-compute[82479]:     </disk>
Apr 14 00:08:58 user nova-compute[82479]:     <interface type="ethernet">
Apr 14 00:08:58 user nova-compute[82479]:       <mac address="fa:16:3e:7b:38:3d"/>
Apr 14 00:08:58 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:08:58 user nova-compute[82479]:       <mtu size="1442"/>
Apr 14 00:08:58 user nova-compute[82479]:       <target dev="tapb5dfa187-0a"/>
Apr 14 00:08:58 user nova-compute[82479]:     </interface>
Apr 14 00:08:58 user nova-compute[82479]:     <serial type="pty">
Apr 14 00:08:58 user nova-compute[82479]:       <log file="/opt/stack/data/nova/instances/01a65362-36ea-4817-8e83-f75d6daf808b/console.log" append="off"/>
Apr 14 00:08:58 user nova-compute[82479]:     </serial>
Apr 14 00:08:58 user nova-compute[82479]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 00:08:58 user nova-compute[82479]:     <video>
Apr 14 00:08:58 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:08:58 user nova-compute[82479]:     </video>
Apr 14 00:08:58 user nova-compute[82479]:     <rng model="virtio">
Apr 14 00:08:58 user nova-compute[82479]:       <backend model="random">/dev/urandom</backend>
Apr 14 00:08:58 user nova-compute[82479]:     </rng>
Apr 14 00:08:58 user nova-compute[82479]:     <controller type="usb" index="0" model="none"/>
Apr 14 00:08:58 user nova-compute[82479]:     <memballoon model="virtio">
Apr 14 00:08:58 user nova-compute[82479]:       <stats period="10"/>
Apr 14 00:08:58 user nova-compute[82479]:     </memballoon>
Apr 14 00:08:58 user nova-compute[82479]:   </devices>
Apr 14 00:08:58 user nova-compute[82479]: </domain>
Apr 14 00:08:58 user nova-compute[82479]:  {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01a65362-36ea-4817-8e83-f75d6daf808b/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.106s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[266b43d0-95ff-4bcb-91a2-5587440931df]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd3c2abb-3075-4a5a-9f5b-13509d8f6bdf]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mpSjLhaD {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01a65362-36ea-4817-8e83-f75d6daf808b/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01a65362-36ea-4817-8e83-f75d6daf808b/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mpSjLhaD" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee89e34-7dfa-4cf9-85c5-8edf175af91e]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mpSjLhaD'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d732f7-eeed-4278-9c94-c21224acc7ea]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c51b0fd-4cad-4aac-a72a-34bdeaf134f1]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)
Apr 14 00:08:58 user nova-compute[82479]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:08:58 user nova-compute[82479]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:08:58 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)
Apr 14 00:08:58 user nova-compute[82479]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:08:58 user nova-compute[82479]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:08:58 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d -p 172.16.0.220:3260 --login {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01a65362-36ea-4817-8e83-f75d6daf808b/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG nova.objects.instance [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lazy-loading 'trusted_certs' on Instance uuid 01a65362-36ea-4817-8e83-f75d6daf808b {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc31886-309c-4e50-9d4a-efc991db0a82]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d, portal: 172.16.0.220,3260]
Apr 14 00:08:58 user nova-compute[82479]: Login to [iface: default, target: iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d, portal: 172.16.0.220,3260] successful.
Apr 14 00:08:58 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c4b0308-b524-48cf-9a6b-166c706be006]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c35385-4c35-4c34-b943-6ddfac65973b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)
Apr 14 00:08:58 user nova-compute[82479]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:08:58 user nova-compute[82479]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:08:58 user nova-compute[82479]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d (non-flash)
Apr 14 00:08:58 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)
Apr 14 00:08:58 user nova-compute[82479]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:08:58 user nova-compute[82479]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:08:58 user nova-compute[82479]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d (non-flash)
Apr 14 00:08:58 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.457s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Connected to 172.16.0.220:3260 {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] HCTL ('36', '-', '-', 0) found on session 14 with lun 0 {{(pid=82479) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=82479) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[206c571b-d5e1-4dff-890c-2d42c62704a1]: (4, ('- - 0', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Searching for a device in session 14 and hctl ['36', '*', '*', 0] yield: sde {{(pid=82479) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mpSjLhaD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.138s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Checking if we can resize image /opt/stack/data/nova/instances/01a65362-36ea-4817-8e83-f75d6daf808b/disk. size=1073741824 {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01a65362-36ea-4817-8e83-f75d6daf808b/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG nova.compute.manager [req-1d64c002-f482-47a0-8bcf-096077ce193e req-58946eff-ad89-4639-8623-16e84b43e331 service nova] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Received event network-vif-plugged-53562eeb-b1fd-47f1-896e-cacd277abf24 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-1d64c002-f482-47a0-8bcf-096077ce193e req-58946eff-ad89-4639-8623-16e84b43e331 service nova] Acquiring lock "8feba40a-03c7-4c60-b862-ee14fb8c9b05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-1d64c002-f482-47a0-8bcf-096077ce193e req-58946eff-ad89-4639-8623-16e84b43e331 service nova] Lock "8feba40a-03c7-4c60-b862-ee14fb8c9b05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-1d64c002-f482-47a0-8bcf-096077ce193e req-58946eff-ad89-4639-8623-16e84b43e331 service nova] Lock "8feba40a-03c7-4c60-b862-ee14fb8c9b05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG nova.compute.manager [req-1d64c002-f482-47a0-8bcf-096077ce193e req-58946eff-ad89-4639-8623-16e84b43e331 service nova] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] No waiting events found dispatching network-vif-plugged-53562eeb-b1fd-47f1-896e-cacd277abf24 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:08:58 user nova-compute[82479]: WARNING nova.compute.manager [req-1d64c002-f482-47a0-8bcf-096077ce193e req-58946eff-ad89-4639-8623-16e84b43e331 service nova] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Received unexpected event network-vif-plugged-53562eeb-b1fd-47f1-896e-cacd277abf24 for instance with vm_state building and task_state spawning.
Apr 14 00:08:58 user nova-compute[82479]: DEBUG nova.compute.manager [req-1d64c002-f482-47a0-8bcf-096077ce193e req-58946eff-ad89-4639-8623-16e84b43e331 service nova] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Received event network-vif-plugged-4085de4c-cb9e-452b-9504-b7c7f8621213 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-1d64c002-f482-47a0-8bcf-096077ce193e req-58946eff-ad89-4639-8623-16e84b43e331 service nova] Acquiring lock "3a6b9f89-e462-47d8-84a1-0ac4ade3ab97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-1d64c002-f482-47a0-8bcf-096077ce193e req-58946eff-ad89-4639-8623-16e84b43e331 service nova] Lock "3a6b9f89-e462-47d8-84a1-0ac4ade3ab97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-1d64c002-f482-47a0-8bcf-096077ce193e req-58946eff-ad89-4639-8623-16e84b43e331 service nova] Lock "3a6b9f89-e462-47d8-84a1-0ac4ade3ab97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG nova.compute.manager [req-1d64c002-f482-47a0-8bcf-096077ce193e req-58946eff-ad89-4639-8623-16e84b43e331 service nova] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] No waiting events found dispatching network-vif-plugged-4085de4c-cb9e-452b-9504-b7c7f8621213 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:08:58 user nova-compute[82479]: WARNING nova.compute.manager [req-1d64c002-f482-47a0-8bcf-096077ce193e req-58946eff-ad89-4639-8623-16e84b43e331 service nova] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Received unexpected event network-vif-plugged-4085de4c-cb9e-452b-9504-b7c7f8621213 for instance with vm_state active and task_state rescuing.
Apr 14 00:08:58 user nova-compute[82479]: DEBUG nova.compute.manager [req-1d64c002-f482-47a0-8bcf-096077ce193e req-58946eff-ad89-4639-8623-16e84b43e331 service nova] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Received event network-vif-plugged-4085de4c-cb9e-452b-9504-b7c7f8621213 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-1d64c002-f482-47a0-8bcf-096077ce193e req-58946eff-ad89-4639-8623-16e84b43e331 service nova] Acquiring lock "3a6b9f89-e462-47d8-84a1-0ac4ade3ab97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-1d64c002-f482-47a0-8bcf-096077ce193e req-58946eff-ad89-4639-8623-16e84b43e331 service nova] Lock "3a6b9f89-e462-47d8-84a1-0ac4ade3ab97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-1d64c002-f482-47a0-8bcf-096077ce193e req-58946eff-ad89-4639-8623-16e84b43e331 service nova] Lock "3a6b9f89-e462-47d8-84a1-0ac4ade3ab97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG nova.compute.manager [req-1d64c002-f482-47a0-8bcf-096077ce193e req-58946eff-ad89-4639-8623-16e84b43e331 service nova] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] No waiting events found dispatching network-vif-plugged-4085de4c-cb9e-452b-9504-b7c7f8621213 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:08:58 user nova-compute[82479]: WARNING nova.compute.manager [req-1d64c002-f482-47a0-8bcf-096077ce193e req-58946eff-ad89-4639-8623-16e84b43e331 service nova] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Received unexpected event network-vif-plugged-4085de4c-cb9e-452b-9504-b7c7f8621213 for instance with vm_state active and task_state rescuing.
Apr 14 00:08:58 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01a65362-36ea-4817-8e83-f75d6daf808b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Cannot resize image /opt/stack/data/nova/instances/01a65362-36ea-4817-8e83-f75d6daf808b/disk to a smaller size. {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG nova.objects.instance [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lazy-loading 'migration_context' on Instance uuid 01a65362-36ea-4817-8e83-f75d6daf808b {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:04:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-874047723',display_name='tempest-AttachVolumeTestJSON-server-874047723',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-874047723',id=5,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFj5BOE0cuvlxZawRQVfnfugrJsq+vAMk/RiiLDSf3KCRmtu0WTqB0nwANMnYIuDZO4AsUPttsoe/j3WMHFiNDVdBMIPFOCGE/kkjYyw9NwqNVOKFmKjVIZ3x8l2xusRtg==',key_name='tempest-keypair-608426082',keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:05:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='ec1aab0338ff4bd195a37a4199a378eb',ramdisk_id='',reservation_id='r-n5aqf0fe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1885059489',owner_user_name='tempest-AttachVolumeTestJSON-1885059489-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:07:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44530987616b417d87ce5909d8de1871',uuid=01a65362-36ea-4817-8e83-f75d6daf808b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "b5dfa187-0a42-4319-990f-1d3b22691c27", "address": "fa:16:3e:7b:38:3d", "network": {"id": "368d9445-850e-4f74-b5cc-86d1eaa95d63", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374332689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec1aab0338ff4bd195a37a4199a378eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5dfa187-0a", "ovs_interfaceid": "b5dfa187-0a42-4319-990f-1d3b22691c27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Converting VIF {"id": "b5dfa187-0a42-4319-990f-1d3b22691c27", "address": "fa:16:3e:7b:38:3d", "network": {"id": "368d9445-850e-4f74-b5cc-86d1eaa95d63", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374332689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec1aab0338ff4bd195a37a4199a378eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5dfa187-0a", "ovs_interfaceid": "b5dfa187-0a42-4319-990f-1d3b22691c27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:38:3d,bridge_name='br-int',has_traffic_filtering=True,id=b5dfa187-0a42-4319-990f-1d3b22691c27,network=Network(368d9445-850e-4f74-b5cc-86d1eaa95d63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5dfa187-0a') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG os_vif [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:38:3d,bridge_name='br-int',has_traffic_filtering=True,id=b5dfa187-0a42-4319-990f-1d3b22691c27,network=Network(368d9445-850e-4f74-b5cc-86d1eaa95d63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5dfa187-0a') {{(pid=82479) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb5dfa187-0a, may_exist=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb5dfa187-0a, col_values=(('external_ids', {'iface-id': 'b5dfa187-0a42-4319-990f-1d3b22691c27', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:38:3d', 'vm-uuid': '01a65362-36ea-4817-8e83-f75d6daf808b'}),)) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:08:58 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:58 user nova-compute[82479]: INFO os_vif [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:38:3d,bridge_name='br-int',has_traffic_filtering=True,id=b5dfa187-0a42-4319-990f-1d3b22691c27,network=Network(368d9445-850e-4f74-b5cc-86d1eaa95d63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5dfa187-0a')
Apr 14 00:08:59 user nova-compute[82479]: DEBUG nova.compute.manager [req-f29f5a96-b777-429e-ab92-338b78f756ec req-a9a231af-cb70-4374-b768-46e368d313c4 service nova] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Received event network-vif-plugged-102987de-d5e4-4ccd-b4fd-7ca7c131e379 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:08:59 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-f29f5a96-b777-429e-ab92-338b78f756ec req-a9a231af-cb70-4374-b768-46e368d313c4 service nova] Acquiring lock "17c6c147-fb62-4204-a416-792b94d3f7dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:08:59 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-f29f5a96-b777-429e-ab92-338b78f756ec req-a9a231af-cb70-4374-b768-46e368d313c4 service nova] Lock "17c6c147-fb62-4204-a416-792b94d3f7dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:08:59 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-f29f5a96-b777-429e-ab92-338b78f756ec req-a9a231af-cb70-4374-b768-46e368d313c4 service nova] Lock "17c6c147-fb62-4204-a416-792b94d3f7dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:08:59 user nova-compute[82479]: DEBUG nova.compute.manager [req-f29f5a96-b777-429e-ab92-338b78f756ec req-a9a231af-cb70-4374-b768-46e368d313c4 service nova] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] No waiting events found dispatching network-vif-plugged-102987de-d5e4-4ccd-b4fd-7ca7c131e379 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:08:59 user nova-compute[82479]: WARNING nova.compute.manager [req-f29f5a96-b777-429e-ab92-338b78f756ec req-a9a231af-cb70-4374-b768-46e368d313c4 service nova] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Received unexpected event network-vif-plugged-102987de-d5e4-4ccd-b4fd-7ca7c131e379 for instance with vm_state building and task_state spawning.
Apr 14 00:08:59 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:59 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:08:59 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.510s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:08:59 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] <== connect_volume: return (3596ms) {'type': 'block', 'scsi_wwn': '23735346365396464', 'path': '/dev/sde'} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:08:59 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23735346365396464', 'path': '/dev/sde'} {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 00:08:59 user nova-compute[82479]: DEBUG nova.objects.instance [None req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lazy-loading 'flavor' on Instance uuid b3475e7e-ceb4-452a-a045-dbf43c5944dd {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:08:59 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 00:08:59 user nova-compute[82479]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:08:59 user nova-compute[82479]:   <source dev="/dev/sde"/>
Apr 14 00:08:59 user nova-compute[82479]:   <target dev="vdb" bus="virtio"/>
Apr 14 00:08:59 user nova-compute[82479]:   <serial>49172d5a-2944-486a-a080-04548e55ac0d</serial>
Apr 14 00:08:59 user nova-compute[82479]: </disk>
Apr 14 00:08:59 user nova-compute[82479]:  {{(pid=82479) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 00:09:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 -F raw /opt/stack/data/nova/instances/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a/disk" returned: 0 in 2.566s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:00 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Created local disks {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 00:09:00 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Ensure instance console log exists: /opt/stack/data/nova/instances/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a/console.log {{(pid=82479) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 00:09:00 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:09:00 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:09:00 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:09:00 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Start _get_guest_xml network_info=[{"id": "1b166f8e-a207-48d3-a0a9-2ad6c44774b2", "address": "fa:16:3e:2b:d2:f7", "network": {"id": "66316d10-fed3-4fb9-877e-a01542ca5855", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-93456010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f20caf676a64b9b97027f3fc9bc724c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b166f8e-a2", "ovs_interfaceid": "1b166f8e-a207-48d3-a0a9-2ad6c44774b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='10e0f38bead025fb552e9c275ff808b5',container_format='bare',created_at=2023-04-14T00:06:55Z,direct_url=<?>,disk_format='qcow2',id=41e32c3a-9146-441b-a88f-b3319bc43f49,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-353632356-shelved',owner='4f20caf676a64b9b97027f3fc9bc724c',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-14T00:06:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': None, 'device_type': 'disk', 'delete_on_termination': False, 'attachment_id': '355a8c10-71ab-4aed-9e38-b43ec2211c2a', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dekLAOnU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a', 'attached_at': '', 'detached_at': '', 'volume_id': 'af1b05d2-717a-489c-8bdf-160d00ebd122', 'serial': 'af1b05d2-717a-489c-8bdf-160d00ebd122'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 00:09:00 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:00 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681430940.800745, 8feba40a-03c7-4c60-b862-ee14fb8c9b05 => Resumed> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:09:00 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] VM Resumed (Lifecycle Event)
Apr 14 00:09:00 user nova-compute[82479]: DEBUG nova.compute.manager [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Instance event wait completed in 0 seconds for  {{(pid=82479) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 00:09:00 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Guest created on hypervisor {{(pid=82479) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 00:09:00 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Instance spawned successfully.
Apr 14 00:09:00 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 00:09:00 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:09:00 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:09:00 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:09:00 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82479) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 00:09:00 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T00:02:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='10e0f38bead025fb552e9c275ff808b5',container_format='bare',created_at=2023-04-14T00:06:55Z,direct_url=<?>,disk_format='qcow2',id=41e32c3a-9146-441b-a88f-b3319bc43f49,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-353632356-shelved',owner='4f20caf676a64b9b97027f3fc9bc724c',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-14T00:06:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 00:09:00 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Flavor limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 00:09:00 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Image limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 00:09:00 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Flavor pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 00:09:00 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Image pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 00:09:00 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 00:09:00 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 00:09:00 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 00:09:00 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Got 1 possible topologies {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 00:09:00 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 00:09:00 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 00:09:00 user nova-compute[82479]: DEBUG nova.objects.instance [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:09:00 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:09:00 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Calling os-brick to attach iSCSI Volume {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 00:09:00 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dekLAOnU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:09:00 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:09:00 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:09:00 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:09:00 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:09:00 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:09:00 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:09:00 user nova-compute[82479]: INFO os_brick.initiator.connectors.iscsi [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 00:09:00 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:09:00 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681430940.8165467, 8feba40a-03c7-4c60-b862-ee14fb8c9b05 => Started> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:09:00 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] VM Started (Lifecycle Event)
Apr 14 00:09:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 -p 172.16.0.220:3260 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:00 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Found default for hw_cdrom_bus of ide {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:09:00 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Found default for hw_disk_bus of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:09:00 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Found default for hw_input_bus of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:09:00 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Found default for hw_pointer_model of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:09:00 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Found default for hw_video_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:09:00 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Found default for hw_vif_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:09:00 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:09:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 -p 172.16.0.220:3260" returned: 21 in 0.030s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:00 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0380ea1-23d9-4aa8-aa2a-e5ef6aae29fd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:09:00 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 00:09:00 user nova-compute[82479]:  {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:09:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 -p 172.16.0.220:3260 --interface default --op new {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:00 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:09:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:00 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e204d5-df20-4d13-9dd5-36fc3f68f8a3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122] added\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:09:00 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122] added
Apr 14 00:09:00 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:09:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:00 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:09:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:00 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31b5a47-40a6-417d-92c1-93b9b73e7481]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:09:00 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:09:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:01 user nova-compute[82479]: INFO nova.compute.manager [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Took 10.47 seconds to spawn the instance on the hypervisor.
Apr 14 00:09:01 user nova-compute[82479]: DEBUG nova.compute.manager [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:09:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:01 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[6673ddc1-3d55-4ec8-9a0c-3922b6a79d1e]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:09:01 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:09:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dekLAOnU {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dekLAOnU" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:01 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[755fb056-e82e-4749-ad1a-f4a89f171e2c]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:09:01 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dekLAOnU'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:09:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:01 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f6bb5f-58ef-45f8-a035-b2818bee0ffc]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:09:01 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:09:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:01 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f52290-b026-4576-b1a6-bd8a6584ba00]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:09:01 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)
Apr 14 00:09:01 user nova-compute[82479]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:09:01 user nova-compute[82479]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:09:01 user nova-compute[82479]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d (non-flash)
Apr 14 00:09:01 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:09:01 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)
Apr 14 00:09:01 user nova-compute[82479]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:09:01 user nova-compute[82479]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:09:01 user nova-compute[82479]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d (non-flash)
Apr 14 00:09:01 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:09:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 -p 172.16.0.220:3260 --login {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:01 user nova-compute[82479]: INFO nova.compute.manager [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Took 11.29 seconds to build instance.
Apr 14 00:09:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-7dabd024-b346-41da-9099-5dd98a186ff4 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "8feba40a-03c7-4c60-b862-ee14fb8c9b05" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.389s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:09:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:01 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[7614c462-11e9-489c-817b-20d72f1d3ea9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:09:01 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122, portal: 172.16.0.220,3260]
Apr 14 00:09:01 user nova-compute[82479]: Login to [iface: default, target: iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122, portal: 172.16.0.220,3260] successful.
Apr 14 00:09:01 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:09:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:01 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9c7e21-0e37-40f2-b798-456fdb67ce54]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:09:01 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:09:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:01 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[d06c508a-1424-43df-aec5-da5df8874a4b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:09:01 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)
Apr 14 00:09:01 user nova-compute[82479]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:09:01 user nova-compute[82479]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:09:01 user nova-compute[82479]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d (non-flash)
Apr 14 00:09:01 user nova-compute[82479]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 (non-flash)
Apr 14 00:09:01 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:09:01 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)
Apr 14 00:09:01 user nova-compute[82479]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:09:01 user nova-compute[82479]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:09:01 user nova-compute[82479]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d (non-flash)
Apr 14 00:09:01 user nova-compute[82479]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 (non-flash)
Apr 14 00:09:01 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:09:01 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.329s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:09:01 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Connected to 172.16.0.220:3260 {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 00:09:01 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] HCTL ('37', '-', '-', 0) found on session 15 with lun 0 {{(pid=82479) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 00:09:01 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=82479) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 00:09:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:01 user nova-compute[82479]: DEBUG nova.compute.manager [req-f63e12fc-ae00-439b-a32d-61a06c2885e6 req-3b9f51d2-7f30-47bf-b011-9629dc6e3c8a service nova] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Received event network-vif-plugged-102987de-d5e4-4ccd-b4fd-7ca7c131e379 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:09:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-f63e12fc-ae00-439b-a32d-61a06c2885e6 req-3b9f51d2-7f30-47bf-b011-9629dc6e3c8a service nova] Acquiring lock "17c6c147-fb62-4204-a416-792b94d3f7dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:09:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-f63e12fc-ae00-439b-a32d-61a06c2885e6 req-3b9f51d2-7f30-47bf-b011-9629dc6e3c8a service nova] Lock "17c6c147-fb62-4204-a416-792b94d3f7dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:09:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-f63e12fc-ae00-439b-a32d-61a06c2885e6 req-3b9f51d2-7f30-47bf-b011-9629dc6e3c8a service nova] Lock "17c6c147-fb62-4204-a416-792b94d3f7dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:09:01 user nova-compute[82479]: DEBUG nova.compute.manager [req-f63e12fc-ae00-439b-a32d-61a06c2885e6 req-3b9f51d2-7f30-47bf-b011-9629dc6e3c8a service nova] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] No waiting events found dispatching network-vif-plugged-102987de-d5e4-4ccd-b4fd-7ca7c131e379 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:09:01 user nova-compute[82479]: WARNING nova.compute.manager [req-f63e12fc-ae00-439b-a32d-61a06c2885e6 req-3b9f51d2-7f30-47bf-b011-9629dc6e3c8a service nova] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Received unexpected event network-vif-plugged-102987de-d5e4-4ccd-b4fd-7ca7c131e379 for instance with vm_state building and task_state spawning.
Apr 14 00:09:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.029s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:01 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[12be931d-e719-4929-a64b-f762b89e90a6]: (4, ('- - 0', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:09:01 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Searching for a device in session 15 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=82479) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 00:09:01 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dekLAOnU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 00:09:01 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:09:01 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:09:01 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] No VIF found with MAC fa:16:3e:f9:fd:1a, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:09:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.818s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:09:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:01 user nova-compute[82479]: DEBUG nova.compute.manager [req-ede5b2e0-86da-4d72-a354-e64e55e028a9 req-e2886fb5-df9f-457a-8c4b-a65f8b22812a service nova] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Received event network-vif-plugged-b5dfa187-0a42-4319-990f-1d3b22691c27 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:09:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-ede5b2e0-86da-4d72-a354-e64e55e028a9 req-e2886fb5-df9f-457a-8c4b-a65f8b22812a service nova] Acquiring lock "01a65362-36ea-4817-8e83-f75d6daf808b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:09:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-ede5b2e0-86da-4d72-a354-e64e55e028a9 req-e2886fb5-df9f-457a-8c4b-a65f8b22812a service nova] Lock "01a65362-36ea-4817-8e83-f75d6daf808b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:09:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-ede5b2e0-86da-4d72-a354-e64e55e028a9 req-e2886fb5-df9f-457a-8c4b-a65f8b22812a service nova] Lock "01a65362-36ea-4817-8e83-f75d6daf808b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:09:01 user nova-compute[82479]: DEBUG nova.compute.manager [req-ede5b2e0-86da-4d72-a354-e64e55e028a9 req-e2886fb5-df9f-457a-8c4b-a65f8b22812a service nova] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] No waiting events found dispatching network-vif-plugged-b5dfa187-0a42-4319-990f-1d3b22691c27 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:09:01 user nova-compute[82479]: WARNING nova.compute.manager [req-ede5b2e0-86da-4d72-a354-e64e55e028a9 req-e2886fb5-df9f-457a-8c4b-a65f8b22812a service nova] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Received unexpected event network-vif-plugged-b5dfa187-0a42-4319-990f-1d3b22691c27 for instance with vm_state stopped and task_state powering-on.
Apr 14 00:09:01 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Removed pending event for 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97 due to event {{(pid=82479) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 00:09:01 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681430941.8767843, 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97 => Resumed> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:09:01 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] VM Resumed (Lifecycle Event)
Apr 14 00:09:01 user nova-compute[82479]: DEBUG nova.compute.manager [None req-0e2089b0-40fc-4ca5-bd17-e1d24db5be4f tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:09:01 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:09:01 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:09:01 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 14 00:09:01 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681430941.8795652, 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97 => Started> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:09:01 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] VM Started (Lifecycle Event)
Apr 14 00:09:01 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:09:01 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:09:02 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:02 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:02 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:02 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.376s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:09:02 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] <== connect_volume: return (1377ms) {'type': 'block', 'scsi_wwn': '23463353866343366', 'path': '/dev/sdf'} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:09:02 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23463353866343366', 'path': '/dev/sdf'} {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 00:09:02 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:02 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:02 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T00:04:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-353632356',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-353632356',id=4,image_ref='41e32c3a-9146-441b-a88f-b3319bc43f49',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-138977160',keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:05:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='4f20caf676a64b9b97027f3fc9bc724c',ramdisk_id='',reservation_id='r-0ad3gf97',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1395403129',owner_user_name='tempest-AttachVolumeShelveTestJSON-1395403129-project-member',shelved_at='2023-04-14T00:06:59.307008',shelved_host='user',shelved_image_id='41e32c3a-9146-441b-a88f-b3319bc43f49'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:08:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f8b18d40ecd4b4e976cf2018af8220c',uuid=1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "1b166f8e-a207-48d3-a0a9-2ad6c44774b2", "address": "fa:16:3e:2b:d2:f7", "network": {"id": "66316d10-fed3-4fb9-877e-a01542ca5855", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-93456010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f20caf676a64b9b97027f3fc9bc724c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b166f8e-a2", "ovs_interfaceid": "1b166f8e-a207-48d3-a0a9-2ad6c44774b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82479) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 00:09:02 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Converting VIF {"id": "1b166f8e-a207-48d3-a0a9-2ad6c44774b2", "address": "fa:16:3e:2b:d2:f7", "network": {"id": "66316d10-fed3-4fb9-877e-a01542ca5855", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-93456010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f20caf676a64b9b97027f3fc9bc724c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b166f8e-a2", "ovs_interfaceid": "1b166f8e-a207-48d3-a0a9-2ad6c44774b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:09:02 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:d2:f7,bridge_name='br-int',has_traffic_filtering=True,id=1b166f8e-a207-48d3-a0a9-2ad6c44774b2,network=Network(66316d10-fed3-4fb9-877e-a01542ca5855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b166f8e-a2') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:09:02 user nova-compute[82479]: DEBUG nova.objects.instance [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lazy-loading 'pci_devices' on Instance uuid 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:09:02 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] End _get_guest_xml xml=<domain type="kvm">
Apr 14 00:09:02 user nova-compute[82479]:   <uuid>1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a</uuid>
Apr 14 00:09:02 user nova-compute[82479]:   <name>instance-00000004</name>
Apr 14 00:09:02 user nova-compute[82479]:   <memory>131072</memory>
Apr 14 00:09:02 user nova-compute[82479]:   <vcpu>1</vcpu>
Apr 14 00:09:02 user nova-compute[82479]:   <metadata>
Apr 14 00:09:02 user nova-compute[82479]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 00:09:02 user nova-compute[82479]:       <nova:package version="0.0.0"/>
Apr 14 00:09:02 user nova-compute[82479]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-353632356</nova:name>
Apr 14 00:09:02 user nova-compute[82479]:       <nova:creationTime>2023-04-14 00:09:00</nova:creationTime>
Apr 14 00:09:02 user nova-compute[82479]:       <nova:flavor name="m1.nano">
Apr 14 00:09:02 user nova-compute[82479]:         <nova:memory>128</nova:memory>
Apr 14 00:09:02 user nova-compute[82479]:         <nova:disk>1</nova:disk>
Apr 14 00:09:02 user nova-compute[82479]:         <nova:swap>0</nova:swap>
Apr 14 00:09:02 user nova-compute[82479]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 00:09:02 user nova-compute[82479]:         <nova:vcpus>1</nova:vcpus>
Apr 14 00:09:02 user nova-compute[82479]:       </nova:flavor>
Apr 14 00:09:02 user nova-compute[82479]:       <nova:owner>
Apr 14 00:09:02 user nova-compute[82479]:         <nova:user uuid="2f8b18d40ecd4b4e976cf2018af8220c">tempest-AttachVolumeShelveTestJSON-1395403129-project-member</nova:user>
Apr 14 00:09:02 user nova-compute[82479]:         <nova:project uuid="4f20caf676a64b9b97027f3fc9bc724c">tempest-AttachVolumeShelveTestJSON-1395403129</nova:project>
Apr 14 00:09:02 user nova-compute[82479]:       </nova:owner>
Apr 14 00:09:02 user nova-compute[82479]:       <nova:root type="image" uuid="41e32c3a-9146-441b-a88f-b3319bc43f49"/>
Apr 14 00:09:02 user nova-compute[82479]:       <nova:ports>
Apr 14 00:09:02 user nova-compute[82479]:         <nova:port uuid="1b166f8e-a207-48d3-a0a9-2ad6c44774b2">
Apr 14 00:09:02 user nova-compute[82479]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 14 00:09:02 user nova-compute[82479]:         </nova:port>
Apr 14 00:09:02 user nova-compute[82479]:       </nova:ports>
Apr 14 00:09:02 user nova-compute[82479]:     </nova:instance>
Apr 14 00:09:02 user nova-compute[82479]:   </metadata>
Apr 14 00:09:02 user nova-compute[82479]:   <sysinfo type="smbios">
Apr 14 00:09:02 user nova-compute[82479]:     <system>
Apr 14 00:09:02 user nova-compute[82479]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 00:09:02 user nova-compute[82479]:       <entry name="product">OpenStack Nova</entry>
Apr 14 00:09:02 user nova-compute[82479]:       <entry name="version">0.0.0</entry>
Apr 14 00:09:02 user nova-compute[82479]:       <entry name="serial">1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a</entry>
Apr 14 00:09:02 user nova-compute[82479]:       <entry name="uuid">1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a</entry>
Apr 14 00:09:02 user nova-compute[82479]:       <entry name="family">Virtual Machine</entry>
Apr 14 00:09:02 user nova-compute[82479]:     </system>
Apr 14 00:09:02 user nova-compute[82479]:   </sysinfo>
Apr 14 00:09:02 user nova-compute[82479]:   <os>
Apr 14 00:09:02 user nova-compute[82479]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 00:09:02 user nova-compute[82479]:     <boot dev="hd"/>
Apr 14 00:09:02 user nova-compute[82479]:     <smbios mode="sysinfo"/>
Apr 14 00:09:02 user nova-compute[82479]:   </os>
Apr 14 00:09:02 user nova-compute[82479]:   <features>
Apr 14 00:09:02 user nova-compute[82479]:     <acpi/>
Apr 14 00:09:02 user nova-compute[82479]:     <apic/>
Apr 14 00:09:02 user nova-compute[82479]:     <vmcoreinfo/>
Apr 14 00:09:02 user nova-compute[82479]:   </features>
Apr 14 00:09:02 user nova-compute[82479]:   <clock offset="utc">
Apr 14 00:09:02 user nova-compute[82479]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 00:09:02 user nova-compute[82479]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 00:09:02 user nova-compute[82479]:     <timer name="hpet" present="no"/>
Apr 14 00:09:02 user nova-compute[82479]:   </clock>
Apr 14 00:09:02 user nova-compute[82479]:   <cpu mode="custom" match="exact">
Apr 14 00:09:02 user nova-compute[82479]:     <model>Nehalem</model>
Apr 14 00:09:02 user nova-compute[82479]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 00:09:02 user nova-compute[82479]:   </cpu>
Apr 14 00:09:02 user nova-compute[82479]:   <devices>
Apr 14 00:09:02 user nova-compute[82479]:     <disk type="file" device="disk">
Apr 14 00:09:02 user nova-compute[82479]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 00:09:02 user nova-compute[82479]:       <source file="/opt/stack/data/nova/instances/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a/disk"/>
Apr 14 00:09:02 user nova-compute[82479]:       <target dev="vda" bus="virtio"/>
Apr 14 00:09:02 user nova-compute[82479]:     </disk>
Apr 14 00:09:02 user nova-compute[82479]:     <disk type="block" device="disk">
Apr 14 00:09:02 user nova-compute[82479]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:09:02 user nova-compute[82479]:       <source dev="/dev/sdf"/>
Apr 14 00:09:02 user nova-compute[82479]:       <target dev="vdc" bus="virtio"/>
Apr 14 00:09:02 user nova-compute[82479]:       <serial>af1b05d2-717a-489c-8bdf-160d00ebd122</serial>
Apr 14 00:09:02 user nova-compute[82479]:     </disk>
Apr 14 00:09:02 user nova-compute[82479]:     <interface type="ethernet">
Apr 14 00:09:02 user nova-compute[82479]:       <mac address="fa:16:3e:2b:d2:f7"/>
Apr 14 00:09:02 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:09:02 user nova-compute[82479]:       <mtu size="1442"/>
Apr 14 00:09:02 user nova-compute[82479]:       <target dev="tap1b166f8e-a2"/>
Apr 14 00:09:02 user nova-compute[82479]:     </interface>
Apr 14 00:09:02 user nova-compute[82479]:     <serial type="pty">
Apr 14 00:09:02 user nova-compute[82479]:       <log file="/opt/stack/data/nova/instances/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a/console.log" append="off"/>
Apr 14 00:09:02 user nova-compute[82479]:     </serial>
Apr 14 00:09:02 user nova-compute[82479]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 00:09:02 user nova-compute[82479]:     <video>
Apr 14 00:09:02 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:09:02 user nova-compute[82479]:     </video>
Apr 14 00:09:02 user nova-compute[82479]:     <rng model="virtio">
Apr 14 00:09:02 user nova-compute[82479]:       <backend model="random">/dev/urandom</backend>
Apr 14 00:09:02 user nova-compute[82479]:     </rng>
Apr 14 00:09:02 user nova-compute[82479]:     <controller type="usb" index="0" model="none"/>
Apr 14 00:09:02 user nova-compute[82479]:     <memballoon model="virtio">
Apr 14 00:09:02 user nova-compute[82479]:       <stats period="10"/>
Apr 14 00:09:02 user nova-compute[82479]:     </memballoon>
Apr 14 00:09:02 user nova-compute[82479]:   </devices>
Apr 14 00:09:02 user nova-compute[82479]: </domain>
Apr 14 00:09:02 user nova-compute[82479]:  {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 00:09:02 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T00:04:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-353632356',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-353632356',id=4,image_ref='41e32c3a-9146-441b-a88f-b3319bc43f49',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-138977160',keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:05:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='4f20caf676a64b9b97027f3fc9bc724c',ramdisk_id='',reservation_id='r-0ad3gf97',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1395403129',owner_user_name='tempest-AttachVolumeShelveTestJSON-1395403129-project-member',shelved_at='2023-04-14T00:06:59.307008',shelved_host='user',shelved_image_id='41e32c3a-9146-441b-a88f-b3319bc43f49'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:08:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f8b18d40ecd4b4e976cf2018af8220c',uuid=1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "1b166f8e-a207-48d3-a0a9-2ad6c44774b2", "address": "fa:16:3e:2b:d2:f7", "network": {"id": "66316d10-fed3-4fb9-877e-a01542ca5855", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-93456010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f20caf676a64b9b97027f3fc9bc724c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b166f8e-a2", "ovs_interfaceid": "1b166f8e-a207-48d3-a0a9-2ad6c44774b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 00:09:02 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Converting VIF {"id": "1b166f8e-a207-48d3-a0a9-2ad6c44774b2", "address": "fa:16:3e:2b:d2:f7", "network": {"id": "66316d10-fed3-4fb9-877e-a01542ca5855", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-93456010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f20caf676a64b9b97027f3fc9bc724c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b166f8e-a2", "ovs_interfaceid": "1b166f8e-a207-48d3-a0a9-2ad6c44774b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:09:02 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:d2:f7,bridge_name='br-int',has_traffic_filtering=True,id=1b166f8e-a207-48d3-a0a9-2ad6c44774b2,network=Network(66316d10-fed3-4fb9-877e-a01542ca5855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b166f8e-a2') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:09:02 user nova-compute[82479]: DEBUG os_vif [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:d2:f7,bridge_name='br-int',has_traffic_filtering=True,id=1b166f8e-a207-48d3-a0a9-2ad6c44774b2,network=Network(66316d10-fed3-4fb9-877e-a01542ca5855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b166f8e-a2') {{(pid=82479) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 00:09:02 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:02 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:09:02 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 00:09:02 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:02 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1b166f8e-a2, may_exist=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:09:02 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1b166f8e-a2, col_values=(('external_ids', {'iface-id': '1b166f8e-a207-48d3-a0a9-2ad6c44774b2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2b:d2:f7', 'vm-uuid': '1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a'}),)) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:09:02 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:02 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:09:02 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:02 user nova-compute[82479]: INFO os_vif [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:d2:f7,bridge_name='br-int',has_traffic_filtering=True,id=1b166f8e-a207-48d3-a0a9-2ad6c44774b2,network=Network(66316d10-fed3-4fb9-877e-a01542ca5855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b166f8e-a2')
Apr 14 00:09:02 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:09:02 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] No BDM found with device name vdc, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:09:02 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] No VIF found with MAC fa:16:3e:2b:d2:f7, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:09:02 user nova-compute[82479]: INFO nova.compute.manager [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Rebuilding instance
Apr 14 00:09:02 user nova-compute[82479]: DEBUG nova.objects.instance [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lazy-loading 'trusted_certs' on Instance uuid b3475e7e-ceb4-452a-a045-dbf43c5944dd {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:09:02 user nova-compute[82479]: DEBUG nova.compute.manager [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:09:03 user nova-compute[82479]: DEBUG nova.objects.instance [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lazy-loading 'pci_requests' on Instance uuid b3475e7e-ceb4-452a-a045-dbf43c5944dd {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:09:03 user nova-compute[82479]: DEBUG nova.objects.instance [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lazy-loading 'pci_devices' on Instance uuid b3475e7e-ceb4-452a-a045-dbf43c5944dd {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:09:03 user nova-compute[82479]: DEBUG nova.objects.instance [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lazy-loading 'resources' on Instance uuid b3475e7e-ceb4-452a-a045-dbf43c5944dd {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:09:03 user nova-compute[82479]: DEBUG nova.objects.instance [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lazy-loading 'migration_context' on Instance uuid b3475e7e-ceb4-452a-a045-dbf43c5944dd {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:09:03 user nova-compute[82479]: DEBUG nova.objects.instance [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Trying to apply a migration context that does not seem to be set for this instance {{(pid=82479) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Apr 14 00:09:03 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:03 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:03 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681430943.2191188, 17c6c147-fb62-4204-a416-792b94d3f7dd => Resumed> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:09:03 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] VM Resumed (Lifecycle Event)
Apr 14 00:09:03 user nova-compute[82479]: DEBUG nova.compute.manager [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Instance event wait completed in 0 seconds for  {{(pid=82479) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 00:09:03 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Guest created on hypervisor {{(pid=82479) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 00:09:03 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Instance spawned successfully.
Apr 14 00:09:03 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 00:09:03 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:09:03 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:03 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:03 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:09:03 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Found default for hw_cdrom_bus of ide {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:09:03 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Found default for hw_disk_bus of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:09:03 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Found default for hw_input_bus of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:09:03 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Found default for hw_pointer_model of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:09:03 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Found default for hw_video_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:09:03 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Found default for hw_vif_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:09:03 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:03 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:09:03 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681430943.2262611, 17c6c147-fb62-4204-a416-792b94d3f7dd => Started> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:09:03 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] VM Started (Lifecycle Event)
Apr 14 00:09:03 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:09:03 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:09:03 user nova-compute[82479]: INFO nova.compute.manager [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Took 8.44 seconds to spawn the instance on the hypervisor.
Apr 14 00:09:03 user nova-compute[82479]: DEBUG nova.compute.manager [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:09:03 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:09:03 user nova-compute[82479]: DEBUG nova.compute.manager [req-e325ece9-40d7-49d9-b263-bd1aca824908 req-1f0041a1-6dc4-4912-b50e-1f5348f00674 service nova] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Received event network-vif-unplugged-617f05b8-c04e-4abf-b4e5-a0234209624a {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:09:03 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-e325ece9-40d7-49d9-b263-bd1aca824908 req-1f0041a1-6dc4-4912-b50e-1f5348f00674 service nova] Acquiring lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:09:03 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-e325ece9-40d7-49d9-b263-bd1aca824908 req-1f0041a1-6dc4-4912-b50e-1f5348f00674 service nova] Lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:09:03 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-e325ece9-40d7-49d9-b263-bd1aca824908 req-1f0041a1-6dc4-4912-b50e-1f5348f00674 service nova] Lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:09:03 user nova-compute[82479]: DEBUG nova.compute.manager [req-e325ece9-40d7-49d9-b263-bd1aca824908 req-1f0041a1-6dc4-4912-b50e-1f5348f00674 service nova] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] No waiting events found dispatching network-vif-unplugged-617f05b8-c04e-4abf-b4e5-a0234209624a {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:09:03 user nova-compute[82479]: WARNING nova.compute.manager [req-e325ece9-40d7-49d9-b263-bd1aca824908 req-1f0041a1-6dc4-4912-b50e-1f5348f00674 service nova] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Received unexpected event network-vif-unplugged-617f05b8-c04e-4abf-b4e5-a0234209624a for instance with vm_state active and task_state rebuilding.
Apr 14 00:09:03 user nova-compute[82479]: INFO nova.compute.manager [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Took 20.12 seconds to build instance.
Apr 14 00:09:03 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8c92becd-7702-4bfb-a692-9be50476eee6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "17c6c147-fb62-4204-a416-792b94d3f7dd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.223s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:09:03 user nova-compute[82479]: DEBUG nova.compute.manager [req-d33aa65b-f3be-4b9f-8ea9-6fc317c6349a req-3914e966-ba3f-4947-8163-46f7e80683c2 service nova] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Received event network-vif-plugged-b5dfa187-0a42-4319-990f-1d3b22691c27 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:09:03 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-d33aa65b-f3be-4b9f-8ea9-6fc317c6349a req-3914e966-ba3f-4947-8163-46f7e80683c2 service nova] Acquiring lock "01a65362-36ea-4817-8e83-f75d6daf808b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:09:03 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-d33aa65b-f3be-4b9f-8ea9-6fc317c6349a req-3914e966-ba3f-4947-8163-46f7e80683c2 service nova] Lock "01a65362-36ea-4817-8e83-f75d6daf808b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:09:03 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-d33aa65b-f3be-4b9f-8ea9-6fc317c6349a req-3914e966-ba3f-4947-8163-46f7e80683c2 service nova] Lock "01a65362-36ea-4817-8e83-f75d6daf808b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:09:03 user nova-compute[82479]: DEBUG nova.compute.manager [req-d33aa65b-f3be-4b9f-8ea9-6fc317c6349a req-3914e966-ba3f-4947-8163-46f7e80683c2 service nova] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] No waiting events found dispatching network-vif-plugged-b5dfa187-0a42-4319-990f-1d3b22691c27 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:09:03 user nova-compute[82479]: WARNING nova.compute.manager [req-d33aa65b-f3be-4b9f-8ea9-6fc317c6349a req-3914e966-ba3f-4947-8163-46f7e80683c2 service nova] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Received unexpected event network-vif-plugged-b5dfa187-0a42-4319-990f-1d3b22691c27 for instance with vm_state stopped and task_state powering-on.
Apr 14 00:09:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:04 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681430944.4564233, 01a65362-36ea-4817-8e83-f75d6daf808b => Resumed> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:09:04 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] VM Resumed (Lifecycle Event)
Apr 14 00:09:04 user nova-compute[82479]: DEBUG nova.compute.manager [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Instance event wait completed in 0 seconds for  {{(pid=82479) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 00:09:04 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Instance rebooted successfully.
Apr 14 00:09:04 user nova-compute[82479]: DEBUG nova.compute.manager [None req-eb9025ea-839c-4404-be35-2545dcdab604 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:09:04 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:09:04 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:09:04 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] During sync_power_state the instance has a pending task (powering-on). Skip.
Apr 14 00:09:04 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681430944.456832, 01a65362-36ea-4817-8e83-f75d6daf808b => Started> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:09:04 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] VM Started (Lifecycle Event)
Apr 14 00:09:04 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:09:04 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:09:04 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Instance destroyed successfully.
Apr 14 00:09:04 user nova-compute[82479]: INFO nova.compute.manager [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Detaching volume 49172d5a-2944-486a-a080-04548e55ac0d
Apr 14 00:09:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:04 user nova-compute[82479]: INFO nova.virt.block_device [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Attempting to driver detach volume 49172d5a-2944-486a-a080-04548e55ac0d from mountpoint /dev/vdb
Apr 14 00:09:04 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Attempting to detach device vdb from instance b3475e7e-ceb4-452a-a045-dbf43c5944dd from the persistent domain config. {{(pid=82479) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 00:09:04 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 00:09:04 user nova-compute[82479]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:09:04 user nova-compute[82479]:   <source dev="/dev/sde"/>
Apr 14 00:09:04 user nova-compute[82479]:   <target dev="vdb" bus="virtio"/>
Apr 14 00:09:04 user nova-compute[82479]:   <serial>49172d5a-2944-486a-a080-04548e55ac0d</serial>
Apr 14 00:09:04 user nova-compute[82479]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 00:09:04 user nova-compute[82479]: </disk>
Apr 14 00:09:04 user nova-compute[82479]:  {{(pid=82479) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 00:09:04 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Successfully detached device vdb from instance b3475e7e-ceb4-452a-a045-dbf43c5944dd from the persistent domain config.
Apr 14 00:09:04 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] calling os-brick to detach iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 00:09:04 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, {'target_iqn': 'iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mpSjLhaD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:09:04 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 14 00:09:04 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:09:04 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:09:04 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:05 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:05 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[7053e315-2144-4daf-b135-06cf91bfe7c4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:09:05 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 00:09:05 user nova-compute[82479]: No targets found.
Apr 14 00:09:05 user nova-compute[82479]: iSNS:
Apr 14 00:09:05 user nova-compute[82479]: No targets found.
Apr 14 00:09:05 user nova-compute[82479]: STATIC:
Apr 14 00:09:05 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc
Apr 14 00:09:05 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:09:05 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:09:05 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d
Apr 14 00:09:05 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:09:05 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:09:05 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7
Apr 14 00:09:05 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:09:05 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:09:05 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122
Apr 14 00:09:05 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:09:05 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:09:05 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a
Apr 14 00:09:05 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:09:05 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:09:05 user nova-compute[82479]: FIRMWARE:
Apr 14 00:09:05 user nova-compute[82479]: No targets found.
Apr 14 00:09:05 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:09:05 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 00:09:05 user nova-compute[82479]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 00:09:05 user nova-compute[82479]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82479) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 00:09:05 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d', 0)] {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 00:09:05 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:05 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:05 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6bd2e9-8364-4ef0-912a-20afc3ac6683]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:09:05 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:05 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:05 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7755708-2d7b-41db-9029-a0ca8ce4701d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:09:05 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)
Apr 14 00:09:05 user nova-compute[82479]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:09:05 user nova-compute[82479]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:09:05 user nova-compute[82479]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d (non-flash)
Apr 14 00:09:05 user nova-compute[82479]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 (non-flash)
Apr 14 00:09:05 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:09:05 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)
Apr 14 00:09:05 user nova-compute[82479]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:09:05 user nova-compute[82479]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:09:05 user nova-compute[82479]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d (non-flash)
Apr 14 00:09:05 user nova-compute[82479]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 (non-flash)
Apr 14 00:09:05 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:09:05 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3344cd8820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d'): ({'sde'}, set())}) {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 00:09:05 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Removing single pathed devices sde {{(pid=82479) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 00:09:05 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:05 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:05 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb6fff8-e3f3-49f6-ab38-9bb55eed0821]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:09:05 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:05 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:05 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b17d22e-94ca-435a-a1ac-1ca7f0f16f85]: (4, ('ok\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:09:05 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Flushing IO for device /dev/sde {{(pid=82479) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 00:09:05 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:05 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:05 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[53235728-e75d-429a-8b63-29289bb94e49]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:09:05 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=82479) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 00:09:05 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:05 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:05 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5dae124-648c-4f32-b182-de17092174c0]: (4, ('1', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:09:05 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 00:09:05 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] SCSI volumes sde have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 00:09:05 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d')] {{(pid=82479) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 00:09:05 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:05 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:05 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e68e8f-e084-420e-9b1c-7678216bfcf5]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:09:05 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:09:05 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d -p 172.16.0.220:3260 --logout {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:05 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:05 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c44f2e-a944-4327-abfe-13556b69f895]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:09:05 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d, portal: 172.16.0.220,3260]
Apr 14 00:09:05 user nova-compute[82479]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d, portal: 172.16.0.220,3260] successful.
Apr 14 00:09:05 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:09:05 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d -p 172.16.0.220:3260 --op delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:05 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:05 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebef99c5-9115-4c80-9356-0d3b8f489e09]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:09:05 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:09:05 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.373s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:09:05 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] <== disconnect_volume: return (374ms) None {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:09:05 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Disconnected iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 00:09:05 user nova-compute[82479]: DEBUG nova.compute.manager [req-79340392-ad1e-48fe-a793-f789451c05b6 req-918f6948-51d4-4022-a7f5-b73ff8511a0f service nova] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Received event network-vif-plugged-617f05b8-c04e-4abf-b4e5-a0234209624a {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:09:05 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-79340392-ad1e-48fe-a793-f789451c05b6 req-918f6948-51d4-4022-a7f5-b73ff8511a0f service nova] Acquiring lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:09:05 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-79340392-ad1e-48fe-a793-f789451c05b6 req-918f6948-51d4-4022-a7f5-b73ff8511a0f service nova] Lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:09:05 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-79340392-ad1e-48fe-a793-f789451c05b6 req-918f6948-51d4-4022-a7f5-b73ff8511a0f service nova] Lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:09:05 user nova-compute[82479]: DEBUG nova.compute.manager [req-79340392-ad1e-48fe-a793-f789451c05b6 req-918f6948-51d4-4022-a7f5-b73ff8511a0f service nova] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] No waiting events found dispatching network-vif-plugged-617f05b8-c04e-4abf-b4e5-a0234209624a {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:09:05 user nova-compute[82479]: WARNING nova.compute.manager [req-79340392-ad1e-48fe-a793-f789451c05b6 req-918f6948-51d4-4022-a7f5-b73ff8511a0f service nova] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Received unexpected event network-vif-plugged-617f05b8-c04e-4abf-b4e5-a0234209624a for instance with vm_state active and task_state rebuilding.
Apr 14 00:09:05 user nova-compute[82479]: DEBUG nova.compute.manager [req-79340392-ad1e-48fe-a793-f789451c05b6 req-918f6948-51d4-4022-a7f5-b73ff8511a0f service nova] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Received event network-vif-plugged-1b166f8e-a207-48d3-a0a9-2ad6c44774b2 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:09:05 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-79340392-ad1e-48fe-a793-f789451c05b6 req-918f6948-51d4-4022-a7f5-b73ff8511a0f service nova] Acquiring lock "1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:09:05 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-79340392-ad1e-48fe-a793-f789451c05b6 req-918f6948-51d4-4022-a7f5-b73ff8511a0f service nova] Lock "1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:09:05 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-79340392-ad1e-48fe-a793-f789451c05b6 req-918f6948-51d4-4022-a7f5-b73ff8511a0f service nova] Lock "1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:09:05 user nova-compute[82479]: DEBUG nova.compute.manager [req-79340392-ad1e-48fe-a793-f789451c05b6 req-918f6948-51d4-4022-a7f5-b73ff8511a0f service nova] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] No waiting events found dispatching network-vif-plugged-1b166f8e-a207-48d3-a0a9-2ad6c44774b2 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:09:05 user nova-compute[82479]: WARNING nova.compute.manager [req-79340392-ad1e-48fe-a793-f789451c05b6 req-918f6948-51d4-4022-a7f5-b73ff8511a0f service nova] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Received unexpected event network-vif-plugged-1b166f8e-a207-48d3-a0a9-2ad6c44774b2 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 14 00:09:05 user nova-compute[82479]: DEBUG nova.compute.manager [req-79340392-ad1e-48fe-a793-f789451c05b6 req-918f6948-51d4-4022-a7f5-b73ff8511a0f service nova] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Received event network-vif-plugged-1b166f8e-a207-48d3-a0a9-2ad6c44774b2 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:09:05 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-79340392-ad1e-48fe-a793-f789451c05b6 req-918f6948-51d4-4022-a7f5-b73ff8511a0f service nova] Acquiring lock "1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:09:05 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-79340392-ad1e-48fe-a793-f789451c05b6 req-918f6948-51d4-4022-a7f5-b73ff8511a0f service nova] Lock "1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:09:05 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-79340392-ad1e-48fe-a793-f789451c05b6 req-918f6948-51d4-4022-a7f5-b73ff8511a0f service nova] Lock "1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:09:05 user nova-compute[82479]: DEBUG nova.compute.manager [req-79340392-ad1e-48fe-a793-f789451c05b6 req-918f6948-51d4-4022-a7f5-b73ff8511a0f service nova] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] No waiting events found dispatching network-vif-plugged-1b166f8e-a207-48d3-a0a9-2ad6c44774b2 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:09:05 user nova-compute[82479]: WARNING nova.compute.manager [req-79340392-ad1e-48fe-a793-f789451c05b6 req-918f6948-51d4-4022-a7f5-b73ff8511a0f service nova] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Received unexpected event network-vif-plugged-1b166f8e-a207-48d3-a0a9-2ad6c44774b2 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 14 00:09:05 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:06 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Instance destroyed successfully.
Apr 14 00:09:06 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:05:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-2144192259',display_name='tempest-ServerActionsTestJSON-server-1662090424',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-2144192259',id=6,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD8E1mkrqLo3jsCiJcIvha4CNzW2T6/HQ38hZ5dGaGtUghmrHejTJlAuKgmy6xusLbaAzGTrJCKVkdgQ5v0CqCqGeNMDA89aLJgLl5KHn3gvI39SkbPja84HarSvbQbbXg==',key_name='tempest-keypair-1040271550',keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:05:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='bf8663ccad9047f4b11b9ae0646c287a',ramdisk_id='',reservation_id='r-amqn5295',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-948553482',owner_user_name='tempest-ServerActionsTestJSON-948553482-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:09:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d86662f2c7648daad87118b7e9f757c',uuid=b3475e7e-ceb4-452a-a045-dbf43c5944dd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "617f05b8-c04e-4abf-b4e5-a0234209624a", "address": "fa:16:3e:f9:fd:1a", "network": {"id": "cb8c9bb1-a885-486d-aa6a-de600bc01c2e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1676259779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8663ccad9047f4b11b9ae0646c287a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617f05b8-c0", "ovs_interfaceid": "617f05b8-c04e-4abf-b4e5-a0234209624a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 00:09:06 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Converting VIF {"id": "617f05b8-c04e-4abf-b4e5-a0234209624a", "address": "fa:16:3e:f9:fd:1a", "network": {"id": "cb8c9bb1-a885-486d-aa6a-de600bc01c2e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1676259779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8663ccad9047f4b11b9ae0646c287a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617f05b8-c0", "ovs_interfaceid": "617f05b8-c04e-4abf-b4e5-a0234209624a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:09:06 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:fd:1a,bridge_name='br-int',has_traffic_filtering=True,id=617f05b8-c04e-4abf-b4e5-a0234209624a,network=Network(cb8c9bb1-a885-486d-aa6a-de600bc01c2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap617f05b8-c0') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:09:06 user nova-compute[82479]: DEBUG os_vif [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:fd:1a,bridge_name='br-int',has_traffic_filtering=True,id=617f05b8-c04e-4abf-b4e5-a0234209624a,network=Network(cb8c9bb1-a885-486d-aa6a-de600bc01c2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap617f05b8-c0') {{(pid=82479) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 00:09:06 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:06 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap617f05b8-c0, bridge=br-int, if_exists=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:09:06 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:06 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:09:06 user nova-compute[82479]: INFO os_vif [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:fd:1a,bridge_name='br-int',has_traffic_filtering=True,id=617f05b8-c04e-4abf-b4e5-a0234209624a,network=Network(cb8c9bb1-a885-486d-aa6a-de600bc01c2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap617f05b8-c0')
Apr 14 00:09:06 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] calling os-brick to detach iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 00:09:06 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, {'target_iqn': 'iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mpSjLhaD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:09:06 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 14 00:09:06 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:09:06 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:09:06 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:06 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:06 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ecdb7c2-9d22-495a-9851-10a02c674c1e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:09:06 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 00:09:06 user nova-compute[82479]: No targets found.
Apr 14 00:09:06 user nova-compute[82479]: iSNS:
Apr 14 00:09:06 user nova-compute[82479]: No targets found.
Apr 14 00:09:06 user nova-compute[82479]: STATIC:
Apr 14 00:09:06 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc
Apr 14 00:09:06 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:09:06 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:09:06 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7
Apr 14 00:09:06 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:09:06 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:09:06 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122
Apr 14 00:09:06 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:09:06 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:09:06 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a
Apr 14 00:09:06 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:09:06 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:09:06 user nova-compute[82479]: FIRMWARE:
Apr 14 00:09:06 user nova-compute[82479]: No targets found.
Apr 14 00:09:06 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:09:06 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 00:09:06 user nova-compute[82479]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 00:09:06 user nova-compute[82479]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82479) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 00:09:06 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d', 0)] {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 00:09:06 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:06 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:06 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[261f36bd-4c22-4f79-a79e-08d6f9fe3e07]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:09:06 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:06 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:06 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e96894-32c1-4d54-ad78-0ca4da12e9c1]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:09:06 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)
Apr 14 00:09:06 user nova-compute[82479]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:09:06 user nova-compute[82479]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:09:06 user nova-compute[82479]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 (non-flash)
Apr 14 00:09:06 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:09:06 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)
Apr 14 00:09:06 user nova-compute[82479]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:09:06 user nova-compute[82479]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:09:06 user nova-compute[82479]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 (non-flash)
Apr 14 00:09:06 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:09:06 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3344bd4820>, {}) {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 00:09:06 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Disconnecting from: [] {{(pid=82479) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 00:09:06 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.079s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:09:06 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] <== disconnect_volume: return (80ms) None {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:09:06 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Disconnected iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 00:09:06 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Deleting instance files /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd_del
Apr 14 00:09:06 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Deletion of /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd_del complete
Apr 14 00:09:06 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681430946.7330036, 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a => Resumed> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:09:06 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] VM Resumed (Lifecycle Event)
Apr 14 00:09:06 user nova-compute[82479]: DEBUG nova.compute.manager [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Instance event wait completed in 0 seconds for  {{(pid=82479) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 00:09:06 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Guest created on hypervisor {{(pid=82479) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 00:09:06 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Instance spawned successfully.
Apr 14 00:09:06 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:09:06 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:09:06 user nova-compute[82479]: INFO nova.virt.block_device [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Booting with volume 49172d5a-2944-486a-a080-04548e55ac0d at /dev/vdb
Apr 14 00:09:06 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:09:06 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681430946.740628, 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a => Started> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:09:06 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] VM Started (Lifecycle Event)
Apr 14 00:09:06 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:09:06 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:09:06 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:09:06 user nova-compute[82479]: DEBUG os_brick.utils [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:09:06 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:06 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:06 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc1ea54-d18c-45e7-bf0e-f3a1e47decc5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fec92fcfdd3\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:09:06 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:06 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:06 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d9a0f8-7c77-4d3e-b9bf-fd42587e3ae3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:09:06 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:06 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:06 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1efa3b2-bc78-4856-a2ae-792edfd98f35]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:09:06 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a85d5c-5003-4902-9cf3-7923973ef575]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:09:06 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Running cmd (subprocess): nvme version {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:07 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] 'nvme version' failed. Not Retrying. {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:09:07 user nova-compute[82479]: DEBUG nova.compute.manager [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:09:07 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] nvme not present on system {{(pid=82479) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 00:09:07 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:07 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:09:07 user nova-compute[82479]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 00:09:07 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[f59f855c-ec4a-4f55-a005-d9fdc12b3753]: (4, '') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:09:07 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82479) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 00:09:07 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 00:09:07 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] LIGHTOS: no hostnqn found. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 00:09:07 user nova-compute[82479]: DEBUG os_brick.utils [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] <== get_connector_properties: return (171ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fec92fcfdd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:09:07 user nova-compute[82479]: DEBUG nova.virt.block_device [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Updating existing volume attachment record: a341bb68-6a2f-4266-9e1c-92874d4bb63a {{(pid=82479) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 00:09:07 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d12139f0-59c1-4a14-9b35-f9a245039363 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 19.146s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:09:10 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:11 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:12 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Creating instance directory {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 00:09:12 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Creating image(s)
Apr 14 00:09:12 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "/opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:09:12 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "/opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:09:12 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "/opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:09:12 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:12 user nova-compute[82479]: DEBUG nova.compute.manager [req-bf1b89fa-f089-41a7-bdd9-55a0da5b4d3d req-f0977e8e-338f-4b9d-b05a-4290417f5b98 service nova] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Received event network-changed-526b82aa-8f72-4ad7-8c1f-2aac7a4a2111 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:09:12 user nova-compute[82479]: DEBUG nova.compute.manager [req-bf1b89fa-f089-41a7-bdd9-55a0da5b4d3d req-f0977e8e-338f-4b9d-b05a-4290417f5b98 service nova] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Refreshing instance network info cache due to event network-changed-526b82aa-8f72-4ad7-8c1f-2aac7a4a2111. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:09:12 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-bf1b89fa-f089-41a7-bdd9-55a0da5b4d3d req-f0977e8e-338f-4b9d-b05a-4290417f5b98 service nova] Acquiring lock "refresh_cache-e3fba4ee-4aae-4ee3-8114-b53510f5442c" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:09:12 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-bf1b89fa-f089-41a7-bdd9-55a0da5b4d3d req-f0977e8e-338f-4b9d-b05a-4290417f5b98 service nova] Acquired lock "refresh_cache-e3fba4ee-4aae-4ee3-8114-b53510f5442c" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:09:12 user nova-compute[82479]: DEBUG nova.network.neutron [req-bf1b89fa-f089-41a7-bdd9-55a0da5b4d3d req-f0977e8e-338f-4b9d-b05a-4290417f5b98 service nova] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Refreshing network info cache for port 526b82aa-8f72-4ad7-8c1f-2aac7a4a2111 {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:09:12 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.237s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:12 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "3e200e101633f2016e569ae4c0a352380507d1e4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:09:12 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "3e200e101633f2016e569ae4c0a352380507d1e4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:09:12 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:12 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.152s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:12 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk 1073741824 {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:12 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk 1073741824" returned: 0 in 0.054s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:12 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "3e200e101633f2016e569ae4c0a352380507d1e4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.211s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:09:12 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:12 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.165s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:12 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk. size=1073741824 {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 00:09:12 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG nova.network.neutron [req-bf1b89fa-f089-41a7-bdd9-55a0da5b4d3d req-f0977e8e-338f-4b9d-b05a-4290417f5b98 service nova] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Updated VIF entry in instance network info cache for port 526b82aa-8f72-4ad7-8c1f-2aac7a4a2111. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG nova.network.neutron [req-bf1b89fa-f089-41a7-bdd9-55a0da5b4d3d req-f0977e8e-338f-4b9d-b05a-4290417f5b98 service nova] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Updating instance_info_cache with network_info: [{"id": "526b82aa-8f72-4ad7-8c1f-2aac7a4a2111", "address": "fa:16:3e:1f:09:96", "network": {"id": "6d80f923-8aef-45df-921b-f77ed4ff0e75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-696070096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44c9d67ad2fa4cb9ab309b98f8fe051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap526b82aa-8f", "ovs_interfaceid": "526b82aa-8f72-4ad7-8c1f-2aac7a4a2111", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Cannot resize image /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk to a smaller size. {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Created local disks {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Ensure instance console log exists: /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/console.log {{(pid=82479) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Start _get_guest_xml network_info=[{"id": "617f05b8-c04e-4abf-b4e5-a0234209624a", "address": "fa:16:3e:f9:fd:1a", "network": {"id": "cb8c9bb1-a885-486d-aa6a-de600bc01c2e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1676259779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8663ccad9047f4b11b9ae0646c287a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617f05b8-c0", "ovs_interfaceid": "617f05b8-c04e-4abf-b4e5-a0234209624a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': None, 'device_type': 'disk', 'delete_on_termination': False, 'attachment_id': 'a341bb68-6a2f-4266-9e1c-92874d4bb63a', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mpSjLhaD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b3475e7e-ceb4-452a-a045-dbf43c5944dd', 'attached_at': '', 'detached_at': '', 'volume_id': '49172d5a-2944-486a-a080-04548e55ac0d', 'serial': '49172d5a-2944-486a-a080-04548e55ac0d'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-bf1b89fa-f089-41a7-bdd9-55a0da5b4d3d req-f0977e8e-338f-4b9d-b05a-4290417f5b98 service nova] Releasing lock "refresh_cache-e3fba4ee-4aae-4ee3-8114-b53510f5442c" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:09:13 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Apr 14 00:09:13 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Apr 14 00:09:13 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82479) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T00:02:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Flavor limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Image limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Flavor pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Image pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Got 1 possible topologies {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG nova.objects.instance [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lazy-loading 'vcpu_model' on Instance uuid b3475e7e-ceb4-452a-a045-dbf43c5944dd {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Calling os-brick to attach iSCSI Volume {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mpSjLhaD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:09:13 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 14 00:09:13 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:09:13 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 14 00:09:13 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:09:13 user nova-compute[82479]: INFO os_brick.initiator.connectors.iscsi [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 00:09:13 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d -p 172.16.0.220:3260 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a69df96-a5ae-4a95-a10d-45f889ae7584]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 00:09:13 user nova-compute[82479]:  {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d -p 172.16.0.220:3260 --interface default --op new {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c70578-d08c-4262-b32e-9573899581df]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d] added\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d] added
Apr 14 00:09:13 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[e570b3ec-ead7-477f-a4c4-9c4a4bd1bf69]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89e2c31-3d7d-446a-b860-9537aa6284c9]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mpSjLhaD {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mpSjLhaD" returned: 0 in 0.022s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3c7763-3042-4158-bd5d-db6388ff08ff]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mpSjLhaD'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f9b46b-e851-48c1-9888-d33f6eb22d01]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[23816b89-bc9b-4479-86a6-485514fdf10e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)
Apr 14 00:09:13 user nova-compute[82479]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:09:13 user nova-compute[82479]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:09:13 user nova-compute[82479]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 (non-flash)
Apr 14 00:09:13 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)
Apr 14 00:09:13 user nova-compute[82479]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:09:13 user nova-compute[82479]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:09:13 user nova-compute[82479]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 (non-flash)
Apr 14 00:09:13 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d -p 172.16.0.220:3260 --login {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[a652cb85-c923-47f6-8358-ebf730df4562]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d, portal: 172.16.0.220,3260]
Apr 14 00:09:13 user nova-compute[82479]: Login to [iface: default, target: iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d, portal: 172.16.0.220,3260] successful.
Apr 14 00:09:13 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.039s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e064b7-4082-4b88-aae3-d8871e4bf5e5]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[debaed78-410f-4549-bf9c-ea7f50f0fc0f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)
Apr 14 00:09:13 user nova-compute[82479]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:09:13 user nova-compute[82479]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:09:13 user nova-compute[82479]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 (non-flash)
Apr 14 00:09:13 user nova-compute[82479]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d (non-flash)
Apr 14 00:09:13 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)
Apr 14 00:09:13 user nova-compute[82479]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:09:13 user nova-compute[82479]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:09:13 user nova-compute[82479]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 (non-flash)
Apr 14 00:09:13 user nova-compute[82479]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d (non-flash)
Apr 14 00:09:13 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.367s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Connected to 172.16.0.220:3260 {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] HCTL ('36', '-', '-', 0) found on session 16 with lun 0 {{(pid=82479) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=82479) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.023s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d1d8cb-b46a-48b0-aa74-28e182c52f0f]: (4, ('- - 0', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Searching for a device in session 16 and hctl ['36', '*', '*', 0] yield: sde {{(pid=82479) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 00:09:13 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mpSjLhaD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 00:09:14 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.415s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:09:14 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] <== connect_volume: return (1417ms) {'type': 'block', 'scsi_wwn': '23735346365396464', 'path': '/dev/sde'} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:09:14 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23735346365396464', 'path': '/dev/sde'} {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 00:09:14 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T00:05:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-2144192259',display_name='tempest-ServerActionsTestJSON-server-1662090424',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-2144192259',id=6,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD8E1mkrqLo3jsCiJcIvha4CNzW2T6/HQ38hZ5dGaGtUghmrHejTJlAuKgmy6xusLbaAzGTrJCKVkdgQ5v0CqCqGeNMDA89aLJgLl5KHn3gvI39SkbPja84HarSvbQbbXg==',key_name='tempest-keypair-1040271550',keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:05:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='bf8663ccad9047f4b11b9ae0646c287a',ramdisk_id='',reservation_id='r-amqn5295',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-948553482',owner_user_name='tempest-ServerActionsTestJSON-948553482-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:09:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d86662f2c7648daad87118b7e9f757c',uuid=b3475e7e-ceb4-452a-a045-dbf43c5944dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "617f05b8-c04e-4abf-b4e5-a0234209624a", "address": "fa:16:3e:f9:fd:1a", "network": {"id": "cb8c9bb1-a885-486d-aa6a-de600bc01c2e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1676259779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8663ccad9047f4b11b9ae0646c287a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617f05b8-c0", "ovs_interfaceid": "617f05b8-c04e-4abf-b4e5-a0234209624a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82479) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 00:09:14 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Converting VIF {"id": "617f05b8-c04e-4abf-b4e5-a0234209624a", "address": "fa:16:3e:f9:fd:1a", "network": {"id": "cb8c9bb1-a885-486d-aa6a-de600bc01c2e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1676259779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8663ccad9047f4b11b9ae0646c287a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617f05b8-c0", "ovs_interfaceid": "617f05b8-c04e-4abf-b4e5-a0234209624a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:09:14 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:fd:1a,bridge_name='br-int',has_traffic_filtering=True,id=617f05b8-c04e-4abf-b4e5-a0234209624a,network=Network(cb8c9bb1-a885-486d-aa6a-de600bc01c2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap617f05b8-c0') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:09:14 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] End _get_guest_xml xml=<domain type="kvm">
Apr 14 00:09:14 user nova-compute[82479]:   <uuid>b3475e7e-ceb4-452a-a045-dbf43c5944dd</uuid>
Apr 14 00:09:14 user nova-compute[82479]:   <name>instance-00000006</name>
Apr 14 00:09:14 user nova-compute[82479]:   <memory>131072</memory>
Apr 14 00:09:14 user nova-compute[82479]:   <vcpu>1</vcpu>
Apr 14 00:09:14 user nova-compute[82479]:   <metadata>
Apr 14 00:09:14 user nova-compute[82479]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 00:09:14 user nova-compute[82479]:       <nova:package version="0.0.0"/>
Apr 14 00:09:14 user nova-compute[82479]:       <nova:name>tempest-ServerActionsTestJSON-server-1662090424</nova:name>
Apr 14 00:09:14 user nova-compute[82479]:       <nova:creationTime>2023-04-14 00:09:13</nova:creationTime>
Apr 14 00:09:14 user nova-compute[82479]:       <nova:flavor name="m1.nano">
Apr 14 00:09:14 user nova-compute[82479]:         <nova:memory>128</nova:memory>
Apr 14 00:09:14 user nova-compute[82479]:         <nova:disk>1</nova:disk>
Apr 14 00:09:14 user nova-compute[82479]:         <nova:swap>0</nova:swap>
Apr 14 00:09:14 user nova-compute[82479]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 00:09:14 user nova-compute[82479]:         <nova:vcpus>1</nova:vcpus>
Apr 14 00:09:14 user nova-compute[82479]:       </nova:flavor>
Apr 14 00:09:14 user nova-compute[82479]:       <nova:owner>
Apr 14 00:09:14 user nova-compute[82479]:         <nova:user uuid="3d86662f2c7648daad87118b7e9f757c">tempest-ServerActionsTestJSON-948553482-project-member</nova:user>
Apr 14 00:09:14 user nova-compute[82479]:         <nova:project uuid="bf8663ccad9047f4b11b9ae0646c287a">tempest-ServerActionsTestJSON-948553482</nova:project>
Apr 14 00:09:14 user nova-compute[82479]:       </nova:owner>
Apr 14 00:09:14 user nova-compute[82479]:       <nova:root type="image" uuid="6db62068-7278-4cd8-b41f-d0140d89e199"/>
Apr 14 00:09:14 user nova-compute[82479]:       <nova:ports>
Apr 14 00:09:14 user nova-compute[82479]:         <nova:port uuid="617f05b8-c04e-4abf-b4e5-a0234209624a">
Apr 14 00:09:14 user nova-compute[82479]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 14 00:09:14 user nova-compute[82479]:         </nova:port>
Apr 14 00:09:14 user nova-compute[82479]:       </nova:ports>
Apr 14 00:09:14 user nova-compute[82479]:     </nova:instance>
Apr 14 00:09:14 user nova-compute[82479]:   </metadata>
Apr 14 00:09:14 user nova-compute[82479]:   <sysinfo type="smbios">
Apr 14 00:09:14 user nova-compute[82479]:     <system>
Apr 14 00:09:14 user nova-compute[82479]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 00:09:14 user nova-compute[82479]:       <entry name="product">OpenStack Nova</entry>
Apr 14 00:09:14 user nova-compute[82479]:       <entry name="version">0.0.0</entry>
Apr 14 00:09:14 user nova-compute[82479]:       <entry name="serial">b3475e7e-ceb4-452a-a045-dbf43c5944dd</entry>
Apr 14 00:09:14 user nova-compute[82479]:       <entry name="uuid">b3475e7e-ceb4-452a-a045-dbf43c5944dd</entry>
Apr 14 00:09:14 user nova-compute[82479]:       <entry name="family">Virtual Machine</entry>
Apr 14 00:09:14 user nova-compute[82479]:     </system>
Apr 14 00:09:14 user nova-compute[82479]:   </sysinfo>
Apr 14 00:09:14 user nova-compute[82479]:   <os>
Apr 14 00:09:14 user nova-compute[82479]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 00:09:14 user nova-compute[82479]:     <boot dev="hd"/>
Apr 14 00:09:14 user nova-compute[82479]:     <smbios mode="sysinfo"/>
Apr 14 00:09:14 user nova-compute[82479]:   </os>
Apr 14 00:09:14 user nova-compute[82479]:   <features>
Apr 14 00:09:14 user nova-compute[82479]:     <acpi/>
Apr 14 00:09:14 user nova-compute[82479]:     <apic/>
Apr 14 00:09:14 user nova-compute[82479]:     <vmcoreinfo/>
Apr 14 00:09:14 user nova-compute[82479]:   </features>
Apr 14 00:09:14 user nova-compute[82479]:   <clock offset="utc">
Apr 14 00:09:14 user nova-compute[82479]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 00:09:14 user nova-compute[82479]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 00:09:14 user nova-compute[82479]:     <timer name="hpet" present="no"/>
Apr 14 00:09:14 user nova-compute[82479]:   </clock>
Apr 14 00:09:14 user nova-compute[82479]:   <cpu mode="custom" match="exact">
Apr 14 00:09:14 user nova-compute[82479]:     <model>Nehalem</model>
Apr 14 00:09:14 user nova-compute[82479]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 00:09:14 user nova-compute[82479]:   </cpu>
Apr 14 00:09:14 user nova-compute[82479]:   <devices>
Apr 14 00:09:14 user nova-compute[82479]:     <disk type="file" device="disk">
Apr 14 00:09:14 user nova-compute[82479]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 00:09:14 user nova-compute[82479]:       <source file="/opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk"/>
Apr 14 00:09:14 user nova-compute[82479]:       <target dev="vda" bus="virtio"/>
Apr 14 00:09:14 user nova-compute[82479]:     </disk>
Apr 14 00:09:14 user nova-compute[82479]:     <disk type="block" device="disk">
Apr 14 00:09:14 user nova-compute[82479]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:09:14 user nova-compute[82479]:       <source dev="/dev/sde"/>
Apr 14 00:09:14 user nova-compute[82479]:       <target dev="vdb" bus="virtio"/>
Apr 14 00:09:14 user nova-compute[82479]:       <serial>49172d5a-2944-486a-a080-04548e55ac0d</serial>
Apr 14 00:09:14 user nova-compute[82479]:     </disk>
Apr 14 00:09:14 user nova-compute[82479]:     <interface type="ethernet">
Apr 14 00:09:14 user nova-compute[82479]:       <mac address="fa:16:3e:f9:fd:1a"/>
Apr 14 00:09:14 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:09:14 user nova-compute[82479]:       <mtu size="1442"/>
Apr 14 00:09:14 user nova-compute[82479]:       <target dev="tap617f05b8-c0"/>
Apr 14 00:09:14 user nova-compute[82479]:     </interface>
Apr 14 00:09:14 user nova-compute[82479]:     <serial type="pty">
Apr 14 00:09:14 user nova-compute[82479]:       <log file="/opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/console.log" append="off"/>
Apr 14 00:09:14 user nova-compute[82479]:     </serial>
Apr 14 00:09:14 user nova-compute[82479]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 00:09:14 user nova-compute[82479]:     <video>
Apr 14 00:09:14 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:09:14 user nova-compute[82479]:     </video>
Apr 14 00:09:14 user nova-compute[82479]:     <rng model="virtio">
Apr 14 00:09:14 user nova-compute[82479]:       <backend model="random">/dev/urandom</backend>
Apr 14 00:09:14 user nova-compute[82479]:     </rng>
Apr 14 00:09:14 user nova-compute[82479]:     <controller type="usb" index="0" model="none"/>
Apr 14 00:09:14 user nova-compute[82479]:     <memballoon model="virtio">
Apr 14 00:09:14 user nova-compute[82479]:       <stats period="10"/>
Apr 14 00:09:14 user nova-compute[82479]:     </memballoon>
Apr 14 00:09:14 user nova-compute[82479]:   </devices>
Apr 14 00:09:14 user nova-compute[82479]: </domain>
Apr 14 00:09:14 user nova-compute[82479]:  {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 00:09:14 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T00:05:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-2144192259',display_name='tempest-ServerActionsTestJSON-server-1662090424',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-2144192259',id=6,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD8E1mkrqLo3jsCiJcIvha4CNzW2T6/HQ38hZ5dGaGtUghmrHejTJlAuKgmy6xusLbaAzGTrJCKVkdgQ5v0CqCqGeNMDA89aLJgLl5KHn3gvI39SkbPja84HarSvbQbbXg==',key_name='tempest-keypair-1040271550',keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:05:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='bf8663ccad9047f4b11b9ae0646c287a',ramdisk_id='',reservation_id='r-amqn5295',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-948553482',owner_user_name='tempest-ServerActionsTestJSON-948553482-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:09:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d86662f2c7648daad87118b7e9f757c',uuid=b3475e7e-ceb4-452a-a045-dbf43c5944dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "617f05b8-c04e-4abf-b4e5-a0234209624a", "address": "fa:16:3e:f9:fd:1a", "network": {"id": "cb8c9bb1-a885-486d-aa6a-de600bc01c2e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1676259779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8663ccad9047f4b11b9ae0646c287a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617f05b8-c0", "ovs_interfaceid": "617f05b8-c04e-4abf-b4e5-a0234209624a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 00:09:14 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Converting VIF {"id": "617f05b8-c04e-4abf-b4e5-a0234209624a", "address": "fa:16:3e:f9:fd:1a", "network": {"id": "cb8c9bb1-a885-486d-aa6a-de600bc01c2e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1676259779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8663ccad9047f4b11b9ae0646c287a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617f05b8-c0", "ovs_interfaceid": "617f05b8-c04e-4abf-b4e5-a0234209624a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:09:14 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:fd:1a,bridge_name='br-int',has_traffic_filtering=True,id=617f05b8-c04e-4abf-b4e5-a0234209624a,network=Network(cb8c9bb1-a885-486d-aa6a-de600bc01c2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap617f05b8-c0') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:09:14 user nova-compute[82479]: DEBUG os_vif [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:fd:1a,bridge_name='br-int',has_traffic_filtering=True,id=617f05b8-c04e-4abf-b4e5-a0234209624a,network=Network(cb8c9bb1-a885-486d-aa6a-de600bc01c2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap617f05b8-c0') {{(pid=82479) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 00:09:14 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:14 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:09:14 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 00:09:14 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:14 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap617f05b8-c0, may_exist=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:09:14 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap617f05b8-c0, col_values=(('external_ids', {'iface-id': '617f05b8-c04e-4abf-b4e5-a0234209624a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:fd:1a', 'vm-uuid': 'b3475e7e-ceb4-452a-a045-dbf43c5944dd'}),)) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:09:14 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:14 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:09:14 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:14 user nova-compute[82479]: INFO os_vif [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:fd:1a,bridge_name='br-int',has_traffic_filtering=True,id=617f05b8-c04e-4abf-b4e5-a0234209624a,network=Network(cb8c9bb1-a885-486d-aa6a-de600bc01c2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap617f05b8-c0')
Apr 14 00:09:14 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:09:14 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:09:14 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] No VIF found with MAC fa:16:3e:f9:fd:1a, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:09:15 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "e3fba4ee-4aae-4ee3-8114-b53510f5442c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:09:15 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "e3fba4ee-4aae-4ee3-8114-b53510f5442c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:09:15 user nova-compute[82479]: DEBUG nova.objects.instance [None req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lazy-loading 'flavor' on Instance uuid e3fba4ee-4aae-4ee3-8114-b53510f5442c {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:09:15 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "e3fba4ee-4aae-4ee3-8114-b53510f5442c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:09:15 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "e3fba4ee-4aae-4ee3-8114-b53510f5442c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:09:15 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "e3fba4ee-4aae-4ee3-8114-b53510f5442c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:09:15 user nova-compute[82479]: INFO nova.compute.manager [None req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Attaching volume 43ba2057-0822-4741-b91d-718067f21593 to /dev/vdb
Apr 14 00:09:15 user nova-compute[82479]: DEBUG os_brick.utils [None req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:09:15 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:15 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:15 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[474562fa-54ab-4aa8-9b4e-ae66c51a105b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fec92fcfdd3\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:09:15 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:15 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:15 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda2cd77-1de3-48a1-80e7-d2206be935f3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:09:15 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:15 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:15 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[be872a05-2807-4b16-a829-003fcb5e5889]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:09:15 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca33501-d51d-42eb-8610-71e9dc4d493a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:09:15 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Running cmd (subprocess): nvme version {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:15 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] 'nvme version' failed. Not Retrying. {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:09:15 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.nvmeof [None req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] nvme not present on system {{(pid=82479) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 00:09:15 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:15 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:09:15 user nova-compute[82479]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 00:09:15 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[038899e9-1f1e-42ac-84ee-ca77066d4879]: (4, '') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:09:15 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82479) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 00:09:15 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 00:09:15 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] LIGHTOS: no hostnqn found. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 00:09:15 user nova-compute[82479]: DEBUG os_brick.utils [None req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fec92fcfdd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:09:15 user nova-compute[82479]: DEBUG nova.virt.block_device [None req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Updating existing volume attachment record: 68c09242-06d5-4c79-9e23-2274dceabfd1 {{(pid=82479) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 00:09:15 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:15 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:15 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:15 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:15 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:16 user nova-compute[82479]: DEBUG nova.compute.manager [req-eca890e9-e2fe-4da2-ab63-81d5a656ead9 req-afa68ad6-2773-4bdf-9df2-a46930948606 service nova] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Received event network-vif-plugged-617f05b8-c04e-4abf-b4e5-a0234209624a {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:09:16 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-eca890e9-e2fe-4da2-ab63-81d5a656ead9 req-afa68ad6-2773-4bdf-9df2-a46930948606 service nova] Acquiring lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:09:16 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-eca890e9-e2fe-4da2-ab63-81d5a656ead9 req-afa68ad6-2773-4bdf-9df2-a46930948606 service nova] Lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:09:16 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-eca890e9-e2fe-4da2-ab63-81d5a656ead9 req-afa68ad6-2773-4bdf-9df2-a46930948606 service nova] Lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:09:16 user nova-compute[82479]: DEBUG nova.compute.manager [req-eca890e9-e2fe-4da2-ab63-81d5a656ead9 req-afa68ad6-2773-4bdf-9df2-a46930948606 service nova] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] No waiting events found dispatching network-vif-plugged-617f05b8-c04e-4abf-b4e5-a0234209624a {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:09:16 user nova-compute[82479]: WARNING nova.compute.manager [req-eca890e9-e2fe-4da2-ab63-81d5a656ead9 req-afa68ad6-2773-4bdf-9df2-a46930948606 service nova] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Received unexpected event network-vif-plugged-617f05b8-c04e-4abf-b4e5-a0234209624a for instance with vm_state active and task_state rebuild_spawning.
Apr 14 00:09:16 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:16 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:16 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:18 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Removed pending event for b3475e7e-ceb4-452a-a045-dbf43c5944dd due to event {{(pid=82479) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 00:09:18 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681430958.604737, b3475e7e-ceb4-452a-a045-dbf43c5944dd => Resumed> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:09:18 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] VM Resumed (Lifecycle Event)
Apr 14 00:09:18 user nova-compute[82479]: DEBUG nova.compute.manager [req-65ebc2f0-9c93-4261-9004-526035e9603b req-16b88ce1-1645-4ee6-a0c4-63120b7b2d2c service nova] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Received event network-vif-plugged-617f05b8-c04e-4abf-b4e5-a0234209624a {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:09:18 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-65ebc2f0-9c93-4261-9004-526035e9603b req-16b88ce1-1645-4ee6-a0c4-63120b7b2d2c service nova] Acquiring lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:09:18 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-65ebc2f0-9c93-4261-9004-526035e9603b req-16b88ce1-1645-4ee6-a0c4-63120b7b2d2c service nova] Lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:09:18 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-65ebc2f0-9c93-4261-9004-526035e9603b req-16b88ce1-1645-4ee6-a0c4-63120b7b2d2c service nova] Lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:09:18 user nova-compute[82479]: DEBUG nova.compute.manager [req-65ebc2f0-9c93-4261-9004-526035e9603b req-16b88ce1-1645-4ee6-a0c4-63120b7b2d2c service nova] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] No waiting events found dispatching network-vif-plugged-617f05b8-c04e-4abf-b4e5-a0234209624a {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:09:18 user nova-compute[82479]: WARNING nova.compute.manager [req-65ebc2f0-9c93-4261-9004-526035e9603b req-16b88ce1-1645-4ee6-a0c4-63120b7b2d2c service nova] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Received unexpected event network-vif-plugged-617f05b8-c04e-4abf-b4e5-a0234209624a for instance with vm_state active and task_state rebuild_spawning.
Apr 14 00:09:18 user nova-compute[82479]: DEBUG nova.compute.manager [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Instance event wait completed in 0 seconds for  {{(pid=82479) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 00:09:18 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Guest created on hypervisor {{(pid=82479) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 00:09:18 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Instance spawned successfully.
Apr 14 00:09:18 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 00:09:18 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:09:18 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Found default for hw_cdrom_bus of ide {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:09:18 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Found default for hw_disk_bus of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:09:18 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Found default for hw_input_bus of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:09:18 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Found default for hw_pointer_model of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:09:18 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Found default for hw_video_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:09:18 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Found default for hw_vif_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:09:18 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:09:18 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Apr 14 00:09:18 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681430958.607649, b3475e7e-ceb4-452a-a045-dbf43c5944dd => Started> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:09:18 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] VM Started (Lifecycle Event)
Apr 14 00:09:18 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:09:18 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:09:18 user nova-compute[82479]: DEBUG nova.compute.manager [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:09:18 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Apr 14 00:09:18 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:09:18 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:09:18 user nova-compute[82479]: DEBUG nova.objects.instance [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Trying to apply a migration context that does not seem to be set for this instance {{(pid=82479) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Apr 14 00:09:18 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.095s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:09:19 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:19 user nova-compute[82479]: DEBUG nova.compute.manager [None req-dd2d920c-3f40-464f-8816-e73f41d36f87 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:09:19 user nova-compute[82479]: INFO nova.compute.manager [None req-dd2d920c-3f40-464f-8816-e73f41d36f87 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] instance snapshotting
Apr 14 00:09:20 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-dd2d920c-3f40-464f-8816-e73f41d36f87 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Beginning live snapshot process
Apr 14 00:09:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-dd2d920c-3f40-464f-8816-e73f41d36f87 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11c3384a-e699-4b10-9f8b-861291e96465/disk --force-share --output=json -f qcow2 {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-dd2d920c-3f40-464f-8816-e73f41d36f87 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11c3384a-e699-4b10-9f8b-861291e96465/disk --force-share --output=json -f qcow2" returned: 0 in 0.156s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-dd2d920c-3f40-464f-8816-e73f41d36f87 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11c3384a-e699-4b10-9f8b-861291e96465/disk --force-share --output=json -f qcow2 {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-dd2d920c-3f40-464f-8816-e73f41d36f87 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11c3384a-e699-4b10-9f8b-861291e96465/disk --force-share --output=json -f qcow2" returned: 0 in 0.141s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-dd2d920c-3f40-464f-8816-e73f41d36f87 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:20 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-dd2d920c-3f40-464f-8816-e73f41d36f87 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.155s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-dd2d920c-3f40-464f-8816-e73f41d36f87 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpx9w9ydo2/189267c892a548e096abfa075b59d545.delta 1073741824 {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-dd2d920c-3f40-464f-8816-e73f41d36f87 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpx9w9ydo2/189267c892a548e096abfa075b59d545.delta 1073741824" returned: 0 in 0.053s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:20 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-dd2d920c-3f40-464f-8816-e73f41d36f87 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 14 00:09:20 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Calling os-brick to attach iSCSI Volume {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 00:09:20 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dNQGcVbh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:09:20 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:09:20 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:09:20 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:09:20 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:09:20 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:09:20 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:09:20 user nova-compute[82479]: INFO os_brick.initiator.connectors.iscsi [None req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 00:09:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 -p 172.16.0.220:3260 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:21 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:21 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1c8b91-0232-4da6-a241-bb39aaa3a3de]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:09:21 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 00:09:21 user nova-compute[82479]:  {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:09:21 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 -p 172.16.0.220:3260 --interface default --op new {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:21 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:21 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f28870-03ad-48ed-93ef-aca50a823cb1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593] added\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:09:21 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593] added
Apr 14 00:09:21 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:09:21 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:21 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:21 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa6bdfa4-3c85-41da-9ec0-d68eaadf9aba]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:09:21 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:09:21 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:21 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.033s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:21 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[85eb4b5e-2809-45e7-aa16-99b9332262c4]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:09:21 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:09:21 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dNQGcVbh {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:21 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dNQGcVbh" returned: 0 in 0.024s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:21 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[0019754a-f2c6-453f-8e59-0b76caf09340]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:09:21 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dNQGcVbh'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:09:21 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:21 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:21 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dab79e9-fac0-4d5c-9b97-d00b4d27a582]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:09:21 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:09:21 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:21 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:21 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f52b11-4285-4cb1-82df-2e6edd270778]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:09:21 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)
Apr 14 00:09:21 user nova-compute[82479]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:09:21 user nova-compute[82479]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:09:21 user nova-compute[82479]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 (non-flash)
Apr 14 00:09:21 user nova-compute[82479]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d (non-flash)
Apr 14 00:09:21 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:09:21 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)
Apr 14 00:09:21 user nova-compute[82479]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:09:21 user nova-compute[82479]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:09:21 user nova-compute[82479]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 (non-flash)
Apr 14 00:09:21 user nova-compute[82479]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d (non-flash)
Apr 14 00:09:21 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:09:21 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 -p 172.16.0.220:3260 --login {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:21 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:21 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[128283c3-996f-4592-bcfc-88465fabc551]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:09:21 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593, portal: 172.16.0.220,3260]
Apr 14 00:09:21 user nova-compute[82479]: Login to [iface: default, target: iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593, portal: 172.16.0.220,3260] successful.
Apr 14 00:09:21 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:09:21 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:21 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:21 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[748cda09-17ac-4bb0-a945-7942032359aa]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:09:21 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:09:21 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:21 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:21 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1486d2b-f26d-45b1-9cc3-33050a52e67d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:09:21 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)
Apr 14 00:09:21 user nova-compute[82479]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:09:21 user nova-compute[82479]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:09:21 user nova-compute[82479]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 (non-flash)
Apr 14 00:09:21 user nova-compute[82479]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d (non-flash)
Apr 14 00:09:21 user nova-compute[82479]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 (non-flash)
Apr 14 00:09:21 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:09:21 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)
Apr 14 00:09:21 user nova-compute[82479]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:09:21 user nova-compute[82479]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:09:21 user nova-compute[82479]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 (non-flash)
Apr 14 00:09:21 user nova-compute[82479]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d (non-flash)
Apr 14 00:09:21 user nova-compute[82479]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 (non-flash)
Apr 14 00:09:21 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:09:21 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.345s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:09:21 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Connected to 172.16.0.220:3260 {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 00:09:21 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] HCTL ('38', '-', '-', 0) found on session 17 with lun 0 {{(pid=82479) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 00:09:21 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=82479) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 00:09:21 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:21 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.023s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:21 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13c408d-0d02-41e6-b1e7-da4538c9952c]: (4, ('- - 0', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:09:21 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Searching for a device in session 17 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=82479) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 00:09:21 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dNQGcVbh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 00:09:21 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-dd2d920c-3f40-464f-8816-e73f41d36f87 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] COPY block job progress, current cursor: 0 final cursor: 43843584 {{(pid=82479) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 00:09:22 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-dd2d920c-3f40-464f-8816-e73f41d36f87 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] COPY block job progress, current cursor: 43843584 final cursor: 43843584 {{(pid=82479) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 00:09:22 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-dd2d920c-3f40-464f-8816-e73f41d36f87 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 14 00:09:22 user nova-compute[82479]: DEBUG nova.privsep.utils [None req-dd2d920c-3f40-464f-8816-e73f41d36f87 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82479) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 00:09:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-dd2d920c-3f40-464f-8816-e73f41d36f87 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpx9w9ydo2/189267c892a548e096abfa075b59d545.delta /opt/stack/data/nova/instances/snapshots/tmpx9w9ydo2/189267c892a548e096abfa075b59d545 {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.488s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:09:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] <== connect_volume: return (1492ms) {'type': 'block', 'scsi_wwn': '26534653234326266', 'path': '/dev/sdg'} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:09:22 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26534653234326266', 'path': '/dev/sdg'} {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 00:09:22 user nova-compute[82479]: DEBUG nova.objects.instance [None req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lazy-loading 'flavor' on Instance uuid e3fba4ee-4aae-4ee3-8114-b53510f5442c {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:09:22 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 00:09:22 user nova-compute[82479]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:09:22 user nova-compute[82479]:   <source dev="/dev/sdg"/>
Apr 14 00:09:22 user nova-compute[82479]:   <target dev="vdb" bus="virtio"/>
Apr 14 00:09:22 user nova-compute[82479]:   <serial>43ba2057-0822-4741-b91d-718067f21593</serial>
Apr 14 00:09:22 user nova-compute[82479]: </disk>
Apr 14 00:09:22 user nova-compute[82479]:  {{(pid=82479) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 00:09:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-dd2d920c-3f40-464f-8816-e73f41d36f87 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpx9w9ydo2/189267c892a548e096abfa075b59d545.delta /opt/stack/data/nova/instances/snapshots/tmpx9w9ydo2/189267c892a548e096abfa075b59d545" returned: 0 in 0.366s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:22 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-dd2d920c-3f40-464f-8816-e73f41d36f87 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Snapshot extracted, beginning image upload
Apr 14 00:09:22 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:09:22 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:09:22 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] No VIF found with MAC fa:16:3e:1f:09:96, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:09:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "e3fba4ee-4aae-4ee3-8114-b53510f5442c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.795s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:09:24 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:25 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-dd2d920c-3f40-464f-8816-e73f41d36f87 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Snapshot image upload complete
Apr 14 00:09:25 user nova-compute[82479]: INFO nova.compute.manager [None req-dd2d920c-3f40-464f-8816-e73f41d36f87 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Took 5.15 seconds to snapshot the instance on the hypervisor.
Apr 14 00:09:25 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:27 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "b21b91b1-a98b-48c7-a2e8-4114c3e31345" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:09:27 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "b21b91b1-a98b-48c7-a2e8-4114c3e31345" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:09:27 user nova-compute[82479]: DEBUG nova.compute.manager [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Starting instance... {{(pid=82479) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 00:09:27 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:09:27 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:09:27 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82479) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 00:09:27 user nova-compute[82479]: INFO nova.compute.claims [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Claim successful on node user
Apr 14 00:09:28 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:09:28 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:09:28 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.462s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:09:28 user nova-compute[82479]: DEBUG nova.compute.manager [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Start building networks asynchronously for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 00:09:28 user nova-compute[82479]: DEBUG nova.compute.manager [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Allocating IP information in the background. {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 00:09:28 user nova-compute[82479]: DEBUG nova.network.neutron [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] allocate_for_instance() {{(pid=82479) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 00:09:28 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 00:09:28 user nova-compute[82479]: DEBUG nova.compute.manager [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Start building block device mappings for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 00:09:28 user nova-compute[82479]: DEBUG nova.policy [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fb293fdfc658466aaa7134269fa46a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9d67ad2fa4cb9ab309b98f8fe051a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82479) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 00:09:28 user nova-compute[82479]: DEBUG nova.compute.manager [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Start spawning the instance on the hypervisor. {{(pid=82479) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 00:09:28 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Creating instance directory {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 00:09:28 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Creating image(s)
Apr 14 00:09:28 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "/opt/stack/data/nova/instances/b21b91b1-a98b-48c7-a2e8-4114c3e31345/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:09:28 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "/opt/stack/data/nova/instances/b21b91b1-a98b-48c7-a2e8-4114c3e31345/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:09:28 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "/opt/stack/data/nova/instances/b21b91b1-a98b-48c7-a2e8-4114c3e31345/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:09:28 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:28 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.137s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:28 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "3e200e101633f2016e569ae4c0a352380507d1e4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:09:28 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "3e200e101633f2016e569ae4c0a352380507d1e4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:09:28 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:28 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.155s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:28 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/b21b91b1-a98b-48c7-a2e8-4114c3e31345/disk 1073741824 {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:28 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/b21b91b1-a98b-48c7-a2e8-4114c3e31345/disk 1073741824" returned: 0 in 0.053s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:28 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "3e200e101633f2016e569ae4c0a352380507d1e4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.217s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:09:28 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:28 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:28 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.153s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:28 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b21b91b1-a98b-48c7-a2e8-4114c3e31345/disk. size=1073741824 {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 00:09:28 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b21b91b1-a98b-48c7-a2e8-4114c3e31345/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:29 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b21b91b1-a98b-48c7-a2e8-4114c3e31345/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:29 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Cannot resize image /opt/stack/data/nova/instances/b21b91b1-a98b-48c7-a2e8-4114c3e31345/disk to a smaller size. {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 00:09:29 user nova-compute[82479]: DEBUG nova.objects.instance [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lazy-loading 'migration_context' on Instance uuid b21b91b1-a98b-48c7-a2e8-4114c3e31345 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:09:29 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Created local disks {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 00:09:29 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Ensure instance console log exists: /opt/stack/data/nova/instances/b21b91b1-a98b-48c7-a2e8-4114c3e31345/console.log {{(pid=82479) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 00:09:29 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:09:29 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:09:29 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:09:29 user nova-compute[82479]: DEBUG nova.network.neutron [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Successfully created port: 01f28b85-9614-4a93-bc9b-7b894b96313a {{(pid=82479) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 00:09:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:30 user nova-compute[82479]: DEBUG nova.network.neutron [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Successfully updated port: 01f28b85-9614-4a93-bc9b-7b894b96313a {{(pid=82479) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 00:09:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "refresh_cache-b21b91b1-a98b-48c7-a2e8-4114c3e31345" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:09:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquired lock "refresh_cache-b21b91b1-a98b-48c7-a2e8-4114c3e31345" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:09:30 user nova-compute[82479]: DEBUG nova.network.neutron [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 00:09:30 user nova-compute[82479]: DEBUG nova.compute.manager [req-896ace59-b2fe-47fe-886a-e3eea88a757e req-d4f0bf30-3d1e-4df3-8bf6-ef3bb6be9802 service nova] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Received event network-changed-01f28b85-9614-4a93-bc9b-7b894b96313a {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:09:30 user nova-compute[82479]: DEBUG nova.compute.manager [req-896ace59-b2fe-47fe-886a-e3eea88a757e req-d4f0bf30-3d1e-4df3-8bf6-ef3bb6be9802 service nova] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Refreshing instance network info cache due to event network-changed-01f28b85-9614-4a93-bc9b-7b894b96313a. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:09:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-896ace59-b2fe-47fe-886a-e3eea88a757e req-d4f0bf30-3d1e-4df3-8bf6-ef3bb6be9802 service nova] Acquiring lock "refresh_cache-b21b91b1-a98b-48c7-a2e8-4114c3e31345" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:09:30 user nova-compute[82479]: DEBUG nova.network.neutron [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Instance cache missing network info. {{(pid=82479) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 00:09:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquiring lock "6fb358a6-7e79-4acf-8fbe-7cc4e67a707b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:09:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6fb358a6-7e79-4acf-8fbe-7cc4e67a707b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:09:30 user nova-compute[82479]: DEBUG nova.compute.manager [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Starting instance... {{(pid=82479) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 00:09:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:09:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:09:30 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82479) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 00:09:30 user nova-compute[82479]: INFO nova.compute.claims [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Claim successful on node user
Apr 14 00:09:30 user nova-compute[82479]: DEBUG nova.network.neutron [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Updating instance_info_cache with network_info: [{"id": "01f28b85-9614-4a93-bc9b-7b894b96313a", "address": "fa:16:3e:1e:16:68", "network": {"id": "6d80f923-8aef-45df-921b-f77ed4ff0e75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-696070096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44c9d67ad2fa4cb9ab309b98f8fe051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01f28b85-96", "ovs_interfaceid": "01f28b85-9614-4a93-bc9b-7b894b96313a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:09:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Releasing lock "refresh_cache-b21b91b1-a98b-48c7-a2e8-4114c3e31345" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:09:30 user nova-compute[82479]: DEBUG nova.compute.manager [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Instance network_info: |[{"id": "01f28b85-9614-4a93-bc9b-7b894b96313a", "address": "fa:16:3e:1e:16:68", "network": {"id": "6d80f923-8aef-45df-921b-f77ed4ff0e75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-696070096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44c9d67ad2fa4cb9ab309b98f8fe051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01f28b85-96", "ovs_interfaceid": "01f28b85-9614-4a93-bc9b-7b894b96313a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 00:09:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-896ace59-b2fe-47fe-886a-e3eea88a757e req-d4f0bf30-3d1e-4df3-8bf6-ef3bb6be9802 service nova] Acquired lock "refresh_cache-b21b91b1-a98b-48c7-a2e8-4114c3e31345" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:09:30 user nova-compute[82479]: DEBUG nova.network.neutron [req-896ace59-b2fe-47fe-886a-e3eea88a757e req-d4f0bf30-3d1e-4df3-8bf6-ef3bb6be9802 service nova] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Refreshing network info cache for port 01f28b85-9614-4a93-bc9b-7b894b96313a {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:09:30 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Start _get_guest_xml network_info=[{"id": "01f28b85-9614-4a93-bc9b-7b894b96313a", "address": "fa:16:3e:1e:16:68", "network": {"id": "6d80f923-8aef-45df-921b-f77ed4ff0e75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-696070096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44c9d67ad2fa4cb9ab309b98f8fe051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01f28b85-96", "ovs_interfaceid": "01f28b85-9614-4a93-bc9b-7b894b96313a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 00:09:30 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:09:30 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:09:30 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82479) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 00:09:30 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T00:02:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 00:09:30 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Flavor limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 00:09:30 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Image limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 00:09:30 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Flavor pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 00:09:30 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Image pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 00:09:30 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 00:09:30 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 00:09:30 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 00:09:30 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Got 1 possible topologies {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 00:09:30 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 00:09:30 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 00:09:30 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:09:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-679422627',display_name='tempest-AttachVolumeNegativeTest-server-679422627',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-679422627',id=15,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCeiJtJCQqS2PvzHgPRX8caDhL22zKM9Gv3U+QC2mkpW6/QtmgBvpNWlwmqo9c3rbYg77B6fYlhGNUJOqzhSxMkT9Q7v/DdYFlQ5yKVzmqfTbNnCeI9BKbmpVv6CfIRkSg==',key_name='tempest-keypair-1420639753',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44c9d67ad2fa4cb9ab309b98f8fe051a',ramdisk_id='',reservation_id='r-54u1mcxs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-719597397',owner_user_name='tempest-AttachVolumeNegativeTest-719597397-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:09:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb293fdfc658466aaa7134269fa46a7c',uuid=b21b91b1-a98b-48c7-a2e8-4114c3e31345,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01f28b85-9614-4a93-bc9b-7b894b96313a", "address": "fa:16:3e:1e:16:68", "network": {"id": "6d80f923-8aef-45df-921b-f77ed4ff0e75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-696070096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44c9d67ad2fa4cb9ab309b98f8fe051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01f28b85-96", "ovs_interfaceid": "01f28b85-9614-4a93-bc9b-7b894b96313a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82479) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 00:09:30 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Converting VIF {"id": "01f28b85-9614-4a93-bc9b-7b894b96313a", "address": "fa:16:3e:1e:16:68", "network": {"id": "6d80f923-8aef-45df-921b-f77ed4ff0e75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-696070096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44c9d67ad2fa4cb9ab309b98f8fe051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01f28b85-96", "ovs_interfaceid": "01f28b85-9614-4a93-bc9b-7b894b96313a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:09:30 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:16:68,bridge_name='br-int',has_traffic_filtering=True,id=01f28b85-9614-4a93-bc9b-7b894b96313a,network=Network(6d80f923-8aef-45df-921b-f77ed4ff0e75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01f28b85-96') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:09:30 user nova-compute[82479]: DEBUG nova.objects.instance [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lazy-loading 'pci_devices' on Instance uuid b21b91b1-a98b-48c7-a2e8-4114c3e31345 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:09:30 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] End _get_guest_xml xml=<domain type="kvm">
Apr 14 00:09:30 user nova-compute[82479]:   <uuid>b21b91b1-a98b-48c7-a2e8-4114c3e31345</uuid>
Apr 14 00:09:30 user nova-compute[82479]:   <name>instance-0000000f</name>
Apr 14 00:09:30 user nova-compute[82479]:   <memory>131072</memory>
Apr 14 00:09:30 user nova-compute[82479]:   <vcpu>1</vcpu>
Apr 14 00:09:30 user nova-compute[82479]:   <metadata>
Apr 14 00:09:30 user nova-compute[82479]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 00:09:30 user nova-compute[82479]:       <nova:package version="0.0.0"/>
Apr 14 00:09:30 user nova-compute[82479]:       <nova:name>tempest-AttachVolumeNegativeTest-server-679422627</nova:name>
Apr 14 00:09:30 user nova-compute[82479]:       <nova:creationTime>2023-04-14 00:09:30</nova:creationTime>
Apr 14 00:09:30 user nova-compute[82479]:       <nova:flavor name="m1.nano">
Apr 14 00:09:30 user nova-compute[82479]:         <nova:memory>128</nova:memory>
Apr 14 00:09:30 user nova-compute[82479]:         <nova:disk>1</nova:disk>
Apr 14 00:09:30 user nova-compute[82479]:         <nova:swap>0</nova:swap>
Apr 14 00:09:30 user nova-compute[82479]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 00:09:30 user nova-compute[82479]:         <nova:vcpus>1</nova:vcpus>
Apr 14 00:09:30 user nova-compute[82479]:       </nova:flavor>
Apr 14 00:09:30 user nova-compute[82479]:       <nova:owner>
Apr 14 00:09:30 user nova-compute[82479]:         <nova:user uuid="fb293fdfc658466aaa7134269fa46a7c">tempest-AttachVolumeNegativeTest-719597397-project-member</nova:user>
Apr 14 00:09:30 user nova-compute[82479]:         <nova:project uuid="44c9d67ad2fa4cb9ab309b98f8fe051a">tempest-AttachVolumeNegativeTest-719597397</nova:project>
Apr 14 00:09:30 user nova-compute[82479]:       </nova:owner>
Apr 14 00:09:30 user nova-compute[82479]:       <nova:root type="image" uuid="6db62068-7278-4cd8-b41f-d0140d89e199"/>
Apr 14 00:09:30 user nova-compute[82479]:       <nova:ports>
Apr 14 00:09:30 user nova-compute[82479]:         <nova:port uuid="01f28b85-9614-4a93-bc9b-7b894b96313a">
Apr 14 00:09:30 user nova-compute[82479]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 14 00:09:30 user nova-compute[82479]:         </nova:port>
Apr 14 00:09:30 user nova-compute[82479]:       </nova:ports>
Apr 14 00:09:30 user nova-compute[82479]:     </nova:instance>
Apr 14 00:09:30 user nova-compute[82479]:   </metadata>
Apr 14 00:09:30 user nova-compute[82479]:   <sysinfo type="smbios">
Apr 14 00:09:30 user nova-compute[82479]:     <system>
Apr 14 00:09:30 user nova-compute[82479]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 00:09:30 user nova-compute[82479]:       <entry name="product">OpenStack Nova</entry>
Apr 14 00:09:30 user nova-compute[82479]:       <entry name="version">0.0.0</entry>
Apr 14 00:09:30 user nova-compute[82479]:       <entry name="serial">b21b91b1-a98b-48c7-a2e8-4114c3e31345</entry>
Apr 14 00:09:30 user nova-compute[82479]:       <entry name="uuid">b21b91b1-a98b-48c7-a2e8-4114c3e31345</entry>
Apr 14 00:09:30 user nova-compute[82479]:       <entry name="family">Virtual Machine</entry>
Apr 14 00:09:30 user nova-compute[82479]:     </system>
Apr 14 00:09:30 user nova-compute[82479]:   </sysinfo>
Apr 14 00:09:30 user nova-compute[82479]:   <os>
Apr 14 00:09:30 user nova-compute[82479]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 00:09:30 user nova-compute[82479]:     <boot dev="hd"/>
Apr 14 00:09:30 user nova-compute[82479]:     <smbios mode="sysinfo"/>
Apr 14 00:09:30 user nova-compute[82479]:   </os>
Apr 14 00:09:30 user nova-compute[82479]:   <features>
Apr 14 00:09:30 user nova-compute[82479]:     <acpi/>
Apr 14 00:09:30 user nova-compute[82479]:     <apic/>
Apr 14 00:09:30 user nova-compute[82479]:     <vmcoreinfo/>
Apr 14 00:09:30 user nova-compute[82479]:   </features>
Apr 14 00:09:30 user nova-compute[82479]:   <clock offset="utc">
Apr 14 00:09:30 user nova-compute[82479]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 00:09:30 user nova-compute[82479]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 00:09:30 user nova-compute[82479]:     <timer name="hpet" present="no"/>
Apr 14 00:09:30 user nova-compute[82479]:   </clock>
Apr 14 00:09:30 user nova-compute[82479]:   <cpu mode="custom" match="exact">
Apr 14 00:09:30 user nova-compute[82479]:     <model>Nehalem</model>
Apr 14 00:09:30 user nova-compute[82479]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 00:09:30 user nova-compute[82479]:   </cpu>
Apr 14 00:09:30 user nova-compute[82479]:   <devices>
Apr 14 00:09:30 user nova-compute[82479]:     <disk type="file" device="disk">
Apr 14 00:09:30 user nova-compute[82479]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 00:09:30 user nova-compute[82479]:       <source file="/opt/stack/data/nova/instances/b21b91b1-a98b-48c7-a2e8-4114c3e31345/disk"/>
Apr 14 00:09:30 user nova-compute[82479]:       <target dev="vda" bus="virtio"/>
Apr 14 00:09:30 user nova-compute[82479]:     </disk>
Apr 14 00:09:30 user nova-compute[82479]:     <interface type="ethernet">
Apr 14 00:09:30 user nova-compute[82479]:       <mac address="fa:16:3e:1e:16:68"/>
Apr 14 00:09:30 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:09:30 user nova-compute[82479]:       <mtu size="1442"/>
Apr 14 00:09:30 user nova-compute[82479]:       <target dev="tap01f28b85-96"/>
Apr 14 00:09:30 user nova-compute[82479]:     </interface>
Apr 14 00:09:30 user nova-compute[82479]:     <serial type="pty">
Apr 14 00:09:30 user nova-compute[82479]:       <log file="/opt/stack/data/nova/instances/b21b91b1-a98b-48c7-a2e8-4114c3e31345/console.log" append="off"/>
Apr 14 00:09:30 user nova-compute[82479]:     </serial>
Apr 14 00:09:30 user nova-compute[82479]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 00:09:30 user nova-compute[82479]:     <video>
Apr 14 00:09:30 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:09:30 user nova-compute[82479]:     </video>
Apr 14 00:09:30 user nova-compute[82479]:     <rng model="virtio">
Apr 14 00:09:30 user nova-compute[82479]:       <backend model="random">/dev/urandom</backend>
Apr 14 00:09:30 user nova-compute[82479]:     </rng>
Apr 14 00:09:30 user nova-compute[82479]:     <controller type="usb" index="0" model="none"/>
Apr 14 00:09:30 user nova-compute[82479]:     <memballoon model="virtio">
Apr 14 00:09:30 user nova-compute[82479]:       <stats period="10"/>
Apr 14 00:09:30 user nova-compute[82479]:     </memballoon>
Apr 14 00:09:30 user nova-compute[82479]:   </devices>
Apr 14 00:09:30 user nova-compute[82479]: </domain>
Apr 14 00:09:30 user nova-compute[82479]:  {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 00:09:30 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:09:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-679422627',display_name='tempest-AttachVolumeNegativeTest-server-679422627',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-679422627',id=15,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCeiJtJCQqS2PvzHgPRX8caDhL22zKM9Gv3U+QC2mkpW6/QtmgBvpNWlwmqo9c3rbYg77B6fYlhGNUJOqzhSxMkT9Q7v/DdYFlQ5yKVzmqfTbNnCeI9BKbmpVv6CfIRkSg==',key_name='tempest-keypair-1420639753',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44c9d67ad2fa4cb9ab309b98f8fe051a',ramdisk_id='',reservation_id='r-54u1mcxs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-719597397',owner_user_name='tempest-AttachVolumeNegativeTest-719597397-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:09:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb293fdfc658466aaa7134269fa46a7c',uuid=b21b91b1-a98b-48c7-a2e8-4114c3e31345,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01f28b85-9614-4a93-bc9b-7b894b96313a", "address": "fa:16:3e:1e:16:68", "network": {"id": "6d80f923-8aef-45df-921b-f77ed4ff0e75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-696070096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44c9d67ad2fa4cb9ab309b98f8fe051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01f28b85-96", "ovs_interfaceid": "01f28b85-9614-4a93-bc9b-7b894b96313a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 00:09:30 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Converting VIF {"id": "01f28b85-9614-4a93-bc9b-7b894b96313a", "address": "fa:16:3e:1e:16:68", "network": {"id": "6d80f923-8aef-45df-921b-f77ed4ff0e75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-696070096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44c9d67ad2fa4cb9ab309b98f8fe051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01f28b85-96", "ovs_interfaceid": "01f28b85-9614-4a93-bc9b-7b894b96313a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:09:30 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:16:68,bridge_name='br-int',has_traffic_filtering=True,id=01f28b85-9614-4a93-bc9b-7b894b96313a,network=Network(6d80f923-8aef-45df-921b-f77ed4ff0e75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01f28b85-96') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:09:30 user nova-compute[82479]: DEBUG os_vif [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:16:68,bridge_name='br-int',has_traffic_filtering=True,id=01f28b85-9614-4a93-bc9b-7b894b96313a,network=Network(6d80f923-8aef-45df-921b-f77ed4ff0e75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01f28b85-96') {{(pid=82479) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 00:09:30 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:30 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:09:30 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 00:09:30 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:30 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap01f28b85-96, may_exist=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:09:30 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap01f28b85-96, col_values=(('external_ids', {'iface-id': '01f28b85-9614-4a93-bc9b-7b894b96313a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:16:68', 'vm-uuid': 'b21b91b1-a98b-48c7-a2e8-4114c3e31345'}),)) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:09:30 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:30 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:09:30 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:30 user nova-compute[82479]: INFO os_vif [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:16:68,bridge_name='br-int',has_traffic_filtering=True,id=01f28b85-9614-4a93-bc9b-7b894b96313a,network=Network(6d80f923-8aef-45df-921b-f77ed4ff0e75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01f28b85-96')
Apr 14 00:09:30 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:30 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:09:30 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] No VIF found with MAC fa:16:3e:1e:16:68, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:09:30 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:09:31 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:09:31 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.551s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:09:31 user nova-compute[82479]: DEBUG nova.compute.manager [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Start building networks asynchronously for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 00:09:31 user nova-compute[82479]: DEBUG nova.network.neutron [req-896ace59-b2fe-47fe-886a-e3eea88a757e req-d4f0bf30-3d1e-4df3-8bf6-ef3bb6be9802 service nova] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Updated VIF entry in instance network info cache for port 01f28b85-9614-4a93-bc9b-7b894b96313a. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:09:31 user nova-compute[82479]: DEBUG nova.network.neutron [req-896ace59-b2fe-47fe-886a-e3eea88a757e req-d4f0bf30-3d1e-4df3-8bf6-ef3bb6be9802 service nova] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Updating instance_info_cache with network_info: [{"id": "01f28b85-9614-4a93-bc9b-7b894b96313a", "address": "fa:16:3e:1e:16:68", "network": {"id": "6d80f923-8aef-45df-921b-f77ed4ff0e75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-696070096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44c9d67ad2fa4cb9ab309b98f8fe051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01f28b85-96", "ovs_interfaceid": "01f28b85-9614-4a93-bc9b-7b894b96313a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:09:31 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-896ace59-b2fe-47fe-886a-e3eea88a757e req-d4f0bf30-3d1e-4df3-8bf6-ef3bb6be9802 service nova] Releasing lock "refresh_cache-b21b91b1-a98b-48c7-a2e8-4114c3e31345" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:09:31 user nova-compute[82479]: DEBUG nova.compute.manager [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Allocating IP information in the background. {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 00:09:31 user nova-compute[82479]: DEBUG nova.network.neutron [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] allocate_for_instance() {{(pid=82479) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 00:09:31 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 00:09:31 user nova-compute[82479]: DEBUG nova.compute.manager [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Start building block device mappings for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 00:09:31 user nova-compute[82479]: DEBUG nova.policy [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6fe75acb64a94a2a88d370f43fa6b776', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f138770c7b4407d83c449500fc000a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82479) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 00:09:31 user nova-compute[82479]: DEBUG nova.compute.manager [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Start spawning the instance on the hypervisor. {{(pid=82479) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 00:09:31 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Creating instance directory {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 00:09:31 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Creating image(s)
Apr 14 00:09:31 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquiring lock "/opt/stack/data/nova/instances/6fb358a6-7e79-4acf-8fbe-7cc4e67a707b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:09:31 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "/opt/stack/data/nova/instances/6fb358a6-7e79-4acf-8fbe-7cc4e67a707b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:09:31 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "/opt/stack/data/nova/instances/6fb358a6-7e79-4acf-8fbe-7cc4e67a707b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:09:31 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquiring lock "790e6a0fbf8f17170f30a5686b33244e6dbee48a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:09:31 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "790e6a0fbf8f17170f30a5686b33244e6dbee48a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:09:32 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/790e6a0fbf8f17170f30a5686b33244e6dbee48a.part --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:32 user nova-compute[82479]: DEBUG nova.network.neutron [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Successfully created port: e4c19308-c4ea-4a47-a0e2-9a8616e8c39c {{(pid=82479) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 00:09:32 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:32 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:32 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:32 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/790e6a0fbf8f17170f30a5686b33244e6dbee48a.part --force-share --output=json" returned: 0 in 0.245s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:32 user nova-compute[82479]: DEBUG nova.virt.images [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] 16275777-e8d4-4654-a571-dc2e6d715cf8 was qcow2, converting to raw {{(pid=82479) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 00:09:32 user nova-compute[82479]: DEBUG nova.privsep.utils [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82479) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 00:09:32 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/790e6a0fbf8f17170f30a5686b33244e6dbee48a.part /opt/stack/data/nova/instances/_base/790e6a0fbf8f17170f30a5686b33244e6dbee48a.converted {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:32 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/790e6a0fbf8f17170f30a5686b33244e6dbee48a.part /opt/stack/data/nova/instances/_base/790e6a0fbf8f17170f30a5686b33244e6dbee48a.converted" returned: 0 in 0.187s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:32 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/790e6a0fbf8f17170f30a5686b33244e6dbee48a.converted --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:32 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:32 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/790e6a0fbf8f17170f30a5686b33244e6dbee48a.converted --force-share --output=json" returned: 0 in 0.174s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:32 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "790e6a0fbf8f17170f30a5686b33244e6dbee48a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.652s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:09:32 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/790e6a0fbf8f17170f30a5686b33244e6dbee48a --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:32 user nova-compute[82479]: DEBUG nova.compute.manager [req-cf8cf1e5-c316-4a13-868f-07c126db6cb8 req-6f4bc915-dc34-4d3b-b5f7-e87f08cdfda8 service nova] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Received event network-vif-plugged-01f28b85-9614-4a93-bc9b-7b894b96313a {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:09:32 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-cf8cf1e5-c316-4a13-868f-07c126db6cb8 req-6f4bc915-dc34-4d3b-b5f7-e87f08cdfda8 service nova] Acquiring lock "b21b91b1-a98b-48c7-a2e8-4114c3e31345-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:09:32 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-cf8cf1e5-c316-4a13-868f-07c126db6cb8 req-6f4bc915-dc34-4d3b-b5f7-e87f08cdfda8 service nova] Lock "b21b91b1-a98b-48c7-a2e8-4114c3e31345-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:09:32 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-cf8cf1e5-c316-4a13-868f-07c126db6cb8 req-6f4bc915-dc34-4d3b-b5f7-e87f08cdfda8 service nova] Lock "b21b91b1-a98b-48c7-a2e8-4114c3e31345-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:09:33 user nova-compute[82479]: DEBUG nova.compute.manager [req-cf8cf1e5-c316-4a13-868f-07c126db6cb8 req-6f4bc915-dc34-4d3b-b5f7-e87f08cdfda8 service nova] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] No waiting events found dispatching network-vif-plugged-01f28b85-9614-4a93-bc9b-7b894b96313a {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:09:33 user nova-compute[82479]: WARNING nova.compute.manager [req-cf8cf1e5-c316-4a13-868f-07c126db6cb8 req-6f4bc915-dc34-4d3b-b5f7-e87f08cdfda8 service nova] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Received unexpected event network-vif-plugged-01f28b85-9614-4a93-bc9b-7b894b96313a for instance with vm_state building and task_state spawning.
Apr 14 00:09:33 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/790e6a0fbf8f17170f30a5686b33244e6dbee48a --force-share --output=json" returned: 0 in 0.176s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:33 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquiring lock "790e6a0fbf8f17170f30a5686b33244e6dbee48a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:09:33 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "790e6a0fbf8f17170f30a5686b33244e6dbee48a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:09:33 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/790e6a0fbf8f17170f30a5686b33244e6dbee48a --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:33 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/790e6a0fbf8f17170f30a5686b33244e6dbee48a --force-share --output=json" returned: 0 in 0.170s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:33 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/790e6a0fbf8f17170f30a5686b33244e6dbee48a,backing_fmt=raw /opt/stack/data/nova/instances/6fb358a6-7e79-4acf-8fbe-7cc4e67a707b/disk 1073741824 {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:33 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/790e6a0fbf8f17170f30a5686b33244e6dbee48a,backing_fmt=raw /opt/stack/data/nova/instances/6fb358a6-7e79-4acf-8fbe-7cc4e67a707b/disk 1073741824" returned: 0 in 0.071s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:33 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "790e6a0fbf8f17170f30a5686b33244e6dbee48a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:09:33 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/790e6a0fbf8f17170f30a5686b33244e6dbee48a --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:33 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/790e6a0fbf8f17170f30a5686b33244e6dbee48a --force-share --output=json" returned: 0 in 0.162s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:33 user nova-compute[82479]: DEBUG nova.objects.instance [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lazy-loading 'migration_context' on Instance uuid 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:09:33 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Created local disks {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 00:09:33 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Ensure instance console log exists: /opt/stack/data/nova/instances/6fb358a6-7e79-4acf-8fbe-7cc4e67a707b/console.log {{(pid=82479) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 00:09:33 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:09:33 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:09:33 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:09:33 user nova-compute[82479]: DEBUG nova.network.neutron [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Successfully updated port: e4c19308-c4ea-4a47-a0e2-9a8616e8c39c {{(pid=82479) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 00:09:33 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquiring lock "refresh_cache-6fb358a6-7e79-4acf-8fbe-7cc4e67a707b" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:09:33 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquired lock "refresh_cache-6fb358a6-7e79-4acf-8fbe-7cc4e67a707b" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:09:33 user nova-compute[82479]: DEBUG nova.network.neutron [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 00:09:33 user nova-compute[82479]: DEBUG nova.compute.manager [req-8266e5ac-7fd7-4679-a37f-23f7de5d956c req-bca21b79-982f-4276-9c1b-3a7e8b44d5bc service nova] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Received event network-changed-e4c19308-c4ea-4a47-a0e2-9a8616e8c39c {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:09:34 user nova-compute[82479]: DEBUG nova.compute.manager [req-8266e5ac-7fd7-4679-a37f-23f7de5d956c req-bca21b79-982f-4276-9c1b-3a7e8b44d5bc service nova] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Refreshing instance network info cache due to event network-changed-e4c19308-c4ea-4a47-a0e2-9a8616e8c39c. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:09:34 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-8266e5ac-7fd7-4679-a37f-23f7de5d956c req-bca21b79-982f-4276-9c1b-3a7e8b44d5bc service nova] Acquiring lock "refresh_cache-6fb358a6-7e79-4acf-8fbe-7cc4e67a707b" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:09:34 user nova-compute[82479]: DEBUG nova.network.neutron [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Instance cache missing network info. {{(pid=82479) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 00:09:34 user nova-compute[82479]: DEBUG nova.network.neutron [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Updating instance_info_cache with network_info: [{"id": "e4c19308-c4ea-4a47-a0e2-9a8616e8c39c", "address": "fa:16:3e:f8:1a:b2", "network": {"id": "f185dffe-f180-4107-8752-182e71fc07c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1954392221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f138770c7b4407d83c449500fc000a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4c19308-c4", "ovs_interfaceid": "e4c19308-c4ea-4a47-a0e2-9a8616e8c39c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:09:34 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Releasing lock "refresh_cache-6fb358a6-7e79-4acf-8fbe-7cc4e67a707b" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:09:34 user nova-compute[82479]: DEBUG nova.compute.manager [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Instance network_info: |[{"id": "e4c19308-c4ea-4a47-a0e2-9a8616e8c39c", "address": "fa:16:3e:f8:1a:b2", "network": {"id": "f185dffe-f180-4107-8752-182e71fc07c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1954392221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f138770c7b4407d83c449500fc000a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4c19308-c4", "ovs_interfaceid": "e4c19308-c4ea-4a47-a0e2-9a8616e8c39c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 00:09:34 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-8266e5ac-7fd7-4679-a37f-23f7de5d956c req-bca21b79-982f-4276-9c1b-3a7e8b44d5bc service nova] Acquired lock "refresh_cache-6fb358a6-7e79-4acf-8fbe-7cc4e67a707b" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:09:34 user nova-compute[82479]: DEBUG nova.network.neutron [req-8266e5ac-7fd7-4679-a37f-23f7de5d956c req-bca21b79-982f-4276-9c1b-3a7e8b44d5bc service nova] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Refreshing network info cache for port e4c19308-c4ea-4a47-a0e2-9a8616e8c39c {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:09:34 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Start _get_guest_xml network_info=[{"id": "e4c19308-c4ea-4a47-a0e2-9a8616e8c39c", "address": "fa:16:3e:f8:1a:b2", "network": {"id": "f185dffe-f180-4107-8752-182e71fc07c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1954392221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f138770c7b4407d83c449500fc000a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4c19308-c4", "ovs_interfaceid": "e4c19308-c4ea-4a47-a0e2-9a8616e8c39c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='45fca67ba83f62ab2ec8da8f70c68e01',container_format='bare',created_at=2023-04-14T00:09:20Z,direct_url=<?>,disk_format='qcow2',id=16275777-e8d4-4654-a571-dc2e6d715cf8,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-845995898',owner='1f138770c7b4407d83c449500fc000a5',properties=ImageMetaProps,protected=<?>,size=38666240,status='active',tags=<?>,updated_at=2023-04-14T00:09:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'image_id': '16275777-e8d4-4654-a571-dc2e6d715cf8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 00:09:34 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:09:34 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:09:34 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82479) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 00:09:34 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T00:02:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='45fca67ba83f62ab2ec8da8f70c68e01',container_format='bare',created_at=2023-04-14T00:09:20Z,direct_url=<?>,disk_format='qcow2',id=16275777-e8d4-4654-a571-dc2e6d715cf8,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-845995898',owner='1f138770c7b4407d83c449500fc000a5',properties=ImageMetaProps,protected=<?>,size=38666240,status='active',tags=<?>,updated_at=2023-04-14T00:09:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 00:09:34 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Flavor limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 00:09:34 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Image limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 00:09:34 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Flavor pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 00:09:34 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Image pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 00:09:34 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 00:09:34 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 00:09:34 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 00:09:34 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Got 1 possible topologies {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 00:09:34 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 00:09:34 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 00:09:34 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:09:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1199162286',display_name='tempest-TestStampPattern-server-1199162286',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1199162286',id=16,image_ref='16275777-e8d4-4654-a571-dc2e6d715cf8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDlLkyaARZkQB95QySk+2VUQZ09Ejf2MBAGMaTBkstJSwxWK7dIH2obGUK+EG+vNkZ0wlDST0FmsMBpmophXdr02YiHRimuo8UQxusvxIG9HcXOIpUbG3VMNRBCqhYxCUw==',key_name='tempest-TestStampPattern-2105733066',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1f138770c7b4407d83c449500fc000a5',ramdisk_id='',reservation_id='r-eksxdm68',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='11c3384a-e699-4b10-9f8b-861291e96465',image_min_disk='1',image_min_ram='0',image_owner_id='1f138770c7b4407d83c449500fc000a5',image_owner_project_name='tempest-TestStampPattern-1381824337',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1381824337-project-member',image_user_id='6fe75acb64a94a2a88d370f43fa6b776',network_allocated='True',owner_project_name='tempest-TestStampPattern-1381824337',owner_user_name='tempest-TestStampPattern-1381824337-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:09:31Z,user_data=None,user_id='6fe75acb64a94a2a88d370f43fa6b776',uuid=6fb358a6-7e79-4acf-8fbe-7cc4e67a707b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4c19308-c4ea-4a47-a0e2-9a8616e8c39c", "address": "fa:16:3e:f8:1a:b2", "network": {"id": "f185dffe-f180-4107-8752-182e71fc07c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1954392221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f138770c7b4407d83c449500fc000a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4c19308-c4", "ovs_interfaceid": "e4c19308-c4ea-4a47-a0e2-9a8616e8c39c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82479) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 00:09:34 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Converting VIF {"id": "e4c19308-c4ea-4a47-a0e2-9a8616e8c39c", "address": "fa:16:3e:f8:1a:b2", "network": {"id": "f185dffe-f180-4107-8752-182e71fc07c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1954392221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f138770c7b4407d83c449500fc000a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4c19308-c4", "ovs_interfaceid": "e4c19308-c4ea-4a47-a0e2-9a8616e8c39c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:09:34 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:1a:b2,bridge_name='br-int',has_traffic_filtering=True,id=e4c19308-c4ea-4a47-a0e2-9a8616e8c39c,network=Network(f185dffe-f180-4107-8752-182e71fc07c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4c19308-c4') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:09:34 user nova-compute[82479]: DEBUG nova.objects.instance [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lazy-loading 'pci_devices' on Instance uuid 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:09:34 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] End _get_guest_xml xml=<domain type="kvm">
Apr 14 00:09:34 user nova-compute[82479]:   <uuid>6fb358a6-7e79-4acf-8fbe-7cc4e67a707b</uuid>
Apr 14 00:09:34 user nova-compute[82479]:   <name>instance-00000010</name>
Apr 14 00:09:34 user nova-compute[82479]:   <memory>131072</memory>
Apr 14 00:09:34 user nova-compute[82479]:   <vcpu>1</vcpu>
Apr 14 00:09:34 user nova-compute[82479]:   <metadata>
Apr 14 00:09:34 user nova-compute[82479]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 00:09:34 user nova-compute[82479]:       <nova:package version="0.0.0"/>
Apr 14 00:09:34 user nova-compute[82479]:       <nova:name>tempest-TestStampPattern-server-1199162286</nova:name>
Apr 14 00:09:34 user nova-compute[82479]:       <nova:creationTime>2023-04-14 00:09:34</nova:creationTime>
Apr 14 00:09:34 user nova-compute[82479]:       <nova:flavor name="m1.nano">
Apr 14 00:09:34 user nova-compute[82479]:         <nova:memory>128</nova:memory>
Apr 14 00:09:34 user nova-compute[82479]:         <nova:disk>1</nova:disk>
Apr 14 00:09:34 user nova-compute[82479]:         <nova:swap>0</nova:swap>
Apr 14 00:09:34 user nova-compute[82479]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 00:09:34 user nova-compute[82479]:         <nova:vcpus>1</nova:vcpus>
Apr 14 00:09:34 user nova-compute[82479]:       </nova:flavor>
Apr 14 00:09:34 user nova-compute[82479]:       <nova:owner>
Apr 14 00:09:34 user nova-compute[82479]:         <nova:user uuid="6fe75acb64a94a2a88d370f43fa6b776">tempest-TestStampPattern-1381824337-project-member</nova:user>
Apr 14 00:09:34 user nova-compute[82479]:         <nova:project uuid="1f138770c7b4407d83c449500fc000a5">tempest-TestStampPattern-1381824337</nova:project>
Apr 14 00:09:34 user nova-compute[82479]:       </nova:owner>
Apr 14 00:09:34 user nova-compute[82479]:       <nova:root type="image" uuid="16275777-e8d4-4654-a571-dc2e6d715cf8"/>
Apr 14 00:09:34 user nova-compute[82479]:       <nova:ports>
Apr 14 00:09:34 user nova-compute[82479]:         <nova:port uuid="e4c19308-c4ea-4a47-a0e2-9a8616e8c39c">
Apr 14 00:09:34 user nova-compute[82479]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 00:09:34 user nova-compute[82479]:         </nova:port>
Apr 14 00:09:34 user nova-compute[82479]:       </nova:ports>
Apr 14 00:09:34 user nova-compute[82479]:     </nova:instance>
Apr 14 00:09:34 user nova-compute[82479]:   </metadata>
Apr 14 00:09:34 user nova-compute[82479]:   <sysinfo type="smbios">
Apr 14 00:09:34 user nova-compute[82479]:     <system>
Apr 14 00:09:34 user nova-compute[82479]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 00:09:34 user nova-compute[82479]:       <entry name="product">OpenStack Nova</entry>
Apr 14 00:09:34 user nova-compute[82479]:       <entry name="version">0.0.0</entry>
Apr 14 00:09:34 user nova-compute[82479]:       <entry name="serial">6fb358a6-7e79-4acf-8fbe-7cc4e67a707b</entry>
Apr 14 00:09:34 user nova-compute[82479]:       <entry name="uuid">6fb358a6-7e79-4acf-8fbe-7cc4e67a707b</entry>
Apr 14 00:09:34 user nova-compute[82479]:       <entry name="family">Virtual Machine</entry>
Apr 14 00:09:34 user nova-compute[82479]:     </system>
Apr 14 00:09:34 user nova-compute[82479]:   </sysinfo>
Apr 14 00:09:34 user nova-compute[82479]:   <os>
Apr 14 00:09:34 user nova-compute[82479]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 00:09:34 user nova-compute[82479]:     <boot dev="hd"/>
Apr 14 00:09:34 user nova-compute[82479]:     <smbios mode="sysinfo"/>
Apr 14 00:09:34 user nova-compute[82479]:   </os>
Apr 14 00:09:34 user nova-compute[82479]:   <features>
Apr 14 00:09:34 user nova-compute[82479]:     <acpi/>
Apr 14 00:09:34 user nova-compute[82479]:     <apic/>
Apr 14 00:09:34 user nova-compute[82479]:     <vmcoreinfo/>
Apr 14 00:09:34 user nova-compute[82479]:   </features>
Apr 14 00:09:34 user nova-compute[82479]:   <clock offset="utc">
Apr 14 00:09:34 user nova-compute[82479]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 00:09:34 user nova-compute[82479]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 00:09:34 user nova-compute[82479]:     <timer name="hpet" present="no"/>
Apr 14 00:09:34 user nova-compute[82479]:   </clock>
Apr 14 00:09:34 user nova-compute[82479]:   <cpu mode="custom" match="exact">
Apr 14 00:09:34 user nova-compute[82479]:     <model>Nehalem</model>
Apr 14 00:09:34 user nova-compute[82479]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 00:09:34 user nova-compute[82479]:   </cpu>
Apr 14 00:09:34 user nova-compute[82479]:   <devices>
Apr 14 00:09:34 user nova-compute[82479]:     <disk type="file" device="disk">
Apr 14 00:09:34 user nova-compute[82479]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 00:09:34 user nova-compute[82479]:       <source file="/opt/stack/data/nova/instances/6fb358a6-7e79-4acf-8fbe-7cc4e67a707b/disk"/>
Apr 14 00:09:34 user nova-compute[82479]:       <target dev="vda" bus="virtio"/>
Apr 14 00:09:34 user nova-compute[82479]:     </disk>
Apr 14 00:09:34 user nova-compute[82479]:     <interface type="ethernet">
Apr 14 00:09:34 user nova-compute[82479]:       <mac address="fa:16:3e:f8:1a:b2"/>
Apr 14 00:09:34 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:09:34 user nova-compute[82479]:       <mtu size="1442"/>
Apr 14 00:09:34 user nova-compute[82479]:       <target dev="tape4c19308-c4"/>
Apr 14 00:09:34 user nova-compute[82479]:     </interface>
Apr 14 00:09:34 user nova-compute[82479]:     <serial type="pty">
Apr 14 00:09:34 user nova-compute[82479]:       <log file="/opt/stack/data/nova/instances/6fb358a6-7e79-4acf-8fbe-7cc4e67a707b/console.log" append="off"/>
Apr 14 00:09:34 user nova-compute[82479]:     </serial>
Apr 14 00:09:34 user nova-compute[82479]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 00:09:34 user nova-compute[82479]:     <video>
Apr 14 00:09:34 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:09:34 user nova-compute[82479]:     </video>
Apr 14 00:09:34 user nova-compute[82479]:     <rng model="virtio">
Apr 14 00:09:34 user nova-compute[82479]:       <backend model="random">/dev/urandom</backend>
Apr 14 00:09:34 user nova-compute[82479]:     </rng>
Apr 14 00:09:34 user nova-compute[82479]:     <controller type="usb" index="0" model="none"/>
Apr 14 00:09:34 user nova-compute[82479]:     <memballoon model="virtio">
Apr 14 00:09:34 user nova-compute[82479]:       <stats period="10"/>
Apr 14 00:09:34 user nova-compute[82479]:     </memballoon>
Apr 14 00:09:34 user nova-compute[82479]:   </devices>
Apr 14 00:09:34 user nova-compute[82479]: </domain>
Apr 14 00:09:34 user nova-compute[82479]:  {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 00:09:34 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:09:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1199162286',display_name='tempest-TestStampPattern-server-1199162286',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1199162286',id=16,image_ref='16275777-e8d4-4654-a571-dc2e6d715cf8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDlLkyaARZkQB95QySk+2VUQZ09Ejf2MBAGMaTBkstJSwxWK7dIH2obGUK+EG+vNkZ0wlDST0FmsMBpmophXdr02YiHRimuo8UQxusvxIG9HcXOIpUbG3VMNRBCqhYxCUw==',key_name='tempest-TestStampPattern-2105733066',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1f138770c7b4407d83c449500fc000a5',ramdisk_id='',reservation_id='r-eksxdm68',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='11c3384a-e699-4b10-9f8b-861291e96465',image_min_disk='1',image_min_ram='0',image_owner_id='1f138770c7b4407d83c449500fc000a5',image_owner_project_name='tempest-TestStampPattern-1381824337',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1381824337-project-member',image_user_id='6fe75acb64a94a2a88d370f43fa6b776',network_allocated='True',owner_project_name='tempest-TestStampPattern-1381824337',owner_user_name='tempest-TestStampPattern-1381824337-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:09:31Z,user_data=None,user_id='6fe75acb64a94a2a88d370f43fa6b776',uuid=6fb358a6-7e79-4acf-8fbe-7cc4e67a707b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4c19308-c4ea-4a47-a0e2-9a8616e8c39c", "address": "fa:16:3e:f8:1a:b2", "network": {"id": "f185dffe-f180-4107-8752-182e71fc07c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1954392221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f138770c7b4407d83c449500fc000a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4c19308-c4", "ovs_interfaceid": "e4c19308-c4ea-4a47-a0e2-9a8616e8c39c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 00:09:34 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Converting VIF {"id": "e4c19308-c4ea-4a47-a0e2-9a8616e8c39c", "address": "fa:16:3e:f8:1a:b2", "network": {"id": "f185dffe-f180-4107-8752-182e71fc07c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1954392221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f138770c7b4407d83c449500fc000a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4c19308-c4", "ovs_interfaceid": "e4c19308-c4ea-4a47-a0e2-9a8616e8c39c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:09:34 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:1a:b2,bridge_name='br-int',has_traffic_filtering=True,id=e4c19308-c4ea-4a47-a0e2-9a8616e8c39c,network=Network(f185dffe-f180-4107-8752-182e71fc07c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4c19308-c4') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:09:34 user nova-compute[82479]: DEBUG os_vif [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:1a:b2,bridge_name='br-int',has_traffic_filtering=True,id=e4c19308-c4ea-4a47-a0e2-9a8616e8c39c,network=Network(f185dffe-f180-4107-8752-182e71fc07c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4c19308-c4') {{(pid=82479) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 00:09:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:09:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 00:09:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape4c19308-c4, may_exist=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:09:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape4c19308-c4, col_values=(('external_ids', {'iface-id': 'e4c19308-c4ea-4a47-a0e2-9a8616e8c39c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:1a:b2', 'vm-uuid': '6fb358a6-7e79-4acf-8fbe-7cc4e67a707b'}),)) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:09:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:09:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:34 user nova-compute[82479]: INFO os_vif [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:1a:b2,bridge_name='br-int',has_traffic_filtering=True,id=e4c19308-c4ea-4a47-a0e2-9a8616e8c39c,network=Network(f185dffe-f180-4107-8752-182e71fc07c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4c19308-c4')
Apr 14 00:09:34 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:09:34 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] No VIF found with MAC fa:16:3e:f8:1a:b2, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:09:34 user nova-compute[82479]: DEBUG nova.network.neutron [req-8266e5ac-7fd7-4679-a37f-23f7de5d956c req-bca21b79-982f-4276-9c1b-3a7e8b44d5bc service nova] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Updated VIF entry in instance network info cache for port e4c19308-c4ea-4a47-a0e2-9a8616e8c39c. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:09:34 user nova-compute[82479]: DEBUG nova.network.neutron [req-8266e5ac-7fd7-4679-a37f-23f7de5d956c req-bca21b79-982f-4276-9c1b-3a7e8b44d5bc service nova] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Updating instance_info_cache with network_info: [{"id": "e4c19308-c4ea-4a47-a0e2-9a8616e8c39c", "address": "fa:16:3e:f8:1a:b2", "network": {"id": "f185dffe-f180-4107-8752-182e71fc07c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1954392221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f138770c7b4407d83c449500fc000a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4c19308-c4", "ovs_interfaceid": "e4c19308-c4ea-4a47-a0e2-9a8616e8c39c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:09:34 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-8266e5ac-7fd7-4679-a37f-23f7de5d956c req-bca21b79-982f-4276-9c1b-3a7e8b44d5bc service nova] Releasing lock "refresh_cache-6fb358a6-7e79-4acf-8fbe-7cc4e67a707b" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:09:35 user nova-compute[82479]: DEBUG nova.compute.manager [req-80f953be-6c63-4e8c-a83d-d83ac9a106f0 req-33e51fcc-3a7d-43f7-a154-176b84572257 service nova] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Received event network-vif-plugged-01f28b85-9614-4a93-bc9b-7b894b96313a {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:09:35 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-80f953be-6c63-4e8c-a83d-d83ac9a106f0 req-33e51fcc-3a7d-43f7-a154-176b84572257 service nova] Acquiring lock "b21b91b1-a98b-48c7-a2e8-4114c3e31345-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:09:35 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-80f953be-6c63-4e8c-a83d-d83ac9a106f0 req-33e51fcc-3a7d-43f7-a154-176b84572257 service nova] Lock "b21b91b1-a98b-48c7-a2e8-4114c3e31345-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:09:35 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-80f953be-6c63-4e8c-a83d-d83ac9a106f0 req-33e51fcc-3a7d-43f7-a154-176b84572257 service nova] Lock "b21b91b1-a98b-48c7-a2e8-4114c3e31345-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:09:35 user nova-compute[82479]: DEBUG nova.compute.manager [req-80f953be-6c63-4e8c-a83d-d83ac9a106f0 req-33e51fcc-3a7d-43f7-a154-176b84572257 service nova] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] No waiting events found dispatching network-vif-plugged-01f28b85-9614-4a93-bc9b-7b894b96313a {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:09:35 user nova-compute[82479]: WARNING nova.compute.manager [req-80f953be-6c63-4e8c-a83d-d83ac9a106f0 req-33e51fcc-3a7d-43f7-a154-176b84572257 service nova] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Received unexpected event network-vif-plugged-01f28b85-9614-4a93-bc9b-7b894b96313a for instance with vm_state building and task_state spawning.
Apr 14 00:09:35 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681430975.0545511, b21b91b1-a98b-48c7-a2e8-4114c3e31345 => Resumed> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:09:35 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] VM Resumed (Lifecycle Event)
Apr 14 00:09:35 user nova-compute[82479]: DEBUG nova.compute.manager [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Instance event wait completed in 0 seconds for  {{(pid=82479) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 00:09:35 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Guest created on hypervisor {{(pid=82479) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 00:09:35 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Instance spawned successfully.
Apr 14 00:09:35 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 00:09:35 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:09:35 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:09:35 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Found default for hw_cdrom_bus of ide {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:09:35 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Found default for hw_disk_bus of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:09:35 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Found default for hw_input_bus of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:09:35 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Found default for hw_pointer_model of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:09:35 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Found default for hw_video_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:09:35 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Found default for hw_vif_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:09:35 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:09:35 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681430975.0559576, b21b91b1-a98b-48c7-a2e8-4114c3e31345 => Started> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:09:35 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] VM Started (Lifecycle Event)
Apr 14 00:09:35 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:09:35 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:09:35 user nova-compute[82479]: INFO nova.compute.manager [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Took 6.85 seconds to spawn the instance on the hypervisor.
Apr 14 00:09:35 user nova-compute[82479]: DEBUG nova.compute.manager [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:09:35 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:09:35 user nova-compute[82479]: INFO nova.compute.manager [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Took 7.65 seconds to build instance.
Apr 14 00:09:35 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-43ecb810-1e6b-4c9b-8b3c-bda2e79bfa12 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "b21b91b1-a98b-48c7-a2e8-4114c3e31345" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.761s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:09:35 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:36 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:36 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:36 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:36 user nova-compute[82479]: DEBUG nova.compute.manager [req-1ac0a9fe-8d8a-4666-9323-f6c1ba12b09c req-a54aa01f-6239-4048-83c6-f95dabba616d service nova] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Received event network-vif-plugged-e4c19308-c4ea-4a47-a0e2-9a8616e8c39c {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:09:36 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-1ac0a9fe-8d8a-4666-9323-f6c1ba12b09c req-a54aa01f-6239-4048-83c6-f95dabba616d service nova] Acquiring lock "6fb358a6-7e79-4acf-8fbe-7cc4e67a707b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:09:36 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-1ac0a9fe-8d8a-4666-9323-f6c1ba12b09c req-a54aa01f-6239-4048-83c6-f95dabba616d service nova] Lock "6fb358a6-7e79-4acf-8fbe-7cc4e67a707b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:09:36 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-1ac0a9fe-8d8a-4666-9323-f6c1ba12b09c req-a54aa01f-6239-4048-83c6-f95dabba616d service nova] Lock "6fb358a6-7e79-4acf-8fbe-7cc4e67a707b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:09:36 user nova-compute[82479]: DEBUG nova.compute.manager [req-1ac0a9fe-8d8a-4666-9323-f6c1ba12b09c req-a54aa01f-6239-4048-83c6-f95dabba616d service nova] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] No waiting events found dispatching network-vif-plugged-e4c19308-c4ea-4a47-a0e2-9a8616e8c39c {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:09:36 user nova-compute[82479]: WARNING nova.compute.manager [req-1ac0a9fe-8d8a-4666-9323-f6c1ba12b09c req-a54aa01f-6239-4048-83c6-f95dabba616d service nova] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Received unexpected event network-vif-plugged-e4c19308-c4ea-4a47-a0e2-9a8616e8c39c for instance with vm_state building and task_state spawning.
Apr 14 00:09:36 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:38 user nova-compute[82479]: DEBUG nova.compute.manager [req-c857ddb2-26df-4b33-8390-92eb4ac9b1ee req-37ce16a9-e5a4-42e0-81d9-bfc347cb5818 service nova] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Received event network-vif-plugged-e4c19308-c4ea-4a47-a0e2-9a8616e8c39c {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:09:38 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-c857ddb2-26df-4b33-8390-92eb4ac9b1ee req-37ce16a9-e5a4-42e0-81d9-bfc347cb5818 service nova] Acquiring lock "6fb358a6-7e79-4acf-8fbe-7cc4e67a707b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:09:38 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-c857ddb2-26df-4b33-8390-92eb4ac9b1ee req-37ce16a9-e5a4-42e0-81d9-bfc347cb5818 service nova] Lock "6fb358a6-7e79-4acf-8fbe-7cc4e67a707b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:09:38 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-c857ddb2-26df-4b33-8390-92eb4ac9b1ee req-37ce16a9-e5a4-42e0-81d9-bfc347cb5818 service nova] Lock "6fb358a6-7e79-4acf-8fbe-7cc4e67a707b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:09:38 user nova-compute[82479]: DEBUG nova.compute.manager [req-c857ddb2-26df-4b33-8390-92eb4ac9b1ee req-37ce16a9-e5a4-42e0-81d9-bfc347cb5818 service nova] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] No waiting events found dispatching network-vif-plugged-e4c19308-c4ea-4a47-a0e2-9a8616e8c39c {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:09:38 user nova-compute[82479]: WARNING nova.compute.manager [req-c857ddb2-26df-4b33-8390-92eb4ac9b1ee req-37ce16a9-e5a4-42e0-81d9-bfc347cb5818 service nova] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Received unexpected event network-vif-plugged-e4c19308-c4ea-4a47-a0e2-9a8616e8c39c for instance with vm_state building and task_state spawning.
Apr 14 00:09:38 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681430978.409412, 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b => Resumed> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:09:38 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] VM Resumed (Lifecycle Event)
Apr 14 00:09:38 user nova-compute[82479]: DEBUG nova.compute.manager [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Instance event wait completed in 0 seconds for  {{(pid=82479) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 00:09:38 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Guest created on hypervisor {{(pid=82479) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 00:09:38 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Instance spawned successfully.
Apr 14 00:09:38 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 00:09:38 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:09:38 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Found default for hw_input_bus of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:09:38 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Found default for hw_pointer_model of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:09:38 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:09:38 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:09:38 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681430978.4108279, 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b => Started> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:09:38 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] VM Started (Lifecycle Event)
Apr 14 00:09:38 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:09:38 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:09:38 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:09:38 user nova-compute[82479]: INFO nova.compute.manager [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Took 7.28 seconds to spawn the instance on the hypervisor.
Apr 14 00:09:38 user nova-compute[82479]: DEBUG nova.compute.manager [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:09:38 user nova-compute[82479]: INFO nova.compute.manager [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Took 8.21 seconds to build instance.
Apr 14 00:09:38 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8f375c09-5bac-4fe6-a8a9-73e73326b1bc tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6fb358a6-7e79-4acf-8fbe-7cc4e67a707b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.307s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:09:39 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:40 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:09:40 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Starting heal instance info cache {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 00:09:40 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "refresh_cache-b3475e7e-ceb4-452a-a045-dbf43c5944dd" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:09:40 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquired lock "refresh_cache-b3475e7e-ceb4-452a-a045-dbf43c5944dd" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:09:40 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Forcefully refreshing network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 00:09:40 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:41 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Updating instance_info_cache with network_info: [{"id": "617f05b8-c04e-4abf-b4e5-a0234209624a", "address": "fa:16:3e:f9:fd:1a", "network": {"id": "cb8c9bb1-a885-486d-aa6a-de600bc01c2e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1676259779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8663ccad9047f4b11b9ae0646c287a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617f05b8-c0", "ovs_interfaceid": "617f05b8-c04e-4abf-b4e5-a0234209624a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:09:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Releasing lock "refresh_cache-b3475e7e-ceb4-452a-a045-dbf43c5944dd" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:09:41 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Updated the network info_cache for instance {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 00:09:41 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:09:41 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:09:42 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:43 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:09:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:45 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:46 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:09:46 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:09:46 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:09:46 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82479) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 00:09:46 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:47 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:09:47 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:09:47 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:09:47 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:09:47 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:09:47 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Auditing locally available compute resources for user (node: user) {{(pid=82479) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 00:09:47 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:48 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:48 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:48 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:48 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:09:48 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11c3384a-e699-4b10-9f8b-861291e96465/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:48 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11c3384a-e699-4b10-9f8b-861291e96465/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:48 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11c3384a-e699-4b10-9f8b-861291e96465/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:48 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11c3384a-e699-4b10-9f8b-861291e96465/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:48 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b21b91b1-a98b-48c7-a2e8-4114c3e31345/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:48 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b21b91b1-a98b-48c7-a2e8-4114c3e31345/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:48 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b21b91b1-a98b-48c7-a2e8-4114c3e31345/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:48 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b21b91b1-a98b-48c7-a2e8-4114c3e31345/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:48 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb358a6-7e79-4acf-8fbe-7cc4e67a707b/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb358a6-7e79-4acf-8fbe-7cc4e67a707b/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb358a6-7e79-4acf-8fbe-7cc4e67a707b/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb358a6-7e79-4acf-8fbe-7cc4e67a707b/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:49 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:09:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97/disk.rescue --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97/disk.rescue --force-share --output=json" returned: 0 in 0.148s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97/disk.rescue --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97/disk.rescue --force-share --output=json" returned: 0 in 0.152s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db291c2f-a72c-46ce-8de8-3956de37ccf8/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db291c2f-a72c-46ce-8de8-3956de37ccf8/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db291c2f-a72c-46ce-8de8-3956de37ccf8/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db291c2f-a72c-46ce-8de8-3956de37ccf8/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01a65362-36ea-4817-8e83-f75d6daf808b/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01a65362-36ea-4817-8e83-f75d6daf808b/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01a65362-36ea-4817-8e83-f75d6daf808b/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01a65362-36ea-4817-8e83-f75d6daf808b/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:50 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:09:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fba4ee-4aae-4ee3-8114-b53510f5442c/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fba4ee-4aae-4ee3-8114-b53510f5442c/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fba4ee-4aae-4ee3-8114-b53510f5442c/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:50 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fba4ee-4aae-4ee3-8114-b53510f5442c/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:50 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:09:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:51 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:09:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8feba40a-03c7-4c60-b862-ee14fb8c9b05/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8feba40a-03c7-4c60-b862-ee14fb8c9b05/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8feba40a-03c7-4c60-b862-ee14fb8c9b05/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8feba40a-03c7-4c60-b862-ee14fb8c9b05/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:51 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:09:52 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:09:52 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:09:52 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Hypervisor/Node resource view: name=user free_ram=7297MB free_disk=26.203208923339844GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82479) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 00:09:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:09:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:09:52 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 23718fd0-58b8-47f9-b1ef-a26a90741ecc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:09:52 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:09:52 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 01a65362-36ea-4817-8e83-f75d6daf808b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:09:52 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance b3475e7e-ceb4-452a-a045-dbf43c5944dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:09:52 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 11c3384a-e699-4b10-9f8b-861291e96465 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:09:52 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance e3fba4ee-4aae-4ee3-8114-b53510f5442c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:09:52 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance db291c2f-a72c-46ce-8de8-3956de37ccf8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:09:52 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 17c6c147-fb62-4204-a416-792b94d3f7dd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:09:52 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:09:52 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 8feba40a-03c7-4c60-b862-ee14fb8c9b05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:09:52 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance b21b91b1-a98b-48c7-a2e8-4114c3e31345 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:09:52 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:09:52 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 00:09:52 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Final resource view: name=user phys_ram=16023MB used_ram=2048MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 00:09:52 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:09:52 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:09:52 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Compute_service record updated for user:user {{(pid=82479) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 00:09:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.582s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:09:53 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:54 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:54 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:54 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:55 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:56 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:58 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:09:58 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:09:58 user nova-compute[82479]: DEBUG nova.compute.manager [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Starting instance... {{(pid=82479) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 00:09:58 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:09:58 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:09:58 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82479) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 00:09:58 user nova-compute[82479]: INFO nova.compute.claims [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Claim successful on node user
Apr 14 00:09:58 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:09:58 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:09:58 user nova-compute[82479]: DEBUG nova.compute.manager [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Starting instance... {{(pid=82479) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 00:09:58 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:09:58 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:09:59 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.538s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:09:59 user nova-compute[82479]: DEBUG nova.compute.manager [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Start building networks asynchronously for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 00:09:59 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:09:59 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:09:59 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82479) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 00:09:59 user nova-compute[82479]: INFO nova.compute.claims [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Claim successful on node user
Apr 14 00:09:59 user nova-compute[82479]: DEBUG nova.compute.manager [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Allocating IP information in the background. {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 00:09:59 user nova-compute[82479]: DEBUG nova.network.neutron [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] allocate_for_instance() {{(pid=82479) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 00:09:59 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 00:09:59 user nova-compute[82479]: DEBUG nova.compute.manager [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Start building block device mappings for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 00:09:59 user nova-compute[82479]: DEBUG nova.compute.manager [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Start spawning the instance on the hypervisor. {{(pid=82479) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 00:09:59 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Creating instance directory {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 00:09:59 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Creating image(s)
Apr 14 00:09:59 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "/opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:09:59 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "/opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:09:59 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "/opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:09:59 user nova-compute[82479]: DEBUG nova.policy [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f43f3171ccad4167ac783bbdfe2df478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524265958bd24a6cb94aa3115eb2b6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82479) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 00:09:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.150s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:59 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "3e200e101633f2016e569ae4c0a352380507d1e4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:09:59 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "3e200e101633f2016e569ae4c0a352380507d1e4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:09:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:59 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:09:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.148s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk 1073741824 {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk 1073741824" returned: 0 in 0.058s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:59 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "3e200e101633f2016e569ae4c0a352380507d1e4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.212s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:09:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:59 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:09:59 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:09:59 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.758s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:09:59 user nova-compute[82479]: DEBUG nova.compute.manager [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Start building networks asynchronously for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 00:09:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.156s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:59 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk. size=1073741824 {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 00:09:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:09:59 user nova-compute[82479]: DEBUG nova.compute.manager [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Allocating IP information in the background. {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 00:09:59 user nova-compute[82479]: DEBUG nova.network.neutron [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] allocate_for_instance() {{(pid=82479) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 00:09:59 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 00:09:59 user nova-compute[82479]: DEBUG nova.compute.manager [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Start building block device mappings for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 00:09:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:09:59 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Cannot resize image /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk to a smaller size. {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 00:09:59 user nova-compute[82479]: DEBUG nova.objects.instance [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lazy-loading 'migration_context' on Instance uuid 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:09:59 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Created local disks {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 00:09:59 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Ensure instance console log exists: /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/console.log {{(pid=82479) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 00:09:59 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:09:59 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:09:59 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:09:59 user nova-compute[82479]: DEBUG nova.policy [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f43f3171ccad4167ac783bbdfe2df478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524265958bd24a6cb94aa3115eb2b6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82479) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 00:10:00 user nova-compute[82479]: DEBUG nova.compute.manager [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Start spawning the instance on the hypervisor. {{(pid=82479) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 00:10:00 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Creating instance directory {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 00:10:00 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Creating image(s)
Apr 14 00:10:00 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "/opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:10:00 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "/opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:10:00 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "/opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:10:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:00 user nova-compute[82479]: DEBUG nova.network.neutron [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Successfully created port: 10a32c68-570b-4ba1-ba36-6ecaf135c9bb {{(pid=82479) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 00:10:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.170s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:00 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "3e200e101633f2016e569ae4c0a352380507d1e4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:10:00 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "3e200e101633f2016e569ae4c0a352380507d1e4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:10:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.145s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk 1073741824 {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk 1073741824" returned: 0 in 0.064s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:00 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "3e200e101633f2016e569ae4c0a352380507d1e4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.217s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:10:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.146s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:00 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk. size=1073741824 {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 00:10:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:00 user nova-compute[82479]: DEBUG nova.network.neutron [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Successfully created port: caaa85dc-5a5f-4480-b6be-b2bc234cd455 {{(pid=82479) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 00:10:00 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:00 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Cannot resize image /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk to a smaller size. {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 00:10:00 user nova-compute[82479]: DEBUG nova.objects.instance [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lazy-loading 'migration_context' on Instance uuid d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:10:00 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Created local disks {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 00:10:00 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Ensure instance console log exists: /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/console.log {{(pid=82479) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 00:10:00 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:10:00 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:10:00 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG nova.network.neutron [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Successfully updated port: 10a32c68-570b-4ba1-ba36-6ecaf135c9bb {{(pid=82479) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "refresh_cache-6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquired lock "refresh_cache-6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG nova.network.neutron [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG nova.network.neutron [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Instance cache missing network info. {{(pid=82479) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG nova.compute.manager [req-2ec28c74-1ef3-485d-84ae-f242c27842d5 req-8441cc0a-3caa-4cf8-899a-dfe12e9e877b service nova] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Received event network-changed-10a32c68-570b-4ba1-ba36-6ecaf135c9bb {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG nova.compute.manager [req-2ec28c74-1ef3-485d-84ae-f242c27842d5 req-8441cc0a-3caa-4cf8-899a-dfe12e9e877b service nova] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Refreshing instance network info cache due to event network-changed-10a32c68-570b-4ba1-ba36-6ecaf135c9bb. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-2ec28c74-1ef3-485d-84ae-f242c27842d5 req-8441cc0a-3caa-4cf8-899a-dfe12e9e877b service nova] Acquiring lock "refresh_cache-6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG nova.network.neutron [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Successfully updated port: caaa85dc-5a5f-4480-b6be-b2bc234cd455 {{(pid=82479) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "refresh_cache-d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquired lock "refresh_cache-d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG nova.network.neutron [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG nova.network.neutron [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Updating instance_info_cache with network_info: [{"id": "10a32c68-570b-4ba1-ba36-6ecaf135c9bb", "address": "fa:16:3e:a4:44:5a", "network": {"id": "08106daa-a35e-4376-8c46-2b4baa51c6ea", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321730350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524265958bd24a6cb94aa3115eb2b6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10a32c68-57", "ovs_interfaceid": "10a32c68-570b-4ba1-ba36-6ecaf135c9bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Releasing lock "refresh_cache-6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG nova.compute.manager [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Instance network_info: |[{"id": "10a32c68-570b-4ba1-ba36-6ecaf135c9bb", "address": "fa:16:3e:a4:44:5a", "network": {"id": "08106daa-a35e-4376-8c46-2b4baa51c6ea", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321730350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524265958bd24a6cb94aa3115eb2b6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10a32c68-57", "ovs_interfaceid": "10a32c68-570b-4ba1-ba36-6ecaf135c9bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-2ec28c74-1ef3-485d-84ae-f242c27842d5 req-8441cc0a-3caa-4cf8-899a-dfe12e9e877b service nova] Acquired lock "refresh_cache-6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG nova.network.neutron [req-2ec28c74-1ef3-485d-84ae-f242c27842d5 req-8441cc0a-3caa-4cf8-899a-dfe12e9e877b service nova] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Refreshing network info cache for port 10a32c68-570b-4ba1-ba36-6ecaf135c9bb {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Start _get_guest_xml network_info=[{"id": "10a32c68-570b-4ba1-ba36-6ecaf135c9bb", "address": "fa:16:3e:a4:44:5a", "network": {"id": "08106daa-a35e-4376-8c46-2b4baa51c6ea", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321730350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524265958bd24a6cb94aa3115eb2b6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10a32c68-57", "ovs_interfaceid": "10a32c68-570b-4ba1-ba36-6ecaf135c9bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 00:10:01 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:10:01 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:10:01 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82479) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T00:02:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Flavor limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Image limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Flavor pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Image pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Got 1 possible topologies {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:09:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1929968798',display_name='tempest-ServerRescueNegativeTestJSON-server-1929968798',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1929968798',id=17,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='524265958bd24a6cb94aa3115eb2b6c7',ramdisk_id='',reservation_id='r-r5gflibu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1055458768',owner_user_name='tempest-ServerRescueNegativeTestJSON-1055458768-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:09:59Z,user_data=None,user_id='f43f3171ccad4167ac783bbdfe2df478',uuid=6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10a32c68-570b-4ba1-ba36-6ecaf135c9bb", "address": "fa:16:3e:a4:44:5a", "network": {"id": "08106daa-a35e-4376-8c46-2b4baa51c6ea", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321730350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524265958bd24a6cb94aa3115eb2b6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10a32c68-57", "ovs_interfaceid": "10a32c68-570b-4ba1-ba36-6ecaf135c9bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82479) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Converting VIF {"id": "10a32c68-570b-4ba1-ba36-6ecaf135c9bb", "address": "fa:16:3e:a4:44:5a", "network": {"id": "08106daa-a35e-4376-8c46-2b4baa51c6ea", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321730350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524265958bd24a6cb94aa3115eb2b6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10a32c68-57", "ovs_interfaceid": "10a32c68-570b-4ba1-ba36-6ecaf135c9bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:44:5a,bridge_name='br-int',has_traffic_filtering=True,id=10a32c68-570b-4ba1-ba36-6ecaf135c9bb,network=Network(08106daa-a35e-4376-8c46-2b4baa51c6ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10a32c68-57') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG nova.objects.instance [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lazy-loading 'pci_devices' on Instance uuid 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG nova.network.neutron [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Instance cache missing network info. {{(pid=82479) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG nova.compute.manager [req-24934eb9-7edd-40a2-a7ea-145d91ba2e3b req-ff2a01a6-d7c7-42b9-a7c0-e550e1044fdd service nova] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Received event network-changed-caaa85dc-5a5f-4480-b6be-b2bc234cd455 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG nova.compute.manager [req-24934eb9-7edd-40a2-a7ea-145d91ba2e3b req-ff2a01a6-d7c7-42b9-a7c0-e550e1044fdd service nova] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Refreshing instance network info cache due to event network-changed-caaa85dc-5a5f-4480-b6be-b2bc234cd455. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-24934eb9-7edd-40a2-a7ea-145d91ba2e3b req-ff2a01a6-d7c7-42b9-a7c0-e550e1044fdd service nova] Acquiring lock "refresh_cache-d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] End _get_guest_xml xml=<domain type="kvm">
Apr 14 00:10:01 user nova-compute[82479]:   <uuid>6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9</uuid>
Apr 14 00:10:01 user nova-compute[82479]:   <name>instance-00000011</name>
Apr 14 00:10:01 user nova-compute[82479]:   <memory>131072</memory>
Apr 14 00:10:01 user nova-compute[82479]:   <vcpu>1</vcpu>
Apr 14 00:10:01 user nova-compute[82479]:   <metadata>
Apr 14 00:10:01 user nova-compute[82479]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 00:10:01 user nova-compute[82479]:       <nova:package version="0.0.0"/>
Apr 14 00:10:01 user nova-compute[82479]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1929968798</nova:name>
Apr 14 00:10:01 user nova-compute[82479]:       <nova:creationTime>2023-04-14 00:10:01</nova:creationTime>
Apr 14 00:10:01 user nova-compute[82479]:       <nova:flavor name="m1.nano">
Apr 14 00:10:01 user nova-compute[82479]:         <nova:memory>128</nova:memory>
Apr 14 00:10:01 user nova-compute[82479]:         <nova:disk>1</nova:disk>
Apr 14 00:10:01 user nova-compute[82479]:         <nova:swap>0</nova:swap>
Apr 14 00:10:01 user nova-compute[82479]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 00:10:01 user nova-compute[82479]:         <nova:vcpus>1</nova:vcpus>
Apr 14 00:10:01 user nova-compute[82479]:       </nova:flavor>
Apr 14 00:10:01 user nova-compute[82479]:       <nova:owner>
Apr 14 00:10:01 user nova-compute[82479]:         <nova:user uuid="f43f3171ccad4167ac783bbdfe2df478">tempest-ServerRescueNegativeTestJSON-1055458768-project-member</nova:user>
Apr 14 00:10:01 user nova-compute[82479]:         <nova:project uuid="524265958bd24a6cb94aa3115eb2b6c7">tempest-ServerRescueNegativeTestJSON-1055458768</nova:project>
Apr 14 00:10:01 user nova-compute[82479]:       </nova:owner>
Apr 14 00:10:01 user nova-compute[82479]:       <nova:root type="image" uuid="6db62068-7278-4cd8-b41f-d0140d89e199"/>
Apr 14 00:10:01 user nova-compute[82479]:       <nova:ports>
Apr 14 00:10:01 user nova-compute[82479]:         <nova:port uuid="10a32c68-570b-4ba1-ba36-6ecaf135c9bb">
Apr 14 00:10:01 user nova-compute[82479]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 14 00:10:01 user nova-compute[82479]:         </nova:port>
Apr 14 00:10:01 user nova-compute[82479]:       </nova:ports>
Apr 14 00:10:01 user nova-compute[82479]:     </nova:instance>
Apr 14 00:10:01 user nova-compute[82479]:   </metadata>
Apr 14 00:10:01 user nova-compute[82479]:   <sysinfo type="smbios">
Apr 14 00:10:01 user nova-compute[82479]:     <system>
Apr 14 00:10:01 user nova-compute[82479]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 00:10:01 user nova-compute[82479]:       <entry name="product">OpenStack Nova</entry>
Apr 14 00:10:01 user nova-compute[82479]:       <entry name="version">0.0.0</entry>
Apr 14 00:10:01 user nova-compute[82479]:       <entry name="serial">6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9</entry>
Apr 14 00:10:01 user nova-compute[82479]:       <entry name="uuid">6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9</entry>
Apr 14 00:10:01 user nova-compute[82479]:       <entry name="family">Virtual Machine</entry>
Apr 14 00:10:01 user nova-compute[82479]:     </system>
Apr 14 00:10:01 user nova-compute[82479]:   </sysinfo>
Apr 14 00:10:01 user nova-compute[82479]:   <os>
Apr 14 00:10:01 user nova-compute[82479]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 00:10:01 user nova-compute[82479]:     <boot dev="hd"/>
Apr 14 00:10:01 user nova-compute[82479]:     <smbios mode="sysinfo"/>
Apr 14 00:10:01 user nova-compute[82479]:   </os>
Apr 14 00:10:01 user nova-compute[82479]:   <features>
Apr 14 00:10:01 user nova-compute[82479]:     <acpi/>
Apr 14 00:10:01 user nova-compute[82479]:     <apic/>
Apr 14 00:10:01 user nova-compute[82479]:     <vmcoreinfo/>
Apr 14 00:10:01 user nova-compute[82479]:   </features>
Apr 14 00:10:01 user nova-compute[82479]:   <clock offset="utc">
Apr 14 00:10:01 user nova-compute[82479]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 00:10:01 user nova-compute[82479]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 00:10:01 user nova-compute[82479]:     <timer name="hpet" present="no"/>
Apr 14 00:10:01 user nova-compute[82479]:   </clock>
Apr 14 00:10:01 user nova-compute[82479]:   <cpu mode="custom" match="exact">
Apr 14 00:10:01 user nova-compute[82479]:     <model>Nehalem</model>
Apr 14 00:10:01 user nova-compute[82479]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 00:10:01 user nova-compute[82479]:   </cpu>
Apr 14 00:10:01 user nova-compute[82479]:   <devices>
Apr 14 00:10:01 user nova-compute[82479]:     <disk type="file" device="disk">
Apr 14 00:10:01 user nova-compute[82479]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 00:10:01 user nova-compute[82479]:       <source file="/opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk"/>
Apr 14 00:10:01 user nova-compute[82479]:       <target dev="vda" bus="virtio"/>
Apr 14 00:10:01 user nova-compute[82479]:     </disk>
Apr 14 00:10:01 user nova-compute[82479]:     <interface type="ethernet">
Apr 14 00:10:01 user nova-compute[82479]:       <mac address="fa:16:3e:a4:44:5a"/>
Apr 14 00:10:01 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:10:01 user nova-compute[82479]:       <mtu size="1442"/>
Apr 14 00:10:01 user nova-compute[82479]:       <target dev="tap10a32c68-57"/>
Apr 14 00:10:01 user nova-compute[82479]:     </interface>
Apr 14 00:10:01 user nova-compute[82479]:     <serial type="pty">
Apr 14 00:10:01 user nova-compute[82479]:       <log file="/opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/console.log" append="off"/>
Apr 14 00:10:01 user nova-compute[82479]:     </serial>
Apr 14 00:10:01 user nova-compute[82479]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 00:10:01 user nova-compute[82479]:     <video>
Apr 14 00:10:01 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:10:01 user nova-compute[82479]:     </video>
Apr 14 00:10:01 user nova-compute[82479]:     <rng model="virtio">
Apr 14 00:10:01 user nova-compute[82479]:       <backend model="random">/dev/urandom</backend>
Apr 14 00:10:01 user nova-compute[82479]:     </rng>
Apr 14 00:10:01 user nova-compute[82479]:     <controller type="usb" index="0" model="none"/>
Apr 14 00:10:01 user nova-compute[82479]:     <memballoon model="virtio">
Apr 14 00:10:01 user nova-compute[82479]:       <stats period="10"/>
Apr 14 00:10:01 user nova-compute[82479]:     </memballoon>
Apr 14 00:10:01 user nova-compute[82479]:   </devices>
Apr 14 00:10:01 user nova-compute[82479]: </domain>
Apr 14 00:10:01 user nova-compute[82479]:  {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:09:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1929968798',display_name='tempest-ServerRescueNegativeTestJSON-server-1929968798',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1929968798',id=17,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='524265958bd24a6cb94aa3115eb2b6c7',ramdisk_id='',reservation_id='r-r5gflibu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1055458768',owner_user_name='tempest-ServerRescueNegativeTestJSON-1055458768-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:09:59Z,user_data=None,user_id='f43f3171ccad4167ac783bbdfe2df478',uuid=6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10a32c68-570b-4ba1-ba36-6ecaf135c9bb", "address": "fa:16:3e:a4:44:5a", "network": {"id": "08106daa-a35e-4376-8c46-2b4baa51c6ea", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321730350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524265958bd24a6cb94aa3115eb2b6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10a32c68-57", "ovs_interfaceid": "10a32c68-570b-4ba1-ba36-6ecaf135c9bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Converting VIF {"id": "10a32c68-570b-4ba1-ba36-6ecaf135c9bb", "address": "fa:16:3e:a4:44:5a", "network": {"id": "08106daa-a35e-4376-8c46-2b4baa51c6ea", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321730350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524265958bd24a6cb94aa3115eb2b6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10a32c68-57", "ovs_interfaceid": "10a32c68-570b-4ba1-ba36-6ecaf135c9bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:44:5a,bridge_name='br-int',has_traffic_filtering=True,id=10a32c68-570b-4ba1-ba36-6ecaf135c9bb,network=Network(08106daa-a35e-4376-8c46-2b4baa51c6ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10a32c68-57') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG os_vif [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:44:5a,bridge_name='br-int',has_traffic_filtering=True,id=10a32c68-570b-4ba1-ba36-6ecaf135c9bb,network=Network(08106daa-a35e-4376-8c46-2b4baa51c6ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10a32c68-57') {{(pid=82479) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap10a32c68-57, may_exist=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap10a32c68-57, col_values=(('external_ids', {'iface-id': '10a32c68-570b-4ba1-ba36-6ecaf135c9bb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:44:5a', 'vm-uuid': '6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9'}),)) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:01 user nova-compute[82479]: INFO os_vif [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:44:5a,bridge_name='br-int',has_traffic_filtering=True,id=10a32c68-570b-4ba1-ba36-6ecaf135c9bb,network=Network(08106daa-a35e-4376-8c46-2b4baa51c6ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10a32c68-57')
Apr 14 00:10:01 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] No VIF found with MAC fa:16:3e:a4:44:5a, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG nova.network.neutron [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Updating instance_info_cache with network_info: [{"id": "caaa85dc-5a5f-4480-b6be-b2bc234cd455", "address": "fa:16:3e:73:2a:e3", "network": {"id": "08106daa-a35e-4376-8c46-2b4baa51c6ea", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321730350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524265958bd24a6cb94aa3115eb2b6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaaa85dc-5a", "ovs_interfaceid": "caaa85dc-5a5f-4480-b6be-b2bc234cd455", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Releasing lock "refresh_cache-d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG nova.compute.manager [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Instance network_info: |[{"id": "caaa85dc-5a5f-4480-b6be-b2bc234cd455", "address": "fa:16:3e:73:2a:e3", "network": {"id": "08106daa-a35e-4376-8c46-2b4baa51c6ea", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321730350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524265958bd24a6cb94aa3115eb2b6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaaa85dc-5a", "ovs_interfaceid": "caaa85dc-5a5f-4480-b6be-b2bc234cd455", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-24934eb9-7edd-40a2-a7ea-145d91ba2e3b req-ff2a01a6-d7c7-42b9-a7c0-e550e1044fdd service nova] Acquired lock "refresh_cache-d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG nova.network.neutron [req-24934eb9-7edd-40a2-a7ea-145d91ba2e3b req-ff2a01a6-d7c7-42b9-a7c0-e550e1044fdd service nova] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Refreshing network info cache for port caaa85dc-5a5f-4480-b6be-b2bc234cd455 {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Start _get_guest_xml network_info=[{"id": "caaa85dc-5a5f-4480-b6be-b2bc234cd455", "address": "fa:16:3e:73:2a:e3", "network": {"id": "08106daa-a35e-4376-8c46-2b4baa51c6ea", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321730350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524265958bd24a6cb94aa3115eb2b6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaaa85dc-5a", "ovs_interfaceid": "caaa85dc-5a5f-4480-b6be-b2bc234cd455", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 00:10:01 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:10:01 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:10:01 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82479) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T00:02:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Flavor limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Image limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Flavor pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Image pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Got 1 possible topologies {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:09:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-969325789',display_name='tempest-ServerRescueNegativeTestJSON-server-969325789',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-969325789',id=18,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='524265958bd24a6cb94aa3115eb2b6c7',ramdisk_id='',reservation_id='r-vvqygcuz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1055458768',owner_user_name='tempest-ServerRescueNegativeTestJSON-1055458768-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:10:00Z,user_data=None,user_id='f43f3171ccad4167ac783bbdfe2df478',uuid=d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "caaa85dc-5a5f-4480-b6be-b2bc234cd455", "address": "fa:16:3e:73:2a:e3", "network": {"id": "08106daa-a35e-4376-8c46-2b4baa51c6ea", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321730350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524265958bd24a6cb94aa3115eb2b6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaaa85dc-5a", "ovs_interfaceid": "caaa85dc-5a5f-4480-b6be-b2bc234cd455", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82479) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Converting VIF {"id": "caaa85dc-5a5f-4480-b6be-b2bc234cd455", "address": "fa:16:3e:73:2a:e3", "network": {"id": "08106daa-a35e-4376-8c46-2b4baa51c6ea", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321730350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524265958bd24a6cb94aa3115eb2b6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaaa85dc-5a", "ovs_interfaceid": "caaa85dc-5a5f-4480-b6be-b2bc234cd455", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:2a:e3,bridge_name='br-int',has_traffic_filtering=True,id=caaa85dc-5a5f-4480-b6be-b2bc234cd455,network=Network(08106daa-a35e-4376-8c46-2b4baa51c6ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcaaa85dc-5a') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG nova.objects.instance [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lazy-loading 'pci_devices' on Instance uuid d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] End _get_guest_xml xml=<domain type="kvm">
Apr 14 00:10:01 user nova-compute[82479]:   <uuid>d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c</uuid>
Apr 14 00:10:01 user nova-compute[82479]:   <name>instance-00000012</name>
Apr 14 00:10:01 user nova-compute[82479]:   <memory>131072</memory>
Apr 14 00:10:01 user nova-compute[82479]:   <vcpu>1</vcpu>
Apr 14 00:10:01 user nova-compute[82479]:   <metadata>
Apr 14 00:10:01 user nova-compute[82479]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 00:10:01 user nova-compute[82479]:       <nova:package version="0.0.0"/>
Apr 14 00:10:01 user nova-compute[82479]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-969325789</nova:name>
Apr 14 00:10:01 user nova-compute[82479]:       <nova:creationTime>2023-04-14 00:10:01</nova:creationTime>
Apr 14 00:10:01 user nova-compute[82479]:       <nova:flavor name="m1.nano">
Apr 14 00:10:01 user nova-compute[82479]:         <nova:memory>128</nova:memory>
Apr 14 00:10:01 user nova-compute[82479]:         <nova:disk>1</nova:disk>
Apr 14 00:10:01 user nova-compute[82479]:         <nova:swap>0</nova:swap>
Apr 14 00:10:01 user nova-compute[82479]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 00:10:01 user nova-compute[82479]:         <nova:vcpus>1</nova:vcpus>
Apr 14 00:10:01 user nova-compute[82479]:       </nova:flavor>
Apr 14 00:10:01 user nova-compute[82479]:       <nova:owner>
Apr 14 00:10:01 user nova-compute[82479]:         <nova:user uuid="f43f3171ccad4167ac783bbdfe2df478">tempest-ServerRescueNegativeTestJSON-1055458768-project-member</nova:user>
Apr 14 00:10:01 user nova-compute[82479]:         <nova:project uuid="524265958bd24a6cb94aa3115eb2b6c7">tempest-ServerRescueNegativeTestJSON-1055458768</nova:project>
Apr 14 00:10:01 user nova-compute[82479]:       </nova:owner>
Apr 14 00:10:01 user nova-compute[82479]:       <nova:root type="image" uuid="6db62068-7278-4cd8-b41f-d0140d89e199"/>
Apr 14 00:10:01 user nova-compute[82479]:       <nova:ports>
Apr 14 00:10:01 user nova-compute[82479]:         <nova:port uuid="caaa85dc-5a5f-4480-b6be-b2bc234cd455">
Apr 14 00:10:01 user nova-compute[82479]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 14 00:10:01 user nova-compute[82479]:         </nova:port>
Apr 14 00:10:01 user nova-compute[82479]:       </nova:ports>
Apr 14 00:10:01 user nova-compute[82479]:     </nova:instance>
Apr 14 00:10:01 user nova-compute[82479]:   </metadata>
Apr 14 00:10:01 user nova-compute[82479]:   <sysinfo type="smbios">
Apr 14 00:10:01 user nova-compute[82479]:     <system>
Apr 14 00:10:01 user nova-compute[82479]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 00:10:01 user nova-compute[82479]:       <entry name="product">OpenStack Nova</entry>
Apr 14 00:10:01 user nova-compute[82479]:       <entry name="version">0.0.0</entry>
Apr 14 00:10:01 user nova-compute[82479]:       <entry name="serial">d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c</entry>
Apr 14 00:10:01 user nova-compute[82479]:       <entry name="uuid">d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c</entry>
Apr 14 00:10:01 user nova-compute[82479]:       <entry name="family">Virtual Machine</entry>
Apr 14 00:10:01 user nova-compute[82479]:     </system>
Apr 14 00:10:01 user nova-compute[82479]:   </sysinfo>
Apr 14 00:10:01 user nova-compute[82479]:   <os>
Apr 14 00:10:01 user nova-compute[82479]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 00:10:01 user nova-compute[82479]:     <boot dev="hd"/>
Apr 14 00:10:01 user nova-compute[82479]:     <smbios mode="sysinfo"/>
Apr 14 00:10:01 user nova-compute[82479]:   </os>
Apr 14 00:10:01 user nova-compute[82479]:   <features>
Apr 14 00:10:01 user nova-compute[82479]:     <acpi/>
Apr 14 00:10:01 user nova-compute[82479]:     <apic/>
Apr 14 00:10:01 user nova-compute[82479]:     <vmcoreinfo/>
Apr 14 00:10:01 user nova-compute[82479]:   </features>
Apr 14 00:10:01 user nova-compute[82479]:   <clock offset="utc">
Apr 14 00:10:01 user nova-compute[82479]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 00:10:01 user nova-compute[82479]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 00:10:01 user nova-compute[82479]:     <timer name="hpet" present="no"/>
Apr 14 00:10:01 user nova-compute[82479]:   </clock>
Apr 14 00:10:01 user nova-compute[82479]:   <cpu mode="custom" match="exact">
Apr 14 00:10:01 user nova-compute[82479]:     <model>Nehalem</model>
Apr 14 00:10:01 user nova-compute[82479]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 00:10:01 user nova-compute[82479]:   </cpu>
Apr 14 00:10:01 user nova-compute[82479]:   <devices>
Apr 14 00:10:01 user nova-compute[82479]:     <disk type="file" device="disk">
Apr 14 00:10:01 user nova-compute[82479]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 00:10:01 user nova-compute[82479]:       <source file="/opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk"/>
Apr 14 00:10:01 user nova-compute[82479]:       <target dev="vda" bus="virtio"/>
Apr 14 00:10:01 user nova-compute[82479]:     </disk>
Apr 14 00:10:01 user nova-compute[82479]:     <interface type="ethernet">
Apr 14 00:10:01 user nova-compute[82479]:       <mac address="fa:16:3e:73:2a:e3"/>
Apr 14 00:10:01 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:10:01 user nova-compute[82479]:       <mtu size="1442"/>
Apr 14 00:10:01 user nova-compute[82479]:       <target dev="tapcaaa85dc-5a"/>
Apr 14 00:10:01 user nova-compute[82479]:     </interface>
Apr 14 00:10:01 user nova-compute[82479]:     <serial type="pty">
Apr 14 00:10:01 user nova-compute[82479]:       <log file="/opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/console.log" append="off"/>
Apr 14 00:10:01 user nova-compute[82479]:     </serial>
Apr 14 00:10:01 user nova-compute[82479]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 00:10:01 user nova-compute[82479]:     <video>
Apr 14 00:10:01 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:10:01 user nova-compute[82479]:     </video>
Apr 14 00:10:01 user nova-compute[82479]:     <rng model="virtio">
Apr 14 00:10:01 user nova-compute[82479]:       <backend model="random">/dev/urandom</backend>
Apr 14 00:10:01 user nova-compute[82479]:     </rng>
Apr 14 00:10:01 user nova-compute[82479]:     <controller type="usb" index="0" model="none"/>
Apr 14 00:10:01 user nova-compute[82479]:     <memballoon model="virtio">
Apr 14 00:10:01 user nova-compute[82479]:       <stats period="10"/>
Apr 14 00:10:01 user nova-compute[82479]:     </memballoon>
Apr 14 00:10:01 user nova-compute[82479]:   </devices>
Apr 14 00:10:01 user nova-compute[82479]: </domain>
Apr 14 00:10:01 user nova-compute[82479]:  {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:09:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-969325789',display_name='tempest-ServerRescueNegativeTestJSON-server-969325789',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-969325789',id=18,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='524265958bd24a6cb94aa3115eb2b6c7',ramdisk_id='',reservation_id='r-vvqygcuz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1055458768',owner_user_name='tempest-ServerRescueNegativeTestJSON-1055458768-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:10:00Z,user_data=None,user_id='f43f3171ccad4167ac783bbdfe2df478',uuid=d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "caaa85dc-5a5f-4480-b6be-b2bc234cd455", "address": "fa:16:3e:73:2a:e3", "network": {"id": "08106daa-a35e-4376-8c46-2b4baa51c6ea", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321730350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524265958bd24a6cb94aa3115eb2b6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaaa85dc-5a", "ovs_interfaceid": "caaa85dc-5a5f-4480-b6be-b2bc234cd455", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Converting VIF {"id": "caaa85dc-5a5f-4480-b6be-b2bc234cd455", "address": "fa:16:3e:73:2a:e3", "network": {"id": "08106daa-a35e-4376-8c46-2b4baa51c6ea", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321730350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524265958bd24a6cb94aa3115eb2b6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaaa85dc-5a", "ovs_interfaceid": "caaa85dc-5a5f-4480-b6be-b2bc234cd455", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:2a:e3,bridge_name='br-int',has_traffic_filtering=True,id=caaa85dc-5a5f-4480-b6be-b2bc234cd455,network=Network(08106daa-a35e-4376-8c46-2b4baa51c6ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcaaa85dc-5a') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG os_vif [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:2a:e3,bridge_name='br-int',has_traffic_filtering=True,id=caaa85dc-5a5f-4480-b6be-b2bc234cd455,network=Network(08106daa-a35e-4376-8c46-2b4baa51c6ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcaaa85dc-5a') {{(pid=82479) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcaaa85dc-5a, may_exist=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:10:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcaaa85dc-5a, col_values=(('external_ids', {'iface-id': 'caaa85dc-5a5f-4480-b6be-b2bc234cd455', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:2a:e3', 'vm-uuid': 'd1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c'}),)) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:10:02 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:02 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:10:02 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:02 user nova-compute[82479]: INFO os_vif [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:2a:e3,bridge_name='br-int',has_traffic_filtering=True,id=caaa85dc-5a5f-4480-b6be-b2bc234cd455,network=Network(08106daa-a35e-4376-8c46-2b4baa51c6ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcaaa85dc-5a')
Apr 14 00:10:02 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:10:02 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] No VIF found with MAC fa:16:3e:73:2a:e3, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:10:02 user nova-compute[82479]: DEBUG nova.network.neutron [req-2ec28c74-1ef3-485d-84ae-f242c27842d5 req-8441cc0a-3caa-4cf8-899a-dfe12e9e877b service nova] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Updated VIF entry in instance network info cache for port 10a32c68-570b-4ba1-ba36-6ecaf135c9bb. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:10:02 user nova-compute[82479]: DEBUG nova.network.neutron [req-2ec28c74-1ef3-485d-84ae-f242c27842d5 req-8441cc0a-3caa-4cf8-899a-dfe12e9e877b service nova] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Updating instance_info_cache with network_info: [{"id": "10a32c68-570b-4ba1-ba36-6ecaf135c9bb", "address": "fa:16:3e:a4:44:5a", "network": {"id": "08106daa-a35e-4376-8c46-2b4baa51c6ea", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321730350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524265958bd24a6cb94aa3115eb2b6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10a32c68-57", "ovs_interfaceid": "10a32c68-570b-4ba1-ba36-6ecaf135c9bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:10:02 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-2ec28c74-1ef3-485d-84ae-f242c27842d5 req-8441cc0a-3caa-4cf8-899a-dfe12e9e877b service nova] Releasing lock "refresh_cache-6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:10:02 user nova-compute[82479]: DEBUG nova.network.neutron [req-24934eb9-7edd-40a2-a7ea-145d91ba2e3b req-ff2a01a6-d7c7-42b9-a7c0-e550e1044fdd service nova] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Updated VIF entry in instance network info cache for port caaa85dc-5a5f-4480-b6be-b2bc234cd455. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:10:02 user nova-compute[82479]: DEBUG nova.network.neutron [req-24934eb9-7edd-40a2-a7ea-145d91ba2e3b req-ff2a01a6-d7c7-42b9-a7c0-e550e1044fdd service nova] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Updating instance_info_cache with network_info: [{"id": "caaa85dc-5a5f-4480-b6be-b2bc234cd455", "address": "fa:16:3e:73:2a:e3", "network": {"id": "08106daa-a35e-4376-8c46-2b4baa51c6ea", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321730350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524265958bd24a6cb94aa3115eb2b6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaaa85dc-5a", "ovs_interfaceid": "caaa85dc-5a5f-4480-b6be-b2bc234cd455", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:10:02 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-24934eb9-7edd-40a2-a7ea-145d91ba2e3b req-ff2a01a6-d7c7-42b9-a7c0-e550e1044fdd service nova] Releasing lock "refresh_cache-d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:10:03 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:04 user nova-compute[82479]: DEBUG nova.compute.manager [req-fc58f2dc-3de0-427c-aa34-a55cccba6361 req-08aad244-17cc-46bc-886e-386780cb1d63 service nova] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Received event network-vif-plugged-10a32c68-570b-4ba1-ba36-6ecaf135c9bb {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:10:04 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-fc58f2dc-3de0-427c-aa34-a55cccba6361 req-08aad244-17cc-46bc-886e-386780cb1d63 service nova] Acquiring lock "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:10:04 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-fc58f2dc-3de0-427c-aa34-a55cccba6361 req-08aad244-17cc-46bc-886e-386780cb1d63 service nova] Lock "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:10:04 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-fc58f2dc-3de0-427c-aa34-a55cccba6361 req-08aad244-17cc-46bc-886e-386780cb1d63 service nova] Lock "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:10:04 user nova-compute[82479]: DEBUG nova.compute.manager [req-fc58f2dc-3de0-427c-aa34-a55cccba6361 req-08aad244-17cc-46bc-886e-386780cb1d63 service nova] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] No waiting events found dispatching network-vif-plugged-10a32c68-570b-4ba1-ba36-6ecaf135c9bb {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:10:04 user nova-compute[82479]: WARNING nova.compute.manager [req-fc58f2dc-3de0-427c-aa34-a55cccba6361 req-08aad244-17cc-46bc-886e-386780cb1d63 service nova] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Received unexpected event network-vif-plugged-10a32c68-570b-4ba1-ba36-6ecaf135c9bb for instance with vm_state building and task_state spawning.
Apr 14 00:10:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:04 user nova-compute[82479]: DEBUG nova.compute.manager [req-70466338-7563-4adc-942c-2f430d6ef199 req-ff8cc763-40ef-4217-92c8-80d01b7a96da service nova] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Received event network-vif-plugged-caaa85dc-5a5f-4480-b6be-b2bc234cd455 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:10:04 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-70466338-7563-4adc-942c-2f430d6ef199 req-ff8cc763-40ef-4217-92c8-80d01b7a96da service nova] Acquiring lock "d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:10:04 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-70466338-7563-4adc-942c-2f430d6ef199 req-ff8cc763-40ef-4217-92c8-80d01b7a96da service nova] Lock "d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:10:04 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-70466338-7563-4adc-942c-2f430d6ef199 req-ff8cc763-40ef-4217-92c8-80d01b7a96da service nova] Lock "d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:10:04 user nova-compute[82479]: DEBUG nova.compute.manager [req-70466338-7563-4adc-942c-2f430d6ef199 req-ff8cc763-40ef-4217-92c8-80d01b7a96da service nova] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] No waiting events found dispatching network-vif-plugged-caaa85dc-5a5f-4480-b6be-b2bc234cd455 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:10:04 user nova-compute[82479]: WARNING nova.compute.manager [req-70466338-7563-4adc-942c-2f430d6ef199 req-ff8cc763-40ef-4217-92c8-80d01b7a96da service nova] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Received unexpected event network-vif-plugged-caaa85dc-5a5f-4480-b6be-b2bc234cd455 for instance with vm_state building and task_state spawning.
Apr 14 00:10:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:05 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:05 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:05 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:06 user nova-compute[82479]: DEBUG nova.compute.manager [req-0f39397d-b31a-4444-8c78-bbfb6a3ab595 req-940c125a-1e93-483e-988a-da1340a5fc7c service nova] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Received event network-vif-plugged-10a32c68-570b-4ba1-ba36-6ecaf135c9bb {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:10:06 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0f39397d-b31a-4444-8c78-bbfb6a3ab595 req-940c125a-1e93-483e-988a-da1340a5fc7c service nova] Acquiring lock "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:10:06 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0f39397d-b31a-4444-8c78-bbfb6a3ab595 req-940c125a-1e93-483e-988a-da1340a5fc7c service nova] Lock "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:10:06 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0f39397d-b31a-4444-8c78-bbfb6a3ab595 req-940c125a-1e93-483e-988a-da1340a5fc7c service nova] Lock "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:10:06 user nova-compute[82479]: DEBUG nova.compute.manager [req-0f39397d-b31a-4444-8c78-bbfb6a3ab595 req-940c125a-1e93-483e-988a-da1340a5fc7c service nova] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] No waiting events found dispatching network-vif-plugged-10a32c68-570b-4ba1-ba36-6ecaf135c9bb {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:10:06 user nova-compute[82479]: WARNING nova.compute.manager [req-0f39397d-b31a-4444-8c78-bbfb6a3ab595 req-940c125a-1e93-483e-988a-da1340a5fc7c service nova] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Received unexpected event network-vif-plugged-10a32c68-570b-4ba1-ba36-6ecaf135c9bb for instance with vm_state building and task_state spawning.
Apr 14 00:10:06 user nova-compute[82479]: DEBUG nova.compute.manager [req-5a761910-30de-4e70-a9df-831d20ba3fcc req-879f2e5c-ad51-4da9-a254-211d3d50db3b service nova] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Received event network-vif-plugged-caaa85dc-5a5f-4480-b6be-b2bc234cd455 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:10:06 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-5a761910-30de-4e70-a9df-831d20ba3fcc req-879f2e5c-ad51-4da9-a254-211d3d50db3b service nova] Acquiring lock "d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:10:06 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-5a761910-30de-4e70-a9df-831d20ba3fcc req-879f2e5c-ad51-4da9-a254-211d3d50db3b service nova] Lock "d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.007s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:10:06 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-5a761910-30de-4e70-a9df-831d20ba3fcc req-879f2e5c-ad51-4da9-a254-211d3d50db3b service nova] Lock "d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:10:06 user nova-compute[82479]: DEBUG nova.compute.manager [req-5a761910-30de-4e70-a9df-831d20ba3fcc req-879f2e5c-ad51-4da9-a254-211d3d50db3b service nova] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] No waiting events found dispatching network-vif-plugged-caaa85dc-5a5f-4480-b6be-b2bc234cd455 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:10:06 user nova-compute[82479]: WARNING nova.compute.manager [req-5a761910-30de-4e70-a9df-831d20ba3fcc req-879f2e5c-ad51-4da9-a254-211d3d50db3b service nova] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Received unexpected event network-vif-plugged-caaa85dc-5a5f-4480-b6be-b2bc234cd455 for instance with vm_state building and task_state spawning.
Apr 14 00:10:06 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681431006.923144, 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 => Resumed> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:10:06 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] VM Resumed (Lifecycle Event)
Apr 14 00:10:06 user nova-compute[82479]: DEBUG nova.compute.manager [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Instance event wait completed in 0 seconds for  {{(pid=82479) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 00:10:06 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Guest created on hypervisor {{(pid=82479) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 00:10:06 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Instance spawned successfully.
Apr 14 00:10:06 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 00:10:06 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:10:06 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Found default for hw_cdrom_bus of ide {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:10:06 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Found default for hw_disk_bus of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:10:06 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Found default for hw_input_bus of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:10:06 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Found default for hw_pointer_model of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:10:06 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Found default for hw_video_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:10:06 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Found default for hw_vif_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:10:06 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:10:07 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:07 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:10:07 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681431006.9247923, 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 => Started> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:10:07 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] VM Started (Lifecycle Event)
Apr 14 00:10:07 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:10:07 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:10:07 user nova-compute[82479]: INFO nova.compute.manager [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Took 7.82 seconds to spawn the instance on the hypervisor.
Apr 14 00:10:07 user nova-compute[82479]: DEBUG nova.compute.manager [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:10:07 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:10:07 user nova-compute[82479]: INFO nova.compute.manager [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Took 8.74 seconds to build instance.
Apr 14 00:10:07 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d8dd2624-527c-44df-91ad-6ac98316832b tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.842s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:10:07 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681431007.210469, d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c => Resumed> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:10:07 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] VM Resumed (Lifecycle Event)
Apr 14 00:10:07 user nova-compute[82479]: DEBUG nova.compute.manager [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Instance event wait completed in 0 seconds for  {{(pid=82479) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 00:10:07 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Guest created on hypervisor {{(pid=82479) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 00:10:07 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Instance spawned successfully.
Apr 14 00:10:07 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 00:10:07 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:10:07 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:10:07 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Found default for hw_cdrom_bus of ide {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:10:07 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Found default for hw_disk_bus of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:10:07 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Found default for hw_input_bus of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:10:07 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Found default for hw_pointer_model of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:10:07 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Found default for hw_video_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:10:07 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Found default for hw_vif_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:10:07 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:10:07 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681431007.2114396, d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c => Started> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:10:07 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] VM Started (Lifecycle Event)
Apr 14 00:10:07 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:10:07 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:10:07 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:10:07 user nova-compute[82479]: INFO nova.compute.manager [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Took 7.32 seconds to spawn the instance on the hypervisor.
Apr 14 00:10:07 user nova-compute[82479]: DEBUG nova.compute.manager [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:10:07 user nova-compute[82479]: INFO nova.compute.manager [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Took 8.43 seconds to build instance.
Apr 14 00:10:07 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ffa8854c-ca6a-4d89-a3e4-5a589284ee02 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.642s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:10:10 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:12 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:12 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Acquiring lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:10:12 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:10:12 user nova-compute[82479]: DEBUG nova.compute.manager [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Starting instance... {{(pid=82479) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 00:10:13 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:10:13 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:10:13 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82479) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 00:10:13 user nova-compute[82479]: INFO nova.compute.claims [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Claim successful on node user
Apr 14 00:10:13 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:10:13 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:10:13 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.486s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:10:13 user nova-compute[82479]: DEBUG nova.compute.manager [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Start building networks asynchronously for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 00:10:13 user nova-compute[82479]: DEBUG nova.compute.manager [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Allocating IP information in the background. {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 00:10:13 user nova-compute[82479]: DEBUG nova.network.neutron [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] allocate_for_instance() {{(pid=82479) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 00:10:13 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 00:10:13 user nova-compute[82479]: DEBUG nova.compute.manager [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Start building block device mappings for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 00:10:13 user nova-compute[82479]: INFO nova.virt.block_device [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Booting with volume 70173bca-df37-41ee-adcb-1e0464d96d62 at /dev/vda
Apr 14 00:10:13 user nova-compute[82479]: DEBUG os_brick.utils [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:10:13 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:13 user nova-compute[82479]: DEBUG nova.policy [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '85f2e1744d6c460a81c97f39a76ef5c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be44ce9922f14c6fa75dc0f99b544851', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82479) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 00:10:13 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:13 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc4897b-02ea-49d4-a688-175faa0371b1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fec92fcfdd3\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:13 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:13 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.026s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:13 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e121aa-25af-431d-b336-eab3d92f0676]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:13 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:13 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:13 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[c17ab24a-e388-473c-ab61-aec16bddea6b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:13 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee528e08-acf2-403f-80ad-937a153a30ea]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:13 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Running cmd (subprocess): nvme version {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:13 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] 'nvme version' failed. Not Retrying. {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:10:13 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.nvmeof [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] nvme not present on system {{(pid=82479) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 00:10:13 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:13 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:10:13 user nova-compute[82479]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 00:10:13 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db63e8d-b199-4db2-a1b0-0ce1e3280bc8]: (4, '') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:13 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82479) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 00:10:13 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 00:10:13 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] LIGHTOS: no hostnqn found. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 00:10:13 user nova-compute[82479]: DEBUG os_brick.utils [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fec92fcfdd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:10:13 user nova-compute[82479]: DEBUG nova.virt.block_device [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Updating existing volume attachment record: c3f8ef01-a91c-46c3-b28f-664c6a038a53 {{(pid=82479) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 00:10:14 user nova-compute[82479]: DEBUG nova.network.neutron [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Successfully created port: 1c533ad9-47bf-4eb9-b931-d855ad4ce53e {{(pid=82479) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 00:10:15 user nova-compute[82479]: DEBUG nova.network.neutron [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Successfully created port: 9dedd1d2-74e4-4aae-8114-9ecd78686a4d {{(pid=82479) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 00:10:15 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:15 user nova-compute[82479]: DEBUG nova.network.neutron [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Successfully created port: d3174ebb-df19-4943-98c4-89c97607f42b {{(pid=82479) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 00:10:16 user nova-compute[82479]: DEBUG nova.network.neutron [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Successfully created port: dff47f62-64b6-4ee5-b163-c74fc50ce6c9 {{(pid=82479) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 00:10:17 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:17 user nova-compute[82479]: DEBUG nova.network.neutron [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Successfully created port: 3839e2a9-bfeb-4103-9d7c-bcf45f9eaf14 {{(pid=82479) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 00:10:18 user nova-compute[82479]: DEBUG nova.network.neutron [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Successfully updated port: 1c533ad9-47bf-4eb9-b931-d855ad4ce53e {{(pid=82479) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 00:10:18 user nova-compute[82479]: DEBUG nova.compute.manager [req-2368ca98-7068-4b6d-9f2b-7f2f67c24c58 req-1df224b5-88a1-4545-92ab-4518e8f8af93 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Received event network-changed-1c533ad9-47bf-4eb9-b931-d855ad4ce53e {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:10:18 user nova-compute[82479]: DEBUG nova.compute.manager [req-2368ca98-7068-4b6d-9f2b-7f2f67c24c58 req-1df224b5-88a1-4545-92ab-4518e8f8af93 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Refreshing instance network info cache due to event network-changed-1c533ad9-47bf-4eb9-b931-d855ad4ce53e. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:10:18 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-2368ca98-7068-4b6d-9f2b-7f2f67c24c58 req-1df224b5-88a1-4545-92ab-4518e8f8af93 service nova] Acquiring lock "refresh_cache-6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:10:18 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-2368ca98-7068-4b6d-9f2b-7f2f67c24c58 req-1df224b5-88a1-4545-92ab-4518e8f8af93 service nova] Acquired lock "refresh_cache-6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:10:18 user nova-compute[82479]: DEBUG nova.network.neutron [req-2368ca98-7068-4b6d-9f2b-7f2f67c24c58 req-1df224b5-88a1-4545-92ab-4518e8f8af93 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Refreshing network info cache for port 1c533ad9-47bf-4eb9-b931-d855ad4ce53e {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:10:18 user nova-compute[82479]: DEBUG nova.network.neutron [req-2368ca98-7068-4b6d-9f2b-7f2f67c24c58 req-1df224b5-88a1-4545-92ab-4518e8f8af93 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Instance cache missing network info. {{(pid=82479) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 00:10:19 user nova-compute[82479]: DEBUG nova.network.neutron [req-2368ca98-7068-4b6d-9f2b-7f2f67c24c58 req-1df224b5-88a1-4545-92ab-4518e8f8af93 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Updating instance_info_cache with network_info: [] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:10:19 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-2368ca98-7068-4b6d-9f2b-7f2f67c24c58 req-1df224b5-88a1-4545-92ab-4518e8f8af93 service nova] Releasing lock "refresh_cache-6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:10:19 user nova-compute[82479]: DEBUG nova.network.neutron [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Successfully updated port: e9ec2eab-0d7a-4be3-acab-a27bce761738 {{(pid=82479) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 00:10:19 user nova-compute[82479]: INFO nova.virt.block_device [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Booting with volume 94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 at /dev/vdb
Apr 14 00:10:20 user nova-compute[82479]: DEBUG os_brick.utils [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:10:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:20 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28108de-04c4-4d0d-a6ee-85b63d6bedbd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fec92fcfdd3\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.028s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:20 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa934cd4-dcb3-4f72-80a1-eec8a21ffcfa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:20 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf59d52-8335-4c1f-9e14-241f10347beb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:20 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[991ba359-316b-49c9-ac31-a4939aa4c8f5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Running cmd (subprocess): nvme version {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] 'nvme version' failed. Not Retrying. {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:10:20 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.nvmeof [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] nvme not present on system {{(pid=82479) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 00:10:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:10:20 user nova-compute[82479]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 00:10:20 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c31f393-6fde-4133-b903-60b3d5547625]: (4, '') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:20 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82479) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 00:10:20 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 00:10:20 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] LIGHTOS: no hostnqn found. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 00:10:20 user nova-compute[82479]: DEBUG os_brick.utils [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] <== get_connector_properties: return (165ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fec92fcfdd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:10:20 user nova-compute[82479]: DEBUG nova.virt.block_device [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Updating existing volume attachment record: db90ce2b-b052-4826-bd61-45ecc34ca9f8 {{(pid=82479) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 00:10:20 user nova-compute[82479]: DEBUG nova.network.neutron [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Successfully updated port: 127b1d7d-d92a-4e24-9470-1758579376bf {{(pid=82479) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 00:10:20 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:20 user nova-compute[82479]: DEBUG nova.compute.manager [req-0a16b0ee-6313-4d98-80e4-9ec056c648dc req-7238b377-ca08-41d5-96ee-e0444b4d9e2a service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Received event network-changed-e9ec2eab-0d7a-4be3-acab-a27bce761738 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:10:20 user nova-compute[82479]: DEBUG nova.compute.manager [req-0a16b0ee-6313-4d98-80e4-9ec056c648dc req-7238b377-ca08-41d5-96ee-e0444b4d9e2a service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Refreshing instance network info cache due to event network-changed-e9ec2eab-0d7a-4be3-acab-a27bce761738. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:10:20 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0a16b0ee-6313-4d98-80e4-9ec056c648dc req-7238b377-ca08-41d5-96ee-e0444b4d9e2a service nova] Acquiring lock "refresh_cache-6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:10:20 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0a16b0ee-6313-4d98-80e4-9ec056c648dc req-7238b377-ca08-41d5-96ee-e0444b4d9e2a service nova] Acquired lock "refresh_cache-6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:10:20 user nova-compute[82479]: DEBUG nova.network.neutron [req-0a16b0ee-6313-4d98-80e4-9ec056c648dc req-7238b377-ca08-41d5-96ee-e0444b4d9e2a service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Refreshing network info cache for port e9ec2eab-0d7a-4be3-acab-a27bce761738 {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:10:21 user nova-compute[82479]: DEBUG nova.network.neutron [req-0a16b0ee-6313-4d98-80e4-9ec056c648dc req-7238b377-ca08-41d5-96ee-e0444b4d9e2a service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Instance cache missing network info. {{(pid=82479) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 00:10:21 user nova-compute[82479]: DEBUG nova.network.neutron [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Successfully updated port: 9dedd1d2-74e4-4aae-8114-9ecd78686a4d {{(pid=82479) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 00:10:21 user nova-compute[82479]: DEBUG nova.network.neutron [req-0a16b0ee-6313-4d98-80e4-9ec056c648dc req-7238b377-ca08-41d5-96ee-e0444b4d9e2a service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Updating instance_info_cache with network_info: [] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:10:21 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0a16b0ee-6313-4d98-80e4-9ec056c648dc req-7238b377-ca08-41d5-96ee-e0444b4d9e2a service nova] Releasing lock "refresh_cache-6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:10:21 user nova-compute[82479]: DEBUG nova.compute.manager [req-0a16b0ee-6313-4d98-80e4-9ec056c648dc req-7238b377-ca08-41d5-96ee-e0444b4d9e2a service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Received event network-changed-127b1d7d-d92a-4e24-9470-1758579376bf {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:10:21 user nova-compute[82479]: DEBUG nova.compute.manager [req-0a16b0ee-6313-4d98-80e4-9ec056c648dc req-7238b377-ca08-41d5-96ee-e0444b4d9e2a service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Refreshing instance network info cache due to event network-changed-127b1d7d-d92a-4e24-9470-1758579376bf. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:10:21 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0a16b0ee-6313-4d98-80e4-9ec056c648dc req-7238b377-ca08-41d5-96ee-e0444b4d9e2a service nova] Acquiring lock "refresh_cache-6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:10:21 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0a16b0ee-6313-4d98-80e4-9ec056c648dc req-7238b377-ca08-41d5-96ee-e0444b4d9e2a service nova] Acquired lock "refresh_cache-6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:10:21 user nova-compute[82479]: DEBUG nova.network.neutron [req-0a16b0ee-6313-4d98-80e4-9ec056c648dc req-7238b377-ca08-41d5-96ee-e0444b4d9e2a service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Refreshing network info cache for port 127b1d7d-d92a-4e24-9470-1758579376bf {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:10:21 user nova-compute[82479]: DEBUG nova.network.neutron [req-0a16b0ee-6313-4d98-80e4-9ec056c648dc req-7238b377-ca08-41d5-96ee-e0444b4d9e2a service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Instance cache missing network info. {{(pid=82479) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 00:10:21 user nova-compute[82479]: DEBUG nova.network.neutron [req-0a16b0ee-6313-4d98-80e4-9ec056c648dc req-7238b377-ca08-41d5-96ee-e0444b4d9e2a service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Updating instance_info_cache with network_info: [] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:10:21 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0a16b0ee-6313-4d98-80e4-9ec056c648dc req-7238b377-ca08-41d5-96ee-e0444b4d9e2a service nova] Releasing lock "refresh_cache-6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:10:22 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:22 user nova-compute[82479]: DEBUG nova.network.neutron [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Successfully updated port: d3174ebb-df19-4943-98c4-89c97607f42b {{(pid=82479) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 00:10:22 user nova-compute[82479]: DEBUG nova.compute.manager [req-ad3c16e5-8c1d-468a-bfea-d68576b631d9 req-91b95af8-7c99-4b16-b3ff-71a7ade0aff9 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Received event network-changed-9dedd1d2-74e4-4aae-8114-9ecd78686a4d {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:10:22 user nova-compute[82479]: DEBUG nova.compute.manager [req-ad3c16e5-8c1d-468a-bfea-d68576b631d9 req-91b95af8-7c99-4b16-b3ff-71a7ade0aff9 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Refreshing instance network info cache due to event network-changed-9dedd1d2-74e4-4aae-8114-9ecd78686a4d. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:10:22 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-ad3c16e5-8c1d-468a-bfea-d68576b631d9 req-91b95af8-7c99-4b16-b3ff-71a7ade0aff9 service nova] Acquiring lock "refresh_cache-6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:10:22 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-ad3c16e5-8c1d-468a-bfea-d68576b631d9 req-91b95af8-7c99-4b16-b3ff-71a7ade0aff9 service nova] Acquired lock "refresh_cache-6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:10:22 user nova-compute[82479]: DEBUG nova.network.neutron [req-ad3c16e5-8c1d-468a-bfea-d68576b631d9 req-91b95af8-7c99-4b16-b3ff-71a7ade0aff9 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Refreshing network info cache for port 9dedd1d2-74e4-4aae-8114-9ecd78686a4d {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:10:23 user nova-compute[82479]: DEBUG nova.network.neutron [req-ad3c16e5-8c1d-468a-bfea-d68576b631d9 req-91b95af8-7c99-4b16-b3ff-71a7ade0aff9 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Instance cache missing network info. {{(pid=82479) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 00:10:23 user nova-compute[82479]: DEBUG nova.network.neutron [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Successfully updated port: dff47f62-64b6-4ee5-b163-c74fc50ce6c9 {{(pid=82479) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 00:10:23 user nova-compute[82479]: DEBUG nova.network.neutron [req-ad3c16e5-8c1d-468a-bfea-d68576b631d9 req-91b95af8-7c99-4b16-b3ff-71a7ade0aff9 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Updating instance_info_cache with network_info: [] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:10:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-ad3c16e5-8c1d-468a-bfea-d68576b631d9 req-91b95af8-7c99-4b16-b3ff-71a7ade0aff9 service nova] Releasing lock "refresh_cache-6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:10:23 user nova-compute[82479]: DEBUG nova.compute.manager [req-ad3c16e5-8c1d-468a-bfea-d68576b631d9 req-91b95af8-7c99-4b16-b3ff-71a7ade0aff9 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Received event network-changed-d3174ebb-df19-4943-98c4-89c97607f42b {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:10:23 user nova-compute[82479]: DEBUG nova.compute.manager [req-ad3c16e5-8c1d-468a-bfea-d68576b631d9 req-91b95af8-7c99-4b16-b3ff-71a7ade0aff9 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Refreshing instance network info cache due to event network-changed-d3174ebb-df19-4943-98c4-89c97607f42b. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:10:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-ad3c16e5-8c1d-468a-bfea-d68576b631d9 req-91b95af8-7c99-4b16-b3ff-71a7ade0aff9 service nova] Acquiring lock "refresh_cache-6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:10:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-ad3c16e5-8c1d-468a-bfea-d68576b631d9 req-91b95af8-7c99-4b16-b3ff-71a7ade0aff9 service nova] Acquired lock "refresh_cache-6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:10:23 user nova-compute[82479]: DEBUG nova.network.neutron [req-ad3c16e5-8c1d-468a-bfea-d68576b631d9 req-91b95af8-7c99-4b16-b3ff-71a7ade0aff9 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Refreshing network info cache for port d3174ebb-df19-4943-98c4-89c97607f42b {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:10:23 user nova-compute[82479]: DEBUG nova.network.neutron [req-ad3c16e5-8c1d-468a-bfea-d68576b631d9 req-91b95af8-7c99-4b16-b3ff-71a7ade0aff9 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Instance cache missing network info. {{(pid=82479) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 00:10:23 user nova-compute[82479]: DEBUG nova.network.neutron [req-ad3c16e5-8c1d-468a-bfea-d68576b631d9 req-91b95af8-7c99-4b16-b3ff-71a7ade0aff9 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Updating instance_info_cache with network_info: [] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:10:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-ad3c16e5-8c1d-468a-bfea-d68576b631d9 req-91b95af8-7c99-4b16-b3ff-71a7ade0aff9 service nova] Releasing lock "refresh_cache-6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:10:23 user nova-compute[82479]: DEBUG nova.network.neutron [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Successfully updated port: 3839e2a9-bfeb-4103-9d7c-bcf45f9eaf14 {{(pid=82479) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 00:10:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Acquiring lock "refresh_cache-6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:10:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Acquired lock "refresh_cache-6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:10:23 user nova-compute[82479]: DEBUG nova.network.neutron [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 00:10:24 user nova-compute[82479]: DEBUG nova.network.neutron [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Instance cache missing network info. {{(pid=82479) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 00:10:25 user nova-compute[82479]: INFO nova.virt.block_device [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Booting with volume 215fee6a-a733-4408-a162-1e700d5bf7fc at /dev/vdc
Apr 14 00:10:25 user nova-compute[82479]: DEBUG os_brick.utils [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:10:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:25 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e7854f-5e6c-4d94-a3cb-18988c363fd8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fec92fcfdd3\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:25 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb733ea1-ff08-4982-8177-f979435edf24]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:25 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[538adb9c-016d-4b36-800b-7e4496c0090c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:25 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[83124ba6-4d56-4a5f-91f8-cc6e4599b1d7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Running cmd (subprocess): nvme version {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] 'nvme version' failed. Not Retrying. {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:10:25 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.nvmeof [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] nvme not present on system {{(pid=82479) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 00:10:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:10:25 user nova-compute[82479]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 00:10:25 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55b4ee4-c64b-44aa-a8b6-cb6b98095b30]: (4, '') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:25 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82479) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 00:10:25 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 00:10:25 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] LIGHTOS: no hostnqn found. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 00:10:25 user nova-compute[82479]: DEBUG os_brick.utils [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fec92fcfdd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:10:25 user nova-compute[82479]: DEBUG nova.virt.block_device [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Updating existing volume attachment record: b4b24ae2-8900-4476-bc99-6ab4831f3406 {{(pid=82479) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 00:10:25 user nova-compute[82479]: DEBUG nova.compute.manager [req-5034f013-1b4b-46e0-a992-1aa8a99c8ef4 req-2567909f-27ae-4bab-abb4-dac625aff8c9 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Received event network-changed-dff47f62-64b6-4ee5-b163-c74fc50ce6c9 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:10:25 user nova-compute[82479]: DEBUG nova.compute.manager [req-5034f013-1b4b-46e0-a992-1aa8a99c8ef4 req-2567909f-27ae-4bab-abb4-dac625aff8c9 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Refreshing instance network info cache due to event network-changed-dff47f62-64b6-4ee5-b163-c74fc50ce6c9. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:10:25 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-5034f013-1b4b-46e0-a992-1aa8a99c8ef4 req-2567909f-27ae-4bab-abb4-dac625aff8c9 service nova] Acquiring lock "refresh_cache-6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:10:25 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:26 user nova-compute[82479]: DEBUG nova.network.neutron [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Updating instance_info_cache with network_info: [{"id": "1c533ad9-47bf-4eb9-b931-d855ad4ce53e", "address": "fa:16:3e:bf:3e:c1", "network": {"id": "4368ab10-ccfd-46d6-a0eb-296895d3ba19", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1929715000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c533ad9-47", "ovs_interfaceid": "1c533ad9-47bf-4eb9-b931-d855ad4ce53e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e9ec2eab-0d7a-4be3-acab-a27bce761738", "address": "fa:16:3e:93:27:43", "network": {"id": "0b416634-9a5d-4d0a-a891-fca1700a2d6b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1990875628", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9ec2eab-0d", "ovs_interfaceid": "e9ec2eab-0d7a-4be3-acab-a27bce761738", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "127b1d7d-d92a-4e24-9470-1758579376bf", "address": "fa:16:3e:bf:72:3f", "network": {"id": "0b416634-9a5d-4d0a-a891-fca1700a2d6b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1990875628", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127b1d7d-d9", "ovs_interfaceid": "127b1d7d-d92a-4e24-9470-1758579376bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9dedd1d2-74e4-4aae-8114-9ecd78686a4d", "address": "fa:16:3e:3a:bb:81", "network": {"id": "0b416634-9a5d-4d0a-a891-fca1700a2d6b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1990875628", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dedd1d2-74", "ovs_interfaceid": "9dedd1d2-74e4-4aae-8114-9ecd78686a4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d3174ebb-df19-4943-98c4-89c97607f42b", "address": "fa:16:3e:ad:34:97", "network": {"id": "0b416634-9a5d-4d0a-a891-fca1700a2d6b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1990875628", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3174ebb-df", "ovs_interfaceid": "d3174ebb-df19-4943-98c4-89c97607f42b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dff47f62-64b6-4ee5-b163-c74fc50ce6c9", "address": "fa:16:3e:fe:ff:79", "network": {"id": "700ca002-00ac-4a55-b2a5-f31c7ca9bcfa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1927044898", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff47f62-64", "ovs_interfaceid": "dff47f62-64b6-4ee5-b163-c74fc50ce6c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3839e2a9-bfeb-4103-9d7c-bcf45f9eaf14", "address": "fa:16:3e:c1:ce:a4", "network": {"id": "700ca002-00ac-4a55-b2a5-f31c7ca9bcfa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1927044898", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3839e2a9-bf", "ovs_interfaceid": "3839e2a9-bfeb-4103-9d7c-bcf45f9eaf14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:10:26 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Releasing lock "refresh_cache-6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:10:26 user nova-compute[82479]: DEBUG nova.compute.manager [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Instance network_info: |[{"id": "1c533ad9-47bf-4eb9-b931-d855ad4ce53e", "address": "fa:16:3e:bf:3e:c1", "network": {"id": "4368ab10-ccfd-46d6-a0eb-296895d3ba19", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1929715000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c533ad9-47", "ovs_interfaceid": "1c533ad9-47bf-4eb9-b931-d855ad4ce53e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e9ec2eab-0d7a-4be3-acab-a27bce761738", "address": "fa:16:3e:93:27:43", "network": {"id": "0b416634-9a5d-4d0a-a891-fca1700a2d6b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1990875628", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9ec2eab-0d", "ovs_interfaceid": "e9ec2eab-0d7a-4be3-acab-a27bce761738", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "127b1d7d-d92a-4e24-9470-1758579376bf", "address": "fa:16:3e:bf:72:3f", "network": {"id": "0b416634-9a5d-4d0a-a891-fca1700a2d6b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1990875628", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127b1d7d-d9", "ovs_interfaceid": "127b1d7d-d92a-4e24-9470-1758579376bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9dedd1d2-74e4-4aae-8114-9ecd78686a4d", "address": "fa:16:3e:3a:bb:81", "network": {"id": "0b416634-9a5d-4d0a-a891-fca1700a2d6b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1990875628", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dedd1d2-74", "ovs_interfaceid": "9dedd1d2-74e4-4aae-8114-9ecd78686a4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d3174ebb-df19-4943-98c4-89c97607f42b", "address": "fa:16:3e:ad:34:97", "network": {"id": "0b416634-9a5d-4d0a-a891-fca1700a2d6b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1990875628", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3174ebb-df", "ovs_interfaceid": "d3174ebb-df19-4943-98c4-89c97607f42b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dff47f62-64b6-4ee5-b163-c74fc50ce6c9", "address": "fa:16:3e:fe:ff:79", "network": {"id": "700ca002-00ac-4a55-b2a5-f31c7ca9bcfa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1927044898", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff47f62-64", "ovs_interfaceid": "dff47f62-64b6-4ee5-b163-c74fc50ce6c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3839e2a9-bfeb-4103-9d7c-bcf45f9eaf14", "address": "fa:16:3e:c1:ce:a4", "network": {"id": "700ca002-00ac-4a55-b2a5-f31c7ca9bcfa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1927044898", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3839e2a9-bf", "ovs_interfaceid": "3839e2a9-bfeb-4103-9d7c-bcf45f9eaf14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 00:10:26 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-5034f013-1b4b-46e0-a992-1aa8a99c8ef4 req-2567909f-27ae-4bab-abb4-dac625aff8c9 service nova] Acquired lock "refresh_cache-6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:10:26 user nova-compute[82479]: DEBUG nova.network.neutron [req-5034f013-1b4b-46e0-a992-1aa8a99c8ef4 req-2567909f-27ae-4bab-abb4-dac625aff8c9 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Refreshing network info cache for port dff47f62-64b6-4ee5-b163-c74fc50ce6c9 {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:10:26 user nova-compute[82479]: DEBUG nova.network.neutron [req-5034f013-1b4b-46e0-a992-1aa8a99c8ef4 req-2567909f-27ae-4bab-abb4-dac625aff8c9 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Updated VIF entry in instance network info cache for port dff47f62-64b6-4ee5-b163-c74fc50ce6c9. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:10:26 user nova-compute[82479]: DEBUG nova.network.neutron [req-5034f013-1b4b-46e0-a992-1aa8a99c8ef4 req-2567909f-27ae-4bab-abb4-dac625aff8c9 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Updating instance_info_cache with network_info: [{"id": "1c533ad9-47bf-4eb9-b931-d855ad4ce53e", "address": "fa:16:3e:bf:3e:c1", "network": {"id": "4368ab10-ccfd-46d6-a0eb-296895d3ba19", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1929715000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c533ad9-47", "ovs_interfaceid": "1c533ad9-47bf-4eb9-b931-d855ad4ce53e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e9ec2eab-0d7a-4be3-acab-a27bce761738", "address": "fa:16:3e:93:27:43", "network": {"id": "0b416634-9a5d-4d0a-a891-fca1700a2d6b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1990875628", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9ec2eab-0d", "ovs_interfaceid": "e9ec2eab-0d7a-4be3-acab-a27bce761738", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "127b1d7d-d92a-4e24-9470-1758579376bf", "address": "fa:16:3e:bf:72:3f", "network": {"id": "0b416634-9a5d-4d0a-a891-fca1700a2d6b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1990875628", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127b1d7d-d9", "ovs_interfaceid": "127b1d7d-d92a-4e24-9470-1758579376bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9dedd1d2-74e4-4aae-8114-9ecd78686a4d", "address": "fa:16:3e:3a:bb:81", "network": {"id": "0b416634-9a5d-4d0a-a891-fca1700a2d6b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1990875628", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dedd1d2-74", "ovs_interfaceid": "9dedd1d2-74e4-4aae-8114-9ecd78686a4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d3174ebb-df19-4943-98c4-89c97607f42b", "address": "fa:16:3e:ad:34:97", "network": {"id": "0b416634-9a5d-4d0a-a891-fca1700a2d6b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1990875628", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3174ebb-df", "ovs_interfaceid": "d3174ebb-df19-4943-98c4-89c97607f42b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dff47f62-64b6-4ee5-b163-c74fc50ce6c9", "address": "fa:16:3e:fe:ff:79", "network": {"id": "700ca002-00ac-4a55-b2a5-f31c7ca9bcfa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1927044898", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff47f62-64", "ovs_interfaceid": "dff47f62-64b6-4ee5-b163-c74fc50ce6c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3839e2a9-bfeb-4103-9d7c-bcf45f9eaf14", "address": "fa:16:3e:c1:ce:a4", "network": {"id": "700ca002-00ac-4a55-b2a5-f31c7ca9bcfa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1927044898", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3839e2a9-bf", "ovs_interfaceid": "3839e2a9-bfeb-4103-9d7c-bcf45f9eaf14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:10:26 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-5034f013-1b4b-46e0-a992-1aa8a99c8ef4 req-2567909f-27ae-4bab-abb4-dac625aff8c9 service nova] Releasing lock "refresh_cache-6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:10:26 user nova-compute[82479]: DEBUG nova.compute.manager [req-5034f013-1b4b-46e0-a992-1aa8a99c8ef4 req-2567909f-27ae-4bab-abb4-dac625aff8c9 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Received event network-changed-3839e2a9-bfeb-4103-9d7c-bcf45f9eaf14 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:10:26 user nova-compute[82479]: DEBUG nova.compute.manager [req-5034f013-1b4b-46e0-a992-1aa8a99c8ef4 req-2567909f-27ae-4bab-abb4-dac625aff8c9 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Refreshing instance network info cache due to event network-changed-3839e2a9-bfeb-4103-9d7c-bcf45f9eaf14. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:10:26 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-5034f013-1b4b-46e0-a992-1aa8a99c8ef4 req-2567909f-27ae-4bab-abb4-dac625aff8c9 service nova] Acquiring lock "refresh_cache-6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:10:26 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-5034f013-1b4b-46e0-a992-1aa8a99c8ef4 req-2567909f-27ae-4bab-abb4-dac625aff8c9 service nova] Acquired lock "refresh_cache-6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:10:26 user nova-compute[82479]: DEBUG nova.network.neutron [req-5034f013-1b4b-46e0-a992-1aa8a99c8ef4 req-2567909f-27ae-4bab-abb4-dac625aff8c9 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Refreshing network info cache for port 3839e2a9-bfeb-4103-9d7c-bcf45f9eaf14 {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:10:27 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:27 user nova-compute[82479]: DEBUG nova.network.neutron [req-5034f013-1b4b-46e0-a992-1aa8a99c8ef4 req-2567909f-27ae-4bab-abb4-dac625aff8c9 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Updated VIF entry in instance network info cache for port 3839e2a9-bfeb-4103-9d7c-bcf45f9eaf14. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:10:27 user nova-compute[82479]: DEBUG nova.network.neutron [req-5034f013-1b4b-46e0-a992-1aa8a99c8ef4 req-2567909f-27ae-4bab-abb4-dac625aff8c9 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Updating instance_info_cache with network_info: [{"id": "1c533ad9-47bf-4eb9-b931-d855ad4ce53e", "address": "fa:16:3e:bf:3e:c1", "network": {"id": "4368ab10-ccfd-46d6-a0eb-296895d3ba19", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1929715000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c533ad9-47", "ovs_interfaceid": "1c533ad9-47bf-4eb9-b931-d855ad4ce53e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e9ec2eab-0d7a-4be3-acab-a27bce761738", "address": "fa:16:3e:93:27:43", "network": {"id": "0b416634-9a5d-4d0a-a891-fca1700a2d6b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1990875628", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9ec2eab-0d", "ovs_interfaceid": "e9ec2eab-0d7a-4be3-acab-a27bce761738", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "127b1d7d-d92a-4e24-9470-1758579376bf", "address": "fa:16:3e:bf:72:3f", "network": {"id": "0b416634-9a5d-4d0a-a891-fca1700a2d6b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1990875628", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127b1d7d-d9", "ovs_interfaceid": "127b1d7d-d92a-4e24-9470-1758579376bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9dedd1d2-74e4-4aae-8114-9ecd78686a4d", "address": "fa:16:3e:3a:bb:81", "network": {"id": "0b416634-9a5d-4d0a-a891-fca1700a2d6b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1990875628", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dedd1d2-74", "ovs_interfaceid": "9dedd1d2-74e4-4aae-8114-9ecd78686a4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d3174ebb-df19-4943-98c4-89c97607f42b", "address": "fa:16:3e:ad:34:97", "network": {"id": "0b416634-9a5d-4d0a-a891-fca1700a2d6b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1990875628", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3174ebb-df", "ovs_interfaceid": "d3174ebb-df19-4943-98c4-89c97607f42b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dff47f62-64b6-4ee5-b163-c74fc50ce6c9", "address": "fa:16:3e:fe:ff:79", "network": {"id": "700ca002-00ac-4a55-b2a5-f31c7ca9bcfa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1927044898", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff47f62-64", "ovs_interfaceid": "dff47f62-64b6-4ee5-b163-c74fc50ce6c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3839e2a9-bfeb-4103-9d7c-bcf45f9eaf14", "address": "fa:16:3e:c1:ce:a4", "network": {"id": "700ca002-00ac-4a55-b2a5-f31c7ca9bcfa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1927044898", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3839e2a9-bf", "ovs_interfaceid": "3839e2a9-bfeb-4103-9d7c-bcf45f9eaf14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:10:27 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-5034f013-1b4b-46e0-a992-1aa8a99c8ef4 req-2567909f-27ae-4bab-abb4-dac625aff8c9 service nova] Releasing lock "refresh_cache-6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:10:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-783184f4-cd60-4716-90ff-082ff2ae2b6f tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Acquiring lock "db291c2f-a72c-46ce-8de8-3956de37ccf8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:10:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-783184f4-cd60-4716-90ff-082ff2ae2b6f tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Lock "db291c2f-a72c-46ce-8de8-3956de37ccf8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:10:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-783184f4-cd60-4716-90ff-082ff2ae2b6f tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Acquiring lock "db291c2f-a72c-46ce-8de8-3956de37ccf8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:10:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-783184f4-cd60-4716-90ff-082ff2ae2b6f tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Lock "db291c2f-a72c-46ce-8de8-3956de37ccf8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:10:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-783184f4-cd60-4716-90ff-082ff2ae2b6f tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Lock "db291c2f-a72c-46ce-8de8-3956de37ccf8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:10:30 user nova-compute[82479]: INFO nova.compute.manager [None req-783184f4-cd60-4716-90ff-082ff2ae2b6f tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] Terminating instance
Apr 14 00:10:30 user nova-compute[82479]: DEBUG nova.compute.manager [None req-783184f4-cd60-4716-90ff-082ff2ae2b6f tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] Start destroying the instance on the hypervisor. {{(pid=82479) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 00:10:30 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:30 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:30 user nova-compute[82479]: DEBUG nova.compute.manager [req-877ac3d0-2928-463a-9a15-881b646cad13 req-1ee3a862-752d-4550-bebb-c0a5e4fe5077 service nova] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] Received event network-vif-unplugged-8916fec3-211a-470f-b70f-8a73690d3466 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:10:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-877ac3d0-2928-463a-9a15-881b646cad13 req-1ee3a862-752d-4550-bebb-c0a5e4fe5077 service nova] Acquiring lock "db291c2f-a72c-46ce-8de8-3956de37ccf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:10:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-877ac3d0-2928-463a-9a15-881b646cad13 req-1ee3a862-752d-4550-bebb-c0a5e4fe5077 service nova] Lock "db291c2f-a72c-46ce-8de8-3956de37ccf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:10:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-877ac3d0-2928-463a-9a15-881b646cad13 req-1ee3a862-752d-4550-bebb-c0a5e4fe5077 service nova] Lock "db291c2f-a72c-46ce-8de8-3956de37ccf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:10:30 user nova-compute[82479]: DEBUG nova.compute.manager [req-877ac3d0-2928-463a-9a15-881b646cad13 req-1ee3a862-752d-4550-bebb-c0a5e4fe5077 service nova] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] No waiting events found dispatching network-vif-unplugged-8916fec3-211a-470f-b70f-8a73690d3466 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:10:30 user nova-compute[82479]: DEBUG nova.compute.manager [req-877ac3d0-2928-463a-9a15-881b646cad13 req-1ee3a862-752d-4550-bebb-c0a5e4fe5077 service nova] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] Received event network-vif-unplugged-8916fec3-211a-470f-b70f-8a73690d3466 for instance with task_state deleting. {{(pid=82479) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 00:10:31 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] Instance destroyed successfully.
Apr 14 00:10:31 user nova-compute[82479]: DEBUG nova.objects.instance [None req-783184f4-cd60-4716-90ff-082ff2ae2b6f tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Lazy-loading 'resources' on Instance uuid db291c2f-a72c-46ce-8de8-3956de37ccf8 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:10:31 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-783184f4-cd60-4716-90ff-082ff2ae2b6f tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:08:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1531683904',display_name='tempest-VolumesActionsTest-instance-1531683904',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1531683904',id=12,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:08:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8d713f06b1714ade81068ed4f9edd035',ramdisk_id='',reservation_id='r-5wspmd2c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-599923376',owner_user_name='tempest-VolumesActionsTest-599923376-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T00:08:34Z,user_data=None,user_id='f6564746aecb479c8e408df9600222cb',uuid=db291c2f-a72c-46ce-8de8-3956de37ccf8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8916fec3-211a-470f-b70f-8a73690d3466", "address": "fa:16:3e:ca:fc:59", "network": {"id": "582cbaa2-4fc5-49e5-95d1-fe2749e7c842", "bridge": "br-int", "label": "tempest-VolumesActionsTest-248701522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "8d713f06b1714ade81068ed4f9edd035", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8916fec3-21", "ovs_interfaceid": "8916fec3-211a-470f-b70f-8a73690d3466", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 00:10:31 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-783184f4-cd60-4716-90ff-082ff2ae2b6f tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Converting VIF {"id": "8916fec3-211a-470f-b70f-8a73690d3466", "address": "fa:16:3e:ca:fc:59", "network": {"id": "582cbaa2-4fc5-49e5-95d1-fe2749e7c842", "bridge": "br-int", "label": "tempest-VolumesActionsTest-248701522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "8d713f06b1714ade81068ed4f9edd035", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8916fec3-21", "ovs_interfaceid": "8916fec3-211a-470f-b70f-8a73690d3466", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:10:31 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-783184f4-cd60-4716-90ff-082ff2ae2b6f tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:fc:59,bridge_name='br-int',has_traffic_filtering=True,id=8916fec3-211a-470f-b70f-8a73690d3466,network=Network(582cbaa2-4fc5-49e5-95d1-fe2749e7c842),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8916fec3-21') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:10:31 user nova-compute[82479]: DEBUG os_vif [None req-783184f4-cd60-4716-90ff-082ff2ae2b6f tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:fc:59,bridge_name='br-int',has_traffic_filtering=True,id=8916fec3-211a-470f-b70f-8a73690d3466,network=Network(582cbaa2-4fc5-49e5-95d1-fe2749e7c842),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8916fec3-21') {{(pid=82479) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 00:10:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8916fec3-21, bridge=br-int, if_exists=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:10:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:31 user nova-compute[82479]: INFO os_vif [None req-783184f4-cd60-4716-90ff-082ff2ae2b6f tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:fc:59,bridge_name='br-int',has_traffic_filtering=True,id=8916fec3-211a-470f-b70f-8a73690d3466,network=Network(582cbaa2-4fc5-49e5-95d1-fe2749e7c842),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8916fec3-21')
Apr 14 00:10:31 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-783184f4-cd60-4716-90ff-082ff2ae2b6f tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] Deleting instance files /opt/stack/data/nova/instances/db291c2f-a72c-46ce-8de8-3956de37ccf8_del
Apr 14 00:10:31 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-783184f4-cd60-4716-90ff-082ff2ae2b6f tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] Deletion of /opt/stack/data/nova/instances/db291c2f-a72c-46ce-8de8-3956de37ccf8_del complete
Apr 14 00:10:31 user nova-compute[82479]: INFO nova.compute.manager [None req-783184f4-cd60-4716-90ff-082ff2ae2b6f tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] Took 0.74 seconds to destroy the instance on the hypervisor.
Apr 14 00:10:31 user nova-compute[82479]: DEBUG oslo.service.loopingcall [None req-783184f4-cd60-4716-90ff-082ff2ae2b6f tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82479) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 00:10:31 user nova-compute[82479]: DEBUG nova.compute.manager [-] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] Deallocating network for instance {{(pid=82479) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 00:10:31 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] deallocate_for_instance() {{(pid=82479) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 00:10:32 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] Updating instance_info_cache with network_info: [] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:10:32 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] Took 0.70 seconds to deallocate network for instance.
Apr 14 00:10:32 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-783184f4-cd60-4716-90ff-082ff2ae2b6f tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:10:32 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-783184f4-cd60-4716-90ff-082ff2ae2b6f tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:10:32 user nova-compute[82479]: DEBUG nova.compute.manager [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Start spawning the instance on the hypervisor. {{(pid=82479) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 00:10:32 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Creating instance directory {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 00:10:32 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Creating image(s)
Apr 14 00:10:32 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Did not create local disks {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 00:10:32 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Ensure instance console log exists: /opt/stack/data/nova/instances/6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c/console.log {{(pid=82479) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 00:10:32 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:10:32 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:10:32 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:10:32 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Start _get_guest_xml network_info=[{"id": "1c533ad9-47bf-4eb9-b931-d855ad4ce53e", "address": "fa:16:3e:bf:3e:c1", "network": {"id": "4368ab10-ccfd-46d6-a0eb-296895d3ba19", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1929715000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c533ad9-47", "ovs_interfaceid": "1c533ad9-47bf-4eb9-b931-d855ad4ce53e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e9ec2eab-0d7a-4be3-acab-a27bce761738", "address": "fa:16:3e:93:27:43", "network": {"id": "0b416634-9a5d-4d0a-a891-fca1700a2d6b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1990875628", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9ec2eab-0d", "ovs_interfaceid": "e9ec2eab-0d7a-4be3-acab-a27bce761738", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "127b1d7d-d92a-4e24-9470-1758579376bf", "address": "fa:16:3e:bf:72:3f", "network": {"id": "0b416634-9a5d-4d0a-a891-fca1700a2d6b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1990875628", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127b1d7d-d9", "ovs_interfaceid": "127b1d7d-d92a-4e24-9470-1758579376bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9dedd1d2-74e4-4aae-8114-9ecd78686a4d", "address": "fa:16:3e:3a:bb:81", "network": {"id": "0b416634-9a5d-4d0a-a891-fca1700a2d6b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1990875628", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dedd1d2-74", "ovs_interfaceid": "9dedd1d2-74e4-4aae-8114-9ecd78686a4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d3174ebb-df19-4943-98c4-89c97607f42b", "address": "fa:16:3e:ad:34:97", "network": {"id": "0b416634-9a5d-4d0a-a891-fca1700a2d6b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1990875628", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3174ebb-df", "ovs_interfaceid": "d3174ebb-df19-4943-98c4-89c97607f42b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dff47f62-64b6-4ee5-b163-c74fc50ce6c9", "address": "fa:16:3e:fe:ff:79", "network": {"id": "700ca002-00ac-4a55-b2a5-f31c7ca9bcfa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1927044898", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff47f62-64", "ovs_interfaceid": "dff47f62-64b6-4ee5-b163-c74fc50ce6c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3839e2a9-bfeb-4103-9d7c-bcf45f9eaf14", "address": "fa:16:3e:c1:ce:a4", "network": {"id": "700ca002-00ac-4a55-b2a5-f31c7ca9bcfa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1927044898", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3839e2a9-bf", "ovs_interfaceid": "3839e2a9-bfeb-4103-9d7c-bcf45f9eaf14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': False, 'attachment_id': 'c3f8ef01-a91c-46c3-b28f-664c6a038a53', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XKCdSwHe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c', 'attached_at': '', 'detached_at': '', 'volume_id': '70173bca-df37-41ee-adcb-1e0464d96d62', 'serial': '70173bca-df37-41ee-adcb-1e0464d96d62'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None}, {'guest_format': None, 'boot_index': 1, 'device_type': 'disk', 'delete_on_termination': False, 'attachment_id': 'db90ce2b-b052-4826-bd61-45ecc34ca9f8', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KBCYoGZf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c', 'attached_at': '', 'detached_at': '', 'volume_id': '94fa4f60-6d5e-4c7b-b5a6-0923600a26e0', 'serial': '94fa4f60-6d5e-4c7b-b5a6-0923600a26e0'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'volume_type': None}, {'guest_format': None, 'boot_index': 2, 'device_type': 'disk', 'delete_on_termination': False, 'attachment_id': 'b4b24ae2-8900-4476-bc99-6ab4831f3406', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jPSrRZvK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c', 'attached_at': '', 'detached_at': '', 'volume_id': '215fee6a-a733-4408-a162-1e700d5bf7fc', 'serial': '215fee6a-a733-4408-a162-1e700d5bf7fc'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 00:10:32 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:10:32 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:10:32 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82479) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 00:10:32 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T00:02:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 00:10:32 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Flavor limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 00:10:32 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Image limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 00:10:32 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Flavor pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 00:10:32 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Image pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 00:10:32 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 00:10:32 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 00:10:32 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 00:10:32 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Got 1 possible topologies {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 00:10:32 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 00:10:32 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 00:10:32 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Calling os-brick to attach iSCSI Volume {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 00:10:32 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XKCdSwHe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:10:32 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:10:32 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:10:32 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:10:32 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:10:32 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:10:32 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:10:32 user nova-compute[82479]: INFO os_brick.initiator.connectors.iscsi [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 00:10:32 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 -p 172.16.0.220:3260 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:32 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:32 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[52849a52-e3af-492c-bebf-393da23d6939]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:32 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 00:10:32 user nova-compute[82479]:  {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:10:32 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 -p 172.16.0.220:3260 --interface default --op new {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:32 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:32 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[b093fa4f-ea25-4053-ac24-784ef7f32839]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62] added\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:32 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62] added
Apr 14 00:10:32 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:10:32 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:32 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-783184f4-cd60-4716-90ff-082ff2ae2b6f tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:10:32 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-783184f4-cd60-4716-90ff-082ff2ae2b6f tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:10:32 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:32 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[118be5ce-eb42-4cbf-a4a5-33a926f56925]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:32 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:10:32 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:32 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:32 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c6b9614-a5d5-4788-8bca-d0fa872f895e]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:32 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:10:32 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XKCdSwHe {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:32 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-783184f4-cd60-4716-90ff-082ff2ae2b6f tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.647s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:10:32 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XKCdSwHe" returned: 0 in 0.023s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:32 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2841f46-cc7a-4725-a013-3b5e06423ef3]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:32 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XKCdSwHe'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:10:32 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:32 user nova-compute[82479]: INFO nova.scheduler.client.report [None req-783184f4-cd60-4716-90ff-082ff2ae2b6f tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Deleted allocations for instance db291c2f-a72c-46ce-8de8-3956de37ccf8
Apr 14 00:10:32 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:32 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c4e518-1860-4ece-9f3d-48b6ae50cc86]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:32 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:10:32 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:32 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:32 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[84cbda30-8e79-4c0b-b1aa-db6ac256ebc5]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:32 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)
Apr 14 00:10:32 user nova-compute[82479]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:10:32 user nova-compute[82479]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:10:32 user nova-compute[82479]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 (non-flash)
Apr 14 00:10:32 user nova-compute[82479]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d (non-flash)
Apr 14 00:10:32 user nova-compute[82479]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 (non-flash)
Apr 14 00:10:32 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:10:32 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)
Apr 14 00:10:32 user nova-compute[82479]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:10:32 user nova-compute[82479]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:10:32 user nova-compute[82479]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 (non-flash)
Apr 14 00:10:32 user nova-compute[82479]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d (non-flash)
Apr 14 00:10:32 user nova-compute[82479]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 (non-flash)
Apr 14 00:10:32 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:10:32 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 -p 172.16.0.220:3260 --login {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:32 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-783184f4-cd60-4716-90ff-082ff2ae2b6f tempest-VolumesActionsTest-599923376 tempest-VolumesActionsTest-599923376-project-member] Lock "db291c2f-a72c-46ce-8de8-3956de37ccf8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.356s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:10:32 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:32 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[bedc1d9f-7135-4fa8-82aa-9ca79ead60b5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:32 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62, portal: 172.16.0.220,3260]
Apr 14 00:10:32 user nova-compute[82479]: Login to [iface: default, target: iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62, portal: 172.16.0.220,3260] successful.
Apr 14 00:10:32 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:10:32 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:32 user nova-compute[82479]: DEBUG nova.compute.manager [req-c985ba87-8109-44d5-9f90-af32d7293574 req-e6387bd2-5c20-4625-b5fc-9f71b0edc865 service nova] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] Received event network-vif-plugged-8916fec3-211a-470f-b70f-8a73690d3466 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:10:32 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-c985ba87-8109-44d5-9f90-af32d7293574 req-e6387bd2-5c20-4625-b5fc-9f71b0edc865 service nova] Acquiring lock "db291c2f-a72c-46ce-8de8-3956de37ccf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:10:32 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-c985ba87-8109-44d5-9f90-af32d7293574 req-e6387bd2-5c20-4625-b5fc-9f71b0edc865 service nova] Lock "db291c2f-a72c-46ce-8de8-3956de37ccf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:10:32 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-c985ba87-8109-44d5-9f90-af32d7293574 req-e6387bd2-5c20-4625-b5fc-9f71b0edc865 service nova] Lock "db291c2f-a72c-46ce-8de8-3956de37ccf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:10:32 user nova-compute[82479]: DEBUG nova.compute.manager [req-c985ba87-8109-44d5-9f90-af32d7293574 req-e6387bd2-5c20-4625-b5fc-9f71b0edc865 service nova] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] No waiting events found dispatching network-vif-plugged-8916fec3-211a-470f-b70f-8a73690d3466 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:10:32 user nova-compute[82479]: WARNING nova.compute.manager [req-c985ba87-8109-44d5-9f90-af32d7293574 req-e6387bd2-5c20-4625-b5fc-9f71b0edc865 service nova] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] Received unexpected event network-vif-plugged-8916fec3-211a-470f-b70f-8a73690d3466 for instance with vm_state deleted and task_state None.
Apr 14 00:10:32 user nova-compute[82479]: DEBUG nova.compute.manager [req-c985ba87-8109-44d5-9f90-af32d7293574 req-e6387bd2-5c20-4625-b5fc-9f71b0edc865 service nova] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] Received event network-vif-deleted-8916fec3-211a-470f-b70f-8a73690d3466 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:10:32 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:32 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a75f98f-7284-48ea-9381-ce6880dbdcde]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:32 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:10:32 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:33 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:33 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[123d1a4b-3371-48a5-93ad-478142a97792]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:33 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)
Apr 14 00:10:33 user nova-compute[82479]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:10:33 user nova-compute[82479]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:10:33 user nova-compute[82479]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 (non-flash)
Apr 14 00:10:33 user nova-compute[82479]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d (non-flash)
Apr 14 00:10:33 user nova-compute[82479]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 (non-flash)
Apr 14 00:10:33 user nova-compute[82479]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 (non-flash)
Apr 14 00:10:33 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:10:33 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)
Apr 14 00:10:33 user nova-compute[82479]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:10:33 user nova-compute[82479]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:10:33 user nova-compute[82479]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 (non-flash)
Apr 14 00:10:33 user nova-compute[82479]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d (non-flash)
Apr 14 00:10:33 user nova-compute[82479]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 (non-flash)
Apr 14 00:10:33 user nova-compute[82479]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 (non-flash)
Apr 14 00:10:33 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:10:33 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.399s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:10:33 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Connected to 172.16.0.220:3260 {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 00:10:33 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] HCTL ('39', '-', '-', 0) found on session 18 with lun 0 {{(pid=82479) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 00:10:33 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=82479) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 00:10:33 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:33 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:33 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9d6c9f-15b6-4ecb-a04c-5f476d662612]: (4, ('- - 0', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:33 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Searching for a device in session 18 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=82479) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 00:10:33 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XKCdSwHe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 00:10:34 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.443s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:10:34 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] <== connect_volume: return (1445ms) {'type': 'block', 'scsi_wwn': '23337623461376533', 'path': '/dev/sdh'} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:10:34 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337623461376533', 'path': '/dev/sdh'} {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 00:10:34 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Calling os-brick to attach iSCSI Volume {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 00:10:34 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KBCYoGZf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:10:34 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:10:34 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:10:34 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:10:34 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:10:34 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:10:34 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:10:34 user nova-compute[82479]: INFO os_brick.initiator.connectors.iscsi [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 00:10:34 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 -p 172.16.0.220:3260 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:34 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:34 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[4014c1a8-9989-49f0-bc8c-68ce16215a54]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:34 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 00:10:34 user nova-compute[82479]:  {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:10:34 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 -p 172.16.0.220:3260 --interface default --op new {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:34 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:34 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a22badc-99f0-497f-84d2-f6e5fb3e7ad6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0] added\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:34 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0] added
Apr 14 00:10:34 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:10:34 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:34 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:34 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[59847cfe-0bea-4615-b1c0-8068f72e11e2]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:34 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:10:34 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:34 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:34 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff600c3-19e0-4f7e-9f90-c8d7a0d94ef5]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:34 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:10:34 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KBCYoGZf {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:34 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KBCYoGZf" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:34 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[bccd9015-a176-4d63-b5c7-c042f4861173]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:34 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KBCYoGZf'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:10:34 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:34 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:34 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[47bc485a-1de9-4a41-b673-f049065aee12]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:34 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:10:34 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:34 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:34 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c98b62-809d-46cd-a943-5a6309c56db7]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:34 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)
Apr 14 00:10:34 user nova-compute[82479]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:10:34 user nova-compute[82479]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:10:34 user nova-compute[82479]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 (non-flash)
Apr 14 00:10:34 user nova-compute[82479]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d (non-flash)
Apr 14 00:10:34 user nova-compute[82479]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 (non-flash)
Apr 14 00:10:34 user nova-compute[82479]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 (non-flash)
Apr 14 00:10:34 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:10:34 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)
Apr 14 00:10:34 user nova-compute[82479]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:10:34 user nova-compute[82479]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:10:34 user nova-compute[82479]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 (non-flash)
Apr 14 00:10:34 user nova-compute[82479]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d (non-flash)
Apr 14 00:10:34 user nova-compute[82479]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 (non-flash)
Apr 14 00:10:34 user nova-compute[82479]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 (non-flash)
Apr 14 00:10:34 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:10:34 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 -p 172.16.0.220:3260 --login {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:34 user nova-compute[82479]: INFO nova.compute.manager [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Rescuing
Apr 14 00:10:34 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "refresh_cache-17c6c147-fb62-4204-a416-792b94d3f7dd" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:10:34 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquired lock "refresh_cache-17c6c147-fb62-4204-a416-792b94d3f7dd" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:10:34 user nova-compute[82479]: DEBUG nova.network.neutron [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 00:10:34 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:34 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[7390ee31-aa22-450a-9b07-c5dc510606be]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:34 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0, portal: 172.16.0.220,3260]
Apr 14 00:10:34 user nova-compute[82479]: Login to [iface: default, target: iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0, portal: 172.16.0.220,3260] successful.
Apr 14 00:10:34 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:10:34 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:34 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:34 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[b520fe92-1bb9-4ac4-9e8b-874b2ab8acad]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:34 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:10:34 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:34 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:34 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf33af72-140c-4a9e-93d6-e58d7088b788]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:34 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)
Apr 14 00:10:34 user nova-compute[82479]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:10:34 user nova-compute[82479]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:10:34 user nova-compute[82479]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 (non-flash)
Apr 14 00:10:34 user nova-compute[82479]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d (non-flash)
Apr 14 00:10:34 user nova-compute[82479]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 (non-flash)
Apr 14 00:10:34 user nova-compute[82479]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 (non-flash)
Apr 14 00:10:34 user nova-compute[82479]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 (non-flash)
Apr 14 00:10:34 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:10:34 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)
Apr 14 00:10:34 user nova-compute[82479]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:10:34 user nova-compute[82479]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:10:34 user nova-compute[82479]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 (non-flash)
Apr 14 00:10:34 user nova-compute[82479]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d (non-flash)
Apr 14 00:10:34 user nova-compute[82479]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 (non-flash)
Apr 14 00:10:34 user nova-compute[82479]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 (non-flash)
Apr 14 00:10:34 user nova-compute[82479]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 (non-flash)
Apr 14 00:10:34 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:10:34 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:10:34 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Connected to 172.16.0.220:3260 {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 00:10:34 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] HCTL ('40', '-', '-', 0) found on session 19 with lun 0 {{(pid=82479) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 00:10:34 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=82479) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 00:10:34 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:34 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:34 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8925fb7-7e9c-4599-bb52-7f4ea15cc3dd]: (4, ('- - 0', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:34 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Searching for a device in session 19 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=82479) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 00:10:34 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KBCYoGZf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 00:10:34 user nova-compute[82479]: DEBUG nova.network.neutron [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Updating instance_info_cache with network_info: [{"id": "102987de-d5e4-4ccd-b4fd-7ca7c131e379", "address": "fa:16:3e:23:dd:a5", "network": {"id": "491696ea-38ef-4c19-9d94-a61223c1fa00", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1323121698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3f111e24414976beddba7ef90c4793", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap102987de-d5", "ovs_interfaceid": "102987de-d5e4-4ccd-b4fd-7ca7c131e379", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:10:34 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Releasing lock "refresh_cache-17c6c147-fb62-4204-a416-792b94d3f7dd" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:10:35 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:35 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:35 user nova-compute[82479]: DEBUG nova.compute.manager [req-8eaac09b-59d4-4823-84a4-4cd2f9164dff req-b0f99a91-5237-43fc-ba1c-4cb7d8f3907a service nova] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Received event network-vif-unplugged-102987de-d5e4-4ccd-b4fd-7ca7c131e379 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:10:35 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-8eaac09b-59d4-4823-84a4-4cd2f9164dff req-b0f99a91-5237-43fc-ba1c-4cb7d8f3907a service nova] Acquiring lock "17c6c147-fb62-4204-a416-792b94d3f7dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:10:35 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-8eaac09b-59d4-4823-84a4-4cd2f9164dff req-b0f99a91-5237-43fc-ba1c-4cb7d8f3907a service nova] Lock "17c6c147-fb62-4204-a416-792b94d3f7dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:10:35 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-8eaac09b-59d4-4823-84a4-4cd2f9164dff req-b0f99a91-5237-43fc-ba1c-4cb7d8f3907a service nova] Lock "17c6c147-fb62-4204-a416-792b94d3f7dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:10:35 user nova-compute[82479]: DEBUG nova.compute.manager [req-8eaac09b-59d4-4823-84a4-4cd2f9164dff req-b0f99a91-5237-43fc-ba1c-4cb7d8f3907a service nova] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] No waiting events found dispatching network-vif-unplugged-102987de-d5e4-4ccd-b4fd-7ca7c131e379 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:10:35 user nova-compute[82479]: WARNING nova.compute.manager [req-8eaac09b-59d4-4823-84a4-4cd2f9164dff req-b0f99a91-5237-43fc-ba1c-4cb7d8f3907a service nova] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Received unexpected event network-vif-unplugged-102987de-d5e4-4ccd-b4fd-7ca7c131e379 for instance with vm_state active and task_state rescuing.
Apr 14 00:10:35 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:35 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:35 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:10:35 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '26236343039616666', 'path': '/dev/sdi'} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:10:35 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236343039616666', 'path': '/dev/sdi'} {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 00:10:35 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Calling os-brick to attach iSCSI Volume {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 00:10:35 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jPSrRZvK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:10:35 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:10:35 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:10:35 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:10:35 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:10:35 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:10:35 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:10:35 user nova-compute[82479]: INFO os_brick.initiator.connectors.iscsi [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 00:10:35 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc -p 172.16.0.220:3260 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:35 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:35 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed11e16d-71a9-4e27-8960-346af28e715b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:35 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 00:10:35 user nova-compute[82479]:  {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:10:35 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc -p 172.16.0.220:3260 --interface default --op new {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:35 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:35 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[322574c9-c879-4b73-b2c0-78cb174d52c8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc] added\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:35 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc] added
Apr 14 00:10:35 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:10:35 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:35 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:35 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[39eb050c-eae9-41cc-b811-e823089e8701]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:35 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:10:35 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:35 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:35 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb43cdc4-c403-47c1-b95e-d86ded71a99d]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:35 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:10:35 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jPSrRZvK {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:35 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jPSrRZvK" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:35 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[e128272a-ab2e-4dfb-9080-d9c3cb6c0814]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:35 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jPSrRZvK'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:10:35 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:35 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:35 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff47db4c-0b32-44f5-95db-e1e51115a5f5]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:35 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:10:35 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:35 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:35 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[f36e001d-c03a-45c1-9973-10c713ada102]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:35 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)
Apr 14 00:10:35 user nova-compute[82479]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:10:35 user nova-compute[82479]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:10:35 user nova-compute[82479]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 (non-flash)
Apr 14 00:10:35 user nova-compute[82479]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d (non-flash)
Apr 14 00:10:35 user nova-compute[82479]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 (non-flash)
Apr 14 00:10:35 user nova-compute[82479]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 (non-flash)
Apr 14 00:10:35 user nova-compute[82479]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 (non-flash)
Apr 14 00:10:35 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:10:35 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)
Apr 14 00:10:35 user nova-compute[82479]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:10:35 user nova-compute[82479]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:10:35 user nova-compute[82479]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 (non-flash)
Apr 14 00:10:35 user nova-compute[82479]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d (non-flash)
Apr 14 00:10:35 user nova-compute[82479]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 (non-flash)
Apr 14 00:10:35 user nova-compute[82479]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 (non-flash)
Apr 14 00:10:35 user nova-compute[82479]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 (non-flash)
Apr 14 00:10:35 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:10:35 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc -p 172.16.0.220:3260 --login {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:35 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:35 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc -p 172.16.0.220:3260 --login" returned: 0 in 0.095s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:35 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e50cee-5ea3-4345-8272-bd1ef30914f0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:35 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc, portal: 172.16.0.220,3260]
Apr 14 00:10:35 user nova-compute[82479]: Login to [iface: default, target: iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc, portal: 172.16.0.220,3260] successful.
Apr 14 00:10:35 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:10:35 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:35 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Instance destroyed successfully.
Apr 14 00:10:35 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Attempting a stable device rescue
Apr 14 00:10:35 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:35 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b8251a-9d86-44ac-8f9a-bd654a01f5c7]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:35 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:10:35 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:35 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=82479) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 14 00:10:35 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:35 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[61af5338-b5b6-4773-a942-f725560b3ad3]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:35 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)
Apr 14 00:10:35 user nova-compute[82479]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:10:35 user nova-compute[82479]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:10:35 user nova-compute[82479]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 (non-flash)
Apr 14 00:10:35 user nova-compute[82479]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d (non-flash)
Apr 14 00:10:35 user nova-compute[82479]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 (non-flash)
Apr 14 00:10:35 user nova-compute[82479]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 (non-flash)
Apr 14 00:10:35 user nova-compute[82479]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 (non-flash)
Apr 14 00:10:35 user nova-compute[82479]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc (non-flash)
Apr 14 00:10:35 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:10:35 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)
Apr 14 00:10:35 user nova-compute[82479]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:10:35 user nova-compute[82479]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:10:35 user nova-compute[82479]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 (non-flash)
Apr 14 00:10:35 user nova-compute[82479]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d (non-flash)
Apr 14 00:10:35 user nova-compute[82479]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 (non-flash)
Apr 14 00:10:35 user nova-compute[82479]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 (non-flash)
Apr 14 00:10:35 user nova-compute[82479]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 (non-flash)
Apr 14 00:10:35 user nova-compute[82479]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc (non-flash)
Apr 14 00:10:35 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:10:35 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:10:35 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Connected to 172.16.0.220:3260 {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 00:10:35 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] HCTL ('41', '-', '-', 0) found on session 20 with lun 0 {{(pid=82479) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 00:10:35 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=82479) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 00:10:35 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:35 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Instance directory exists: not creating {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 00:10:35 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Creating image(s)
Apr 14 00:10:35 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "/opt/stack/data/nova/instances/17c6c147-fb62-4204-a416-792b94d3f7dd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:10:35 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "/opt/stack/data/nova/instances/17c6c147-fb62-4204-a416-792b94d3f7dd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:10:35 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "/opt/stack/data/nova/instances/17c6c147-fb62-4204-a416-792b94d3f7dd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:10:35 user nova-compute[82479]: DEBUG nova.objects.instance [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lazy-loading 'trusted_certs' on Instance uuid 17c6c147-fb62-4204-a416-792b94d3f7dd {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:10:35 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.017s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:35 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b29bbcf-aee9-4892-84ab-8dc8636120ad]: (4, ('- - 0', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:35 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Searching for a device in session 20 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=82479) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 00:10:35 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jPSrRZvK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 00:10:35 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "2b62e8d46ab06db23c4b2d8ac0ee1f254fec5cba" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:10:35 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "2b62e8d46ab06db23c4b2d8ac0ee1f254fec5cba" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:10:36 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b62e8d46ab06db23c4b2d8ac0ee1f254fec5cba.part --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:36 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:36 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.381s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:10:36 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] <== connect_volume: return (1384ms) {'type': 'block', 'scsi_wwn': '23834353630623965', 'path': '/dev/sdj'} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:10:36 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23834353630623965', 'path': '/dev/sdj'} {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 00:10:36 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b62e8d46ab06db23c4b2d8ac0ee1f254fec5cba.part --force-share --output=json" returned: 0 in 0.223s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:36 user nova-compute[82479]: DEBUG nova.virt.images [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] abb285f7-c82d-4a2c-be02-c183ea364f79 was qcow2, converting to raw {{(pid=82479) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 00:10:36 user nova-compute[82479]: DEBUG nova.privsep.utils [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82479) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 00:10:36 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2b62e8d46ab06db23c4b2d8ac0ee1f254fec5cba.part /opt/stack/data/nova/instances/_base/2b62e8d46ab06db23c4b2d8ac0ee1f254fec5cba.converted {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:36 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T00:10:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1988157619',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1988157619',id=19,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzFzYtOkhtTfUxmZfatH6CLkRspJ29CcFKsj7Jii/QnXAw3odYM7Fg7NrRwCCXWDFq4MfAcHuoGwdJI+7pLDpdqmMb7XOB25SJmdfg0Ga4BVIZeAS8DmBQk03SznYKaXw==',key_name='tempest-keypair-84265846',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be44ce9922f14c6fa75dc0f99b544851',ramdisk_id='',reservation_id='r-evii7suo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1295697559',owner_user_name='tempest-TaggedBootDevicesTest_v242-1295697559-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:10:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85f2e1744d6c460a81c97f39a76ef5c7',uuid=6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c533ad9-47bf-4eb9-b931-d855ad4ce53e", "address": "fa:16:3e:bf:3e:c1", "network": {"id": "4368ab10-ccfd-46d6-a0eb-296895d3ba19", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1929715000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c533ad9-47", "ovs_interfaceid": "1c533ad9-47bf-4eb9-b931-d855ad4ce53e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82479) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 00:10:36 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Converting VIF {"id": "1c533ad9-47bf-4eb9-b931-d855ad4ce53e", "address": "fa:16:3e:bf:3e:c1", "network": {"id": "4368ab10-ccfd-46d6-a0eb-296895d3ba19", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1929715000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c533ad9-47", "ovs_interfaceid": "1c533ad9-47bf-4eb9-b931-d855ad4ce53e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:10:36 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:3e:c1,bridge_name='br-int',has_traffic_filtering=True,id=1c533ad9-47bf-4eb9-b931-d855ad4ce53e,network=Network(4368ab10-ccfd-46d6-a0eb-296895d3ba19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c533ad9-47') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:10:36 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T00:10:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1988157619',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1988157619',id=19,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzFzYtOkhtTfUxmZfatH6CLkRspJ29CcFKsj7Jii/QnXAw3odYM7Fg7NrRwCCXWDFq4MfAcHuoGwdJI+7pLDpdqmMb7XOB25SJmdfg0Ga4BVIZeAS8DmBQk03SznYKaXw==',key_name='tempest-keypair-84265846',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be44ce9922f14c6fa75dc0f99b544851',ramdisk_id='',reservation_id='r-evii7suo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1295697559',owner_user_name='tempest-TaggedBootDevicesTest_v242-1295697559-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:10:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85f2e1744d6c460a81c97f39a76ef5c7',uuid=6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9ec2eab-0d7a-4be3-acab-a27bce761738", "address": "fa:16:3e:93:27:43", "network": {"id": "0b416634-9a5d-4d0a-a891-fca1700a2d6b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1990875628", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9ec2eab-0d", "ovs_interfaceid": "e9ec2eab-0d7a-4be3-acab-a27bce761738", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82479) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 00:10:36 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Converting VIF {"id": "e9ec2eab-0d7a-4be3-acab-a27bce761738", "address": "fa:16:3e:93:27:43", "network": {"id": "0b416634-9a5d-4d0a-a891-fca1700a2d6b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1990875628", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9ec2eab-0d", "ovs_interfaceid": "e9ec2eab-0d7a-4be3-acab-a27bce761738", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:10:36 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:27:43,bridge_name='br-int',has_traffic_filtering=True,id=e9ec2eab-0d7a-4be3-acab-a27bce761738,network=Network(0b416634-9a5d-4d0a-a891-fca1700a2d6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape9ec2eab-0d') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:10:36 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T00:10:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1988157619',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1988157619',id=19,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzFzYtOkhtTfUxmZfatH6CLkRspJ29CcFKsj7Jii/QnXAw3odYM7Fg7NrRwCCXWDFq4MfAcHuoGwdJI+7pLDpdqmMb7XOB25SJmdfg0Ga4BVIZeAS8DmBQk03SznYKaXw==',key_name='tempest-keypair-84265846',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be44ce9922f14c6fa75dc0f99b544851',ramdisk_id='',reservation_id='r-evii7suo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1295697559',owner_user_name='tempest-TaggedBootDevicesTest_v242-1295697559-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:10:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85f2e1744d6c460a81c97f39a76ef5c7',uuid=6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "127b1d7d-d92a-4e24-9470-1758579376bf", "address": "fa:16:3e:bf:72:3f", "network": {"id": "0b416634-9a5d-4d0a-a891-fca1700a2d6b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1990875628", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127b1d7d-d9", "ovs_interfaceid": "127b1d7d-d92a-4e24-9470-1758579376bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82479) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 00:10:36 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Converting VIF {"id": "127b1d7d-d92a-4e24-9470-1758579376bf", "address": "fa:16:3e:bf:72:3f", "network": {"id": "0b416634-9a5d-4d0a-a891-fca1700a2d6b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1990875628", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127b1d7d-d9", "ovs_interfaceid": "127b1d7d-d92a-4e24-9470-1758579376bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:10:36 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:72:3f,bridge_name='br-int',has_traffic_filtering=True,id=127b1d7d-d92a-4e24-9470-1758579376bf,network=Network(0b416634-9a5d-4d0a-a891-fca1700a2d6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap127b1d7d-d9') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:10:36 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T00:10:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1988157619',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1988157619',id=19,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzFzYtOkhtTfUxmZfatH6CLkRspJ29CcFKsj7Jii/QnXAw3odYM7Fg7NrRwCCXWDFq4MfAcHuoGwdJI+7pLDpdqmMb7XOB25SJmdfg0Ga4BVIZeAS8DmBQk03SznYKaXw==',key_name='tempest-keypair-84265846',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be44ce9922f14c6fa75dc0f99b544851',ramdisk_id='',reservation_id='r-evii7suo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1295697559',owner_user_name='tempest-TaggedBootDevicesTest_v242-1295697559-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:10:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85f2e1744d6c460a81c97f39a76ef5c7',uuid=6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9dedd1d2-74e4-4aae-8114-9ecd78686a4d", "address": "fa:16:3e:3a:bb:81", "network": {"id": "0b416634-9a5d-4d0a-a891-fca1700a2d6b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1990875628", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dedd1d2-74", "ovs_interfaceid": "9dedd1d2-74e4-4aae-8114-9ecd78686a4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82479) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 00:10:36 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Converting VIF {"id": "9dedd1d2-74e4-4aae-8114-9ecd78686a4d", "address": "fa:16:3e:3a:bb:81", "network": {"id": "0b416634-9a5d-4d0a-a891-fca1700a2d6b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1990875628", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dedd1d2-74", "ovs_interfaceid": "9dedd1d2-74e4-4aae-8114-9ecd78686a4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:10:36 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:bb:81,bridge_name='br-int',has_traffic_filtering=True,id=9dedd1d2-74e4-4aae-8114-9ecd78686a4d,network=Network(0b416634-9a5d-4d0a-a891-fca1700a2d6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dedd1d2-74') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:10:36 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T00:10:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1988157619',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1988157619',id=19,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzFzYtOkhtTfUxmZfatH6CLkRspJ29CcFKsj7Jii/QnXAw3odYM7Fg7NrRwCCXWDFq4MfAcHuoGwdJI+7pLDpdqmMb7XOB25SJmdfg0Ga4BVIZeAS8DmBQk03SznYKaXw==',key_name='tempest-keypair-84265846',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be44ce9922f14c6fa75dc0f99b544851',ramdisk_id='',reservation_id='r-evii7suo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1295697559',owner_user_name='tempest-TaggedBootDevicesTest_v242-1295697559-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:10:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85f2e1744d6c460a81c97f39a76ef5c7',uuid=6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3174ebb-df19-4943-98c4-89c97607f42b", "address": "fa:16:3e:ad:34:97", "network": {"id": "0b416634-9a5d-4d0a-a891-fca1700a2d6b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1990875628", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3174ebb-df", "ovs_interfaceid": "d3174ebb-df19-4943-98c4-89c97607f42b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82479) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 00:10:36 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Converting VIF {"id": "d3174ebb-df19-4943-98c4-89c97607f42b", "address": "fa:16:3e:ad:34:97", "network": {"id": "0b416634-9a5d-4d0a-a891-fca1700a2d6b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1990875628", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3174ebb-df", "ovs_interfaceid": "d3174ebb-df19-4943-98c4-89c97607f42b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:10:36 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:34:97,bridge_name='br-int',has_traffic_filtering=True,id=d3174ebb-df19-4943-98c4-89c97607f42b,network=Network(0b416634-9a5d-4d0a-a891-fca1700a2d6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3174ebb-df') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:10:36 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T00:10:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1988157619',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1988157619',id=19,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzFzYtOkhtTfUxmZfatH6CLkRspJ29CcFKsj7Jii/QnXAw3odYM7Fg7NrRwCCXWDFq4MfAcHuoGwdJI+7pLDpdqmMb7XOB25SJmdfg0Ga4BVIZeAS8DmBQk03SznYKaXw==',key_name='tempest-keypair-84265846',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be44ce9922f14c6fa75dc0f99b544851',ramdisk_id='',reservation_id='r-evii7suo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1295697559',owner_user_name='tempest-TaggedBootDevicesTest_v242-1295697559-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:10:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85f2e1744d6c460a81c97f39a76ef5c7',uuid=6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dff47f62-64b6-4ee5-b163-c74fc50ce6c9", "address": "fa:16:3e:fe:ff:79", "network": {"id": "700ca002-00ac-4a55-b2a5-f31c7ca9bcfa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1927044898", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff47f62-64", "ovs_interfaceid": "dff47f62-64b6-4ee5-b163-c74fc50ce6c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82479) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Converting VIF {"id": "dff47f62-64b6-4ee5-b163-c74fc50ce6c9", "address": "fa:16:3e:fe:ff:79", "network": {"id": "700ca002-00ac-4a55-b2a5-f31c7ca9bcfa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1927044898", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff47f62-64", "ovs_interfaceid": "dff47f62-64b6-4ee5-b163-c74fc50ce6c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:ff:79,bridge_name='br-int',has_traffic_filtering=True,id=dff47f62-64b6-4ee5-b163-c74fc50ce6c9,network=Network(700ca002-00ac-4a55-b2a5-f31c7ca9bcfa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdff47f62-64') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T00:10:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1988157619',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1988157619',id=19,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzFzYtOkhtTfUxmZfatH6CLkRspJ29CcFKsj7Jii/QnXAw3odYM7Fg7NrRwCCXWDFq4MfAcHuoGwdJI+7pLDpdqmMb7XOB25SJmdfg0Ga4BVIZeAS8DmBQk03SznYKaXw==',key_name='tempest-keypair-84265846',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be44ce9922f14c6fa75dc0f99b544851',ramdisk_id='',reservation_id='r-evii7suo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1295697559',owner_user_name='tempest-TaggedBootDevicesTest_v242-1295697559-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:10:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85f2e1744d6c460a81c97f39a76ef5c7',uuid=6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3839e2a9-bfeb-4103-9d7c-bcf45f9eaf14", "address": "fa:16:3e:c1:ce:a4", "network": {"id": "700ca002-00ac-4a55-b2a5-f31c7ca9bcfa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1927044898", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3839e2a9-bf", "ovs_interfaceid": "3839e2a9-bfeb-4103-9d7c-bcf45f9eaf14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82479) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Converting VIF {"id": "3839e2a9-bfeb-4103-9d7c-bcf45f9eaf14", "address": "fa:16:3e:c1:ce:a4", "network": {"id": "700ca002-00ac-4a55-b2a5-f31c7ca9bcfa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1927044898", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3839e2a9-bf", "ovs_interfaceid": "3839e2a9-bfeb-4103-9d7c-bcf45f9eaf14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:ce:a4,bridge_name='br-int',has_traffic_filtering=True,id=3839e2a9-bfeb-4103-9d7c-bcf45f9eaf14,network=Network(700ca002-00ac-4a55-b2a5-f31c7ca9bcfa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3839e2a9-bf') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG nova.objects.instance [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Lazy-loading 'pci_devices' on Instance uuid 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] End _get_guest_xml xml=<domain type="kvm">
Apr 14 00:10:37 user nova-compute[82479]:   <uuid>6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c</uuid>
Apr 14 00:10:37 user nova-compute[82479]:   <name>instance-00000013</name>
Apr 14 00:10:37 user nova-compute[82479]:   <memory>131072</memory>
Apr 14 00:10:37 user nova-compute[82479]:   <vcpu>1</vcpu>
Apr 14 00:10:37 user nova-compute[82479]:   <metadata>
Apr 14 00:10:37 user nova-compute[82479]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 00:10:37 user nova-compute[82479]:       <nova:package version="0.0.0"/>
Apr 14 00:10:37 user nova-compute[82479]:       <nova:name>tempest-device-tagging-server-1988157619</nova:name>
Apr 14 00:10:37 user nova-compute[82479]:       <nova:creationTime>2023-04-14 00:10:32</nova:creationTime>
Apr 14 00:10:37 user nova-compute[82479]:       <nova:flavor name="m1.nano">
Apr 14 00:10:37 user nova-compute[82479]:         <nova:memory>128</nova:memory>
Apr 14 00:10:37 user nova-compute[82479]:         <nova:disk>1</nova:disk>
Apr 14 00:10:37 user nova-compute[82479]:         <nova:swap>0</nova:swap>
Apr 14 00:10:37 user nova-compute[82479]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 00:10:37 user nova-compute[82479]:         <nova:vcpus>1</nova:vcpus>
Apr 14 00:10:37 user nova-compute[82479]:       </nova:flavor>
Apr 14 00:10:37 user nova-compute[82479]:       <nova:owner>
Apr 14 00:10:37 user nova-compute[82479]:         <nova:user uuid="85f2e1744d6c460a81c97f39a76ef5c7">tempest-TaggedBootDevicesTest_v242-1295697559-project-member</nova:user>
Apr 14 00:10:37 user nova-compute[82479]:         <nova:project uuid="be44ce9922f14c6fa75dc0f99b544851">tempest-TaggedBootDevicesTest_v242-1295697559</nova:project>
Apr 14 00:10:37 user nova-compute[82479]:       </nova:owner>
Apr 14 00:10:37 user nova-compute[82479]:       <nova:root type="image" uuid="6db62068-7278-4cd8-b41f-d0140d89e199"/>
Apr 14 00:10:37 user nova-compute[82479]:       <nova:ports>
Apr 14 00:10:37 user nova-compute[82479]:         <nova:port uuid="1c533ad9-47bf-4eb9-b931-d855ad4ce53e">
Apr 14 00:10:37 user nova-compute[82479]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 14 00:10:37 user nova-compute[82479]:         </nova:port>
Apr 14 00:10:37 user nova-compute[82479]:         <nova:port uuid="e9ec2eab-0d7a-4be3-acab-a27bce761738">
Apr 14 00:10:37 user nova-compute[82479]:           <nova:ip type="fixed" address="10.1.1.109" ipVersion="4"/>
Apr 14 00:10:37 user nova-compute[82479]:         </nova:port>
Apr 14 00:10:37 user nova-compute[82479]:         <nova:port uuid="127b1d7d-d92a-4e24-9470-1758579376bf">
Apr 14 00:10:37 user nova-compute[82479]:           <nova:ip type="fixed" address="10.1.1.219" ipVersion="4"/>
Apr 14 00:10:37 user nova-compute[82479]:         </nova:port>
Apr 14 00:10:37 user nova-compute[82479]:         <nova:port uuid="9dedd1d2-74e4-4aae-8114-9ecd78686a4d">
Apr 14 00:10:37 user nova-compute[82479]:           <nova:ip type="fixed" address="10.1.1.104" ipVersion="4"/>
Apr 14 00:10:37 user nova-compute[82479]:         </nova:port>
Apr 14 00:10:37 user nova-compute[82479]:         <nova:port uuid="d3174ebb-df19-4943-98c4-89c97607f42b">
Apr 14 00:10:37 user nova-compute[82479]:           <nova:ip type="fixed" address="10.1.1.111" ipVersion="4"/>
Apr 14 00:10:37 user nova-compute[82479]:         </nova:port>
Apr 14 00:10:37 user nova-compute[82479]:         <nova:port uuid="dff47f62-64b6-4ee5-b163-c74fc50ce6c9">
Apr 14 00:10:37 user nova-compute[82479]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Apr 14 00:10:37 user nova-compute[82479]:         </nova:port>
Apr 14 00:10:37 user nova-compute[82479]:         <nova:port uuid="3839e2a9-bfeb-4103-9d7c-bcf45f9eaf14">
Apr 14 00:10:37 user nova-compute[82479]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Apr 14 00:10:37 user nova-compute[82479]:         </nova:port>
Apr 14 00:10:37 user nova-compute[82479]:       </nova:ports>
Apr 14 00:10:37 user nova-compute[82479]:     </nova:instance>
Apr 14 00:10:37 user nova-compute[82479]:   </metadata>
Apr 14 00:10:37 user nova-compute[82479]:   <sysinfo type="smbios">
Apr 14 00:10:37 user nova-compute[82479]:     <system>
Apr 14 00:10:37 user nova-compute[82479]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 00:10:37 user nova-compute[82479]:       <entry name="product">OpenStack Nova</entry>
Apr 14 00:10:37 user nova-compute[82479]:       <entry name="version">0.0.0</entry>
Apr 14 00:10:37 user nova-compute[82479]:       <entry name="serial">6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c</entry>
Apr 14 00:10:37 user nova-compute[82479]:       <entry name="uuid">6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c</entry>
Apr 14 00:10:37 user nova-compute[82479]:       <entry name="family">Virtual Machine</entry>
Apr 14 00:10:37 user nova-compute[82479]:     </system>
Apr 14 00:10:37 user nova-compute[82479]:   </sysinfo>
Apr 14 00:10:37 user nova-compute[82479]:   <os>
Apr 14 00:10:37 user nova-compute[82479]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 00:10:37 user nova-compute[82479]:     <boot dev="hd"/>
Apr 14 00:10:37 user nova-compute[82479]:     <smbios mode="sysinfo"/>
Apr 14 00:10:37 user nova-compute[82479]:   </os>
Apr 14 00:10:37 user nova-compute[82479]:   <features>
Apr 14 00:10:37 user nova-compute[82479]:     <acpi/>
Apr 14 00:10:37 user nova-compute[82479]:     <apic/>
Apr 14 00:10:37 user nova-compute[82479]:     <vmcoreinfo/>
Apr 14 00:10:37 user nova-compute[82479]:   </features>
Apr 14 00:10:37 user nova-compute[82479]:   <clock offset="utc">
Apr 14 00:10:37 user nova-compute[82479]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 00:10:37 user nova-compute[82479]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 00:10:37 user nova-compute[82479]:     <timer name="hpet" present="no"/>
Apr 14 00:10:37 user nova-compute[82479]:   </clock>
Apr 14 00:10:37 user nova-compute[82479]:   <cpu mode="custom" match="exact">
Apr 14 00:10:37 user nova-compute[82479]:     <model>Nehalem</model>
Apr 14 00:10:37 user nova-compute[82479]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 00:10:37 user nova-compute[82479]:   </cpu>
Apr 14 00:10:37 user nova-compute[82479]:   <devices>
Apr 14 00:10:37 user nova-compute[82479]:     <disk type="file" device="cdrom">
Apr 14 00:10:37 user nova-compute[82479]:       <driver name="qemu" type="raw" cache="none"/>
Apr 14 00:10:37 user nova-compute[82479]:       <source file="/opt/stack/data/nova/instances/6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c/disk.config"/>
Apr 14 00:10:37 user nova-compute[82479]:       <target dev="hda" bus="ide"/>
Apr 14 00:10:37 user nova-compute[82479]:     </disk>
Apr 14 00:10:37 user nova-compute[82479]:     <disk type="block" device="disk">
Apr 14 00:10:37 user nova-compute[82479]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:10:37 user nova-compute[82479]:       <source dev="/dev/sdh"/>
Apr 14 00:10:37 user nova-compute[82479]:       <target dev="vda" bus="virtio"/>
Apr 14 00:10:37 user nova-compute[82479]:       <serial>70173bca-df37-41ee-adcb-1e0464d96d62</serial>
Apr 14 00:10:37 user nova-compute[82479]:     </disk>
Apr 14 00:10:37 user nova-compute[82479]:     <disk type="block" device="disk">
Apr 14 00:10:37 user nova-compute[82479]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:10:37 user nova-compute[82479]:       <source dev="/dev/sdi"/>
Apr 14 00:10:37 user nova-compute[82479]:       <target dev="vdb" bus="virtio"/>
Apr 14 00:10:37 user nova-compute[82479]:       <serial>94fa4f60-6d5e-4c7b-b5a6-0923600a26e0</serial>
Apr 14 00:10:37 user nova-compute[82479]:     </disk>
Apr 14 00:10:37 user nova-compute[82479]:     <disk type="block" device="disk">
Apr 14 00:10:37 user nova-compute[82479]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:10:37 user nova-compute[82479]:       <source dev="/dev/sdj"/>
Apr 14 00:10:37 user nova-compute[82479]:       <target dev="vdc" bus="virtio"/>
Apr 14 00:10:37 user nova-compute[82479]:       <serial>215fee6a-a733-4408-a162-1e700d5bf7fc</serial>
Apr 14 00:10:37 user nova-compute[82479]:     </disk>
Apr 14 00:10:37 user nova-compute[82479]:     <interface type="ethernet">
Apr 14 00:10:37 user nova-compute[82479]:       <mac address="fa:16:3e:bf:3e:c1"/>
Apr 14 00:10:37 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:10:37 user nova-compute[82479]:       <mtu size="1442"/>
Apr 14 00:10:37 user nova-compute[82479]:       <target dev="tap1c533ad9-47"/>
Apr 14 00:10:37 user nova-compute[82479]:     </interface>
Apr 14 00:10:37 user nova-compute[82479]:     <interface type="ethernet">
Apr 14 00:10:37 user nova-compute[82479]:       <mac address="fa:16:3e:93:27:43"/>
Apr 14 00:10:37 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:10:37 user nova-compute[82479]:       <mtu size="1442"/>
Apr 14 00:10:37 user nova-compute[82479]:       <target dev="tape9ec2eab-0d"/>
Apr 14 00:10:37 user nova-compute[82479]:     </interface>
Apr 14 00:10:37 user nova-compute[82479]:     <interface type="ethernet">
Apr 14 00:10:37 user nova-compute[82479]:       <mac address="fa:16:3e:bf:72:3f"/>
Apr 14 00:10:37 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:10:37 user nova-compute[82479]:       <mtu size="1442"/>
Apr 14 00:10:37 user nova-compute[82479]:       <target dev="tap127b1d7d-d9"/>
Apr 14 00:10:37 user nova-compute[82479]:     </interface>
Apr 14 00:10:37 user nova-compute[82479]:     <interface type="ethernet">
Apr 14 00:10:37 user nova-compute[82479]:       <mac address="fa:16:3e:3a:bb:81"/>
Apr 14 00:10:37 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:10:37 user nova-compute[82479]:       <mtu size="1442"/>
Apr 14 00:10:37 user nova-compute[82479]:       <target dev="tap9dedd1d2-74"/>
Apr 14 00:10:37 user nova-compute[82479]:     </interface>
Apr 14 00:10:37 user nova-compute[82479]:     <interface type="ethernet">
Apr 14 00:10:37 user nova-compute[82479]:       <mac address="fa:16:3e:ad:34:97"/>
Apr 14 00:10:37 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:10:37 user nova-compute[82479]:       <mtu size="1442"/>
Apr 14 00:10:37 user nova-compute[82479]:       <target dev="tapd3174ebb-df"/>
Apr 14 00:10:37 user nova-compute[82479]:     </interface>
Apr 14 00:10:37 user nova-compute[82479]:     <interface type="ethernet">
Apr 14 00:10:37 user nova-compute[82479]:       <mac address="fa:16:3e:fe:ff:79"/>
Apr 14 00:10:37 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:10:37 user nova-compute[82479]:       <mtu size="1442"/>
Apr 14 00:10:37 user nova-compute[82479]:       <target dev="tapdff47f62-64"/>
Apr 14 00:10:37 user nova-compute[82479]:     </interface>
Apr 14 00:10:37 user nova-compute[82479]:     <interface type="ethernet">
Apr 14 00:10:37 user nova-compute[82479]:       <mac address="fa:16:3e:c1:ce:a4"/>
Apr 14 00:10:37 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:10:37 user nova-compute[82479]:       <mtu size="1442"/>
Apr 14 00:10:37 user nova-compute[82479]:       <target dev="tap3839e2a9-bf"/>
Apr 14 00:10:37 user nova-compute[82479]:     </interface>
Apr 14 00:10:37 user nova-compute[82479]:     <serial type="pty">
Apr 14 00:10:37 user nova-compute[82479]:       <log file="/opt/stack/data/nova/instances/6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c/console.log" append="off"/>
Apr 14 00:10:37 user nova-compute[82479]:     </serial>
Apr 14 00:10:37 user nova-compute[82479]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 00:10:37 user nova-compute[82479]:     <video>
Apr 14 00:10:37 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:10:37 user nova-compute[82479]:     </video>
Apr 14 00:10:37 user nova-compute[82479]:     <rng model="virtio">
Apr 14 00:10:37 user nova-compute[82479]:       <backend model="random">/dev/urandom</backend>
Apr 14 00:10:37 user nova-compute[82479]:     </rng>
Apr 14 00:10:37 user nova-compute[82479]:     <controller type="usb" index="0" model="none"/>
Apr 14 00:10:37 user nova-compute[82479]:     <memballoon model="virtio">
Apr 14 00:10:37 user nova-compute[82479]:       <stats period="10"/>
Apr 14 00:10:37 user nova-compute[82479]:     </memballoon>
Apr 14 00:10:37 user nova-compute[82479]:   </devices>
Apr 14 00:10:37 user nova-compute[82479]: </domain>
Apr 14 00:10:37 user nova-compute[82479]:  {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T00:10:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1988157619',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1988157619',id=19,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzFzYtOkhtTfUxmZfatH6CLkRspJ29CcFKsj7Jii/QnXAw3odYM7Fg7NrRwCCXWDFq4MfAcHuoGwdJI+7pLDpdqmMb7XOB25SJmdfg0Ga4BVIZeAS8DmBQk03SznYKaXw==',key_name='tempest-keypair-84265846',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be44ce9922f14c6fa75dc0f99b544851',ramdisk_id='',reservation_id='r-evii7suo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1295697559',owner_user_name='tempest-TaggedBootDevicesTest_v242-1295697559-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:10:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85f2e1744d6c460a81c97f39a76ef5c7',uuid=6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c533ad9-47bf-4eb9-b931-d855ad4ce53e", "address": "fa:16:3e:bf:3e:c1", "network": {"id": "4368ab10-ccfd-46d6-a0eb-296895d3ba19", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1929715000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c533ad9-47", "ovs_interfaceid": "1c533ad9-47bf-4eb9-b931-d855ad4ce53e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Converting VIF {"id": "1c533ad9-47bf-4eb9-b931-d855ad4ce53e", "address": "fa:16:3e:bf:3e:c1", "network": {"id": "4368ab10-ccfd-46d6-a0eb-296895d3ba19", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1929715000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c533ad9-47", "ovs_interfaceid": "1c533ad9-47bf-4eb9-b931-d855ad4ce53e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:3e:c1,bridge_name='br-int',has_traffic_filtering=True,id=1c533ad9-47bf-4eb9-b931-d855ad4ce53e,network=Network(4368ab10-ccfd-46d6-a0eb-296895d3ba19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c533ad9-47') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG os_vif [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:3e:c1,bridge_name='br-int',has_traffic_filtering=True,id=1c533ad9-47bf-4eb9-b931-d855ad4ce53e,network=Network(4368ab10-ccfd-46d6-a0eb-296895d3ba19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c533ad9-47') {{(pid=82479) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1c533ad9-47, may_exist=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1c533ad9-47, col_values=(('external_ids', {'iface-id': '1c533ad9-47bf-4eb9-b931-d855ad4ce53e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:3e:c1', 'vm-uuid': '6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c'}),)) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:37 user nova-compute[82479]: INFO os_vif [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:3e:c1,bridge_name='br-int',has_traffic_filtering=True,id=1c533ad9-47bf-4eb9-b931-d855ad4ce53e,network=Network(4368ab10-ccfd-46d6-a0eb-296895d3ba19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c533ad9-47')
Apr 14 00:10:37 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T00:10:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1988157619',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1988157619',id=19,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzFzYtOkhtTfUxmZfatH6CLkRspJ29CcFKsj7Jii/QnXAw3odYM7Fg7NrRwCCXWDFq4MfAcHuoGwdJI+7pLDpdqmMb7XOB25SJmdfg0Ga4BVIZeAS8DmBQk03SznYKaXw==',key_name='tempest-keypair-84265846',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be44ce9922f14c6fa75dc0f99b544851',ramdisk_id='',reservation_id='r-evii7suo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1295697559',owner_user_name='tempest-TaggedBootDevicesTest_v242-1295697559-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:10:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85f2e1744d6c460a81c97f39a76ef5c7',uuid=6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9ec2eab-0d7a-4be3-acab-a27bce761738", "address": "fa:16:3e:93:27:43", "network": {"id": "0b416634-9a5d-4d0a-a891-fca1700a2d6b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1990875628", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9ec2eab-0d", "ovs_interfaceid": "e9ec2eab-0d7a-4be3-acab-a27bce761738", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82479) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Converting VIF {"id": "e9ec2eab-0d7a-4be3-acab-a27bce761738", "address": "fa:16:3e:93:27:43", "network": {"id": "0b416634-9a5d-4d0a-a891-fca1700a2d6b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1990875628", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9ec2eab-0d", "ovs_interfaceid": "e9ec2eab-0d7a-4be3-acab-a27bce761738", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:27:43,bridge_name='br-int',has_traffic_filtering=True,id=e9ec2eab-0d7a-4be3-acab-a27bce761738,network=Network(0b416634-9a5d-4d0a-a891-fca1700a2d6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape9ec2eab-0d') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG os_vif [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:27:43,bridge_name='br-int',has_traffic_filtering=True,id=e9ec2eab-0d7a-4be3-acab-a27bce761738,network=Network(0b416634-9a5d-4d0a-a891-fca1700a2d6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape9ec2eab-0d') {{(pid=82479) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2b62e8d46ab06db23c4b2d8ac0ee1f254fec5cba.part /opt/stack/data/nova/instances/_base/2b62e8d46ab06db23c4b2d8ac0ee1f254fec5cba.converted" returned: 0 in 0.151s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b62e8d46ab06db23c4b2d8ac0ee1f254fec5cba.converted --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape9ec2eab-0d, may_exist=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape9ec2eab-0d, col_values=(('external_ids', {'iface-id': 'e9ec2eab-0d7a-4be3-acab-a27bce761738', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:93:27:43', 'vm-uuid': '6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c'}),)) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:37 user nova-compute[82479]: INFO os_vif [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:27:43,bridge_name='br-int',has_traffic_filtering=True,id=e9ec2eab-0d7a-4be3-acab-a27bce761738,network=Network(0b416634-9a5d-4d0a-a891-fca1700a2d6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape9ec2eab-0d')
Apr 14 00:10:37 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T00:10:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1988157619',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1988157619',id=19,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzFzYtOkhtTfUxmZfatH6CLkRspJ29CcFKsj7Jii/QnXAw3odYM7Fg7NrRwCCXWDFq4MfAcHuoGwdJI+7pLDpdqmMb7XOB25SJmdfg0Ga4BVIZeAS8DmBQk03SznYKaXw==',key_name='tempest-keypair-84265846',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be44ce9922f14c6fa75dc0f99b544851',ramdisk_id='',reservation_id='r-evii7suo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1295697559',owner_user_name='tempest-TaggedBootDevicesTest_v242-1295697559-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:10:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85f2e1744d6c460a81c97f39a76ef5c7',uuid=6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "127b1d7d-d92a-4e24-9470-1758579376bf", "address": "fa:16:3e:bf:72:3f", "network": {"id": "0b416634-9a5d-4d0a-a891-fca1700a2d6b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1990875628", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127b1d7d-d9", "ovs_interfaceid": "127b1d7d-d92a-4e24-9470-1758579376bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82479) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Converting VIF {"id": "127b1d7d-d92a-4e24-9470-1758579376bf", "address": "fa:16:3e:bf:72:3f", "network": {"id": "0b416634-9a5d-4d0a-a891-fca1700a2d6b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1990875628", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127b1d7d-d9", "ovs_interfaceid": "127b1d7d-d92a-4e24-9470-1758579376bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:72:3f,bridge_name='br-int',has_traffic_filtering=True,id=127b1d7d-d92a-4e24-9470-1758579376bf,network=Network(0b416634-9a5d-4d0a-a891-fca1700a2d6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap127b1d7d-d9') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG os_vif [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:72:3f,bridge_name='br-int',has_traffic_filtering=True,id=127b1d7d-d92a-4e24-9470-1758579376bf,network=Network(0b416634-9a5d-4d0a-a891-fca1700a2d6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap127b1d7d-d9') {{(pid=82479) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap127b1d7d-d9, may_exist=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap127b1d7d-d9, col_values=(('external_ids', {'iface-id': '127b1d7d-d92a-4e24-9470-1758579376bf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:72:3f', 'vm-uuid': '6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c'}),)) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:37 user nova-compute[82479]: INFO os_vif [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:72:3f,bridge_name='br-int',has_traffic_filtering=True,id=127b1d7d-d92a-4e24-9470-1758579376bf,network=Network(0b416634-9a5d-4d0a-a891-fca1700a2d6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap127b1d7d-d9')
Apr 14 00:10:37 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T00:10:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1988157619',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1988157619',id=19,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzFzYtOkhtTfUxmZfatH6CLkRspJ29CcFKsj7Jii/QnXAw3odYM7Fg7NrRwCCXWDFq4MfAcHuoGwdJI+7pLDpdqmMb7XOB25SJmdfg0Ga4BVIZeAS8DmBQk03SznYKaXw==',key_name='tempest-keypair-84265846',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be44ce9922f14c6fa75dc0f99b544851',ramdisk_id='',reservation_id='r-evii7suo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1295697559',owner_user_name='tempest-TaggedBootDevicesTest_v242-1295697559-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:10:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85f2e1744d6c460a81c97f39a76ef5c7',uuid=6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9dedd1d2-74e4-4aae-8114-9ecd78686a4d", "address": "fa:16:3e:3a:bb:81", "network": {"id": "0b416634-9a5d-4d0a-a891-fca1700a2d6b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1990875628", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dedd1d2-74", "ovs_interfaceid": "9dedd1d2-74e4-4aae-8114-9ecd78686a4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Converting VIF {"id": "9dedd1d2-74e4-4aae-8114-9ecd78686a4d", "address": "fa:16:3e:3a:bb:81", "network": {"id": "0b416634-9a5d-4d0a-a891-fca1700a2d6b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1990875628", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dedd1d2-74", "ovs_interfaceid": "9dedd1d2-74e4-4aae-8114-9ecd78686a4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:bb:81,bridge_name='br-int',has_traffic_filtering=True,id=9dedd1d2-74e4-4aae-8114-9ecd78686a4d,network=Network(0b416634-9a5d-4d0a-a891-fca1700a2d6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dedd1d2-74') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG os_vif [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:bb:81,bridge_name='br-int',has_traffic_filtering=True,id=9dedd1d2-74e4-4aae-8114-9ecd78686a4d,network=Network(0b416634-9a5d-4d0a-a891-fca1700a2d6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dedd1d2-74') {{(pid=82479) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9dedd1d2-74, may_exist=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9dedd1d2-74, col_values=(('external_ids', {'iface-id': '9dedd1d2-74e4-4aae-8114-9ecd78686a4d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:bb:81', 'vm-uuid': '6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c'}),)) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b62e8d46ab06db23c4b2d8ac0ee1f254fec5cba.converted --force-share --output=json" returned: 0 in 0.142s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "2b62e8d46ab06db23c4b2d8ac0ee1f254fec5cba" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.353s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "2b62e8d46ab06db23c4b2d8ac0ee1f254fec5cba" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "2b62e8d46ab06db23c4b2d8ac0ee1f254fec5cba" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b62e8d46ab06db23c4b2d8ac0ee1f254fec5cba --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:10:37 user nova-compute[82479]: INFO os_vif [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:bb:81,bridge_name='br-int',has_traffic_filtering=True,id=9dedd1d2-74e4-4aae-8114-9ecd78686a4d,network=Network(0b416634-9a5d-4d0a-a891-fca1700a2d6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dedd1d2-74')
Apr 14 00:10:37 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T00:10:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1988157619',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1988157619',id=19,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzFzYtOkhtTfUxmZfatH6CLkRspJ29CcFKsj7Jii/QnXAw3odYM7Fg7NrRwCCXWDFq4MfAcHuoGwdJI+7pLDpdqmMb7XOB25SJmdfg0Ga4BVIZeAS8DmBQk03SznYKaXw==',key_name='tempest-keypair-84265846',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be44ce9922f14c6fa75dc0f99b544851',ramdisk_id='',reservation_id='r-evii7suo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1295697559',owner_user_name='tempest-TaggedBootDevicesTest_v242-1295697559-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:10:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85f2e1744d6c460a81c97f39a76ef5c7',uuid=6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3174ebb-df19-4943-98c4-89c97607f42b", "address": "fa:16:3e:ad:34:97", "network": {"id": "0b416634-9a5d-4d0a-a891-fca1700a2d6b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1990875628", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3174ebb-df", "ovs_interfaceid": "d3174ebb-df19-4943-98c4-89c97607f42b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Converting VIF {"id": "d3174ebb-df19-4943-98c4-89c97607f42b", "address": "fa:16:3e:ad:34:97", "network": {"id": "0b416634-9a5d-4d0a-a891-fca1700a2d6b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1990875628", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3174ebb-df", "ovs_interfaceid": "d3174ebb-df19-4943-98c4-89c97607f42b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:34:97,bridge_name='br-int',has_traffic_filtering=True,id=d3174ebb-df19-4943-98c4-89c97607f42b,network=Network(0b416634-9a5d-4d0a-a891-fca1700a2d6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3174ebb-df') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG os_vif [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:34:97,bridge_name='br-int',has_traffic_filtering=True,id=d3174ebb-df19-4943-98c4-89c97607f42b,network=Network(0b416634-9a5d-4d0a-a891-fca1700a2d6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3174ebb-df') {{(pid=82479) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd3174ebb-df, may_exist=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd3174ebb-df, col_values=(('external_ids', {'iface-id': 'd3174ebb-df19-4943-98c4-89c97607f42b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:34:97', 'vm-uuid': '6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c'}),)) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG nova.compute.manager [req-400fd6d0-e77c-41ea-a4ac-4853ca80fda0 req-7deafddb-1717-457d-ad08-d57def77b9d7 service nova] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Received event network-vif-plugged-102987de-d5e4-4ccd-b4fd-7ca7c131e379 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-400fd6d0-e77c-41ea-a4ac-4853ca80fda0 req-7deafddb-1717-457d-ad08-d57def77b9d7 service nova] Acquiring lock "17c6c147-fb62-4204-a416-792b94d3f7dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-400fd6d0-e77c-41ea-a4ac-4853ca80fda0 req-7deafddb-1717-457d-ad08-d57def77b9d7 service nova] Lock "17c6c147-fb62-4204-a416-792b94d3f7dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-400fd6d0-e77c-41ea-a4ac-4853ca80fda0 req-7deafddb-1717-457d-ad08-d57def77b9d7 service nova] Lock "17c6c147-fb62-4204-a416-792b94d3f7dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG nova.compute.manager [req-400fd6d0-e77c-41ea-a4ac-4853ca80fda0 req-7deafddb-1717-457d-ad08-d57def77b9d7 service nova] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] No waiting events found dispatching network-vif-plugged-102987de-d5e4-4ccd-b4fd-7ca7c131e379 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:10:37 user nova-compute[82479]: WARNING nova.compute.manager [req-400fd6d0-e77c-41ea-a4ac-4853ca80fda0 req-7deafddb-1717-457d-ad08-d57def77b9d7 service nova] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Received unexpected event network-vif-plugged-102987de-d5e4-4ccd-b4fd-7ca7c131e379 for instance with vm_state active and task_state rescuing.
Apr 14 00:10:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:37 user nova-compute[82479]: INFO os_vif [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:34:97,bridge_name='br-int',has_traffic_filtering=True,id=d3174ebb-df19-4943-98c4-89c97607f42b,network=Network(0b416634-9a5d-4d0a-a891-fca1700a2d6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3174ebb-df')
Apr 14 00:10:37 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T00:10:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1988157619',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1988157619',id=19,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzFzYtOkhtTfUxmZfatH6CLkRspJ29CcFKsj7Jii/QnXAw3odYM7Fg7NrRwCCXWDFq4MfAcHuoGwdJI+7pLDpdqmMb7XOB25SJmdfg0Ga4BVIZeAS8DmBQk03SznYKaXw==',key_name='tempest-keypair-84265846',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be44ce9922f14c6fa75dc0f99b544851',ramdisk_id='',reservation_id='r-evii7suo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1295697559',owner_user_name='tempest-TaggedBootDevicesTest_v242-1295697559-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:10:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85f2e1744d6c460a81c97f39a76ef5c7',uuid=6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dff47f62-64b6-4ee5-b163-c74fc50ce6c9", "address": "fa:16:3e:fe:ff:79", "network": {"id": "700ca002-00ac-4a55-b2a5-f31c7ca9bcfa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1927044898", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff47f62-64", "ovs_interfaceid": "dff47f62-64b6-4ee5-b163-c74fc50ce6c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Converting VIF {"id": "dff47f62-64b6-4ee5-b163-c74fc50ce6c9", "address": "fa:16:3e:fe:ff:79", "network": {"id": "700ca002-00ac-4a55-b2a5-f31c7ca9bcfa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1927044898", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff47f62-64", "ovs_interfaceid": "dff47f62-64b6-4ee5-b163-c74fc50ce6c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:ff:79,bridge_name='br-int',has_traffic_filtering=True,id=dff47f62-64b6-4ee5-b163-c74fc50ce6c9,network=Network(700ca002-00ac-4a55-b2a5-f31c7ca9bcfa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdff47f62-64') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG os_vif [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:ff:79,bridge_name='br-int',has_traffic_filtering=True,id=dff47f62-64b6-4ee5-b163-c74fc50ce6c9,network=Network(700ca002-00ac-4a55-b2a5-f31c7ca9bcfa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdff47f62-64') {{(pid=82479) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdff47f62-64, may_exist=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdff47f62-64, col_values=(('external_ids', {'iface-id': 'dff47f62-64b6-4ee5-b163-c74fc50ce6c9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:ff:79', 'vm-uuid': '6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c'}),)) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2b62e8d46ab06db23c4b2d8ac0ee1f254fec5cba --force-share --output=json" returned: 0 in 0.144s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2b62e8d46ab06db23c4b2d8ac0ee1f254fec5cba,backing_fmt=raw /opt/stack/data/nova/instances/17c6c147-fb62-4204-a416-792b94d3f7dd/disk.rescue {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:37 user nova-compute[82479]: INFO os_vif [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:ff:79,bridge_name='br-int',has_traffic_filtering=True,id=dff47f62-64b6-4ee5-b163-c74fc50ce6c9,network=Network(700ca002-00ac-4a55-b2a5-f31c7ca9bcfa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdff47f62-64')
Apr 14 00:10:37 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T00:10:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1988157619',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1988157619',id=19,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzFzYtOkhtTfUxmZfatH6CLkRspJ29CcFKsj7Jii/QnXAw3odYM7Fg7NrRwCCXWDFq4MfAcHuoGwdJI+7pLDpdqmMb7XOB25SJmdfg0Ga4BVIZeAS8DmBQk03SznYKaXw==',key_name='tempest-keypair-84265846',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be44ce9922f14c6fa75dc0f99b544851',ramdisk_id='',reservation_id='r-evii7suo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1295697559',owner_user_name='tempest-TaggedBootDevicesTest_v242-1295697559-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:10:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85f2e1744d6c460a81c97f39a76ef5c7',uuid=6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3839e2a9-bfeb-4103-9d7c-bcf45f9eaf14", "address": "fa:16:3e:c1:ce:a4", "network": {"id": "700ca002-00ac-4a55-b2a5-f31c7ca9bcfa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1927044898", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3839e2a9-bf", "ovs_interfaceid": "3839e2a9-bfeb-4103-9d7c-bcf45f9eaf14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Converting VIF {"id": "3839e2a9-bfeb-4103-9d7c-bcf45f9eaf14", "address": "fa:16:3e:c1:ce:a4", "network": {"id": "700ca002-00ac-4a55-b2a5-f31c7ca9bcfa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1927044898", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3839e2a9-bf", "ovs_interfaceid": "3839e2a9-bfeb-4103-9d7c-bcf45f9eaf14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:ce:a4,bridge_name='br-int',has_traffic_filtering=True,id=3839e2a9-bfeb-4103-9d7c-bcf45f9eaf14,network=Network(700ca002-00ac-4a55-b2a5-f31c7ca9bcfa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3839e2a9-bf') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG os_vif [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:ce:a4,bridge_name='br-int',has_traffic_filtering=True,id=3839e2a9-bfeb-4103-9d7c-bcf45f9eaf14,network=Network(700ca002-00ac-4a55-b2a5-f31c7ca9bcfa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3839e2a9-bf') {{(pid=82479) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2b62e8d46ab06db23c4b2d8ac0ee1f254fec5cba,backing_fmt=raw /opt/stack/data/nova/instances/17c6c147-fb62-4204-a416-792b94d3f7dd/disk.rescue" returned: 0 in 0.057s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "2b62e8d46ab06db23c4b2d8ac0ee1f254fec5cba" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.203s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG nova.objects.instance [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lazy-loading 'migration_context' on Instance uuid 17c6c147-fb62-4204-a416-792b94d3f7dd {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3839e2a9-bf, may_exist=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3839e2a9-bf, col_values=(('external_ids', {'iface-id': '3839e2a9-bfeb-4103-9d7c-bcf45f9eaf14', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:ce:a4', 'vm-uuid': '6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c'}),)) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Created local disks {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Start _get_guest_xml network_info=[{"id": "102987de-d5e4-4ccd-b4fd-7ca7c131e379", "address": "fa:16:3e:23:dd:a5", "network": {"id": "491696ea-38ef-4c19-9d94-a61223c1fa00", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1323121698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1323121698-network", "vif_mac": "fa:16:3e:23:dd:a5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3f111e24414976beddba7ef90c4793", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap102987de-d5", "ovs_interfaceid": "102987de-d5e4-4ccd-b4fd-7ca7c131e379", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'abb285f7-c82d-4a2c-be02-c183ea364f79', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': False, 'attachment_id': 'c83af900-31a1-488d-a8b4-ff896990a329', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DXAVYghe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '17c6c147-fb62-4204-a416-792b94d3f7dd', 'attached_at': '', 'detached_at': '', 'volume_id': 'c3cfdf84-a3e1-41e3-85ec-481f5ba478cc', 'serial': 'c3cfdf84-a3e1-41e3-85ec-481f5ba478cc'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG nova.objects.instance [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lazy-loading 'resources' on Instance uuid 17c6c147-fb62-4204-a416-792b94d3f7dd {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG nova.objects.instance [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lazy-loading 'numa_topology' on Instance uuid 17c6c147-fb62-4204-a416-792b94d3f7dd {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:10:37 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:10:37 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:10:37 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82479) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T00:02:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Flavor limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Image limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Flavor pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Image pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Got 1 possible topologies {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG nova.objects.instance [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lazy-loading 'vcpu_model' on Instance uuid 17c6c147-fb62-4204-a416-792b94d3f7dd {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:37 user nova-compute[82479]: INFO os_vif [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:ce:a4,bridge_name='br-int',has_traffic_filtering=True,id=3839e2a9-bfeb-4103-9d7c-bcf45f9eaf14,network=Network(700ca002-00ac-4a55-b2a5-f31c7ca9bcfa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3839e2a9-bf')
Apr 14 00:10:37 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Calling os-brick to attach iSCSI Volume {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DXAVYghe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:10:37 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:10:37 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:10:37 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:10:37 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:10:37 user nova-compute[82479]: INFO os_brick.initiator.connectors.iscsi [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 00:10:37 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc -p 172.16.0.220:3260 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a24a3a-564c-4b4a-964a-d5b9db45dc27]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = DXAVYghe\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 14 00:10:37 user nova-compute[82479]: node.name = iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc
Apr 14 00:10:37 user nova-compute[82479]: node.tpgt = -1
Apr 14 00:10:37 user nova-compute[82479]: node.startup = automatic
Apr 14 00:10:37 user nova-compute[82479]: node.leading_login = No
Apr 14 00:10:37 user nova-compute[82479]: iface.iscsi_ifacename = default
Apr 14 00:10:37 user nova-compute[82479]: iface.net_ifacename = <empty>
Apr 14 00:10:37 user nova-compute[82479]: iface.ipaddress = <empty>
Apr 14 00:10:37 user nova-compute[82479]: iface.prefix_len = 0
Apr 14 00:10:37 user nova-compute[82479]: iface.hwaddress = <empty>
Apr 14 00:10:37 user nova-compute[82479]: iface.transport_name = tcp
Apr 14 00:10:37 user nova-compute[82479]: iface.initiatorname = <empty>
Apr 14 00:10:37 user nova-compute[82479]: iface.state = <empty>
Apr 14 00:10:37 user nova-compute[82479]: iface.vlan_id = 0
Apr 14 00:10:37 user nova-compute[82479]: iface.vlan_priority = 0
Apr 14 00:10:37 user nova-compute[82479]: iface.vlan_state = <empty>
Apr 14 00:10:37 user nova-compute[82479]: iface.iface_num = 0
Apr 14 00:10:37 user nova-compute[82479]: iface.mtu = 0
Apr 14 00:10:37 user nova-compute[82479]: iface.port = 0
Apr 14 00:10:37 user nova-compute[82479]: iface.bootproto = <empty>
Apr 14 00:10:37 user nova-compute[82479]: iface.subnet_mask = <empty>
Apr 14 00:10:37 user nova-compute[82479]: iface.gateway = <empty>
Apr 14 00:10:37 user nova-compute[82479]: iface.dhcp_alt_client_id_state = <empty>
Apr 14 00:10:37 user nova-compute[82479]: iface.dhcp_alt_client_id = <empty>
Apr 14 00:10:37 user nova-compute[82479]: iface.dhcp_dns = <empty>
Apr 14 00:10:37 user nova-compute[82479]: iface.dhcp_learn_iqn = <empty>
Apr 14 00:10:37 user nova-compute[82479]: iface.dhcp_req_vendor_id_state = <empty>
Apr 14 00:10:37 user nova-compute[82479]: iface.dhcp_vendor_id_state = <empty>
Apr 14 00:10:37 user nova-compute[82479]: iface.dhcp_vendor_id = <empty>
Apr 14 00:10:37 user nova-compute[82479]: iface.dhcp_slp_da = <empty>
Apr 14 00:10:37 user nova-compute[82479]: iface.fragmentation = <empty>
Apr 14 00:10:37 user nova-compute[82479]: iface.gratuitous_arp = <empty>
Apr 14 00:10:37 user nova-compute[82479]: iface.incoming_forwarding = <empty>
Apr 14 00:10:37 user nova-compute[82479]: iface.tos_state = <empty>
Apr 14 00:10:37 user nova-compute[82479]: iface.tos = 0
Apr 14 00:10:37 user nova-compute[82479]: iface.ttl = 0
Apr 14 00:10:37 user nova-compute[82479]: iface.delayed_ack = <empty>
Apr 14 00:10:37 user nova-compute[82479]: iface.tcp_nagle = <empty>
Apr 14 00:10:37 user nova-compute[82479]: iface.tcp_wsf_state = <empty>
Apr 14 00:10:37 user nova-compute[82479]: iface.tcp_wsf = 0
Apr 14 00:10:37 user nova-compute[82479]: iface.tcp_timer_scale = 0
Apr 14 00:10:37 user nova-compute[82479]: iface.tcp_timestamp = <empty>
Apr 14 00:10:37 user nova-compute[82479]: iface.redirect = <empty>
Apr 14 00:10:37 user nova-compute[82479]: iface.def_task_mgmt_timeout = 0
Apr 14 00:10:37 user nova-compute[82479]: iface.header_digest = <empty>
Apr 14 00:10:37 user nova-compute[82479]: iface.data_digest = <empty>
Apr 14 00:10:37 user nova-compute[82479]: iface.immediate_data = <empty>
Apr 14 00:10:37 user nova-compute[82479]: iface.initial_r2t = <empty>
Apr 14 00:10:37 user nova-compute[82479]: iface.data_seq_inorder = <empty>
Apr 14 00:10:37 user nova-compute[82479]: iface.data_pdu_inorder = <empty>
Apr 14 00:10:37 user nova-compute[82479]: iface.erl = 0
Apr 14 00:10:37 user nova-compute[82479]: iface.max_receive_data_len = 0
Apr 14 00:10:37 user nova-compute[82479]: iface.first_burst_len = 0
Apr 14 00:10:37 user nova-compute[82479]: iface.max_outstanding_r2t = 0
Apr 14 00:10:37 user nova-compute[82479]: iface.max_burst_len = 0
Apr 14 00:10:37 user nova-compute[82479]: iface.chap_auth = <empty>
Apr 14 00:10:37 user nova-compute[82479]: iface.bidi_chap = <empty>
Apr 14 00:10:37 user nova-compute[82479]: iface.strict_login_compliance = <empty>
Apr 14 00:10:37 user nova-compute[82479]: iface.discovery_auth = <empty>
Apr 14 00:10:37 user nova-compute[82479]: iface.discovery_logout = <empty>
Apr 14 00:10:37 user nova-compute[82479]: node.discovery_address = <empty>
Apr 14 00:10:37 user nova-compute[82479]: node.discovery_port = 0
Apr 14 00:10:37 user nova-compute[82479]: node.discovery_type = static
Apr 14 00:10:37 user nova-compute[82479]: node.session.initial_cmdsn = 0
Apr 14 00:10:37 user nova-compute[82479]: node.session.initial_login_retry_max = 8
Apr 14 00:10:37 user nova-compute[82479]: node.session.xmit_thread_priority = -20
Apr 14 00:10:37 user nova-compute[82479]: node.session.cmds_max = 128
Apr 14 00:10:37 user nova-compute[82479]: node.session.queue_depth = 32
Apr 14 00:10:37 user nova-compute[82479]: node.session.nr_sessions = 1
Apr 14 00:10:37 user nova-compute[82479]: node.session.auth.authmethod = CHAP
Apr 14 00:10:37 user nova-compute[82479]: node.session.auth.username = DXAVYghe
Apr 14 00:10:37 user nova-compute[82479]: node.session.auth.password = ***
Apr 14 00:10:37 user nova-compute[82479]: node.session.auth.username_in = <empty>
Apr 14 00:10:37 user nova-compute[82479]: node.session.auth.password_in = <empty>
Apr 14 00:10:37 user nova-compute[82479]: node.session.auth.chap_algs = MD5
Apr 14 00:10:37 user nova-compute[82479]: node.session.timeo.replacement_timeout = 120
Apr 14 00:10:37 user nova-compute[82479]: node.session.err_timeo.abort_timeout = 15
Apr 14 00:10:37 user nova-compute[82479]: node.session.err_timeo.lu_reset_timeout = 30
Apr 14 00:10:37 user nova-compute[82479]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 14 00:10:37 user nova-compute[82479]: node.session.err_timeo.host_reset_timeout = 60
Apr 14 00:10:37 user nova-compute[82479]: node.session.iscsi.FastAbort = Yes
Apr 14 00:10:37 user nova-compute[82479]: node.session.iscsi.InitialR2T = No
Apr 14 00:10:37 user nova-compute[82479]: node.session.iscsi.ImmediateData = Yes
Apr 14 00:10:37 user nova-compute[82479]: node.session.iscsi.FirstBurstLength = 262144
Apr 14 00:10:37 user nova-compute[82479]: node.session.iscsi.MaxBurstLength = 16776192
Apr 14 00:10:37 user nova-compute[82479]: node.session.iscsi.DefaultTime2Retain = 0
Apr 14 00:10:37 user nova-compute[82479]: node.session.iscsi.DefaultTime2Wait = 2
Apr 14 00:10:37 user nova-compute[82479]: node.session.iscsi.MaxConnections = 1
Apr 14 00:10:37 user nova-compute[82479]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 14 00:10:37 user nova-compute[82479]: node.session.iscsi.ERL = 0
Apr 14 00:10:37 user nova-compute[82479]: node.session.scan = manual
Apr 14 00:10:37 user nova-compute[82479]: node.session.reopen_max = 0
Apr 14 00:10:37 user nova-compute[82479]: node.conn[0].address = 172.16.0.220
Apr 14 00:10:37 user nova-compute[82479]: node.conn[0].port = 3260
Apr 14 00:10:37 user nova-compute[82479]: node.conn[0].startup = manual
Apr 14 00:10:37 user nova-compute[82479]: node.conn[0].tcp.window_size = 524288
Apr 14 00:10:37 user nova-compute[82479]: node.conn[0].tcp.type_of_service = 0
Apr 14 00:10:37 user nova-compute[82479]: node.conn[0].timeo.logout_timeout = 15
Apr 14 00:10:37 user nova-compute[82479]: node.conn[0].timeo.login_timeout = 15
Apr 14 00:10:37 user nova-compute[82479]: node.conn[0].timeo.auth_timeout = 45
Apr 14 00:10:37 user nova-compute[82479]: node.conn[0].timeo.noop_out_interval = 5
Apr 14 00:10:37 user nova-compute[82479]: node.conn[0].timeo.noop_out_timeout = 5
Apr 14 00:10:37 user nova-compute[82479]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 14 00:10:37 user nova-compute[82479]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 14 00:10:37 user nova-compute[82479]: node.conn[0].iscsi.HeaderDigest = None
Apr 14 00:10:37 user nova-compute[82479]: node.conn[0].iscsi.DataDigest = None
Apr 14 00:10:37 user nova-compute[82479]: node.conn[0].iscsi.IFMarker = No
Apr 14 00:10:37 user nova-compute[82479]: node.conn[0].iscsi.OFMarker = No
Apr 14 00:10:37 user nova-compute[82479]: # END RECORD
Apr 14 00:10:37 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7947a06-7c4b-4e29-abab-1a5884b65e6a]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] No BDM found with device name hda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] No BDM found with device name vdc, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] No VIF found with MAC fa:16:3e:bf:3e:c1, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] No VIF found with MAC fa:16:3e:ad:34:97, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:10:37 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Using config drive
Apr 14 00:10:37 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[937fa73a-7436-48ba-85b3-7071e906fa46]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DXAVYghe {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DXAVYghe" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7b6daf-e124-43ff-a6b3-5afaca69ffaf]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DXAVYghe'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e696c6-a41f-4e13-9bb3-89a2920e740c]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ba6dfc-be1d-46fc-9f38-3098dd1da5e4]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)
Apr 14 00:10:37 user nova-compute[82479]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:10:37 user nova-compute[82479]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:10:37 user nova-compute[82479]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 (non-flash)
Apr 14 00:10:37 user nova-compute[82479]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d (non-flash)
Apr 14 00:10:37 user nova-compute[82479]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 (non-flash)
Apr 14 00:10:37 user nova-compute[82479]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 (non-flash)
Apr 14 00:10:37 user nova-compute[82479]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 (non-flash)
Apr 14 00:10:37 user nova-compute[82479]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc (non-flash)
Apr 14 00:10:37 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)
Apr 14 00:10:37 user nova-compute[82479]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:10:37 user nova-compute[82479]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:10:37 user nova-compute[82479]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 (non-flash)
Apr 14 00:10:37 user nova-compute[82479]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d (non-flash)
Apr 14 00:10:37 user nova-compute[82479]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 (non-flash)
Apr 14 00:10:37 user nova-compute[82479]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 (non-flash)
Apr 14 00:10:37 user nova-compute[82479]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 (non-flash)
Apr 14 00:10:37 user nova-compute[82479]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc (non-flash)
Apr 14 00:10:37 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.176s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Connected to 172.16.0.220:3260 {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] HCTL ('34', '0', '0', 0) found on session 12 with lun 0 {{(pid=82479) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=82479) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.013s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[11532a5b-7340-4704-8c38-d422bc0c8d16]: (4, ('0 0 0', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Searching for a device in session 12 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=82479) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DXAVYghe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.201s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] <== connect_volume: return (202ms) {'type': 'block', 'scsi_wwn': '23630323661303463', 'path': '/dev/sdc'} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630323661303463', 'path': '/dev/sdc'} {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:08:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1240439258',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1240439258',id=13,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:09:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ba3f111e24414976beddba7ef90c4793',ramdisk_id='',reservation_id='r-uxopaibn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1545234843',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:09:03Z,user_data=None,user_id='90bad96535c3453792982c5acab9dbc6',uuid=17c6c147-fb62-4204-a416-792b94d3f7dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "102987de-d5e4-4ccd-b4fd-7ca7c131e379", "address": "fa:16:3e:23:dd:a5", "network": {"id": "491696ea-38ef-4c19-9d94-a61223c1fa00", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1323121698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1323121698-network", "vif_mac": "fa:16:3e:23:dd:a5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3f111e24414976beddba7ef90c4793", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap102987de-d5", "ovs_interfaceid": "102987de-d5e4-4ccd-b4fd-7ca7c131e379", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82479) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Converting VIF {"id": "102987de-d5e4-4ccd-b4fd-7ca7c131e379", "address": "fa:16:3e:23:dd:a5", "network": {"id": "491696ea-38ef-4c19-9d94-a61223c1fa00", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1323121698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1323121698-network", "vif_mac": "fa:16:3e:23:dd:a5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3f111e24414976beddba7ef90c4793", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap102987de-d5", "ovs_interfaceid": "102987de-d5e4-4ccd-b4fd-7ca7c131e379", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:dd:a5,bridge_name='br-int',has_traffic_filtering=True,id=102987de-d5e4-4ccd-b4fd-7ca7c131e379,network=Network(491696ea-38ef-4c19-9d94-a61223c1fa00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap102987de-d5') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG nova.objects.instance [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lazy-loading 'pci_devices' on Instance uuid 17c6c147-fb62-4204-a416-792b94d3f7dd {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:10:37 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Creating config drive at /opt/stack/data/nova/instances/6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c/disk.config
Apr 14 00:10:37 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpv3e7veqy {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] End _get_guest_xml xml=<domain type="kvm">
Apr 14 00:10:37 user nova-compute[82479]:   <uuid>17c6c147-fb62-4204-a416-792b94d3f7dd</uuid>
Apr 14 00:10:37 user nova-compute[82479]:   <name>instance-0000000d</name>
Apr 14 00:10:37 user nova-compute[82479]:   <memory>131072</memory>
Apr 14 00:10:37 user nova-compute[82479]:   <vcpu>1</vcpu>
Apr 14 00:10:37 user nova-compute[82479]:   <metadata>
Apr 14 00:10:37 user nova-compute[82479]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 00:10:37 user nova-compute[82479]:       <nova:package version="0.0.0"/>
Apr 14 00:10:37 user nova-compute[82479]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1240439258</nova:name>
Apr 14 00:10:37 user nova-compute[82479]:       <nova:creationTime>2023-04-14 00:10:37</nova:creationTime>
Apr 14 00:10:37 user nova-compute[82479]:       <nova:flavor name="m1.nano">
Apr 14 00:10:37 user nova-compute[82479]:         <nova:memory>128</nova:memory>
Apr 14 00:10:37 user nova-compute[82479]:         <nova:disk>1</nova:disk>
Apr 14 00:10:37 user nova-compute[82479]:         <nova:swap>0</nova:swap>
Apr 14 00:10:37 user nova-compute[82479]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 00:10:37 user nova-compute[82479]:         <nova:vcpus>1</nova:vcpus>
Apr 14 00:10:37 user nova-compute[82479]:       </nova:flavor>
Apr 14 00:10:37 user nova-compute[82479]:       <nova:owner>
Apr 14 00:10:37 user nova-compute[82479]:         <nova:user uuid="90bad96535c3453792982c5acab9dbc6">tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member</nova:user>
Apr 14 00:10:37 user nova-compute[82479]:         <nova:project uuid="ba3f111e24414976beddba7ef90c4793">tempest-ServerBootFromVolumeStableRescueTest-1545234843</nova:project>
Apr 14 00:10:37 user nova-compute[82479]:       </nova:owner>
Apr 14 00:10:37 user nova-compute[82479]:       <nova:root type="image" uuid="6db62068-7278-4cd8-b41f-d0140d89e199"/>
Apr 14 00:10:37 user nova-compute[82479]:       <nova:ports>
Apr 14 00:10:37 user nova-compute[82479]:         <nova:port uuid="102987de-d5e4-4ccd-b4fd-7ca7c131e379">
Apr 14 00:10:37 user nova-compute[82479]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 14 00:10:37 user nova-compute[82479]:         </nova:port>
Apr 14 00:10:37 user nova-compute[82479]:       </nova:ports>
Apr 14 00:10:37 user nova-compute[82479]:     </nova:instance>
Apr 14 00:10:37 user nova-compute[82479]:   </metadata>
Apr 14 00:10:37 user nova-compute[82479]:   <sysinfo type="smbios">
Apr 14 00:10:37 user nova-compute[82479]:     <system>
Apr 14 00:10:37 user nova-compute[82479]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 00:10:37 user nova-compute[82479]:       <entry name="product">OpenStack Nova</entry>
Apr 14 00:10:37 user nova-compute[82479]:       <entry name="version">0.0.0</entry>
Apr 14 00:10:37 user nova-compute[82479]:       <entry name="serial">17c6c147-fb62-4204-a416-792b94d3f7dd</entry>
Apr 14 00:10:37 user nova-compute[82479]:       <entry name="uuid">17c6c147-fb62-4204-a416-792b94d3f7dd</entry>
Apr 14 00:10:37 user nova-compute[82479]:       <entry name="family">Virtual Machine</entry>
Apr 14 00:10:37 user nova-compute[82479]:     </system>
Apr 14 00:10:37 user nova-compute[82479]:   </sysinfo>
Apr 14 00:10:37 user nova-compute[82479]:   <os>
Apr 14 00:10:37 user nova-compute[82479]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 00:10:37 user nova-compute[82479]:     <smbios mode="sysinfo"/>
Apr 14 00:10:37 user nova-compute[82479]:   </os>
Apr 14 00:10:37 user nova-compute[82479]:   <features>
Apr 14 00:10:37 user nova-compute[82479]:     <acpi/>
Apr 14 00:10:37 user nova-compute[82479]:     <apic/>
Apr 14 00:10:37 user nova-compute[82479]:     <vmcoreinfo/>
Apr 14 00:10:37 user nova-compute[82479]:   </features>
Apr 14 00:10:37 user nova-compute[82479]:   <clock offset="utc">
Apr 14 00:10:37 user nova-compute[82479]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 00:10:37 user nova-compute[82479]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 00:10:37 user nova-compute[82479]:     <timer name="hpet" present="no"/>
Apr 14 00:10:37 user nova-compute[82479]:   </clock>
Apr 14 00:10:37 user nova-compute[82479]:   <cpu mode="custom" match="exact">
Apr 14 00:10:37 user nova-compute[82479]:     <model>Nehalem</model>
Apr 14 00:10:37 user nova-compute[82479]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 00:10:37 user nova-compute[82479]:   </cpu>
Apr 14 00:10:37 user nova-compute[82479]:   <devices>
Apr 14 00:10:37 user nova-compute[82479]:     <disk type="block" device="disk">
Apr 14 00:10:37 user nova-compute[82479]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:10:37 user nova-compute[82479]:       <source dev="/dev/sdc"/>
Apr 14 00:10:37 user nova-compute[82479]:       <target dev="vda" bus="virtio"/>
Apr 14 00:10:37 user nova-compute[82479]:       <serial>c3cfdf84-a3e1-41e3-85ec-481f5ba478cc</serial>
Apr 14 00:10:37 user nova-compute[82479]:     </disk>
Apr 14 00:10:37 user nova-compute[82479]:     <disk type="file" device="disk">
Apr 14 00:10:37 user nova-compute[82479]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 00:10:37 user nova-compute[82479]:       <source file="/opt/stack/data/nova/instances/17c6c147-fb62-4204-a416-792b94d3f7dd/disk.rescue"/>
Apr 14 00:10:37 user nova-compute[82479]:       <target dev="vdb" bus="virtio"/>
Apr 14 00:10:37 user nova-compute[82479]:       <boot order="1"/>
Apr 14 00:10:37 user nova-compute[82479]:     </disk>
Apr 14 00:10:37 user nova-compute[82479]:     <interface type="ethernet">
Apr 14 00:10:37 user nova-compute[82479]:       <mac address="fa:16:3e:23:dd:a5"/>
Apr 14 00:10:37 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:10:37 user nova-compute[82479]:       <mtu size="1442"/>
Apr 14 00:10:37 user nova-compute[82479]:       <target dev="tap102987de-d5"/>
Apr 14 00:10:37 user nova-compute[82479]:     </interface>
Apr 14 00:10:37 user nova-compute[82479]:     <serial type="pty">
Apr 14 00:10:37 user nova-compute[82479]:       <log file="/opt/stack/data/nova/instances/17c6c147-fb62-4204-a416-792b94d3f7dd/console.log" append="off"/>
Apr 14 00:10:37 user nova-compute[82479]:     </serial>
Apr 14 00:10:37 user nova-compute[82479]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 00:10:37 user nova-compute[82479]:     <video>
Apr 14 00:10:37 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:10:37 user nova-compute[82479]:     </video>
Apr 14 00:10:37 user nova-compute[82479]:     <rng model="virtio">
Apr 14 00:10:37 user nova-compute[82479]:       <backend model="random">/dev/urandom</backend>
Apr 14 00:10:37 user nova-compute[82479]:     </rng>
Apr 14 00:10:37 user nova-compute[82479]:     <controller type="usb" index="0" model="none"/>
Apr 14 00:10:37 user nova-compute[82479]:     <memballoon model="virtio">
Apr 14 00:10:37 user nova-compute[82479]:       <stats period="10"/>
Apr 14 00:10:37 user nova-compute[82479]:     </memballoon>
Apr 14 00:10:37 user nova-compute[82479]:   </devices>
Apr 14 00:10:37 user nova-compute[82479]: </domain>
Apr 14 00:10:37 user nova-compute[82479]:  {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpv3e7veqy" returned: 0 in 0.095s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e6300b39-c3bd-43c3-8d36-cadb15388b15 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:10:37 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e6300b39-c3bd-43c3-8d36-cadb15388b15 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:10:37 user nova-compute[82479]: INFO nova.compute.manager [None req-e6300b39-c3bd-43c3-8d36-cadb15388b15 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Detaching volume af1b05d2-717a-489c-8bdf-160d00ebd122
Apr 14 00:10:37 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Instance destroyed successfully.
Apr 14 00:10:38 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:10:38 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:10:38 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] No VIF found with MAC fa:16:3e:23:dd:a5, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:10:38 user nova-compute[82479]: INFO nova.virt.block_device [None req-e6300b39-c3bd-43c3-8d36-cadb15388b15 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Attempting to driver detach volume af1b05d2-717a-489c-8bdf-160d00ebd122 from mountpoint /dev/vdc
Apr 14 00:10:38 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-e6300b39-c3bd-43c3-8d36-cadb15388b15 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Attempting to detach device vdc from instance 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a from the persistent domain config. {{(pid=82479) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 00:10:38 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-e6300b39-c3bd-43c3-8d36-cadb15388b15 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 00:10:38 user nova-compute[82479]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:10:38 user nova-compute[82479]:   <source dev="/dev/sdf"/>
Apr 14 00:10:38 user nova-compute[82479]:   <target dev="vdc" bus="virtio"/>
Apr 14 00:10:38 user nova-compute[82479]:   <serial>af1b05d2-717a-489c-8bdf-160d00ebd122</serial>
Apr 14 00:10:38 user nova-compute[82479]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 00:10:38 user nova-compute[82479]: </disk>
Apr 14 00:10:38 user nova-compute[82479]:  {{(pid=82479) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 00:10:38 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-e6300b39-c3bd-43c3-8d36-cadb15388b15 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Successfully detached device vdc from instance 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a from the persistent domain config.
Apr 14 00:10:38 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-e6300b39-c3bd-43c3-8d36-cadb15388b15 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a from the live domain config. {{(pid=82479) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 00:10:38 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-e6300b39-c3bd-43c3-8d36-cadb15388b15 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 00:10:38 user nova-compute[82479]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:10:38 user nova-compute[82479]:   <source dev="/dev/sdf"/>
Apr 14 00:10:38 user nova-compute[82479]:   <target dev="vdc" bus="virtio"/>
Apr 14 00:10:38 user nova-compute[82479]:   <serial>af1b05d2-717a-489c-8bdf-160d00ebd122</serial>
Apr 14 00:10:38 user nova-compute[82479]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 00:10:38 user nova-compute[82479]: </disk>
Apr 14 00:10:38 user nova-compute[82479]:  {{(pid=82479) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 00:10:39 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Received event <DeviceRemovedEvent: 1681431039.4117239, 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=82479) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 00:10:39 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-e6300b39-c3bd-43c3-8d36-cadb15388b15 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a {{(pid=82479) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 00:10:39 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-e6300b39-c3bd-43c3-8d36-cadb15388b15 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Successfully detached device vdc from instance 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a from the live domain config.
Apr 14 00:10:39 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6300b39-c3bd-43c3-8d36-cadb15388b15 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] calling os-brick to detach iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 00:10:39 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6300b39-c3bd-43c3-8d36-cadb15388b15 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, {'target_iqn': 'iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dekLAOnU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:10:39 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-e6300b39-c3bd-43c3-8d36-cadb15388b15 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:10:39 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-e6300b39-c3bd-43c3-8d36-cadb15388b15 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:10:39 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-e6300b39-c3bd-43c3-8d36-cadb15388b15 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:10:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:39 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d003e47-7ff1-4df7-8978-be7c28287adb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:39 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6300b39-c3bd-43c3-8d36-cadb15388b15 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 00:10:39 user nova-compute[82479]: No targets found.
Apr 14 00:10:39 user nova-compute[82479]: iSNS:
Apr 14 00:10:39 user nova-compute[82479]: No targets found.
Apr 14 00:10:39 user nova-compute[82479]: STATIC:
Apr 14 00:10:39 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0
Apr 14 00:10:39 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:10:39 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:10:39 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc
Apr 14 00:10:39 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:10:39 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:10:39 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d
Apr 14 00:10:39 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:10:39 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:10:39 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7
Apr 14 00:10:39 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:10:39 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:10:39 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122
Apr 14 00:10:39 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:10:39 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:10:39 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a
Apr 14 00:10:39 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:10:39 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:10:39 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc
Apr 14 00:10:39 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:10:39 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:10:39 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593
Apr 14 00:10:39 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:10:39 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:10:39 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62
Apr 14 00:10:39 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:10:39 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:10:39 user nova-compute[82479]: FIRMWARE:
Apr 14 00:10:39 user nova-compute[82479]: No targets found.
Apr 14 00:10:39 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:10:39 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6300b39-c3bd-43c3-8d36-cadb15388b15 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 00:10:39 user nova-compute[82479]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 00:10:39 user nova-compute[82479]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82479) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 00:10:39 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6300b39-c3bd-43c3-8d36-cadb15388b15 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122', 0)] {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 00:10:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:39 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[d58329e7-63b5-4826-afb6-ed8beacf04aa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:39 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b744cdb-fce2-4fee-81d2-cc89e2727d2f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:39 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6300b39-c3bd-43c3-8d36-cadb15388b15 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)
Apr 14 00:10:39 user nova-compute[82479]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:10:39 user nova-compute[82479]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:10:39 user nova-compute[82479]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 (non-flash)
Apr 14 00:10:39 user nova-compute[82479]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d (non-flash)
Apr 14 00:10:39 user nova-compute[82479]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 (non-flash)
Apr 14 00:10:39 user nova-compute[82479]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 (non-flash)
Apr 14 00:10:39 user nova-compute[82479]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 (non-flash)
Apr 14 00:10:39 user nova-compute[82479]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc (non-flash)
Apr 14 00:10:39 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:10:39 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6300b39-c3bd-43c3-8d36-cadb15388b15 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)
Apr 14 00:10:39 user nova-compute[82479]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:10:39 user nova-compute[82479]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:10:39 user nova-compute[82479]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 (non-flash)
Apr 14 00:10:39 user nova-compute[82479]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d (non-flash)
Apr 14 00:10:39 user nova-compute[82479]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 (non-flash)
Apr 14 00:10:39 user nova-compute[82479]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 (non-flash)
Apr 14 00:10:39 user nova-compute[82479]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 (non-flash)
Apr 14 00:10:39 user nova-compute[82479]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc (non-flash)
Apr 14 00:10:39 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:10:39 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6300b39-c3bd-43c3-8d36-cadb15388b15 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3338219090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122'): ({'sdf'}, set())}) {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 00:10:39 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-e6300b39-c3bd-43c3-8d36-cadb15388b15 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Removing single pathed devices sdf {{(pid=82479) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 00:10:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:39 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f3b230-c092-475b-8060-367b2154bc48]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:39 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9159e8-3c74-4909-a373-4700d1e1ecd8]: (4, ('ok\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:39 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-e6300b39-c3bd-43c3-8d36-cadb15388b15 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Flushing IO for device /dev/sdf {{(pid=82479) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 00:10:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:39 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be9ee58-c823-43ba-a2d2-413260596464]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:39 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-e6300b39-c3bd-43c3-8d36-cadb15388b15 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=82479) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 00:10:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:39 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:10:39 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Cleaning up deleted instances with incomplete migration  {{(pid=82479) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 00:10:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.040s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:39 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e79be49-3eea-46fc-b22f-cb38e1cff82c]: (4, ('1', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:39 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-e6300b39-c3bd-43c3-8d36-cadb15388b15 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 00:10:39 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-e6300b39-c3bd-43c3-8d36-cadb15388b15 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] SCSI volumes sdf have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 00:10:39 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6300b39-c3bd-43c3-8d36-cadb15388b15 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122')] {{(pid=82479) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 00:10:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:39 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa043187-7fb7-4bec-8ac1-aac08f7336b2]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:39 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6300b39-c3bd-43c3-8d36-cadb15388b15 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:10:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 -p 172.16.0.220:3260 --logout {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:39 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6367ab3-db23-465f-9ce6-c8810e7e1be9]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:39 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6300b39-c3bd-43c3-8d36-cadb15388b15 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122, portal: 172.16.0.220,3260]
Apr 14 00:10:39 user nova-compute[82479]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122, portal: 172.16.0.220,3260] successful.
Apr 14 00:10:39 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:10:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 -p 172.16.0.220:3260 --op delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:39 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[b358c7df-d398-4184-86a0-134be0ee3636]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:39 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6300b39-c3bd-43c3-8d36-cadb15388b15 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:10:39 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-e6300b39-c3bd-43c3-8d36-cadb15388b15 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:10:39 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6300b39-c3bd-43c3-8d36-cadb15388b15 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] <== disconnect_volume: return (356ms) None {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:10:39 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6300b39-c3bd-43c3-8d36-cadb15388b15 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Disconnected iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 00:10:40 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:40 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:40 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:40 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:40 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:10:40 user nova-compute[82479]: DEBUG nova.objects.instance [None req-e6300b39-c3bd-43c3-8d36-cadb15388b15 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lazy-loading 'flavor' on Instance uuid 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:10:40 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e6300b39-c3bd-43c3-8d36-cadb15388b15 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.796s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:10:40 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:40 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:41 user nova-compute[82479]: DEBUG nova.compute.manager [req-c1dbe981-aa61-45b1-9ca6-e5c6d139ccf1 req-a30d91a0-400f-4b8d-af02-7bf6b220b0e8 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Received event network-vif-plugged-1c533ad9-47bf-4eb9-b931-d855ad4ce53e {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:10:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-c1dbe981-aa61-45b1-9ca6-e5c6d139ccf1 req-a30d91a0-400f-4b8d-af02-7bf6b220b0e8 service nova] Acquiring lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:10:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-c1dbe981-aa61-45b1-9ca6-e5c6d139ccf1 req-a30d91a0-400f-4b8d-af02-7bf6b220b0e8 service nova] Lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:10:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-c1dbe981-aa61-45b1-9ca6-e5c6d139ccf1 req-a30d91a0-400f-4b8d-af02-7bf6b220b0e8 service nova] Lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:10:41 user nova-compute[82479]: DEBUG nova.compute.manager [req-c1dbe981-aa61-45b1-9ca6-e5c6d139ccf1 req-a30d91a0-400f-4b8d-af02-7bf6b220b0e8 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] No waiting events found dispatching network-vif-plugged-1c533ad9-47bf-4eb9-b931-d855ad4ce53e {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:10:41 user nova-compute[82479]: WARNING nova.compute.manager [req-c1dbe981-aa61-45b1-9ca6-e5c6d139ccf1 req-a30d91a0-400f-4b8d-af02-7bf6b220b0e8 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Received unexpected event network-vif-plugged-1c533ad9-47bf-4eb9-b931-d855ad4ce53e for instance with vm_state building and task_state spawning.
Apr 14 00:10:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:41 user nova-compute[82479]: DEBUG nova.compute.manager [req-44899895-eebd-4989-be7d-67c434b60267 req-4e01d864-922c-4496-a485-84199150cd07 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Received event network-vif-plugged-e9ec2eab-0d7a-4be3-acab-a27bce761738 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:10:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-44899895-eebd-4989-be7d-67c434b60267 req-4e01d864-922c-4496-a485-84199150cd07 service nova] Acquiring lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:10:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-44899895-eebd-4989-be7d-67c434b60267 req-4e01d864-922c-4496-a485-84199150cd07 service nova] Lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:10:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-44899895-eebd-4989-be7d-67c434b60267 req-4e01d864-922c-4496-a485-84199150cd07 service nova] Lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:10:41 user nova-compute[82479]: DEBUG nova.compute.manager [req-44899895-eebd-4989-be7d-67c434b60267 req-4e01d864-922c-4496-a485-84199150cd07 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] No waiting events found dispatching network-vif-plugged-e9ec2eab-0d7a-4be3-acab-a27bce761738 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:10:41 user nova-compute[82479]: WARNING nova.compute.manager [req-44899895-eebd-4989-be7d-67c434b60267 req-4e01d864-922c-4496-a485-84199150cd07 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Received unexpected event network-vif-plugged-e9ec2eab-0d7a-4be3-acab-a27bce761738 for instance with vm_state building and task_state spawning.
Apr 14 00:10:41 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:10:41 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:10:41 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Starting heal instance info cache {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 00:10:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:41 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Didn't find any instances for network info cache update. {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 00:10:41 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:10:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:42 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:42 user nova-compute[82479]: INFO nova.compute.manager [None req-9313599f-9fa8-4fa1-833d-1fdd0768383d tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Unrescuing
Apr 14 00:10:42 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-9313599f-9fa8-4fa1-833d-1fdd0768383d tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Acquiring lock "refresh_cache-3a6b9f89-e462-47d8-84a1-0ac4ade3ab97" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:10:42 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-9313599f-9fa8-4fa1-833d-1fdd0768383d tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Acquired lock "refresh_cache-3a6b9f89-e462-47d8-84a1-0ac4ade3ab97" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:10:42 user nova-compute[82479]: DEBUG nova.network.neutron [None req-9313599f-9fa8-4fa1-833d-1fdd0768383d tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 00:10:42 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:42 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:42 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:42 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:42 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:42 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:42 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:42 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:42 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:42 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:42 user nova-compute[82479]: DEBUG nova.compute.manager [req-ad1aded5-4140-44af-9440-f2658edf0afa req-8003155a-fd71-4707-ba6e-e948b46e3148 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Received event network-vif-plugged-9dedd1d2-74e4-4aae-8114-9ecd78686a4d {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:10:42 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-ad1aded5-4140-44af-9440-f2658edf0afa req-8003155a-fd71-4707-ba6e-e948b46e3148 service nova] Acquiring lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:10:42 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-ad1aded5-4140-44af-9440-f2658edf0afa req-8003155a-fd71-4707-ba6e-e948b46e3148 service nova] Lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:10:42 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-ad1aded5-4140-44af-9440-f2658edf0afa req-8003155a-fd71-4707-ba6e-e948b46e3148 service nova] Lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:10:42 user nova-compute[82479]: DEBUG nova.compute.manager [req-ad1aded5-4140-44af-9440-f2658edf0afa req-8003155a-fd71-4707-ba6e-e948b46e3148 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] No waiting events found dispatching network-vif-plugged-9dedd1d2-74e4-4aae-8114-9ecd78686a4d {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:10:42 user nova-compute[82479]: WARNING nova.compute.manager [req-ad1aded5-4140-44af-9440-f2658edf0afa req-8003155a-fd71-4707-ba6e-e948b46e3148 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Received unexpected event network-vif-plugged-9dedd1d2-74e4-4aae-8114-9ecd78686a4d for instance with vm_state building and task_state spawning.
Apr 14 00:10:42 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:42 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:42 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:42 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:43 user nova-compute[82479]: DEBUG nova.compute.manager [req-83fde45b-7527-450c-ab4d-1631b52437a5 req-b62101fb-ed95-4336-a566-a43a382f769c service nova] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Received event network-changed-53562eeb-b1fd-47f1-896e-cacd277abf24 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:10:43 user nova-compute[82479]: DEBUG nova.compute.manager [req-83fde45b-7527-450c-ab4d-1631b52437a5 req-b62101fb-ed95-4336-a566-a43a382f769c service nova] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Refreshing instance network info cache due to event network-changed-53562eeb-b1fd-47f1-896e-cacd277abf24. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:10:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-83fde45b-7527-450c-ab4d-1631b52437a5 req-b62101fb-ed95-4336-a566-a43a382f769c service nova] Acquiring lock "refresh_cache-8feba40a-03c7-4c60-b862-ee14fb8c9b05" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:10:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-83fde45b-7527-450c-ab4d-1631b52437a5 req-b62101fb-ed95-4336-a566-a43a382f769c service nova] Acquired lock "refresh_cache-8feba40a-03c7-4c60-b862-ee14fb8c9b05" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:10:43 user nova-compute[82479]: DEBUG nova.network.neutron [req-83fde45b-7527-450c-ab4d-1631b52437a5 req-b62101fb-ed95-4336-a566-a43a382f769c service nova] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Refreshing network info cache for port 53562eeb-b1fd-47f1-896e-cacd277abf24 {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:10:43 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:43 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:43 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:43 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:43 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:43 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:43 user nova-compute[82479]: DEBUG nova.network.neutron [None req-9313599f-9fa8-4fa1-833d-1fdd0768383d tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Updating instance_info_cache with network_info: [{"id": "4085de4c-cb9e-452b-9504-b7c7f8621213", "address": "fa:16:3e:2b:ab:7d", "network": {"id": "10c34d1a-edc4-4b0c-96a7-b29a7c292e74", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-573422654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931198e56de4cf08db59bcc40f2a260", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4085de4c-cb", "ovs_interfaceid": "4085de4c-cb9e-452b-9504-b7c7f8621213", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:10:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-9313599f-9fa8-4fa1-833d-1fdd0768383d tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Releasing lock "refresh_cache-3a6b9f89-e462-47d8-84a1-0ac4ade3ab97" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:10:43 user nova-compute[82479]: DEBUG nova.objects.instance [None req-9313599f-9fa8-4fa1-833d-1fdd0768383d tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lazy-loading 'flavor' on Instance uuid 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:10:43 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:43 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:43 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:43 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:43 user nova-compute[82479]: DEBUG nova.compute.manager [req-52d7054b-4167-440a-8be5-abad45107f5d req-e04f8cf1-34e6-4db7-a0dd-b3d344dc7bbc service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Received event network-vif-plugged-e9ec2eab-0d7a-4be3-acab-a27bce761738 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:10:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-52d7054b-4167-440a-8be5-abad45107f5d req-e04f8cf1-34e6-4db7-a0dd-b3d344dc7bbc service nova] Acquiring lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:10:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-52d7054b-4167-440a-8be5-abad45107f5d req-e04f8cf1-34e6-4db7-a0dd-b3d344dc7bbc service nova] Lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:10:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-52d7054b-4167-440a-8be5-abad45107f5d req-e04f8cf1-34e6-4db7-a0dd-b3d344dc7bbc service nova] Lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:10:43 user nova-compute[82479]: DEBUG nova.compute.manager [req-52d7054b-4167-440a-8be5-abad45107f5d req-e04f8cf1-34e6-4db7-a0dd-b3d344dc7bbc service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] No waiting events found dispatching network-vif-plugged-e9ec2eab-0d7a-4be3-acab-a27bce761738 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:10:43 user nova-compute[82479]: WARNING nova.compute.manager [req-52d7054b-4167-440a-8be5-abad45107f5d req-e04f8cf1-34e6-4db7-a0dd-b3d344dc7bbc service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Received unexpected event network-vif-plugged-e9ec2eab-0d7a-4be3-acab-a27bce761738 for instance with vm_state building and task_state spawning.
Apr 14 00:10:43 user nova-compute[82479]: DEBUG nova.compute.manager [req-52d7054b-4167-440a-8be5-abad45107f5d req-e04f8cf1-34e6-4db7-a0dd-b3d344dc7bbc service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Received event network-vif-plugged-127b1d7d-d92a-4e24-9470-1758579376bf {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:10:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-52d7054b-4167-440a-8be5-abad45107f5d req-e04f8cf1-34e6-4db7-a0dd-b3d344dc7bbc service nova] Acquiring lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:10:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-52d7054b-4167-440a-8be5-abad45107f5d req-e04f8cf1-34e6-4db7-a0dd-b3d344dc7bbc service nova] Lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:10:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-52d7054b-4167-440a-8be5-abad45107f5d req-e04f8cf1-34e6-4db7-a0dd-b3d344dc7bbc service nova] Lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:10:43 user nova-compute[82479]: DEBUG nova.compute.manager [req-52d7054b-4167-440a-8be5-abad45107f5d req-e04f8cf1-34e6-4db7-a0dd-b3d344dc7bbc service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] No waiting events found dispatching network-vif-plugged-127b1d7d-d92a-4e24-9470-1758579376bf {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:10:43 user nova-compute[82479]: WARNING nova.compute.manager [req-52d7054b-4167-440a-8be5-abad45107f5d req-e04f8cf1-34e6-4db7-a0dd-b3d344dc7bbc service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Received unexpected event network-vif-plugged-127b1d7d-d92a-4e24-9470-1758579376bf for instance with vm_state building and task_state spawning.
Apr 14 00:10:43 user nova-compute[82479]: DEBUG nova.compute.manager [req-52d7054b-4167-440a-8be5-abad45107f5d req-e04f8cf1-34e6-4db7-a0dd-b3d344dc7bbc service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Received event network-vif-plugged-127b1d7d-d92a-4e24-9470-1758579376bf {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:10:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-52d7054b-4167-440a-8be5-abad45107f5d req-e04f8cf1-34e6-4db7-a0dd-b3d344dc7bbc service nova] Acquiring lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:10:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-52d7054b-4167-440a-8be5-abad45107f5d req-e04f8cf1-34e6-4db7-a0dd-b3d344dc7bbc service nova] Lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:10:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-52d7054b-4167-440a-8be5-abad45107f5d req-e04f8cf1-34e6-4db7-a0dd-b3d344dc7bbc service nova] Lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:10:43 user nova-compute[82479]: DEBUG nova.compute.manager [req-52d7054b-4167-440a-8be5-abad45107f5d req-e04f8cf1-34e6-4db7-a0dd-b3d344dc7bbc service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] No waiting events found dispatching network-vif-plugged-127b1d7d-d92a-4e24-9470-1758579376bf {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:10:43 user nova-compute[82479]: WARNING nova.compute.manager [req-52d7054b-4167-440a-8be5-abad45107f5d req-e04f8cf1-34e6-4db7-a0dd-b3d344dc7bbc service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Received unexpected event network-vif-plugged-127b1d7d-d92a-4e24-9470-1758579376bf for instance with vm_state building and task_state spawning.
Apr 14 00:10:43 user nova-compute[82479]: DEBUG nova.compute.manager [req-52d7054b-4167-440a-8be5-abad45107f5d req-e04f8cf1-34e6-4db7-a0dd-b3d344dc7bbc service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Received event network-vif-plugged-d3174ebb-df19-4943-98c4-89c97607f42b {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:10:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-52d7054b-4167-440a-8be5-abad45107f5d req-e04f8cf1-34e6-4db7-a0dd-b3d344dc7bbc service nova] Acquiring lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:10:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-52d7054b-4167-440a-8be5-abad45107f5d req-e04f8cf1-34e6-4db7-a0dd-b3d344dc7bbc service nova] Lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:10:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-52d7054b-4167-440a-8be5-abad45107f5d req-e04f8cf1-34e6-4db7-a0dd-b3d344dc7bbc service nova] Lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:10:43 user nova-compute[82479]: DEBUG nova.compute.manager [req-52d7054b-4167-440a-8be5-abad45107f5d req-e04f8cf1-34e6-4db7-a0dd-b3d344dc7bbc service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] No waiting events found dispatching network-vif-plugged-d3174ebb-df19-4943-98c4-89c97607f42b {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:10:43 user nova-compute[82479]: WARNING nova.compute.manager [req-52d7054b-4167-440a-8be5-abad45107f5d req-e04f8cf1-34e6-4db7-a0dd-b3d344dc7bbc service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Received unexpected event network-vif-plugged-d3174ebb-df19-4943-98c4-89c97607f42b for instance with vm_state building and task_state spawning.
Apr 14 00:10:43 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-94ce69ce-843c-49e6-aa7d-15437cf1d265 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Acquiring lock "8feba40a-03c7-4c60-b862-ee14fb8c9b05" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-94ce69ce-843c-49e6-aa7d-15437cf1d265 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "8feba40a-03c7-4c60-b862-ee14fb8c9b05" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Removed pending event for 17c6c147-fb62-4204-a416-792b94d3f7dd due to event {{(pid=82479) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681431044.2009652, 17c6c147-fb62-4204-a416-792b94d3f7dd => Resumed> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:10:44 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] VM Resumed (Lifecycle Event)
Apr 14 00:10:44 user nova-compute[82479]: DEBUG nova.compute.manager [None req-ce8a8bea-d0cb-4d1f-a933-6201c0f33fe8 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG nova.objects.instance [None req-94ce69ce-843c-49e6-aa7d-15437cf1d265 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lazy-loading 'flavor' on Instance uuid 8feba40a-03c7-4c60-b862-ee14fb8c9b05 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-94ce69ce-843c-49e6-aa7d-15437cf1d265 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "8feba40a-03c7-4c60-b862-ee14fb8c9b05" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.106s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a9394194-1477-494d-98b0-71819c4e4134 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "01a65362-36ea-4817-8e83-f75d6daf808b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a9394194-1477-494d-98b0-71819c4e4134 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "01a65362-36ea-4817-8e83-f75d6daf808b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:10:44 user nova-compute[82479]: INFO nova.compute.manager [None req-a9394194-1477-494d-98b0-71819c4e4134 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Detaching volume 5021c122-fea0-4125-8b1f-c1ab3c4de5e7
Apr 14 00:10:44 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 14 00:10:44 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681431044.2029343, 17c6c147-fb62-4204-a416-792b94d3f7dd => Started> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:10:44 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] VM Started (Lifecycle Event)
Apr 14 00:10:44 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:10:44 user nova-compute[82479]: INFO nova.virt.block_device [None req-a9394194-1477-494d-98b0-71819c4e4134 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Attempting to driver detach volume 5021c122-fea0-4125-8b1f-c1ab3c4de5e7 from mountpoint /dev/vdb
Apr 14 00:10:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-a9394194-1477-494d-98b0-71819c4e4134 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Attempting to detach device vdb from instance 01a65362-36ea-4817-8e83-f75d6daf808b from the persistent domain config. {{(pid=82479) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-a9394194-1477-494d-98b0-71819c4e4134 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 00:10:44 user nova-compute[82479]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:10:44 user nova-compute[82479]:   <source dev="/dev/sdd"/>
Apr 14 00:10:44 user nova-compute[82479]:   <target dev="vdb" bus="virtio"/>
Apr 14 00:10:44 user nova-compute[82479]:   <serial>5021c122-fea0-4125-8b1f-c1ab3c4de5e7</serial>
Apr 14 00:10:44 user nova-compute[82479]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 00:10:44 user nova-compute[82479]: </disk>
Apr 14 00:10:44 user nova-compute[82479]:  {{(pid=82479) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 00:10:44 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Instance destroyed successfully.
Apr 14 00:10:44 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-a9394194-1477-494d-98b0-71819c4e4134 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Successfully detached device vdb from instance 01a65362-36ea-4817-8e83-f75d6daf808b from the persistent domain config.
Apr 14 00:10:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-a9394194-1477-494d-98b0-71819c4e4134 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 01a65362-36ea-4817-8e83-f75d6daf808b from the live domain config. {{(pid=82479) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-a9394194-1477-494d-98b0-71819c4e4134 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 00:10:44 user nova-compute[82479]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:10:44 user nova-compute[82479]:   <source dev="/dev/sdd"/>
Apr 14 00:10:44 user nova-compute[82479]:   <target dev="vdb" bus="virtio"/>
Apr 14 00:10:44 user nova-compute[82479]:   <serial>5021c122-fea0-4125-8b1f-c1ab3c4de5e7</serial>
Apr 14 00:10:44 user nova-compute[82479]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 00:10:44 user nova-compute[82479]: </disk>
Apr 14 00:10:44 user nova-compute[82479]:  {{(pid=82479) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-94ce69ce-843c-49e6-aa7d-15437cf1d265 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Acquiring lock "8feba40a-03c7-4c60-b862-ee14fb8c9b05" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-94ce69ce-843c-49e6-aa7d-15437cf1d265 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "8feba40a-03c7-4c60-b862-ee14fb8c9b05" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:10:44 user nova-compute[82479]: INFO nova.compute.manager [None req-94ce69ce-843c-49e6-aa7d-15437cf1d265 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Attaching volume bb161de0-be74-4875-be21-dbca6bfcfc22 to /dev/vdb
Apr 14 00:10:44 user nova-compute[82479]: DEBUG os_brick.utils [None req-94ce69ce-843c-49e6-aa7d-15437cf1d265 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[781a8e9f-bc39-4ec3-872b-660a603992eb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fec92fcfdd3\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3792a86-27f8-4b19-81c3-11c64593a710]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG nova.network.neutron [req-83fde45b-7527-450c-ab4d-1631b52437a5 req-b62101fb-ed95-4336-a566-a43a382f769c service nova] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Updated VIF entry in instance network info cache for port 53562eeb-b1fd-47f1-896e-cacd277abf24. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG nova.network.neutron [req-83fde45b-7527-450c-ab4d-1631b52437a5 req-b62101fb-ed95-4336-a566-a43a382f769c service nova] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Updating instance_info_cache with network_info: [{"id": "53562eeb-b1fd-47f1-896e-cacd277abf24", "address": "fa:16:3e:e2:4e:ff", "network": {"id": "49f71fbc-7d65-4cc6-9efe-3918d5dbd51a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2079147315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dffbe999e60a4add9f23c83f9b0a4252", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53562eeb-b1", "ovs_interfaceid": "53562eeb-b1fd-47f1-896e-cacd277abf24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[08078af4-c755-4775-9d27-2766380e9240]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[35519d71-0c0c-42a2-8fd4-1168a82dce64]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-94ce69ce-843c-49e6-aa7d-15437cf1d265 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Running cmd (subprocess): nvme version {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-94ce69ce-843c-49e6-aa7d-15437cf1d265 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] 'nvme version' failed. Not Retrying. {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.nvmeof [None req-94ce69ce-843c-49e6-aa7d-15437cf1d265 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] nvme not present on system {{(pid=82479) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-83fde45b-7527-450c-ab4d-1631b52437a5 req-b62101fb-ed95-4336-a566-a43a382f769c service nova] Releasing lock "refresh_cache-8feba40a-03c7-4c60-b862-ee14fb8c9b05" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG nova.compute.manager [req-83fde45b-7527-450c-ab4d-1631b52437a5 req-b62101fb-ed95-4336-a566-a43a382f769c service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Received event network-vif-plugged-1c533ad9-47bf-4eb9-b931-d855ad4ce53e {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-83fde45b-7527-450c-ab4d-1631b52437a5 req-b62101fb-ed95-4336-a566-a43a382f769c service nova] Acquiring lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-83fde45b-7527-450c-ab4d-1631b52437a5 req-b62101fb-ed95-4336-a566-a43a382f769c service nova] Lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-83fde45b-7527-450c-ab4d-1631b52437a5 req-b62101fb-ed95-4336-a566-a43a382f769c service nova] Lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG nova.compute.manager [req-83fde45b-7527-450c-ab4d-1631b52437a5 req-b62101fb-ed95-4336-a566-a43a382f769c service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] No waiting events found dispatching network-vif-plugged-1c533ad9-47bf-4eb9-b931-d855ad4ce53e {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:10:44 user nova-compute[82479]: WARNING nova.compute.manager [req-83fde45b-7527-450c-ab4d-1631b52437a5 req-b62101fb-ed95-4336-a566-a43a382f769c service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Received unexpected event network-vif-plugged-1c533ad9-47bf-4eb9-b931-d855ad4ce53e for instance with vm_state building and task_state spawning.
Apr 14 00:10:44 user nova-compute[82479]: DEBUG nova.compute.manager [req-83fde45b-7527-450c-ab4d-1631b52437a5 req-b62101fb-ed95-4336-a566-a43a382f769c service nova] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Received event network-vif-plugged-102987de-d5e4-4ccd-b4fd-7ca7c131e379 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-83fde45b-7527-450c-ab4d-1631b52437a5 req-b62101fb-ed95-4336-a566-a43a382f769c service nova] Acquiring lock "17c6c147-fb62-4204-a416-792b94d3f7dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-83fde45b-7527-450c-ab4d-1631b52437a5 req-b62101fb-ed95-4336-a566-a43a382f769c service nova] Lock "17c6c147-fb62-4204-a416-792b94d3f7dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-83fde45b-7527-450c-ab4d-1631b52437a5 req-b62101fb-ed95-4336-a566-a43a382f769c service nova] Lock "17c6c147-fb62-4204-a416-792b94d3f7dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG nova.compute.manager [req-83fde45b-7527-450c-ab4d-1631b52437a5 req-b62101fb-ed95-4336-a566-a43a382f769c service nova] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] No waiting events found dispatching network-vif-plugged-102987de-d5e4-4ccd-b4fd-7ca7c131e379 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:10:44 user nova-compute[82479]: WARNING nova.compute.manager [req-83fde45b-7527-450c-ab4d-1631b52437a5 req-b62101fb-ed95-4336-a566-a43a382f769c service nova] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Received unexpected event network-vif-plugged-102987de-d5e4-4ccd-b4fd-7ca7c131e379 for instance with vm_state active and task_state rescuing.
Apr 14 00:10:44 user nova-compute[82479]: DEBUG nova.compute.manager [req-83fde45b-7527-450c-ab4d-1631b52437a5 req-b62101fb-ed95-4336-a566-a43a382f769c service nova] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Received event network-vif-plugged-102987de-d5e4-4ccd-b4fd-7ca7c131e379 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-83fde45b-7527-450c-ab4d-1631b52437a5 req-b62101fb-ed95-4336-a566-a43a382f769c service nova] Acquiring lock "17c6c147-fb62-4204-a416-792b94d3f7dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-83fde45b-7527-450c-ab4d-1631b52437a5 req-b62101fb-ed95-4336-a566-a43a382f769c service nova] Lock "17c6c147-fb62-4204-a416-792b94d3f7dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-83fde45b-7527-450c-ab4d-1631b52437a5 req-b62101fb-ed95-4336-a566-a43a382f769c service nova] Lock "17c6c147-fb62-4204-a416-792b94d3f7dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG nova.compute.manager [req-83fde45b-7527-450c-ab4d-1631b52437a5 req-b62101fb-ed95-4336-a566-a43a382f769c service nova] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] No waiting events found dispatching network-vif-plugged-102987de-d5e4-4ccd-b4fd-7ca7c131e379 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:10:44 user nova-compute[82479]: WARNING nova.compute.manager [req-83fde45b-7527-450c-ab4d-1631b52437a5 req-b62101fb-ed95-4336-a566-a43a382f769c service nova] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Received unexpected event network-vif-plugged-102987de-d5e4-4ccd-b4fd-7ca7c131e379 for instance with vm_state active and task_state rescuing.
Apr 14 00:10:44 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:10:44 user nova-compute[82479]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 00:10:44 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba2d3aa-75fc-455e-ac76-ae3244ec99d4]: (4, '') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-94ce69ce-843c-49e6-aa7d-15437cf1d265 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82479) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-94ce69ce-843c-49e6-aa7d-15437cf1d265 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-94ce69ce-843c-49e6-aa7d-15437cf1d265 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] LIGHTOS: no hostnqn found. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG os_brick.utils [None req-94ce69ce-843c-49e6-aa7d-15437cf1d265 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fec92fcfdd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG nova.virt.block_device [None req-94ce69ce-843c-49e6-aa7d-15437cf1d265 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Updating existing volume attachment record: 230eabb9-f683-4619-b7c2-d60679414559 {{(pid=82479) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG nova.compute.manager [req-63d78807-0df3-4a7d-b5f5-da9e2a304ffa req-f5eaecea-0034-466a-9899-527958e3c31c service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Received event network-vif-plugged-9dedd1d2-74e4-4aae-8114-9ecd78686a4d {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-63d78807-0df3-4a7d-b5f5-da9e2a304ffa req-f5eaecea-0034-466a-9899-527958e3c31c service nova] Acquiring lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-63d78807-0df3-4a7d-b5f5-da9e2a304ffa req-f5eaecea-0034-466a-9899-527958e3c31c service nova] Lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-63d78807-0df3-4a7d-b5f5-da9e2a304ffa req-f5eaecea-0034-466a-9899-527958e3c31c service nova] Lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG nova.compute.manager [req-63d78807-0df3-4a7d-b5f5-da9e2a304ffa req-f5eaecea-0034-466a-9899-527958e3c31c service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] No waiting events found dispatching network-vif-plugged-9dedd1d2-74e4-4aae-8114-9ecd78686a4d {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:10:44 user nova-compute[82479]: WARNING nova.compute.manager [req-63d78807-0df3-4a7d-b5f5-da9e2a304ffa req-f5eaecea-0034-466a-9899-527958e3c31c service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Received unexpected event network-vif-plugged-9dedd1d2-74e4-4aae-8114-9ecd78686a4d for instance with vm_state building and task_state spawning.
Apr 14 00:10:44 user nova-compute[82479]: DEBUG nova.compute.manager [req-63d78807-0df3-4a7d-b5f5-da9e2a304ffa req-f5eaecea-0034-466a-9899-527958e3c31c service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Received event network-vif-plugged-dff47f62-64b6-4ee5-b163-c74fc50ce6c9 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-63d78807-0df3-4a7d-b5f5-da9e2a304ffa req-f5eaecea-0034-466a-9899-527958e3c31c service nova] Acquiring lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-63d78807-0df3-4a7d-b5f5-da9e2a304ffa req-f5eaecea-0034-466a-9899-527958e3c31c service nova] Lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-63d78807-0df3-4a7d-b5f5-da9e2a304ffa req-f5eaecea-0034-466a-9899-527958e3c31c service nova] Lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG nova.compute.manager [req-63d78807-0df3-4a7d-b5f5-da9e2a304ffa req-f5eaecea-0034-466a-9899-527958e3c31c service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] No waiting events found dispatching network-vif-plugged-dff47f62-64b6-4ee5-b163-c74fc50ce6c9 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:10:44 user nova-compute[82479]: WARNING nova.compute.manager [req-63d78807-0df3-4a7d-b5f5-da9e2a304ffa req-f5eaecea-0034-466a-9899-527958e3c31c service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Received unexpected event network-vif-plugged-dff47f62-64b6-4ee5-b163-c74fc50ce6c9 for instance with vm_state building and task_state spawning.
Apr 14 00:10:44 user nova-compute[82479]: DEBUG nova.compute.manager [req-63d78807-0df3-4a7d-b5f5-da9e2a304ffa req-f5eaecea-0034-466a-9899-527958e3c31c service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Received event network-vif-plugged-dff47f62-64b6-4ee5-b163-c74fc50ce6c9 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-63d78807-0df3-4a7d-b5f5-da9e2a304ffa req-f5eaecea-0034-466a-9899-527958e3c31c service nova] Acquiring lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-63d78807-0df3-4a7d-b5f5-da9e2a304ffa req-f5eaecea-0034-466a-9899-527958e3c31c service nova] Lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-63d78807-0df3-4a7d-b5f5-da9e2a304ffa req-f5eaecea-0034-466a-9899-527958e3c31c service nova] Lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG nova.compute.manager [req-63d78807-0df3-4a7d-b5f5-da9e2a304ffa req-f5eaecea-0034-466a-9899-527958e3c31c service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] No waiting events found dispatching network-vif-plugged-dff47f62-64b6-4ee5-b163-c74fc50ce6c9 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:10:44 user nova-compute[82479]: WARNING nova.compute.manager [req-63d78807-0df3-4a7d-b5f5-da9e2a304ffa req-f5eaecea-0034-466a-9899-527958e3c31c service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Received unexpected event network-vif-plugged-dff47f62-64b6-4ee5-b163-c74fc50ce6c9 for instance with vm_state building and task_state spawning.
Apr 14 00:10:44 user nova-compute[82479]: DEBUG nova.compute.manager [req-63d78807-0df3-4a7d-b5f5-da9e2a304ffa req-f5eaecea-0034-466a-9899-527958e3c31c service nova] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Received event network-vif-unplugged-4085de4c-cb9e-452b-9504-b7c7f8621213 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-63d78807-0df3-4a7d-b5f5-da9e2a304ffa req-f5eaecea-0034-466a-9899-527958e3c31c service nova] Acquiring lock "3a6b9f89-e462-47d8-84a1-0ac4ade3ab97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-63d78807-0df3-4a7d-b5f5-da9e2a304ffa req-f5eaecea-0034-466a-9899-527958e3c31c service nova] Lock "3a6b9f89-e462-47d8-84a1-0ac4ade3ab97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-63d78807-0df3-4a7d-b5f5-da9e2a304ffa req-f5eaecea-0034-466a-9899-527958e3c31c service nova] Lock "3a6b9f89-e462-47d8-84a1-0ac4ade3ab97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG nova.compute.manager [req-63d78807-0df3-4a7d-b5f5-da9e2a304ffa req-f5eaecea-0034-466a-9899-527958e3c31c service nova] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] No waiting events found dispatching network-vif-unplugged-4085de4c-cb9e-452b-9504-b7c7f8621213 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:10:44 user nova-compute[82479]: WARNING nova.compute.manager [req-63d78807-0df3-4a7d-b5f5-da9e2a304ffa req-f5eaecea-0034-466a-9899-527958e3c31c service nova] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Received unexpected event network-vif-unplugged-4085de4c-cb9e-452b-9504-b7c7f8621213 for instance with vm_state rescued and task_state unrescuing.
Apr 14 00:10:44 user nova-compute[82479]: DEBUG nova.compute.manager [req-63d78807-0df3-4a7d-b5f5-da9e2a304ffa req-f5eaecea-0034-466a-9899-527958e3c31c service nova] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Received event network-vif-plugged-4085de4c-cb9e-452b-9504-b7c7f8621213 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-63d78807-0df3-4a7d-b5f5-da9e2a304ffa req-f5eaecea-0034-466a-9899-527958e3c31c service nova] Acquiring lock "3a6b9f89-e462-47d8-84a1-0ac4ade3ab97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-63d78807-0df3-4a7d-b5f5-da9e2a304ffa req-f5eaecea-0034-466a-9899-527958e3c31c service nova] Lock "3a6b9f89-e462-47d8-84a1-0ac4ade3ab97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-63d78807-0df3-4a7d-b5f5-da9e2a304ffa req-f5eaecea-0034-466a-9899-527958e3c31c service nova] Lock "3a6b9f89-e462-47d8-84a1-0ac4ade3ab97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG nova.compute.manager [req-63d78807-0df3-4a7d-b5f5-da9e2a304ffa req-f5eaecea-0034-466a-9899-527958e3c31c service nova] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] No waiting events found dispatching network-vif-plugged-4085de4c-cb9e-452b-9504-b7c7f8621213 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:10:44 user nova-compute[82479]: WARNING nova.compute.manager [req-63d78807-0df3-4a7d-b5f5-da9e2a304ffa req-f5eaecea-0034-466a-9899-527958e3c31c service nova] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Received unexpected event network-vif-plugged-4085de4c-cb9e-452b-9504-b7c7f8621213 for instance with vm_state rescued and task_state unrescuing.
Apr 14 00:10:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Received event <DeviceRemovedEvent: 1681431045.2136836, 01a65362-36ea-4817-8e83-f75d6daf808b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82479) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-a9394194-1477-494d-98b0-71819c4e4134 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 01a65362-36ea-4817-8e83-f75d6daf808b {{(pid=82479) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 00:10:45 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-a9394194-1477-494d-98b0-71819c4e4134 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Successfully detached device vdb from instance 01a65362-36ea-4817-8e83-f75d6daf808b from the live domain config.
Apr 14 00:10:45 user nova-compute[82479]: DEBUG nova.compute.manager [req-d191f2ff-6712-4412-ac9e-43627ce763b1 req-17f4598a-0616-4a48-bb8a-776584d732d1 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Received event network-vif-plugged-3839e2a9-bfeb-4103-9d7c-bcf45f9eaf14 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-d191f2ff-6712-4412-ac9e-43627ce763b1 req-17f4598a-0616-4a48-bb8a-776584d732d1 service nova] Acquiring lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-d191f2ff-6712-4412-ac9e-43627ce763b1 req-17f4598a-0616-4a48-bb8a-776584d732d1 service nova] Lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-d191f2ff-6712-4412-ac9e-43627ce763b1 req-17f4598a-0616-4a48-bb8a-776584d732d1 service nova] Lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG nova.compute.manager [req-d191f2ff-6712-4412-ac9e-43627ce763b1 req-17f4598a-0616-4a48-bb8a-776584d732d1 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] No waiting events found dispatching network-vif-plugged-3839e2a9-bfeb-4103-9d7c-bcf45f9eaf14 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:10:45 user nova-compute[82479]: WARNING nova.compute.manager [req-d191f2ff-6712-4412-ac9e-43627ce763b1 req-17f4598a-0616-4a48-bb8a-776584d732d1 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Received unexpected event network-vif-plugged-3839e2a9-bfeb-4103-9d7c-bcf45f9eaf14 for instance with vm_state building and task_state spawning.
Apr 14 00:10:45 user nova-compute[82479]: DEBUG nova.compute.manager [req-d191f2ff-6712-4412-ac9e-43627ce763b1 req-17f4598a-0616-4a48-bb8a-776584d732d1 service nova] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Received event network-changed-4085de4c-cb9e-452b-9504-b7c7f8621213 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG nova.compute.manager [req-d191f2ff-6712-4412-ac9e-43627ce763b1 req-17f4598a-0616-4a48-bb8a-776584d732d1 service nova] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Refreshing instance network info cache due to event network-changed-4085de4c-cb9e-452b-9504-b7c7f8621213. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-d191f2ff-6712-4412-ac9e-43627ce763b1 req-17f4598a-0616-4a48-bb8a-776584d732d1 service nova] Acquiring lock "refresh_cache-3a6b9f89-e462-47d8-84a1-0ac4ade3ab97" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-d191f2ff-6712-4412-ac9e-43627ce763b1 req-17f4598a-0616-4a48-bb8a-776584d732d1 service nova] Acquired lock "refresh_cache-3a6b9f89-e462-47d8-84a1-0ac4ade3ab97" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG nova.network.neutron [req-d191f2ff-6712-4412-ac9e-43627ce763b1 req-17f4598a-0616-4a48-bb8a-776584d732d1 service nova] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Refreshing network info cache for port 4085de4c-cb9e-452b-9504-b7c7f8621213 {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9394194-1477-494d-98b0-71819c4e4134 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] calling os-brick to detach iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9394194-1477-494d-98b0-71819c4e4134 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, {'target_iqn': 'iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'npILkxwF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:10:45 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-a9394194-1477-494d-98b0-71819c4e4134 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:10:45 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-a9394194-1477-494d-98b0-71819c4e4134 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-a9394194-1477-494d-98b0-71819c4e4134 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[42705a81-c189-4aa0-992f-63e7ba8a2908]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9394194-1477-494d-98b0-71819c4e4134 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 00:10:45 user nova-compute[82479]: No targets found.
Apr 14 00:10:45 user nova-compute[82479]: iSNS:
Apr 14 00:10:45 user nova-compute[82479]: No targets found.
Apr 14 00:10:45 user nova-compute[82479]: STATIC:
Apr 14 00:10:45 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0
Apr 14 00:10:45 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:10:45 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:10:45 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc
Apr 14 00:10:45 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:10:45 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:10:45 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d
Apr 14 00:10:45 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:10:45 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:10:45 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7
Apr 14 00:10:45 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:10:45 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:10:45 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a
Apr 14 00:10:45 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:10:45 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:10:45 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc
Apr 14 00:10:45 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:10:45 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:10:45 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593
Apr 14 00:10:45 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:10:45 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:10:45 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62
Apr 14 00:10:45 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:10:45 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:10:45 user nova-compute[82479]: FIRMWARE:
Apr 14 00:10:45 user nova-compute[82479]: No targets found.
Apr 14 00:10:45 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9394194-1477-494d-98b0-71819c4e4134 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 00:10:45 user nova-compute[82479]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 00:10:45 user nova-compute[82479]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82479) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9394194-1477-494d-98b0-71819c4e4134 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7', 0)] {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfedda98-9379-4abb-b3de-41828f9de58a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[859e869f-7a62-4cb0-af20-8f360a7fc8e0]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9394194-1477-494d-98b0-71819c4e4134 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)
Apr 14 00:10:45 user nova-compute[82479]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:10:45 user nova-compute[82479]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:10:45 user nova-compute[82479]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d (non-flash)
Apr 14 00:10:45 user nova-compute[82479]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 (non-flash)
Apr 14 00:10:45 user nova-compute[82479]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 (non-flash)
Apr 14 00:10:45 user nova-compute[82479]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 (non-flash)
Apr 14 00:10:45 user nova-compute[82479]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc (non-flash)
Apr 14 00:10:45 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9394194-1477-494d-98b0-71819c4e4134 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)
Apr 14 00:10:45 user nova-compute[82479]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:10:45 user nova-compute[82479]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)
Apr 14 00:10:45 user nova-compute[82479]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d (non-flash)
Apr 14 00:10:45 user nova-compute[82479]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 (non-flash)
Apr 14 00:10:45 user nova-compute[82479]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 (non-flash)
Apr 14 00:10:45 user nova-compute[82479]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 (non-flash)
Apr 14 00:10:45 user nova-compute[82479]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc (non-flash)
Apr 14 00:10:45 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9394194-1477-494d-98b0-71819c4e4134 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f33381c7130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7'): ({'sdd'}, set())}) {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-a9394194-1477-494d-98b0-71819c4e4134 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Removing single pathed devices sdd {{(pid=82479) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c1f6e7-ebe7-410b-8a65-5acb44abee5b]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b15ec8-61ef-4100-8323-21771495f9d4]: (4, ('ok\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-a9394194-1477-494d-98b0-71819c4e4134 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Flushing IO for device /dev/sdd {{(pid=82479) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[d561e989-404e-4d03-8d07-d24db6de724f]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-a9394194-1477-494d-98b0-71819c4e4134 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=82479) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1059fff-24eb-4880-b308-26a7a89fb1e4]: (4, ('1', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-a9394194-1477-494d-98b0-71819c4e4134 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-a9394194-1477-494d-98b0-71819c4e4134 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] SCSI volumes sdd have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9394194-1477-494d-98b0-71819c4e4134 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7')] {{(pid=82479) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ace498-ec0a-47c7-b353-2912c3a14af9]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9394194-1477-494d-98b0-71819c4e4134 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 -p 172.16.0.220:3260 --logout {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[88797044-7b9f-4b54-a543-8095ab1f398d]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9394194-1477-494d-98b0-71819c4e4134 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7, portal: 172.16.0.220,3260]
Apr 14 00:10:45 user nova-compute[82479]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7, portal: 172.16.0.220,3260] successful.
Apr 14 00:10:45 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 -p 172.16.0.220:3260 --op delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[299efc58-d66e-43b3-831b-cb8a62d8405d]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9394194-1477-494d-98b0-71819c4e4134 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-a9394194-1477-494d-98b0-71819c4e4134 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.371s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9394194-1477-494d-98b0-71819c4e4134 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] <== disconnect_volume: return (372ms) None {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9394194-1477-494d-98b0-71819c4e4134 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Disconnected iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG nova.compute.manager [req-3a15055d-e4d6-4e1c-af76-3d4a6ac321e2 req-25f4ce81-f365-4d1a-8a91-4ae4432bc61f service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Received event network-vif-plugged-d3174ebb-df19-4943-98c4-89c97607f42b {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-3a15055d-e4d6-4e1c-af76-3d4a6ac321e2 req-25f4ce81-f365-4d1a-8a91-4ae4432bc61f service nova] Acquiring lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-3a15055d-e4d6-4e1c-af76-3d4a6ac321e2 req-25f4ce81-f365-4d1a-8a91-4ae4432bc61f service nova] Lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-3a15055d-e4d6-4e1c-af76-3d4a6ac321e2 req-25f4ce81-f365-4d1a-8a91-4ae4432bc61f service nova] Lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG nova.compute.manager [req-3a15055d-e4d6-4e1c-af76-3d4a6ac321e2 req-25f4ce81-f365-4d1a-8a91-4ae4432bc61f service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] No waiting events found dispatching network-vif-plugged-d3174ebb-df19-4943-98c4-89c97607f42b {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:10:45 user nova-compute[82479]: WARNING nova.compute.manager [req-3a15055d-e4d6-4e1c-af76-3d4a6ac321e2 req-25f4ce81-f365-4d1a-8a91-4ae4432bc61f service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Received unexpected event network-vif-plugged-d3174ebb-df19-4943-98c4-89c97607f42b for instance with vm_state building and task_state spawning.
Apr 14 00:10:45 user nova-compute[82479]: DEBUG nova.network.neutron [req-d191f2ff-6712-4412-ac9e-43627ce763b1 req-17f4598a-0616-4a48-bb8a-776584d732d1 service nova] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Updated VIF entry in instance network info cache for port 4085de4c-cb9e-452b-9504-b7c7f8621213. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG nova.network.neutron [req-d191f2ff-6712-4412-ac9e-43627ce763b1 req-17f4598a-0616-4a48-bb8a-776584d732d1 service nova] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Updating instance_info_cache with network_info: [{"id": "4085de4c-cb9e-452b-9504-b7c7f8621213", "address": "fa:16:3e:2b:ab:7d", "network": {"id": "10c34d1a-edc4-4b0c-96a7-b29a7c292e74", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-573422654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931198e56de4cf08db59bcc40f2a260", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4085de4c-cb", "ovs_interfaceid": "4085de4c-cb9e-452b-9504-b7c7f8621213", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-d191f2ff-6712-4412-ac9e-43627ce763b1 req-17f4598a-0616-4a48-bb8a-776584d732d1 service nova] Releasing lock "refresh_cache-3a6b9f89-e462-47d8-84a1-0ac4ade3ab97" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG nova.compute.manager [req-d191f2ff-6712-4412-ac9e-43627ce763b1 req-17f4598a-0616-4a48-bb8a-776584d732d1 service nova] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Received event network-changed-4085de4c-cb9e-452b-9504-b7c7f8621213 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG nova.compute.manager [req-d191f2ff-6712-4412-ac9e-43627ce763b1 req-17f4598a-0616-4a48-bb8a-776584d732d1 service nova] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Refreshing instance network info cache due to event network-changed-4085de4c-cb9e-452b-9504-b7c7f8621213. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-d191f2ff-6712-4412-ac9e-43627ce763b1 req-17f4598a-0616-4a48-bb8a-776584d732d1 service nova] Acquiring lock "refresh_cache-3a6b9f89-e462-47d8-84a1-0ac4ade3ab97" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-d191f2ff-6712-4412-ac9e-43627ce763b1 req-17f4598a-0616-4a48-bb8a-776584d732d1 service nova] Acquired lock "refresh_cache-3a6b9f89-e462-47d8-84a1-0ac4ade3ab97" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG nova.network.neutron [req-d191f2ff-6712-4412-ac9e-43627ce763b1 req-17f4598a-0616-4a48-bb8a-776584d732d1 service nova] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Refreshing network info cache for port 4085de4c-cb9e-452b-9504-b7c7f8621213 {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681431045.9927785, 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c => Resumed> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:10:45 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] VM Resumed (Lifecycle Event)
Apr 14 00:10:45 user nova-compute[82479]: DEBUG nova.compute.manager [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Instance event wait completed in 0 seconds for  {{(pid=82479) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 00:10:45 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Guest created on hypervisor {{(pid=82479) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 00:10:46 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Instance spawned successfully.
Apr 14 00:10:46 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 00:10:46 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:10:46 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Found default for hw_cdrom_bus of ide {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:10:46 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Found default for hw_disk_bus of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:10:46 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Found default for hw_input_bus of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:10:46 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Found default for hw_pointer_model of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:10:46 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Found default for hw_video_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:10:46 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Found default for hw_vif_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:10:46 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:10:46 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:10:46 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681431045.996881, 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c => Started> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:10:46 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] VM Started (Lifecycle Event)
Apr 14 00:10:46 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:10:46 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:10:46 user nova-compute[82479]: INFO nova.compute.manager [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Took 13.60 seconds to spawn the instance on the hypervisor.
Apr 14 00:10:46 user nova-compute[82479]: DEBUG nova.compute.manager [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:10:46 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:10:46 user nova-compute[82479]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681431031.2201462, db291c2f-a72c-46ce-8de8-3956de37ccf8 => Stopped> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:10:46 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] VM Stopped (Lifecycle Event)
Apr 14 00:10:46 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:46 user nova-compute[82479]: INFO nova.compute.manager [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Took 33.62 seconds to build instance.
Apr 14 00:10:46 user nova-compute[82479]: DEBUG nova.objects.instance [None req-a9394194-1477-494d-98b0-71819c4e4134 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lazy-loading 'flavor' on Instance uuid 01a65362-36ea-4817-8e83-f75d6daf808b {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:10:46 user nova-compute[82479]: DEBUG nova.compute.manager [None req-978f6cc8-29e4-42ef-9471-aed303a7bfb2 None None] [instance: db291c2f-a72c-46ce-8de8-3956de37ccf8] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:10:46 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 33.756s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:10:46 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a9394194-1477-494d-98b0-71819c4e4134 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "01a65362-36ea-4817-8e83-f75d6daf808b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.406s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:10:46 user nova-compute[82479]: DEBUG nova.network.neutron [req-d191f2ff-6712-4412-ac9e-43627ce763b1 req-17f4598a-0616-4a48-bb8a-776584d732d1 service nova] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Updated VIF entry in instance network info cache for port 4085de4c-cb9e-452b-9504-b7c7f8621213. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:10:46 user nova-compute[82479]: DEBUG nova.network.neutron [req-d191f2ff-6712-4412-ac9e-43627ce763b1 req-17f4598a-0616-4a48-bb8a-776584d732d1 service nova] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Updating instance_info_cache with network_info: [{"id": "4085de4c-cb9e-452b-9504-b7c7f8621213", "address": "fa:16:3e:2b:ab:7d", "network": {"id": "10c34d1a-edc4-4b0c-96a7-b29a7c292e74", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-573422654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931198e56de4cf08db59bcc40f2a260", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4085de4c-cb", "ovs_interfaceid": "4085de4c-cb9e-452b-9504-b7c7f8621213", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:10:46 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-d191f2ff-6712-4412-ac9e-43627ce763b1 req-17f4598a-0616-4a48-bb8a-776584d732d1 service nova] Releasing lock "refresh_cache-3a6b9f89-e462-47d8-84a1-0ac4ade3ab97" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:10:46 user nova-compute[82479]: DEBUG nova.compute.manager [req-d191f2ff-6712-4412-ac9e-43627ce763b1 req-17f4598a-0616-4a48-bb8a-776584d732d1 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Received event network-vif-plugged-3839e2a9-bfeb-4103-9d7c-bcf45f9eaf14 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:10:46 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-d191f2ff-6712-4412-ac9e-43627ce763b1 req-17f4598a-0616-4a48-bb8a-776584d732d1 service nova] Acquiring lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:10:46 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-d191f2ff-6712-4412-ac9e-43627ce763b1 req-17f4598a-0616-4a48-bb8a-776584d732d1 service nova] Lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:10:46 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-d191f2ff-6712-4412-ac9e-43627ce763b1 req-17f4598a-0616-4a48-bb8a-776584d732d1 service nova] Lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:10:46 user nova-compute[82479]: DEBUG nova.compute.manager [req-d191f2ff-6712-4412-ac9e-43627ce763b1 req-17f4598a-0616-4a48-bb8a-776584d732d1 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] No waiting events found dispatching network-vif-plugged-3839e2a9-bfeb-4103-9d7c-bcf45f9eaf14 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:10:46 user nova-compute[82479]: WARNING nova.compute.manager [req-d191f2ff-6712-4412-ac9e-43627ce763b1 req-17f4598a-0616-4a48-bb8a-776584d732d1 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Received unexpected event network-vif-plugged-3839e2a9-bfeb-4103-9d7c-bcf45f9eaf14 for instance with vm_state building and task_state spawning.
Apr 14 00:10:47 user nova-compute[82479]: DEBUG nova.compute.manager [req-4b46591e-8c38-4ac9-aeb4-f8cc2d87aa49 req-f7cecbf8-868e-4c65-8a1f-b4716dd53e2d service nova] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Received event network-vif-plugged-4085de4c-cb9e-452b-9504-b7c7f8621213 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:10:47 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-4b46591e-8c38-4ac9-aeb4-f8cc2d87aa49 req-f7cecbf8-868e-4c65-8a1f-b4716dd53e2d service nova] Acquiring lock "3a6b9f89-e462-47d8-84a1-0ac4ade3ab97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:10:47 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-4b46591e-8c38-4ac9-aeb4-f8cc2d87aa49 req-f7cecbf8-868e-4c65-8a1f-b4716dd53e2d service nova] Lock "3a6b9f89-e462-47d8-84a1-0ac4ade3ab97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:10:47 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-4b46591e-8c38-4ac9-aeb4-f8cc2d87aa49 req-f7cecbf8-868e-4c65-8a1f-b4716dd53e2d service nova] Lock "3a6b9f89-e462-47d8-84a1-0ac4ade3ab97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:10:47 user nova-compute[82479]: DEBUG nova.compute.manager [req-4b46591e-8c38-4ac9-aeb4-f8cc2d87aa49 req-f7cecbf8-868e-4c65-8a1f-b4716dd53e2d service nova] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] No waiting events found dispatching network-vif-plugged-4085de4c-cb9e-452b-9504-b7c7f8621213 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:10:47 user nova-compute[82479]: WARNING nova.compute.manager [req-4b46591e-8c38-4ac9-aeb4-f8cc2d87aa49 req-f7cecbf8-868e-4c65-8a1f-b4716dd53e2d service nova] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Received unexpected event network-vif-plugged-4085de4c-cb9e-452b-9504-b7c7f8621213 for instance with vm_state rescued and task_state unrescuing.
Apr 14 00:10:47 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:47 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:47 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:47 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:47 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:47 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:10:47 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:10:47 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:10:47 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82479) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 00:10:47 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-bf6cc7ba-3072-492a-8380-85bece0b276e tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "01a65362-36ea-4817-8e83-f75d6daf808b" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:10:47 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-bf6cc7ba-3072-492a-8380-85bece0b276e tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "01a65362-36ea-4817-8e83-f75d6daf808b" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:10:47 user nova-compute[82479]: DEBUG nova.compute.manager [None req-bf6cc7ba-3072-492a-8380-85bece0b276e tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:10:47 user nova-compute[82479]: DEBUG nova.compute.manager [None req-bf6cc7ba-3072-492a-8380-85bece0b276e tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=82479) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3323}}
Apr 14 00:10:47 user nova-compute[82479]: DEBUG nova.objects.instance [None req-bf6cc7ba-3072-492a-8380-85bece0b276e tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lazy-loading 'flavor' on Instance uuid 01a65362-36ea-4817-8e83-f75d6daf808b {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:10:47 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:47 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:48 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:48 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:48 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:48 user nova-compute[82479]: DEBUG nova.compute.manager [req-2bd70ad0-818a-44c3-b8ed-044c0de21133 req-ef5f0952-8f88-4b43-87b9-f48e85b97eb6 service nova] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Received event network-vif-unplugged-b5dfa187-0a42-4319-990f-1d3b22691c27 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:10:48 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-2bd70ad0-818a-44c3-b8ed-044c0de21133 req-ef5f0952-8f88-4b43-87b9-f48e85b97eb6 service nova] Acquiring lock "01a65362-36ea-4817-8e83-f75d6daf808b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:10:48 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-2bd70ad0-818a-44c3-b8ed-044c0de21133 req-ef5f0952-8f88-4b43-87b9-f48e85b97eb6 service nova] Lock "01a65362-36ea-4817-8e83-f75d6daf808b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:10:48 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-2bd70ad0-818a-44c3-b8ed-044c0de21133 req-ef5f0952-8f88-4b43-87b9-f48e85b97eb6 service nova] Lock "01a65362-36ea-4817-8e83-f75d6daf808b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:10:48 user nova-compute[82479]: DEBUG nova.compute.manager [req-2bd70ad0-818a-44c3-b8ed-044c0de21133 req-ef5f0952-8f88-4b43-87b9-f48e85b97eb6 service nova] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] No waiting events found dispatching network-vif-unplugged-b5dfa187-0a42-4319-990f-1d3b22691c27 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:10:48 user nova-compute[82479]: WARNING nova.compute.manager [req-2bd70ad0-818a-44c3-b8ed-044c0de21133 req-ef5f0952-8f88-4b43-87b9-f48e85b97eb6 service nova] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Received unexpected event network-vif-unplugged-b5dfa187-0a42-4319-990f-1d3b22691c27 for instance with vm_state active and task_state powering-off.
Apr 14 00:10:48 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:48 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:48 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:10:48 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:10:48 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:48 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:10:48 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:10:48 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:10:48 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Auditing locally available compute resources for user (node: user) {{(pid=82479) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 00:10:48 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Instance destroyed successfully.
Apr 14 00:10:48 user nova-compute[82479]: DEBUG nova.compute.manager [None req-bf6cc7ba-3072-492a-8380-85bece0b276e tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:10:48 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:48 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-bf6cc7ba-3072-492a-8380-85bece0b276e tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "01a65362-36ea-4817-8e83-f75d6daf808b" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.949s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:10:49 user nova-compute[82479]: DEBUG nova.compute.manager [None req-9313599f-9fa8-4fa1-833d-1fdd0768383d tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:10:49 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Removed pending event for 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97 due to event {{(pid=82479) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 00:10:49 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681431048.9995463, 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97 => Resumed> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:10:49 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] VM Resumed (Lifecycle Event)
Apr 14 00:10:49 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:10:49 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:10:49 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] skipping disk /dev/sdj (vdc) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:10:49 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:10:49 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:10:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17c6c147-fb62-4204-a416-792b94d3f7dd/disk.rescue --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:49 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:10:49 user nova-compute[82479]: DEBUG nova.compute.manager [req-0e046770-c205-4cc8-93c0-f13820082000 req-1d989e3b-1a49-4439-b7ed-18d822aab8d9 service nova] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Received event network-vif-plugged-4085de4c-cb9e-452b-9504-b7c7f8621213 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:10:49 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0e046770-c205-4cc8-93c0-f13820082000 req-1d989e3b-1a49-4439-b7ed-18d822aab8d9 service nova] Acquiring lock "3a6b9f89-e462-47d8-84a1-0ac4ade3ab97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:10:49 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0e046770-c205-4cc8-93c0-f13820082000 req-1d989e3b-1a49-4439-b7ed-18d822aab8d9 service nova] Lock "3a6b9f89-e462-47d8-84a1-0ac4ade3ab97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:10:49 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0e046770-c205-4cc8-93c0-f13820082000 req-1d989e3b-1a49-4439-b7ed-18d822aab8d9 service nova] Lock "3a6b9f89-e462-47d8-84a1-0ac4ade3ab97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:10:49 user nova-compute[82479]: DEBUG nova.compute.manager [req-0e046770-c205-4cc8-93c0-f13820082000 req-1d989e3b-1a49-4439-b7ed-18d822aab8d9 service nova] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] No waiting events found dispatching network-vif-plugged-4085de4c-cb9e-452b-9504-b7c7f8621213 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:10:49 user nova-compute[82479]: WARNING nova.compute.manager [req-0e046770-c205-4cc8-93c0-f13820082000 req-1d989e3b-1a49-4439-b7ed-18d822aab8d9 service nova] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Received unexpected event network-vif-plugged-4085de4c-cb9e-452b-9504-b7c7f8621213 for instance with vm_state rescued and task_state unrescuing.
Apr 14 00:10:49 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681431049.0035164, 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97 => Started> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:10:49 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] VM Started (Lifecycle Event)
Apr 14 00:10:49 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:10:49 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:10:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17c6c147-fb62-4204-a416-792b94d3f7dd/disk.rescue --force-share --output=json" returned: 0 in 0.156s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17c6c147-fb62-4204-a416-792b94d3f7dd/disk.rescue --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17c6c147-fb62-4204-a416-792b94d3f7dd/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11c3384a-e699-4b10-9f8b-861291e96465/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11c3384a-e699-4b10-9f8b-861291e96465/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11c3384a-e699-4b10-9f8b-861291e96465/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11c3384a-e699-4b10-9f8b-861291e96465/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:49 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:10:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8feba40a-03c7-4c60-b862-ee14fb8c9b05/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:50 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94ce69ce-843c-49e6-aa7d-15437cf1d265 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Calling os-brick to attach iSCSI Volume {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 00:10:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ce69ce-843c-49e6-aa7d-15437cf1d265 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LEcXASpF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:10:50 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-94ce69ce-843c-49e6-aa7d-15437cf1d265 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:10:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-94ce69ce-843c-49e6-aa7d-15437cf1d265 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:10:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-94ce69ce-843c-49e6-aa7d-15437cf1d265 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:10:50 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-94ce69ce-843c-49e6-aa7d-15437cf1d265 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:10:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-94ce69ce-843c-49e6-aa7d-15437cf1d265 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:10:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-94ce69ce-843c-49e6-aa7d-15437cf1d265 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:10:50 user nova-compute[82479]: INFO os_brick.initiator.connectors.iscsi [None req-94ce69ce-843c-49e6-aa7d-15437cf1d265 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 00:10:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22 -p 172.16.0.220:3260 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8feba40a-03c7-4c60-b862-ee14fb8c9b05/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8feba40a-03c7-4c60-b862-ee14fb8c9b05/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:50 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d6d13e-50f0-484b-aa8b-5e80d46ad938]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ce69ce-843c-49e6-aa7d-15437cf1d265 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 00:10:50 user nova-compute[82479]:  {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:10:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22 -p 172.16.0.220:3260 --interface default --op new {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:50 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7db2c42-8727-48cc-86e7-8fcaf02722ef]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22] added\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ce69ce-843c-49e6-aa7d-15437cf1d265 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22] added
Apr 14 00:10:50 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:10:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:50 user nova-compute[82479]: DEBUG nova.compute.manager [req-1d976ea7-440a-41a5-85b7-9bdc3b11089f req-b1c50cb3-29dd-4407-961b-213063b90c48 service nova] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Received event network-vif-plugged-b5dfa187-0a42-4319-990f-1d3b22691c27 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:10:50 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-1d976ea7-440a-41a5-85b7-9bdc3b11089f req-b1c50cb3-29dd-4407-961b-213063b90c48 service nova] Acquiring lock "01a65362-36ea-4817-8e83-f75d6daf808b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:10:50 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-1d976ea7-440a-41a5-85b7-9bdc3b11089f req-b1c50cb3-29dd-4407-961b-213063b90c48 service nova] Lock "01a65362-36ea-4817-8e83-f75d6daf808b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:10:50 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-1d976ea7-440a-41a5-85b7-9bdc3b11089f req-b1c50cb3-29dd-4407-961b-213063b90c48 service nova] Lock "01a65362-36ea-4817-8e83-f75d6daf808b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:10:50 user nova-compute[82479]: DEBUG nova.compute.manager [req-1d976ea7-440a-41a5-85b7-9bdc3b11089f req-b1c50cb3-29dd-4407-961b-213063b90c48 service nova] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] No waiting events found dispatching network-vif-plugged-b5dfa187-0a42-4319-990f-1d3b22691c27 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:10:50 user nova-compute[82479]: WARNING nova.compute.manager [req-1d976ea7-440a-41a5-85b7-9bdc3b11089f req-b1c50cb3-29dd-4407-961b-213063b90c48 service nova] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Received unexpected event network-vif-plugged-b5dfa187-0a42-4319-990f-1d3b22691c27 for instance with vm_state stopped and task_state None.
Apr 14 00:10:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:50 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9291f2-f550-458c-b0b9-b0b288d6bd0f]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ce69ce-843c-49e6-aa7d-15437cf1d265 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:10:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:50 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[38af28c9-5c16-4852-ab3f-70a0d70dc3c9]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ce69ce-843c-49e6-aa7d-15437cf1d265 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:10:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LEcXASpF {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LEcXASpF" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:50 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[39166b95-8c2d-468c-8484-61e20c38738c]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ce69ce-843c-49e6-aa7d-15437cf1d265 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LEcXASpF'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:10:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8feba40a-03c7-4c60-b862-ee14fb8c9b05/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b21b91b1-a98b-48c7-a2e8-4114c3e31345/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:50 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3bcdfcc-7256-4233-944a-c9c5faa07df7]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ce69ce-843c-49e6-aa7d-15437cf1d265 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:10:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:50 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[2695727a-a1d5-4bd5-a3d7-ff81c9b4c2f0]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ce69ce-843c-49e6-aa7d-15437cf1d265 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)
Apr 14 00:10:50 user nova-compute[82479]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:10:50 user nova-compute[82479]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d (non-flash)
Apr 14 00:10:50 user nova-compute[82479]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 (non-flash)
Apr 14 00:10:50 user nova-compute[82479]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 (non-flash)
Apr 14 00:10:50 user nova-compute[82479]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 (non-flash)
Apr 14 00:10:50 user nova-compute[82479]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc (non-flash)
Apr 14 00:10:50 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:10:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ce69ce-843c-49e6-aa7d-15437cf1d265 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)
Apr 14 00:10:50 user nova-compute[82479]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:10:50 user nova-compute[82479]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d (non-flash)
Apr 14 00:10:50 user nova-compute[82479]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 (non-flash)
Apr 14 00:10:50 user nova-compute[82479]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 (non-flash)
Apr 14 00:10:50 user nova-compute[82479]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 (non-flash)
Apr 14 00:10:50 user nova-compute[82479]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc (non-flash)
Apr 14 00:10:50 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:10:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22 -p 172.16.0.220:3260 --login {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b21b91b1-a98b-48c7-a2e8-4114c3e31345/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b21b91b1-a98b-48c7-a2e8-4114c3e31345/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22 -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:50 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[48192b71-7f00-4178-983b-1d3d29963013]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ce69ce-843c-49e6-aa7d-15437cf1d265 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22, portal: 172.16.0.220,3260]
Apr 14 00:10:50 user nova-compute[82479]: Login to [iface: default, target: iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22, portal: 172.16.0.220,3260] successful.
Apr 14 00:10:50 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:10:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:50 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[e867734c-ae01-4252-a1f1-32ccdc2dd160]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ce69ce-843c-49e6-aa7d-15437cf1d265 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:10:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:50 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7ac196-93a6-4cbe-9afb-1407009d9ca4]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ce69ce-843c-49e6-aa7d-15437cf1d265 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)
Apr 14 00:10:50 user nova-compute[82479]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:10:50 user nova-compute[82479]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d (non-flash)
Apr 14 00:10:50 user nova-compute[82479]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 (non-flash)
Apr 14 00:10:50 user nova-compute[82479]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 (non-flash)
Apr 14 00:10:50 user nova-compute[82479]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 (non-flash)
Apr 14 00:10:50 user nova-compute[82479]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc (non-flash)
Apr 14 00:10:50 user nova-compute[82479]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22 (non-flash)
Apr 14 00:10:50 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:10:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ce69ce-843c-49e6-aa7d-15437cf1d265 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)
Apr 14 00:10:50 user nova-compute[82479]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:10:50 user nova-compute[82479]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d (non-flash)
Apr 14 00:10:50 user nova-compute[82479]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 (non-flash)
Apr 14 00:10:50 user nova-compute[82479]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 (non-flash)
Apr 14 00:10:50 user nova-compute[82479]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 (non-flash)
Apr 14 00:10:50 user nova-compute[82479]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc (non-flash)
Apr 14 00:10:50 user nova-compute[82479]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22 (non-flash)
Apr 14 00:10:50 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:10:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-94ce69ce-843c-49e6-aa7d-15437cf1d265 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.464s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:10:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ce69ce-843c-49e6-aa7d-15437cf1d265 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Connected to 172.16.0.220:3260 {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 00:10:50 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-94ce69ce-843c-49e6-aa7d-15437cf1d265 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] HCTL ('35', '-', '-', 0) found on session 21 with lun 0 {{(pid=82479) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 00:10:50 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-94ce69ce-843c-49e6-aa7d-15437cf1d265 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=82479) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 00:10:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.029s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:50 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[e296ba49-537a-45cd-99de-094153436155]: (4, ('- - 0', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:50 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-94ce69ce-843c-49e6-aa7d-15437cf1d265 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Searching for a device in session 21 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=82479) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 00:10:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ce69ce-843c-49e6-aa7d-15437cf1d265 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LEcXASpF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 00:10:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b21b91b1-a98b-48c7-a2e8-4114c3e31345/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01a65362-36ea-4817-8e83-f75d6daf808b/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:50 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01a65362-36ea-4817-8e83-f75d6daf808b/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01a65362-36ea-4817-8e83-f75d6daf808b/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01a65362-36ea-4817-8e83-f75d6daf808b/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:51 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-94ce69ce-843c-49e6-aa7d-15437cf1d265 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.521s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:10:51 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ce69ce-843c-49e6-aa7d-15437cf1d265 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] <== connect_volume: return (1525ms) {'type': 'block', 'scsi_wwn': '23961656663623163', 'path': '/dev/sdd'} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:10:51 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94ce69ce-843c-49e6-aa7d-15437cf1d265 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961656663623163', 'path': '/dev/sdd'} {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 00:10:51 user nova-compute[82479]: DEBUG nova.objects.instance [None req-94ce69ce-843c-49e6-aa7d-15437cf1d265 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lazy-loading 'flavor' on Instance uuid 8feba40a-03c7-4c60-b862-ee14fb8c9b05 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:10:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:51 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-94ce69ce-843c-49e6-aa7d-15437cf1d265 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 00:10:51 user nova-compute[82479]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:10:51 user nova-compute[82479]:   <source dev="/dev/sdd"/>
Apr 14 00:10:51 user nova-compute[82479]:   <target dev="vdb" bus="virtio"/>
Apr 14 00:10:51 user nova-compute[82479]:   <serial>bb161de0-be74-4875-be21-dbca6bfcfc22</serial>
Apr 14 00:10:51 user nova-compute[82479]: </disk>
Apr 14 00:10:51 user nova-compute[82479]:  {{(pid=82479) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 00:10:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:52 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:52 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb358a6-7e79-4acf-8fbe-7cc4e67a707b/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:52 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb358a6-7e79-4acf-8fbe-7cc4e67a707b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:52 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb358a6-7e79-4acf-8fbe-7cc4e67a707b/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:52 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-94ce69ce-843c-49e6-aa7d-15437cf1d265 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:10:52 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-94ce69ce-843c-49e6-aa7d-15437cf1d265 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:10:52 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-94ce69ce-843c-49e6-aa7d-15437cf1d265 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] No VIF found with MAC fa:16:3e:e2:4e:ff, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:10:52 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb358a6-7e79-4acf-8fbe-7cc4e67a707b/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:52 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-94ce69ce-843c-49e6-aa7d-15437cf1d265 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "8feba40a-03c7-4c60-b862-ee14fb8c9b05" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.944s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:10:52 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:52 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:52 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:52 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:52 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:52 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:52 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:53 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:10:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fba4ee-4aae-4ee3-8114-b53510f5442c/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fba4ee-4aae-4ee3-8114-b53510f5442c/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fba4ee-4aae-4ee3-8114-b53510f5442c/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fba4ee-4aae-4ee3-8114-b53510f5442c/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:53 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:10:53 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:10:53 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:10:53 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Hypervisor/Node resource view: name=user free_ram=7212MB free_disk=26.094406127929688GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82479) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 00:10:53 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:10:53 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:10:53 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-cc975729-3d1e-4d9e-9a38-6d1608b78d75 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Acquiring lock "8feba40a-03c7-4c60-b862-ee14fb8c9b05" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:10:53 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-cc975729-3d1e-4d9e-9a38-6d1608b78d75 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "8feba40a-03c7-4c60-b862-ee14fb8c9b05" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:10:53 user nova-compute[82479]: INFO nova.compute.manager [None req-cc975729-3d1e-4d9e-9a38-6d1608b78d75 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Detaching volume bb161de0-be74-4875-be21-dbca6bfcfc22
Apr 14 00:10:54 user nova-compute[82479]: INFO nova.virt.block_device [None req-cc975729-3d1e-4d9e-9a38-6d1608b78d75 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Attempting to driver detach volume bb161de0-be74-4875-be21-dbca6bfcfc22 from mountpoint /dev/vdb
Apr 14 00:10:54 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-cc975729-3d1e-4d9e-9a38-6d1608b78d75 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Attempting to detach device vdb from instance 8feba40a-03c7-4c60-b862-ee14fb8c9b05 from the persistent domain config. {{(pid=82479) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-cc975729-3d1e-4d9e-9a38-6d1608b78d75 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 00:10:54 user nova-compute[82479]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:10:54 user nova-compute[82479]:   <source dev="/dev/sdd"/>
Apr 14 00:10:54 user nova-compute[82479]:   <target dev="vdb" bus="virtio"/>
Apr 14 00:10:54 user nova-compute[82479]:   <serial>bb161de0-be74-4875-be21-dbca6bfcfc22</serial>
Apr 14 00:10:54 user nova-compute[82479]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 00:10:54 user nova-compute[82479]: </disk>
Apr 14 00:10:54 user nova-compute[82479]:  {{(pid=82479) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 00:10:54 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-cc975729-3d1e-4d9e-9a38-6d1608b78d75 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Successfully detached device vdb from instance 8feba40a-03c7-4c60-b862-ee14fb8c9b05 from the persistent domain config.
Apr 14 00:10:54 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-cc975729-3d1e-4d9e-9a38-6d1608b78d75 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8feba40a-03c7-4c60-b862-ee14fb8c9b05 from the live domain config. {{(pid=82479) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-cc975729-3d1e-4d9e-9a38-6d1608b78d75 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 00:10:54 user nova-compute[82479]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:10:54 user nova-compute[82479]:   <source dev="/dev/sdd"/>
Apr 14 00:10:54 user nova-compute[82479]:   <target dev="vdb" bus="virtio"/>
Apr 14 00:10:54 user nova-compute[82479]:   <serial>bb161de0-be74-4875-be21-dbca6bfcfc22</serial>
Apr 14 00:10:54 user nova-compute[82479]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 00:10:54 user nova-compute[82479]: </disk>
Apr 14 00:10:54 user nova-compute[82479]:  {{(pid=82479) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 23718fd0-58b8-47f9-b1ef-a26a90741ecc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 01a65362-36ea-4817-8e83-f75d6daf808b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance b3475e7e-ceb4-452a-a045-dbf43c5944dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 11c3384a-e699-4b10-9f8b-861291e96465 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance e3fba4ee-4aae-4ee3-8114-b53510f5442c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 17c6c147-fb62-4204-a416-792b94d3f7dd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 8feba40a-03c7-4c60-b862-ee14fb8c9b05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance b21b91b1-a98b-48c7-a2e8-4114c3e31345 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Final resource view: name=user phys_ram=16023MB used_ram=2304MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Refreshing inventories for resource provider 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Updating ProviderTree inventory for provider 3847975a-19aa-4b27-9180-14b5cc49044a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Updating inventory in ProviderTree for provider 3847975a-19aa-4b27-9180-14b5cc49044a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Refreshing aggregate associations for resource provider 3847975a-19aa-4b27-9180-14b5cc49044a, aggregates: None {{(pid=82479) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Refreshing trait associations for resource provider 3847975a-19aa-4b27-9180-14b5cc49044a, traits: COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,HW_CPU_X86_SSE42,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO {{(pid=82479) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Received event <DeviceRemovedEvent: 1681431054.587367, 8feba40a-03c7-4c60-b862-ee14fb8c9b05 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82479) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-cc975729-3d1e-4d9e-9a38-6d1608b78d75 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8feba40a-03c7-4c60-b862-ee14fb8c9b05 {{(pid=82479) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 00:10:54 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-cc975729-3d1e-4d9e-9a38-6d1608b78d75 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Successfully detached device vdb from instance 8feba40a-03c7-4c60-b862-ee14fb8c9b05 from the live domain config.
Apr 14 00:10:54 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc975729-3d1e-4d9e-9a38-6d1608b78d75 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] calling os-brick to detach iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc975729-3d1e-4d9e-9a38-6d1608b78d75 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, {'target_iqn': 'iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LEcXASpF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:10:54 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-cc975729-3d1e-4d9e-9a38-6d1608b78d75 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:10:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-cc975729-3d1e-4d9e-9a38-6d1608b78d75 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-cc975729-3d1e-4d9e-9a38-6d1608b78d75 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.010s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e2fe3f-5ae0-4365-9b89-7aef742987f0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc975729-3d1e-4d9e-9a38-6d1608b78d75 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 00:10:54 user nova-compute[82479]: No targets found.
Apr 14 00:10:54 user nova-compute[82479]: iSNS:
Apr 14 00:10:54 user nova-compute[82479]: No targets found.
Apr 14 00:10:54 user nova-compute[82479]: STATIC:
Apr 14 00:10:54 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0
Apr 14 00:10:54 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:10:54 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:10:54 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc
Apr 14 00:10:54 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:10:54 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:10:54 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d
Apr 14 00:10:54 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:10:54 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:10:54 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22
Apr 14 00:10:54 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:10:54 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:10:54 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a
Apr 14 00:10:54 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:10:54 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:10:54 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc
Apr 14 00:10:54 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:10:54 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:10:54 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593
Apr 14 00:10:54 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:10:54 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:10:54 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62
Apr 14 00:10:54 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:10:54 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:10:54 user nova-compute[82479]: FIRMWARE:
Apr 14 00:10:54 user nova-compute[82479]: No targets found.
Apr 14 00:10:54 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc975729-3d1e-4d9e-9a38-6d1608b78d75 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 00:10:54 user nova-compute[82479]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 00:10:54 user nova-compute[82479]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82479) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc975729-3d1e-4d9e-9a38-6d1608b78d75 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22', 0)] {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[e324547b-c747-42eb-8f48-163b084e8801]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.057s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[3850bdaa-bb11-4d9b-ab01-832149a4a0fb]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc975729-3d1e-4d9e-9a38-6d1608b78d75 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)
Apr 14 00:10:54 user nova-compute[82479]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:10:54 user nova-compute[82479]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d (non-flash)
Apr 14 00:10:54 user nova-compute[82479]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 (non-flash)
Apr 14 00:10:54 user nova-compute[82479]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 (non-flash)
Apr 14 00:10:54 user nova-compute[82479]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 (non-flash)
Apr 14 00:10:54 user nova-compute[82479]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc (non-flash)
Apr 14 00:10:54 user nova-compute[82479]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22 (non-flash)
Apr 14 00:10:54 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc975729-3d1e-4d9e-9a38-6d1608b78d75 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)
Apr 14 00:10:54 user nova-compute[82479]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:10:54 user nova-compute[82479]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d (non-flash)
Apr 14 00:10:54 user nova-compute[82479]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 (non-flash)
Apr 14 00:10:54 user nova-compute[82479]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 (non-flash)
Apr 14 00:10:54 user nova-compute[82479]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 (non-flash)
Apr 14 00:10:54 user nova-compute[82479]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc (non-flash)
Apr 14 00:10:54 user nova-compute[82479]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22 (non-flash)
Apr 14 00:10:54 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc975729-3d1e-4d9e-9a38-6d1608b78d75 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3338358700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22'): ({'sdd'}, set())}) {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-cc975729-3d1e-4d9e-9a38-6d1608b78d75 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Removing single pathed devices sdd {{(pid=82479) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[f46a16ea-7971-4e35-90c2-5a2298bb8948]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[b251eb6b-6d2a-4142-a576-689ecc0a827e]: (4, ('ok\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-cc975729-3d1e-4d9e-9a38-6d1608b78d75 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Flushing IO for device /dev/sdd {{(pid=82479) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4725387-d1f2-44ef-a971-880c4e5c10aa]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-cc975729-3d1e-4d9e-9a38-6d1608b78d75 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=82479) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Compute_service record updated for user:user {{(pid=82479) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.909s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Cleaning up deleted instances {{(pid=82479) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.053s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[d601f482-12f1-4cda-aac3-8035951f8b8a]: (4, ('1', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] There are 0 instances to clean {{(pid=82479) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-cc975729-3d1e-4d9e-9a38-6d1608b78d75 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-cc975729-3d1e-4d9e-9a38-6d1608b78d75 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] SCSI volumes sdd have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc975729-3d1e-4d9e-9a38-6d1608b78d75 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22')] {{(pid=82479) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ad0739-29b1-4765-b27e-79dc96a87115]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc975729-3d1e-4d9e-9a38-6d1608b78d75 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22 -p 172.16.0.220:3260 --logout {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[2152922c-92ab-47ec-b3d5-8101b08f4723]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc975729-3d1e-4d9e-9a38-6d1608b78d75 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22, portal: 172.16.0.220,3260]
Apr 14 00:10:54 user nova-compute[82479]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22, portal: 172.16.0.220,3260] successful.
Apr 14 00:10:54 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:10:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22 -p 172.16.0.220:3260 --op delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:10:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:10:55 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[e752cb71-7909-448c-8e94-38663b71b41b]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:10:55 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc975729-3d1e-4d9e-9a38-6d1608b78d75 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:10:55 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-cc975729-3d1e-4d9e-9a38-6d1608b78d75 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.409s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:10:55 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc975729-3d1e-4d9e-9a38-6d1608b78d75 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] <== disconnect_volume: return (419ms) None {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:10:55 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc975729-3d1e-4d9e-9a38-6d1608b78d75 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Disconnected iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 00:10:55 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:10:55 user nova-compute[82479]: DEBUG nova.objects.instance [None req-cc975729-3d1e-4d9e-9a38-6d1608b78d75 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lazy-loading 'flavor' on Instance uuid 8feba40a-03c7-4c60-b862-ee14fb8c9b05 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:10:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-cc975729-3d1e-4d9e-9a38-6d1608b78d75 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "8feba40a-03c7-4c60-b862-ee14fb8c9b05" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.021s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:10:57 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:11:00 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:11:02 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:11:03 user nova-compute[82479]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681431048.653654, 01a65362-36ea-4817-8e83-f75d6daf808b => Stopped> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:11:03 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] VM Stopped (Lifecycle Event)
Apr 14 00:11:03 user nova-compute[82479]: DEBUG nova.compute.manager [None req-014cdffe-d271-43d9-8a40-b4b1c17269ee None None] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:11:03 user nova-compute[82479]: DEBUG nova.compute.manager [None req-014cdffe-d271-43d9-8a40-b4b1c17269ee None None] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:11:05 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:11:07 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:11:10 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:11:12 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:11:15 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:11:16 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-df32b9ba-8057-4d59-8810-06f9cd52e565 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Acquiring lock "3a6b9f89-e462-47d8-84a1-0ac4ade3ab97" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:11:16 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-df32b9ba-8057-4d59-8810-06f9cd52e565 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "3a6b9f89-e462-47d8-84a1-0ac4ade3ab97" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:11:16 user nova-compute[82479]: INFO nova.compute.manager [None req-df32b9ba-8057-4d59-8810-06f9cd52e565 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Detaching volume 028eff5c-aa61-4243-985e-5210aedff04a
Apr 14 00:11:16 user nova-compute[82479]: INFO nova.virt.block_device [None req-df32b9ba-8057-4d59-8810-06f9cd52e565 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Attempting to driver detach volume 028eff5c-aa61-4243-985e-5210aedff04a from mountpoint /dev/vdb
Apr 14 00:11:16 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-df32b9ba-8057-4d59-8810-06f9cd52e565 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Attempting to detach device vdb from instance 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97 from the persistent domain config. {{(pid=82479) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 00:11:16 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-df32b9ba-8057-4d59-8810-06f9cd52e565 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 00:11:16 user nova-compute[82479]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:11:16 user nova-compute[82479]:   <source dev="/dev/sdb"/>
Apr 14 00:11:16 user nova-compute[82479]:   <target dev="vdb" bus="virtio"/>
Apr 14 00:11:16 user nova-compute[82479]:   <serial>028eff5c-aa61-4243-985e-5210aedff04a</serial>
Apr 14 00:11:16 user nova-compute[82479]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 00:11:16 user nova-compute[82479]: </disk>
Apr 14 00:11:16 user nova-compute[82479]:  {{(pid=82479) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 00:11:16 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-df32b9ba-8057-4d59-8810-06f9cd52e565 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Successfully detached device vdb from instance 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97 from the persistent domain config.
Apr 14 00:11:16 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-df32b9ba-8057-4d59-8810-06f9cd52e565 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97 from the live domain config. {{(pid=82479) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 00:11:16 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-df32b9ba-8057-4d59-8810-06f9cd52e565 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 00:11:16 user nova-compute[82479]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:11:16 user nova-compute[82479]:   <source dev="/dev/sdb"/>
Apr 14 00:11:16 user nova-compute[82479]:   <target dev="vdb" bus="virtio"/>
Apr 14 00:11:16 user nova-compute[82479]:   <serial>028eff5c-aa61-4243-985e-5210aedff04a</serial>
Apr 14 00:11:16 user nova-compute[82479]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 00:11:16 user nova-compute[82479]: </disk>
Apr 14 00:11:16 user nova-compute[82479]:  {{(pid=82479) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 00:11:16 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Received event <DeviceRemovedEvent: 1681431076.7684953, 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82479) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 00:11:16 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-df32b9ba-8057-4d59-8810-06f9cd52e565 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97 {{(pid=82479) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 00:11:16 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-df32b9ba-8057-4d59-8810-06f9cd52e565 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Successfully detached device vdb from instance 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97 from the live domain config.
Apr 14 00:11:16 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df32b9ba-8057-4d59-8810-06f9cd52e565 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] calling os-brick to detach iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 00:11:16 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-df32b9ba-8057-4d59-8810-06f9cd52e565 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, {'target_iqn': 'iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iVbjylRT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:11:16 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-df32b9ba-8057-4d59-8810-06f9cd52e565 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:11:16 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-df32b9ba-8057-4d59-8810-06f9cd52e565 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:11:16 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-df32b9ba-8057-4d59-8810-06f9cd52e565 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:11:16 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:16 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:16 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[7782310c-0e5f-4f25-b9d3-253f616790bc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:11:16 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-df32b9ba-8057-4d59-8810-06f9cd52e565 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 00:11:16 user nova-compute[82479]: No targets found.
Apr 14 00:11:16 user nova-compute[82479]: iSNS:
Apr 14 00:11:16 user nova-compute[82479]: No targets found.
Apr 14 00:11:16 user nova-compute[82479]: STATIC:
Apr 14 00:11:16 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0
Apr 14 00:11:16 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:11:16 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:11:16 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc
Apr 14 00:11:16 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:11:16 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:11:16 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d
Apr 14 00:11:16 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:11:16 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:11:16 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a
Apr 14 00:11:16 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:11:16 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:11:16 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc
Apr 14 00:11:16 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:11:16 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:11:16 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593
Apr 14 00:11:16 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:11:16 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:11:16 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62
Apr 14 00:11:16 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:11:16 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:11:16 user nova-compute[82479]: FIRMWARE:
Apr 14 00:11:16 user nova-compute[82479]: No targets found.
Apr 14 00:11:16 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:11:16 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-df32b9ba-8057-4d59-8810-06f9cd52e565 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 00:11:16 user nova-compute[82479]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 00:11:16 user nova-compute[82479]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82479) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 00:11:16 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-df32b9ba-8057-4d59-8810-06f9cd52e565 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a', 0)] {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 00:11:16 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:16 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:16 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae30dd3-dcc9-44e0-a92a-d0e172d1859e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:11:16 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:16 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:16 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b44feb-7578-472f-a9b5-f39a85d1887b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:11:16 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-df32b9ba-8057-4d59-8810-06f9cd52e565 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)
Apr 14 00:11:16 user nova-compute[82479]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:11:16 user nova-compute[82479]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d (non-flash)
Apr 14 00:11:16 user nova-compute[82479]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 (non-flash)
Apr 14 00:11:16 user nova-compute[82479]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 (non-flash)
Apr 14 00:11:16 user nova-compute[82479]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 (non-flash)
Apr 14 00:11:16 user nova-compute[82479]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc (non-flash)
Apr 14 00:11:16 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:11:16 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-df32b9ba-8057-4d59-8810-06f9cd52e565 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a (non-flash)
Apr 14 00:11:16 user nova-compute[82479]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:11:16 user nova-compute[82479]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d (non-flash)
Apr 14 00:11:16 user nova-compute[82479]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 (non-flash)
Apr 14 00:11:16 user nova-compute[82479]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 (non-flash)
Apr 14 00:11:16 user nova-compute[82479]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 (non-flash)
Apr 14 00:11:16 user nova-compute[82479]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc (non-flash)
Apr 14 00:11:16 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:11:16 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-df32b9ba-8057-4d59-8810-06f9cd52e565 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f333025f130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a'): ({'sdb'}, set())}) {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 00:11:16 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-df32b9ba-8057-4d59-8810-06f9cd52e565 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Removing single pathed devices sdb {{(pid=82479) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 00:11:16 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:16 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:16 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[898a4dd1-4179-414a-b9ed-537a0372de2e]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:11:16 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:16 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:16 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[d095a4f5-0573-4f23-a76c-3e3e54f951d6]: (4, ('ok\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:11:16 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-df32b9ba-8057-4d59-8810-06f9cd52e565 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Flushing IO for device /dev/sdb {{(pid=82479) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 00:11:16 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:16 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:16 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b9d3e40-abf9-4234-ab58-17642180e27a]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:11:16 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-df32b9ba-8057-4d59-8810-06f9cd52e565 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82479) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 00:11:16 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:16 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:16 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c3cfd2-e393-46bb-a223-3615ea4d7f77]: (4, ('1', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:11:16 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-df32b9ba-8057-4d59-8810-06f9cd52e565 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 00:11:16 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-df32b9ba-8057-4d59-8810-06f9cd52e565 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] SCSI volumes sdb have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 00:11:16 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-df32b9ba-8057-4d59-8810-06f9cd52e565 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a')] {{(pid=82479) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 00:11:16 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:17 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:17 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee16cae-e5e0-4775-b302-e507a5ebda9d]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:11:17 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-df32b9ba-8057-4d59-8810-06f9cd52e565 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:11:17 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a -p 172.16.0.220:3260 --logout {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:17 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:17 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f36bf5f-e790-46db-839d-884b2d63e10a]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:11:17 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-df32b9ba-8057-4d59-8810-06f9cd52e565 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a, portal: 172.16.0.220,3260]
Apr 14 00:11:17 user nova-compute[82479]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a, portal: 172.16.0.220,3260] successful.
Apr 14 00:11:17 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:11:17 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a -p 172.16.0.220:3260 --op delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:17 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:17 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[be113005-95e0-4529-9242-3439b70a3e8e]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:11:17 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-df32b9ba-8057-4d59-8810-06f9cd52e565 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:11:17 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-df32b9ba-8057-4d59-8810-06f9cd52e565 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:11:17 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-df32b9ba-8057-4d59-8810-06f9cd52e565 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] <== disconnect_volume: return (339ms) None {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:11:17 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df32b9ba-8057-4d59-8810-06f9cd52e565 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Disconnected iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 00:11:17 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:11:17 user nova-compute[82479]: DEBUG nova.objects.instance [None req-df32b9ba-8057-4d59-8810-06f9cd52e565 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lazy-loading 'flavor' on Instance uuid 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:11:17 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-df32b9ba-8057-4d59-8810-06f9cd52e565 tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "3a6b9f89-e462-47d8-84a1-0ac4ade3ab97" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.706s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:11:19 user nova-compute[82479]: DEBUG nova.compute.manager [req-49e45c01-11b6-4fde-9b9d-a4fd584891e5 req-c2cddc79-5230-4c82-a601-3e74e84c099d service nova] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Received event network-changed-01f28b85-9614-4a93-bc9b-7b894b96313a {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:11:19 user nova-compute[82479]: DEBUG nova.compute.manager [req-49e45c01-11b6-4fde-9b9d-a4fd584891e5 req-c2cddc79-5230-4c82-a601-3e74e84c099d service nova] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Refreshing instance network info cache due to event network-changed-01f28b85-9614-4a93-bc9b-7b894b96313a. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:11:19 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-49e45c01-11b6-4fde-9b9d-a4fd584891e5 req-c2cddc79-5230-4c82-a601-3e74e84c099d service nova] Acquiring lock "refresh_cache-b21b91b1-a98b-48c7-a2e8-4114c3e31345" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:11:19 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-49e45c01-11b6-4fde-9b9d-a4fd584891e5 req-c2cddc79-5230-4c82-a601-3e74e84c099d service nova] Acquired lock "refresh_cache-b21b91b1-a98b-48c7-a2e8-4114c3e31345" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:11:19 user nova-compute[82479]: DEBUG nova.network.neutron [req-49e45c01-11b6-4fde-9b9d-a4fd584891e5 req-c2cddc79-5230-4c82-a601-3e74e84c099d service nova] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Refreshing network info cache for port 01f28b85-9614-4a93-bc9b-7b894b96313a {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:11:19 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e0e798ff-3c64-4c7c-9d8c-b3bf1f3cd3f3 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "b21b91b1-a98b-48c7-a2e8-4114c3e31345" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:11:19 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e0e798ff-3c64-4c7c-9d8c-b3bf1f3cd3f3 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "b21b91b1-a98b-48c7-a2e8-4114c3e31345" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:11:19 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e0e798ff-3c64-4c7c-9d8c-b3bf1f3cd3f3 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "b21b91b1-a98b-48c7-a2e8-4114c3e31345-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:11:19 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e0e798ff-3c64-4c7c-9d8c-b3bf1f3cd3f3 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "b21b91b1-a98b-48c7-a2e8-4114c3e31345-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:11:19 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e0e798ff-3c64-4c7c-9d8c-b3bf1f3cd3f3 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "b21b91b1-a98b-48c7-a2e8-4114c3e31345-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:11:19 user nova-compute[82479]: INFO nova.compute.manager [None req-e0e798ff-3c64-4c7c-9d8c-b3bf1f3cd3f3 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Terminating instance
Apr 14 00:11:19 user nova-compute[82479]: DEBUG nova.compute.manager [None req-e0e798ff-3c64-4c7c-9d8c-b3bf1f3cd3f3 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Start destroying the instance on the hypervisor. {{(pid=82479) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 00:11:19 user nova-compute[82479]: DEBUG nova.network.neutron [req-49e45c01-11b6-4fde-9b9d-a4fd584891e5 req-c2cddc79-5230-4c82-a601-3e74e84c099d service nova] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Updated VIF entry in instance network info cache for port 01f28b85-9614-4a93-bc9b-7b894b96313a. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:11:19 user nova-compute[82479]: DEBUG nova.network.neutron [req-49e45c01-11b6-4fde-9b9d-a4fd584891e5 req-c2cddc79-5230-4c82-a601-3e74e84c099d service nova] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Updating instance_info_cache with network_info: [{"id": "01f28b85-9614-4a93-bc9b-7b894b96313a", "address": "fa:16:3e:1e:16:68", "network": {"id": "6d80f923-8aef-45df-921b-f77ed4ff0e75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-696070096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44c9d67ad2fa4cb9ab309b98f8fe051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01f28b85-96", "ovs_interfaceid": "01f28b85-9614-4a93-bc9b-7b894b96313a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:11:19 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:11:19 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-49e45c01-11b6-4fde-9b9d-a4fd584891e5 req-c2cddc79-5230-4c82-a601-3e74e84c099d service nova] Releasing lock "refresh_cache-b21b91b1-a98b-48c7-a2e8-4114c3e31345" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:11:19 user nova-compute[82479]: DEBUG nova.compute.manager [req-67d77ddc-5862-4263-98c9-4f191bf85e2d req-3b191fd4-0ae9-41d3-baee-a1478a4e34d8 service nova] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Received event network-vif-unplugged-01f28b85-9614-4a93-bc9b-7b894b96313a {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:11:19 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-67d77ddc-5862-4263-98c9-4f191bf85e2d req-3b191fd4-0ae9-41d3-baee-a1478a4e34d8 service nova] Acquiring lock "b21b91b1-a98b-48c7-a2e8-4114c3e31345-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:11:19 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-67d77ddc-5862-4263-98c9-4f191bf85e2d req-3b191fd4-0ae9-41d3-baee-a1478a4e34d8 service nova] Lock "b21b91b1-a98b-48c7-a2e8-4114c3e31345-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:11:19 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-67d77ddc-5862-4263-98c9-4f191bf85e2d req-3b191fd4-0ae9-41d3-baee-a1478a4e34d8 service nova] Lock "b21b91b1-a98b-48c7-a2e8-4114c3e31345-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:11:19 user nova-compute[82479]: DEBUG nova.compute.manager [req-67d77ddc-5862-4263-98c9-4f191bf85e2d req-3b191fd4-0ae9-41d3-baee-a1478a4e34d8 service nova] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] No waiting events found dispatching network-vif-unplugged-01f28b85-9614-4a93-bc9b-7b894b96313a {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:11:19 user nova-compute[82479]: DEBUG nova.compute.manager [req-67d77ddc-5862-4263-98c9-4f191bf85e2d req-3b191fd4-0ae9-41d3-baee-a1478a4e34d8 service nova] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Received event network-vif-unplugged-01f28b85-9614-4a93-bc9b-7b894b96313a for instance with task_state deleting. {{(pid=82479) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 00:11:19 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:11:19 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:11:20 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:11:20 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Instance destroyed successfully.
Apr 14 00:11:20 user nova-compute[82479]: DEBUG nova.objects.instance [None req-e0e798ff-3c64-4c7c-9d8c-b3bf1f3cd3f3 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lazy-loading 'resources' on Instance uuid b21b91b1-a98b-48c7-a2e8-4114c3e31345 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:11:20 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-e0e798ff-3c64-4c7c-9d8c-b3bf1f3cd3f3 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:09:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-679422627',display_name='tempest-AttachVolumeNegativeTest-server-679422627',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-679422627',id=15,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCeiJtJCQqS2PvzHgPRX8caDhL22zKM9Gv3U+QC2mkpW6/QtmgBvpNWlwmqo9c3rbYg77B6fYlhGNUJOqzhSxMkT9Q7v/DdYFlQ5yKVzmqfTbNnCeI9BKbmpVv6CfIRkSg==',key_name='tempest-keypair-1420639753',keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:09:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='44c9d67ad2fa4cb9ab309b98f8fe051a',ramdisk_id='',reservation_id='r-54u1mcxs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-719597397',owner_user_name='tempest-AttachVolumeNegativeTest-719597397-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T00:09:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb293fdfc658466aaa7134269fa46a7c',uuid=b21b91b1-a98b-48c7-a2e8-4114c3e31345,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "01f28b85-9614-4a93-bc9b-7b894b96313a", "address": "fa:16:3e:1e:16:68", "network": {"id": "6d80f923-8aef-45df-921b-f77ed4ff0e75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-696070096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44c9d67ad2fa4cb9ab309b98f8fe051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01f28b85-96", "ovs_interfaceid": "01f28b85-9614-4a93-bc9b-7b894b96313a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 00:11:20 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-e0e798ff-3c64-4c7c-9d8c-b3bf1f3cd3f3 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Converting VIF {"id": "01f28b85-9614-4a93-bc9b-7b894b96313a", "address": "fa:16:3e:1e:16:68", "network": {"id": "6d80f923-8aef-45df-921b-f77ed4ff0e75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-696070096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44c9d67ad2fa4cb9ab309b98f8fe051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01f28b85-96", "ovs_interfaceid": "01f28b85-9614-4a93-bc9b-7b894b96313a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:11:20 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-e0e798ff-3c64-4c7c-9d8c-b3bf1f3cd3f3 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:16:68,bridge_name='br-int',has_traffic_filtering=True,id=01f28b85-9614-4a93-bc9b-7b894b96313a,network=Network(6d80f923-8aef-45df-921b-f77ed4ff0e75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01f28b85-96') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:11:20 user nova-compute[82479]: DEBUG os_vif [None req-e0e798ff-3c64-4c7c-9d8c-b3bf1f3cd3f3 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:16:68,bridge_name='br-int',has_traffic_filtering=True,id=01f28b85-9614-4a93-bc9b-7b894b96313a,network=Network(6d80f923-8aef-45df-921b-f77ed4ff0e75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01f28b85-96') {{(pid=82479) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 00:11:20 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:11:20 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap01f28b85-96, bridge=br-int, if_exists=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:11:20 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:11:20 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:11:20 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:11:20 user nova-compute[82479]: INFO os_vif [None req-e0e798ff-3c64-4c7c-9d8c-b3bf1f3cd3f3 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:16:68,bridge_name='br-int',has_traffic_filtering=True,id=01f28b85-9614-4a93-bc9b-7b894b96313a,network=Network(6d80f923-8aef-45df-921b-f77ed4ff0e75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01f28b85-96')
Apr 14 00:11:20 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-e0e798ff-3c64-4c7c-9d8c-b3bf1f3cd3f3 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Deleting instance files /opt/stack/data/nova/instances/b21b91b1-a98b-48c7-a2e8-4114c3e31345_del
Apr 14 00:11:20 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-e0e798ff-3c64-4c7c-9d8c-b3bf1f3cd3f3 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Deletion of /opt/stack/data/nova/instances/b21b91b1-a98b-48c7-a2e8-4114c3e31345_del complete
Apr 14 00:11:20 user nova-compute[82479]: INFO nova.compute.manager [None req-e0e798ff-3c64-4c7c-9d8c-b3bf1f3cd3f3 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Took 0.90 seconds to destroy the instance on the hypervisor.
Apr 14 00:11:20 user nova-compute[82479]: DEBUG oslo.service.loopingcall [None req-e0e798ff-3c64-4c7c-9d8c-b3bf1f3cd3f3 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82479) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 00:11:20 user nova-compute[82479]: DEBUG nova.compute.manager [-] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Deallocating network for instance {{(pid=82479) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 00:11:20 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] deallocate_for_instance() {{(pid=82479) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 00:11:20 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:11:21 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Updating instance_info_cache with network_info: [] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:11:21 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Took 0.87 seconds to deallocate network for instance.
Apr 14 00:11:21 user nova-compute[82479]: DEBUG nova.compute.manager [req-80936122-39c1-4fab-8f17-6984e9d36601 req-ef7681e5-fc6a-4785-90e0-5a3f7ae1a818 service nova] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Received event network-vif-deleted-01f28b85-9614-4a93-bc9b-7b894b96313a {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:11:21 user nova-compute[82479]: INFO nova.compute.manager [req-80936122-39c1-4fab-8f17-6984e9d36601 req-ef7681e5-fc6a-4785-90e0-5a3f7ae1a818 service nova] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Neutron deleted interface 01f28b85-9614-4a93-bc9b-7b894b96313a; detaching it from the instance and deleting it from the info cache
Apr 14 00:11:21 user nova-compute[82479]: DEBUG nova.network.neutron [req-80936122-39c1-4fab-8f17-6984e9d36601 req-ef7681e5-fc6a-4785-90e0-5a3f7ae1a818 service nova] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Updating instance_info_cache with network_info: [] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:11:21 user nova-compute[82479]: DEBUG nova.compute.manager [req-80936122-39c1-4fab-8f17-6984e9d36601 req-ef7681e5-fc6a-4785-90e0-5a3f7ae1a818 service nova] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Detach interface failed, port_id=01f28b85-9614-4a93-bc9b-7b894b96313a, reason: Instance b21b91b1-a98b-48c7-a2e8-4114c3e31345 could not be found. {{(pid=82479) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 00:11:21 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e0e798ff-3c64-4c7c-9d8c-b3bf1f3cd3f3 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:11:21 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e0e798ff-3c64-4c7c-9d8c-b3bf1f3cd3f3 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:11:21 user nova-compute[82479]: DEBUG nova.compute.manager [req-d5d0fb40-3d08-40d7-9c1d-441fd2b39fff req-d50385cf-6a9b-4b5e-9386-f743a94beeb5 service nova] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Received event network-vif-plugged-01f28b85-9614-4a93-bc9b-7b894b96313a {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:11:21 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-d5d0fb40-3d08-40d7-9c1d-441fd2b39fff req-d50385cf-6a9b-4b5e-9386-f743a94beeb5 service nova] Acquiring lock "b21b91b1-a98b-48c7-a2e8-4114c3e31345-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:11:21 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-d5d0fb40-3d08-40d7-9c1d-441fd2b39fff req-d50385cf-6a9b-4b5e-9386-f743a94beeb5 service nova] Lock "b21b91b1-a98b-48c7-a2e8-4114c3e31345-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:11:21 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-d5d0fb40-3d08-40d7-9c1d-441fd2b39fff req-d50385cf-6a9b-4b5e-9386-f743a94beeb5 service nova] Lock "b21b91b1-a98b-48c7-a2e8-4114c3e31345-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:11:21 user nova-compute[82479]: DEBUG nova.compute.manager [req-d5d0fb40-3d08-40d7-9c1d-441fd2b39fff req-d50385cf-6a9b-4b5e-9386-f743a94beeb5 service nova] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] No waiting events found dispatching network-vif-plugged-01f28b85-9614-4a93-bc9b-7b894b96313a {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:11:21 user nova-compute[82479]: WARNING nova.compute.manager [req-d5d0fb40-3d08-40d7-9c1d-441fd2b39fff req-d50385cf-6a9b-4b5e-9386-f743a94beeb5 service nova] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Received unexpected event network-vif-plugged-01f28b85-9614-4a93-bc9b-7b894b96313a for instance with vm_state deleted and task_state None.
Apr 14 00:11:22 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-e0e798ff-3c64-4c7c-9d8c-b3bf1f3cd3f3 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:11:22 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-e0e798ff-3c64-4c7c-9d8c-b3bf1f3cd3f3 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:11:22 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e0e798ff-3c64-4c7c-9d8c-b3bf1f3cd3f3 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.739s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:11:22 user nova-compute[82479]: INFO nova.scheduler.client.report [None req-e0e798ff-3c64-4c7c-9d8c-b3bf1f3cd3f3 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Deleted allocations for instance b21b91b1-a98b-48c7-a2e8-4114c3e31345
Apr 14 00:11:22 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e0e798ff-3c64-4c7c-9d8c-b3bf1f3cd3f3 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "b21b91b1-a98b-48c7-a2e8-4114c3e31345" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.713s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:11:24 user nova-compute[82479]: DEBUG nova.compute.manager [req-c199b795-bd7a-4ff8-b249-fd0b50cbfe0f req-23ce447e-e444-452f-af67-1f11ea62b840 service nova] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Received event network-changed-e4c19308-c4ea-4a47-a0e2-9a8616e8c39c {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:11:24 user nova-compute[82479]: DEBUG nova.compute.manager [req-c199b795-bd7a-4ff8-b249-fd0b50cbfe0f req-23ce447e-e444-452f-af67-1f11ea62b840 service nova] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Refreshing instance network info cache due to event network-changed-e4c19308-c4ea-4a47-a0e2-9a8616e8c39c. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:11:24 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-c199b795-bd7a-4ff8-b249-fd0b50cbfe0f req-23ce447e-e444-452f-af67-1f11ea62b840 service nova] Acquiring lock "refresh_cache-6fb358a6-7e79-4acf-8fbe-7cc4e67a707b" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:11:24 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-c199b795-bd7a-4ff8-b249-fd0b50cbfe0f req-23ce447e-e444-452f-af67-1f11ea62b840 service nova] Acquired lock "refresh_cache-6fb358a6-7e79-4acf-8fbe-7cc4e67a707b" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:11:24 user nova-compute[82479]: DEBUG nova.network.neutron [req-c199b795-bd7a-4ff8-b249-fd0b50cbfe0f req-23ce447e-e444-452f-af67-1f11ea62b840 service nova] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Refreshing network info cache for port e4c19308-c4ea-4a47-a0e2-9a8616e8c39c {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:11:24 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-27919267-f13b-4101-935e-c17a0618e983 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquiring lock "6fb358a6-7e79-4acf-8fbe-7cc4e67a707b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:11:24 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-27919267-f13b-4101-935e-c17a0618e983 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6fb358a6-7e79-4acf-8fbe-7cc4e67a707b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:11:24 user nova-compute[82479]: DEBUG nova.objects.instance [None req-27919267-f13b-4101-935e-c17a0618e983 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lazy-loading 'flavor' on Instance uuid 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:11:24 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-27919267-f13b-4101-935e-c17a0618e983 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6fb358a6-7e79-4acf-8fbe-7cc4e67a707b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:11:24 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-27919267-f13b-4101-935e-c17a0618e983 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquiring lock "6fb358a6-7e79-4acf-8fbe-7cc4e67a707b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:11:24 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-27919267-f13b-4101-935e-c17a0618e983 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6fb358a6-7e79-4acf-8fbe-7cc4e67a707b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:11:24 user nova-compute[82479]: INFO nova.compute.manager [None req-27919267-f13b-4101-935e-c17a0618e983 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Attaching volume 9a4ad5f1-58f1-4934-b18f-9890ae47ecde to /dev/vdb
Apr 14 00:11:24 user nova-compute[82479]: DEBUG os_brick.utils [None req-27919267-f13b-4101-935e-c17a0618e983 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:11:24 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:24 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:24 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba55a5e1-7d80-4dff-9325-730dc7778f07]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fec92fcfdd3\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:11:24 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:24 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:24 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[09509ad1-82d5-4c87-b035-58b1b8d169b0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:11:24 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:24 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:24 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed44443d-cb7a-4eb0-bf6b-110596031559]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:11:24 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[9991879a-1155-49db-9bbe-cea512f0b8de]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:11:24 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-27919267-f13b-4101-935e-c17a0618e983 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Running cmd (subprocess): nvme version {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:24 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-27919267-f13b-4101-935e-c17a0618e983 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] 'nvme version' failed. Not Retrying. {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:11:24 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.nvmeof [None req-27919267-f13b-4101-935e-c17a0618e983 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] nvme not present on system {{(pid=82479) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 00:11:24 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:24 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:11:24 user nova-compute[82479]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 00:11:24 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2d71a4-13fc-4f41-bf25-2c076cde0065]: (4, '') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:11:24 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-27919267-f13b-4101-935e-c17a0618e983 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82479) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 00:11:24 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-27919267-f13b-4101-935e-c17a0618e983 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 00:11:24 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-27919267-f13b-4101-935e-c17a0618e983 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] LIGHTOS: no hostnqn found. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 00:11:24 user nova-compute[82479]: DEBUG os_brick.utils [None req-27919267-f13b-4101-935e-c17a0618e983 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fec92fcfdd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:11:24 user nova-compute[82479]: DEBUG nova.virt.block_device [None req-27919267-f13b-4101-935e-c17a0618e983 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Updating existing volume attachment record: 9d5d69c6-e22a-4e28-8616-ca5a56ff488a {{(pid=82479) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 00:11:24 user nova-compute[82479]: DEBUG nova.network.neutron [req-c199b795-bd7a-4ff8-b249-fd0b50cbfe0f req-23ce447e-e444-452f-af67-1f11ea62b840 service nova] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Updated VIF entry in instance network info cache for port e4c19308-c4ea-4a47-a0e2-9a8616e8c39c. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:11:24 user nova-compute[82479]: DEBUG nova.network.neutron [req-c199b795-bd7a-4ff8-b249-fd0b50cbfe0f req-23ce447e-e444-452f-af67-1f11ea62b840 service nova] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Updating instance_info_cache with network_info: [{"id": "e4c19308-c4ea-4a47-a0e2-9a8616e8c39c", "address": "fa:16:3e:f8:1a:b2", "network": {"id": "f185dffe-f180-4107-8752-182e71fc07c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1954392221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f138770c7b4407d83c449500fc000a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4c19308-c4", "ovs_interfaceid": "e4c19308-c4ea-4a47-a0e2-9a8616e8c39c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:11:24 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-c199b795-bd7a-4ff8-b249-fd0b50cbfe0f req-23ce447e-e444-452f-af67-1f11ea62b840 service nova] Releasing lock "refresh_cache-6fb358a6-7e79-4acf-8fbe-7cc4e67a707b" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:11:25 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:11:25 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:11:28 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-31848412-0fcf-4093-b182-37cf135c74a1 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:11:28 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-31848412-0fcf-4093-b182-37cf135c74a1 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:11:28 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-31848412-0fcf-4093-b182-37cf135c74a1 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:11:28 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-31848412-0fcf-4093-b182-37cf135c74a1 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:11:28 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-31848412-0fcf-4093-b182-37cf135c74a1 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:11:28 user nova-compute[82479]: INFO nova.compute.manager [None req-31848412-0fcf-4093-b182-37cf135c74a1 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Terminating instance
Apr 14 00:11:28 user nova-compute[82479]: DEBUG nova.compute.manager [None req-31848412-0fcf-4093-b182-37cf135c74a1 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Start destroying the instance on the hypervisor. {{(pid=82479) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 00:11:28 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:11:28 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:11:28 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:11:28 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:11:28 user nova-compute[82479]: DEBUG nova.compute.manager [req-eab45858-7efe-4e0b-a16d-045c3ba56990 req-24ad6acb-89d0-497f-b8f4-1d3dc872ad8b service nova] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Received event network-vif-unplugged-1b166f8e-a207-48d3-a0a9-2ad6c44774b2 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:11:28 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-eab45858-7efe-4e0b-a16d-045c3ba56990 req-24ad6acb-89d0-497f-b8f4-1d3dc872ad8b service nova] Acquiring lock "1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:11:28 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-eab45858-7efe-4e0b-a16d-045c3ba56990 req-24ad6acb-89d0-497f-b8f4-1d3dc872ad8b service nova] Lock "1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:11:28 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-eab45858-7efe-4e0b-a16d-045c3ba56990 req-24ad6acb-89d0-497f-b8f4-1d3dc872ad8b service nova] Lock "1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:11:28 user nova-compute[82479]: DEBUG nova.compute.manager [req-eab45858-7efe-4e0b-a16d-045c3ba56990 req-24ad6acb-89d0-497f-b8f4-1d3dc872ad8b service nova] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] No waiting events found dispatching network-vif-unplugged-1b166f8e-a207-48d3-a0a9-2ad6c44774b2 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:11:28 user nova-compute[82479]: DEBUG nova.compute.manager [req-eab45858-7efe-4e0b-a16d-045c3ba56990 req-24ad6acb-89d0-497f-b8f4-1d3dc872ad8b service nova] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Received event network-vif-unplugged-1b166f8e-a207-48d3-a0a9-2ad6c44774b2 for instance with task_state deleting. {{(pid=82479) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 00:11:29 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Instance destroyed successfully.
Apr 14 00:11:29 user nova-compute[82479]: DEBUG nova.objects.instance [None req-31848412-0fcf-4093-b182-37cf135c74a1 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lazy-loading 'resources' on Instance uuid 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:11:29 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-31848412-0fcf-4093-b182-37cf135c74a1 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T00:04:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-353632356',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-353632356',id=4,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHS95AsHXsHQ5WUo+qNFwgIJLlEtcpS8GwdztFmcvwprZsn2CsvfRn9jDCwGdOGL9HuU0oylsscRpNL9zF0nJQKzqNgC5UVyUERTxALD/prKFHPNrGlE0h48XNBp/faanQ==',key_name='tempest-keypair-138977160',keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:09:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4f20caf676a64b9b97027f3fc9bc724c',ramdisk_id='',reservation_id='r-0ad3gf97',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1395403129',owner_user_name='tempest-AttachVolumeShelveTestJSON-1395403129-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T00:09:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f8b18d40ecd4b4e976cf2018af8220c',uuid=1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1b166f8e-a207-48d3-a0a9-2ad6c44774b2", "address": "fa:16:3e:2b:d2:f7", "network": {"id": "66316d10-fed3-4fb9-877e-a01542ca5855", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-93456010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f20caf676a64b9b97027f3fc9bc724c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b166f8e-a2", "ovs_interfaceid": "1b166f8e-a207-48d3-a0a9-2ad6c44774b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 00:11:29 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-31848412-0fcf-4093-b182-37cf135c74a1 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Converting VIF {"id": "1b166f8e-a207-48d3-a0a9-2ad6c44774b2", "address": "fa:16:3e:2b:d2:f7", "network": {"id": "66316d10-fed3-4fb9-877e-a01542ca5855", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-93456010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f20caf676a64b9b97027f3fc9bc724c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b166f8e-a2", "ovs_interfaceid": "1b166f8e-a207-48d3-a0a9-2ad6c44774b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:11:29 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-31848412-0fcf-4093-b182-37cf135c74a1 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:d2:f7,bridge_name='br-int',has_traffic_filtering=True,id=1b166f8e-a207-48d3-a0a9-2ad6c44774b2,network=Network(66316d10-fed3-4fb9-877e-a01542ca5855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b166f8e-a2') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:11:29 user nova-compute[82479]: DEBUG os_vif [None req-31848412-0fcf-4093-b182-37cf135c74a1 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:d2:f7,bridge_name='br-int',has_traffic_filtering=True,id=1b166f8e-a207-48d3-a0a9-2ad6c44774b2,network=Network(66316d10-fed3-4fb9-877e-a01542ca5855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b166f8e-a2') {{(pid=82479) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 00:11:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:11:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1b166f8e-a2, bridge=br-int, if_exists=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:11:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:11:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:11:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:11:29 user nova-compute[82479]: INFO os_vif [None req-31848412-0fcf-4093-b182-37cf135c74a1 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:d2:f7,bridge_name='br-int',has_traffic_filtering=True,id=1b166f8e-a207-48d3-a0a9-2ad6c44774b2,network=Network(66316d10-fed3-4fb9-877e-a01542ca5855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b166f8e-a2')
Apr 14 00:11:29 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-31848412-0fcf-4093-b182-37cf135c74a1 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Deleting instance files /opt/stack/data/nova/instances/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a_del
Apr 14 00:11:29 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-31848412-0fcf-4093-b182-37cf135c74a1 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Deletion of /opt/stack/data/nova/instances/1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a_del complete
Apr 14 00:11:29 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27919267-f13b-4101-935e-c17a0618e983 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Calling os-brick to attach iSCSI Volume {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 00:11:29 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-27919267-f13b-4101-935e-c17a0618e983 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PTrqskZW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:11:29 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-27919267-f13b-4101-935e-c17a0618e983 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:11:29 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-27919267-f13b-4101-935e-c17a0618e983 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:11:29 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-27919267-f13b-4101-935e-c17a0618e983 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:11:29 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-27919267-f13b-4101-935e-c17a0618e983 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:11:29 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-27919267-f13b-4101-935e-c17a0618e983 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:11:29 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-27919267-f13b-4101-935e-c17a0618e983 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:11:29 user nova-compute[82479]: INFO os_brick.initiator.connectors.iscsi [None req-27919267-f13b-4101-935e-c17a0618e983 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 00:11:29 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde -p 172.16.0.220:3260 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:29 user nova-compute[82479]: INFO nova.compute.manager [None req-31848412-0fcf-4093-b182-37cf135c74a1 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Took 0.91 seconds to destroy the instance on the hypervisor.
Apr 14 00:11:29 user nova-compute[82479]: DEBUG oslo.service.loopingcall [None req-31848412-0fcf-4093-b182-37cf135c74a1 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82479) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 00:11:29 user nova-compute[82479]: DEBUG nova.compute.manager [-] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Deallocating network for instance {{(pid=82479) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 00:11:29 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] deallocate_for_instance() {{(pid=82479) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 00:11:29 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:29 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba99563d-3894-4d81-a104-5d1dba0a54cf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:11:29 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-27919267-f13b-4101-935e-c17a0618e983 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 00:11:29 user nova-compute[82479]:  {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:11:29 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde -p 172.16.0.220:3260 --interface default --op new {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:29 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:29 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c01cd72-b7f4-47e5-8227-7408b63b3d8a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde] added\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:11:29 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-27919267-f13b-4101-935e-c17a0618e983 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde] added
Apr 14 00:11:29 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:11:29 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:29 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:29 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67bbbb2-97d3-41fc-b505-4241037293c5]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:11:29 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-27919267-f13b-4101-935e-c17a0618e983 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:11:29 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:29 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:29 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f961bd-086b-422d-ab6e-fb97dcc539b9]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:11:29 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-27919267-f13b-4101-935e-c17a0618e983 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:11:29 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PTrqskZW {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:29 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PTrqskZW" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:29 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda4bf61-12ad-43d8-a2db-9b48310971ee]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:11:29 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-27919267-f13b-4101-935e-c17a0618e983 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PTrqskZW'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:11:29 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:29 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:29 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75db270-d294-4457-862a-60be1c51959b]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:11:29 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-27919267-f13b-4101-935e-c17a0618e983 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:11:29 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:29 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:29 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d4c2b87-38da-4371-b5ec-8a3e0d37cabc]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:11:29 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-27919267-f13b-4101-935e-c17a0618e983 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:11:29 user nova-compute[82479]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d (non-flash)
Apr 14 00:11:29 user nova-compute[82479]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 (non-flash)
Apr 14 00:11:29 user nova-compute[82479]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 (non-flash)
Apr 14 00:11:29 user nova-compute[82479]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 (non-flash)
Apr 14 00:11:29 user nova-compute[82479]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc (non-flash)
Apr 14 00:11:29 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:11:29 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-27919267-f13b-4101-935e-c17a0618e983 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:11:29 user nova-compute[82479]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d (non-flash)
Apr 14 00:11:29 user nova-compute[82479]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 (non-flash)
Apr 14 00:11:29 user nova-compute[82479]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 (non-flash)
Apr 14 00:11:29 user nova-compute[82479]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 (non-flash)
Apr 14 00:11:29 user nova-compute[82479]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc (non-flash)
Apr 14 00:11:29 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:11:29 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde -p 172.16.0.220:3260 --login {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:29 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:29 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[9465dec6-fed6-4649-9163-084cbe9beaa1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:11:29 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-27919267-f13b-4101-935e-c17a0618e983 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde, portal: 172.16.0.220,3260]
Apr 14 00:11:29 user nova-compute[82479]: Login to [iface: default, target: iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde, portal: 172.16.0.220,3260] successful.
Apr 14 00:11:29 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:11:29 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:29 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:29 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[89153766-3fd3-49bd-bac7-8c94119b2f8a]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:11:29 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-27919267-f13b-4101-935e-c17a0618e983 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:11:29 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:29 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:29 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[e32e0cd0-d292-4e03-b0ed-013a3e7b3119]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:11:29 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-27919267-f13b-4101-935e-c17a0618e983 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:11:29 user nova-compute[82479]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d (non-flash)
Apr 14 00:11:29 user nova-compute[82479]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 (non-flash)
Apr 14 00:11:29 user nova-compute[82479]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 (non-flash)
Apr 14 00:11:29 user nova-compute[82479]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 (non-flash)
Apr 14 00:11:29 user nova-compute[82479]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc (non-flash)
Apr 14 00:11:29 user nova-compute[82479]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde (non-flash)
Apr 14 00:11:29 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:11:29 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-27919267-f13b-4101-935e-c17a0618e983 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:11:29 user nova-compute[82479]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d (non-flash)
Apr 14 00:11:29 user nova-compute[82479]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 (non-flash)
Apr 14 00:11:29 user nova-compute[82479]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 (non-flash)
Apr 14 00:11:29 user nova-compute[82479]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 (non-flash)
Apr 14 00:11:29 user nova-compute[82479]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc (non-flash)
Apr 14 00:11:29 user nova-compute[82479]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde (non-flash)
Apr 14 00:11:29 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:11:29 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-27919267-f13b-4101-935e-c17a0618e983 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:11:29 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-27919267-f13b-4101-935e-c17a0618e983 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Connected to 172.16.0.220:3260 {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 00:11:29 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-27919267-f13b-4101-935e-c17a0618e983 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] HCTL ('33', '-', '-', 0) found on session 22 with lun 0 {{(pid=82479) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 00:11:29 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-27919267-f13b-4101-935e-c17a0618e983 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82479) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 00:11:29 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:29 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:29 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a40974-a38a-4920-8fe2-3ce6e08908e3]: (4, ('- - 0', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:11:29 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-27919267-f13b-4101-935e-c17a0618e983 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82479) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 00:11:29 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-27919267-f13b-4101-935e-c17a0618e983 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PTrqskZW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 00:11:30 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Updating instance_info_cache with network_info: [] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:11:30 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Took 0.95 seconds to deallocate network for instance.
Apr 14 00:11:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-31848412-0fcf-4093-b182-37cf135c74a1 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:11:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-31848412-0fcf-4093-b182-37cf135c74a1 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:11:30 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-27919267-f13b-4101-935e-c17a0618e983 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:11:30 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-27919267-f13b-4101-935e-c17a0618e983 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '26536373266333933', 'path': '/dev/sdb'} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:11:30 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27919267-f13b-4101-935e-c17a0618e983 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26536373266333933', 'path': '/dev/sdb'} {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 00:11:30 user nova-compute[82479]: DEBUG nova.objects.instance [None req-27919267-f13b-4101-935e-c17a0618e983 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lazy-loading 'flavor' on Instance uuid 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:11:30 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-31848412-0fcf-4093-b182-37cf135c74a1 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:11:30 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-27919267-f13b-4101-935e-c17a0618e983 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 00:11:30 user nova-compute[82479]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:11:30 user nova-compute[82479]:   <source dev="/dev/sdb"/>
Apr 14 00:11:30 user nova-compute[82479]:   <target dev="vdb" bus="virtio"/>
Apr 14 00:11:30 user nova-compute[82479]:   <serial>9a4ad5f1-58f1-4934-b18f-9890ae47ecde</serial>
Apr 14 00:11:30 user nova-compute[82479]: </disk>
Apr 14 00:11:30 user nova-compute[82479]:  {{(pid=82479) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 00:11:30 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-31848412-0fcf-4093-b182-37cf135c74a1 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:11:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-31848412-0fcf-4093-b182-37cf135c74a1 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.394s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:11:30 user nova-compute[82479]: INFO nova.scheduler.client.report [None req-31848412-0fcf-4093-b182-37cf135c74a1 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Deleted allocations for instance 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a
Apr 14 00:11:30 user nova-compute[82479]: DEBUG nova.compute.manager [req-facf7686-6150-4ceb-8404-23a019c4f7ce req-787caa9b-aee2-4eb4-84f4-2c5695ebfc4b service nova] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Received event network-vif-plugged-1b166f8e-a207-48d3-a0a9-2ad6c44774b2 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:11:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-facf7686-6150-4ceb-8404-23a019c4f7ce req-787caa9b-aee2-4eb4-84f4-2c5695ebfc4b service nova] Acquiring lock "1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:11:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-facf7686-6150-4ceb-8404-23a019c4f7ce req-787caa9b-aee2-4eb4-84f4-2c5695ebfc4b service nova] Lock "1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:11:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-facf7686-6150-4ceb-8404-23a019c4f7ce req-787caa9b-aee2-4eb4-84f4-2c5695ebfc4b service nova] Lock "1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:11:30 user nova-compute[82479]: DEBUG nova.compute.manager [req-facf7686-6150-4ceb-8404-23a019c4f7ce req-787caa9b-aee2-4eb4-84f4-2c5695ebfc4b service nova] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] No waiting events found dispatching network-vif-plugged-1b166f8e-a207-48d3-a0a9-2ad6c44774b2 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:11:30 user nova-compute[82479]: WARNING nova.compute.manager [req-facf7686-6150-4ceb-8404-23a019c4f7ce req-787caa9b-aee2-4eb4-84f4-2c5695ebfc4b service nova] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Received unexpected event network-vif-plugged-1b166f8e-a207-48d3-a0a9-2ad6c44774b2 for instance with vm_state deleted and task_state None.
Apr 14 00:11:30 user nova-compute[82479]: DEBUG nova.compute.manager [req-facf7686-6150-4ceb-8404-23a019c4f7ce req-787caa9b-aee2-4eb4-84f4-2c5695ebfc4b service nova] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Received event network-vif-deleted-1b166f8e-a207-48d3-a0a9-2ad6c44774b2 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:11:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-31848412-0fcf-4093-b182-37cf135c74a1 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.458s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:11:30 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:11:30 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-27919267-f13b-4101-935e-c17a0618e983 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:11:30 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-27919267-f13b-4101-935e-c17a0618e983 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:11:30 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-27919267-f13b-4101-935e-c17a0618e983 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] No VIF found with MAC fa:16:3e:f8:1a:b2, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:11:31 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-27919267-f13b-4101-935e-c17a0618e983 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6fb358a6-7e79-4acf-8fbe-7cc4e67a707b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.707s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:11:32 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-507058e1-f87f-484c-8ef4-e26ec08ea977 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquiring lock "6fb358a6-7e79-4acf-8fbe-7cc4e67a707b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:11:32 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-507058e1-f87f-484c-8ef4-e26ec08ea977 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6fb358a6-7e79-4acf-8fbe-7cc4e67a707b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:11:32 user nova-compute[82479]: INFO nova.compute.manager [None req-507058e1-f87f-484c-8ef4-e26ec08ea977 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Detaching volume 9a4ad5f1-58f1-4934-b18f-9890ae47ecde
Apr 14 00:11:32 user nova-compute[82479]: INFO nova.virt.block_device [None req-507058e1-f87f-484c-8ef4-e26ec08ea977 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Attempting to driver detach volume 9a4ad5f1-58f1-4934-b18f-9890ae47ecde from mountpoint /dev/vdb
Apr 14 00:11:32 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-507058e1-f87f-484c-8ef4-e26ec08ea977 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Attempting to detach device vdb from instance 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b from the persistent domain config. {{(pid=82479) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 00:11:32 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-507058e1-f87f-484c-8ef4-e26ec08ea977 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 00:11:32 user nova-compute[82479]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:11:32 user nova-compute[82479]:   <source dev="/dev/sdb"/>
Apr 14 00:11:32 user nova-compute[82479]:   <target dev="vdb" bus="virtio"/>
Apr 14 00:11:32 user nova-compute[82479]:   <serial>9a4ad5f1-58f1-4934-b18f-9890ae47ecde</serial>
Apr 14 00:11:32 user nova-compute[82479]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 00:11:32 user nova-compute[82479]: </disk>
Apr 14 00:11:32 user nova-compute[82479]:  {{(pid=82479) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 00:11:32 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-507058e1-f87f-484c-8ef4-e26ec08ea977 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Successfully detached device vdb from instance 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b from the persistent domain config.
Apr 14 00:11:32 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-507058e1-f87f-484c-8ef4-e26ec08ea977 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b from the live domain config. {{(pid=82479) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 00:11:32 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-507058e1-f87f-484c-8ef4-e26ec08ea977 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 00:11:32 user nova-compute[82479]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:11:32 user nova-compute[82479]:   <source dev="/dev/sdb"/>
Apr 14 00:11:32 user nova-compute[82479]:   <target dev="vdb" bus="virtio"/>
Apr 14 00:11:32 user nova-compute[82479]:   <serial>9a4ad5f1-58f1-4934-b18f-9890ae47ecde</serial>
Apr 14 00:11:32 user nova-compute[82479]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 00:11:32 user nova-compute[82479]: </disk>
Apr 14 00:11:32 user nova-compute[82479]:  {{(pid=82479) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 00:11:33 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Received event <DeviceRemovedEvent: 1681431093.4586012, 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82479) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 00:11:33 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-507058e1-f87f-484c-8ef4-e26ec08ea977 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b {{(pid=82479) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 00:11:33 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-507058e1-f87f-484c-8ef4-e26ec08ea977 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Successfully detached device vdb from instance 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b from the live domain config.
Apr 14 00:11:33 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-507058e1-f87f-484c-8ef4-e26ec08ea977 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] calling os-brick to detach iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 00:11:33 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-507058e1-f87f-484c-8ef4-e26ec08ea977 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, {'target_iqn': 'iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PTrqskZW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:11:33 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-507058e1-f87f-484c-8ef4-e26ec08ea977 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:11:33 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-507058e1-f87f-484c-8ef4-e26ec08ea977 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:11:33 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-507058e1-f87f-484c-8ef4-e26ec08ea977 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:11:33 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:33 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:33 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e5e62b-8666-48fa-832b-a52e3fd471dc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:11:33 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-507058e1-f87f-484c-8ef4-e26ec08ea977 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 00:11:33 user nova-compute[82479]: No targets found.
Apr 14 00:11:33 user nova-compute[82479]: iSNS:
Apr 14 00:11:33 user nova-compute[82479]: No targets found.
Apr 14 00:11:33 user nova-compute[82479]: STATIC:
Apr 14 00:11:33 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0
Apr 14 00:11:33 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:11:33 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:11:33 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde
Apr 14 00:11:33 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:11:33 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:11:33 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc
Apr 14 00:11:33 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:11:33 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:11:33 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d
Apr 14 00:11:33 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:11:33 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:11:33 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc
Apr 14 00:11:33 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:11:33 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:11:33 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593
Apr 14 00:11:33 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:11:33 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:11:33 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62
Apr 14 00:11:33 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:11:33 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:11:33 user nova-compute[82479]: FIRMWARE:
Apr 14 00:11:33 user nova-compute[82479]: No targets found.
Apr 14 00:11:33 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:11:33 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-507058e1-f87f-484c-8ef4-e26ec08ea977 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 00:11:33 user nova-compute[82479]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 00:11:33 user nova-compute[82479]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82479) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 00:11:33 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-507058e1-f87f-484c-8ef4-e26ec08ea977 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde', 0)] {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 00:11:33 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:33 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:33 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38942ee-b09a-472f-b584-8ff23af92abe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:11:33 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:33 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:33 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[85407d47-ded3-496d-be7a-e30220a97e50]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:11:33 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-507058e1-f87f-484c-8ef4-e26ec08ea977 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:11:33 user nova-compute[82479]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d (non-flash)
Apr 14 00:11:33 user nova-compute[82479]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 (non-flash)
Apr 14 00:11:33 user nova-compute[82479]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 (non-flash)
Apr 14 00:11:33 user nova-compute[82479]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 (non-flash)
Apr 14 00:11:33 user nova-compute[82479]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc (non-flash)
Apr 14 00:11:33 user nova-compute[82479]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde (non-flash)
Apr 14 00:11:33 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:11:33 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-507058e1-f87f-484c-8ef4-e26ec08ea977 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:11:33 user nova-compute[82479]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d (non-flash)
Apr 14 00:11:33 user nova-compute[82479]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 (non-flash)
Apr 14 00:11:33 user nova-compute[82479]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 (non-flash)
Apr 14 00:11:33 user nova-compute[82479]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 (non-flash)
Apr 14 00:11:33 user nova-compute[82479]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc (non-flash)
Apr 14 00:11:33 user nova-compute[82479]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde (non-flash)
Apr 14 00:11:33 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:11:33 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-507058e1-f87f-484c-8ef4-e26ec08ea977 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3344cd8040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde'): ({'sdb'}, set())}) {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 00:11:33 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-507058e1-f87f-484c-8ef4-e26ec08ea977 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Removing single pathed devices sdb {{(pid=82479) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 00:11:33 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:33 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:33 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[9313eb0f-8d2f-4d34-9a7d-2c3bd6173094]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:11:33 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:33 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:33 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1fafbb6-1909-4fba-a4b8-85bcc84fa340]: (4, ('ok\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:11:33 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-507058e1-f87f-484c-8ef4-e26ec08ea977 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Flushing IO for device /dev/sdb {{(pid=82479) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 00:11:33 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:33 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:33 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0bf8b64-fbbf-41e5-a0a9-c4969d1c0018]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:11:33 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-507058e1-f87f-484c-8ef4-e26ec08ea977 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82479) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 00:11:33 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:33 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:33 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a81bb80-5a05-4ef5-be12-7488dbfcb543]: (4, ('1', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:11:33 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-507058e1-f87f-484c-8ef4-e26ec08ea977 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 00:11:33 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-507058e1-f87f-484c-8ef4-e26ec08ea977 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] SCSI volumes sdb have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 00:11:33 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-507058e1-f87f-484c-8ef4-e26ec08ea977 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde')] {{(pid=82479) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 00:11:33 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:33 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:33 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f68929-2198-48df-9a5d-b8150439f599]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:11:33 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-507058e1-f87f-484c-8ef4-e26ec08ea977 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:11:33 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde -p 172.16.0.220:3260 --logout {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:33 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:33 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b785d51-1b45-48fa-a9fd-96419133438a]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:11:33 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-507058e1-f87f-484c-8ef4-e26ec08ea977 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde, portal: 172.16.0.220,3260]
Apr 14 00:11:33 user nova-compute[82479]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde, portal: 172.16.0.220,3260] successful.
Apr 14 00:11:33 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:11:33 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde -p 172.16.0.220:3260 --op delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:33 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:33 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc83647f-6e10-4e86-bbb1-decd229be6f5]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:11:33 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-507058e1-f87f-484c-8ef4-e26ec08ea977 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:11:33 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-507058e1-f87f-484c-8ef4-e26ec08ea977 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.384s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:11:33 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-507058e1-f87f-484c-8ef4-e26ec08ea977 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] <== disconnect_volume: return (385ms) None {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:11:33 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-507058e1-f87f-484c-8ef4-e26ec08ea977 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Disconnected iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 00:11:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:11:34 user nova-compute[82479]: DEBUG nova.objects.instance [None req-507058e1-f87f-484c-8ef4-e26ec08ea977 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lazy-loading 'flavor' on Instance uuid 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:11:34 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-507058e1-f87f-484c-8ef4-e26ec08ea977 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6fb358a6-7e79-4acf-8fbe-7cc4e67a707b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.968s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:11:35 user nova-compute[82479]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681431080.288619, b21b91b1-a98b-48c7-a2e8-4114c3e31345 => Stopped> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:11:35 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] VM Stopped (Lifecycle Event)
Apr 14 00:11:35 user nova-compute[82479]: DEBUG nova.compute.manager [None req-59c2d887-a314-4645-8a5b-eda009d8e577 None None] [instance: b21b91b1-a98b-48c7-a2e8-4114c3e31345] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:11:35 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:11:39 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:11:40 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:11:41 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._sync_power_states {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:11:41 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Triggering sync for uuid 23718fd0-58b8-47f9-b1ef-a26a90741ecc {{(pid=82479) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 00:11:41 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Triggering sync for uuid 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97 {{(pid=82479) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 00:11:41 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Triggering sync for uuid 01a65362-36ea-4817-8e83-f75d6daf808b {{(pid=82479) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 00:11:41 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Triggering sync for uuid b3475e7e-ceb4-452a-a045-dbf43c5944dd {{(pid=82479) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 00:11:41 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Triggering sync for uuid 11c3384a-e699-4b10-9f8b-861291e96465 {{(pid=82479) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 00:11:41 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Triggering sync for uuid e3fba4ee-4aae-4ee3-8114-b53510f5442c {{(pid=82479) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 00:11:41 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Triggering sync for uuid 17c6c147-fb62-4204-a416-792b94d3f7dd {{(pid=82479) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 00:11:41 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Triggering sync for uuid 8feba40a-03c7-4c60-b862-ee14fb8c9b05 {{(pid=82479) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 00:11:41 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Triggering sync for uuid 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b {{(pid=82479) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 00:11:41 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Triggering sync for uuid 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 {{(pid=82479) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 00:11:41 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Triggering sync for uuid d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c {{(pid=82479) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 00:11:41 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Triggering sync for uuid 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c {{(pid=82479) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 00:11:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "23718fd0-58b8-47f9-b1ef-a26a90741ecc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:11:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "23718fd0-58b8-47f9-b1ef-a26a90741ecc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:11:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "3a6b9f89-e462-47d8-84a1-0ac4ade3ab97" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:11:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "3a6b9f89-e462-47d8-84a1-0ac4ade3ab97" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:11:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "01a65362-36ea-4817-8e83-f75d6daf808b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:11:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "01a65362-36ea-4817-8e83-f75d6daf808b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:11:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:11:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:11:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "11c3384a-e699-4b10-9f8b-861291e96465" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:11:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "11c3384a-e699-4b10-9f8b-861291e96465" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:11:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "e3fba4ee-4aae-4ee3-8114-b53510f5442c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:11:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "e3fba4ee-4aae-4ee3-8114-b53510f5442c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:11:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "17c6c147-fb62-4204-a416-792b94d3f7dd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:11:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "17c6c147-fb62-4204-a416-792b94d3f7dd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:11:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "8feba40a-03c7-4c60-b862-ee14fb8c9b05" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:11:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "8feba40a-03c7-4c60-b862-ee14fb8c9b05" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:11:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "6fb358a6-7e79-4acf-8fbe-7cc4e67a707b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:11:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "6fb358a6-7e79-4acf-8fbe-7cc4e67a707b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:11:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:11:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:11:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:11:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:11:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:11:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:11:41 user nova-compute[82479]: WARNING oslo_messaging._drivers.amqpdriver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20
Apr 14 00:11:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "3a6b9f89-e462-47d8-84a1-0ac4ade3ab97" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.083s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:11:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "8feba40a-03c7-4c60-b862-ee14fb8c9b05" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.083s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:11:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "23718fd0-58b8-47f9-b1ef-a26a90741ecc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.093s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:11:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.095s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:11:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.101s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:11:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "11c3384a-e699-4b10-9f8b-861291e96465" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.108s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:11:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "17c6c147-fb62-4204-a416-792b94d3f7dd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.117s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:11:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.116s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:11:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "01a65362-36ea-4817-8e83-f75d6daf808b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.181s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:11:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.185s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:11:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "e3fba4ee-4aae-4ee3-8114-b53510f5442c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.192s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:11:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "6fb358a6-7e79-4acf-8fbe-7cc4e67a707b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.203s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:11:42 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:11:42 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:11:43 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:11:43 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Starting heal instance info cache {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 00:11:43 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Rebuilding the list of instances to heal {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 00:11:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "refresh_cache-23718fd0-58b8-47f9-b1ef-a26a90741ecc" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:11:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquired lock "refresh_cache-23718fd0-58b8-47f9-b1ef-a26a90741ecc" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:11:43 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Forcefully refreshing network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 00:11:43 user nova-compute[82479]: DEBUG nova.objects.instance [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lazy-loading 'info_cache' on Instance uuid 23718fd0-58b8-47f9-b1ef-a26a90741ecc {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:11:44 user nova-compute[82479]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681431089.035244, 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a => Stopped> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:11:44 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] VM Stopped (Lifecycle Event)
Apr 14 00:11:44 user nova-compute[82479]: DEBUG nova.compute.manager [None req-2d364088-8d0b-4ce5-a2bd-9b3d11c6951a None None] [instance: 1cb6faa3-d18b-49ab-9c4d-c8269cc76d1a] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:11:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:11:44 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Updating instance_info_cache with network_info: [{"id": "db4fcb1f-e93d-4eee-851d-0c47f24dcdb3", "address": "fa:16:3e:28:8a:3c", "network": {"id": "491696ea-38ef-4c19-9d94-a61223c1fa00", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1323121698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3f111e24414976beddba7ef90c4793", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb4fcb1f-e9", "ovs_interfaceid": "db4fcb1f-e93d-4eee-851d-0c47f24dcdb3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:11:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Releasing lock "refresh_cache-23718fd0-58b8-47f9-b1ef-a26a90741ecc" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:11:44 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Updated the network info_cache for instance {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 00:11:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Acquiring lock "493c65ce-aceb-4273-926e-d3633e676008" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:11:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "493c65ce-aceb-4273-926e-d3633e676008" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:11:45 user nova-compute[82479]: DEBUG nova.compute.manager [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 493c65ce-aceb-4273-926e-d3633e676008] Starting instance... {{(pid=82479) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 00:11:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:11:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:11:45 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82479) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 00:11:45 user nova-compute[82479]: INFO nova.compute.claims [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 493c65ce-aceb-4273-926e-d3633e676008] Claim successful on node user
Apr 14 00:11:45 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:11:45 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:11:45 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:11:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.515s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:11:45 user nova-compute[82479]: DEBUG nova.compute.manager [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 493c65ce-aceb-4273-926e-d3633e676008] Start building networks asynchronously for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 00:11:45 user nova-compute[82479]: DEBUG nova.compute.manager [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 493c65ce-aceb-4273-926e-d3633e676008] Allocating IP information in the background. {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 00:11:45 user nova-compute[82479]: DEBUG nova.network.neutron [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 493c65ce-aceb-4273-926e-d3633e676008] allocate_for_instance() {{(pid=82479) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 00:11:45 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 493c65ce-aceb-4273-926e-d3633e676008] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 00:11:45 user nova-compute[82479]: DEBUG nova.compute.manager [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 493c65ce-aceb-4273-926e-d3633e676008] Start building block device mappings for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 00:11:45 user nova-compute[82479]: DEBUG nova.compute.manager [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 493c65ce-aceb-4273-926e-d3633e676008] Start spawning the instance on the hypervisor. {{(pid=82479) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 00:11:45 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 493c65ce-aceb-4273-926e-d3633e676008] Creating instance directory {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 00:11:45 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 493c65ce-aceb-4273-926e-d3633e676008] Creating image(s)
Apr 14 00:11:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Acquiring lock "/opt/stack/data/nova/instances/493c65ce-aceb-4273-926e-d3633e676008/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:11:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "/opt/stack/data/nova/instances/493c65ce-aceb-4273-926e-d3633e676008/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:11:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "/opt/stack/data/nova/instances/493c65ce-aceb-4273-926e-d3633e676008/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:11:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.132s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:46 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Acquiring lock "3e200e101633f2016e569ae4c0a352380507d1e4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:11:46 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "3e200e101633f2016e569ae4c0a352380507d1e4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:11:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.135s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/493c65ce-aceb-4273-926e-d3633e676008/disk 1073741824 {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/493c65ce-aceb-4273-926e-d3633e676008/disk 1073741824" returned: 0 in 0.053s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:46 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "3e200e101633f2016e569ae4c0a352380507d1e4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:11:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:46 user nova-compute[82479]: DEBUG nova.policy [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '74d7e3d598e74c288e6a44996303b85e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffbe999e60a4add9f23c83f9b0a4252', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82479) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 00:11:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.132s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:46 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Checking if we can resize image /opt/stack/data/nova/instances/493c65ce-aceb-4273-926e-d3633e676008/disk. size=1073741824 {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 00:11:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/493c65ce-aceb-4273-926e-d3633e676008/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/493c65ce-aceb-4273-926e-d3633e676008/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:46 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Cannot resize image /opt/stack/data/nova/instances/493c65ce-aceb-4273-926e-d3633e676008/disk to a smaller size. {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 00:11:46 user nova-compute[82479]: DEBUG nova.objects.instance [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lazy-loading 'migration_context' on Instance uuid 493c65ce-aceb-4273-926e-d3633e676008 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:11:46 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 493c65ce-aceb-4273-926e-d3633e676008] Created local disks {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 00:11:46 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 493c65ce-aceb-4273-926e-d3633e676008] Ensure instance console log exists: /opt/stack/data/nova/instances/493c65ce-aceb-4273-926e-d3633e676008/console.log {{(pid=82479) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 00:11:46 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:11:46 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:11:46 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:11:47 user nova-compute[82479]: DEBUG nova.network.neutron [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 493c65ce-aceb-4273-926e-d3633e676008] Successfully created port: 6f4cb2f5-fcb3-4349-b8a6-ec85658ffe5b {{(pid=82479) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 00:11:47 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:11:47 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82479) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 00:11:47 user nova-compute[82479]: DEBUG nova.network.neutron [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 493c65ce-aceb-4273-926e-d3633e676008] Successfully updated port: 6f4cb2f5-fcb3-4349-b8a6-ec85658ffe5b {{(pid=82479) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 00:11:47 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Acquiring lock "refresh_cache-493c65ce-aceb-4273-926e-d3633e676008" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:11:47 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Acquired lock "refresh_cache-493c65ce-aceb-4273-926e-d3633e676008" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:11:47 user nova-compute[82479]: DEBUG nova.network.neutron [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 493c65ce-aceb-4273-926e-d3633e676008] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 00:11:47 user nova-compute[82479]: DEBUG nova.compute.manager [req-b8cbd7e8-2477-45b2-8b35-fb5dbdbca587 req-9ba07121-6c14-48ef-a558-dd2b1b530531 service nova] [instance: 493c65ce-aceb-4273-926e-d3633e676008] Received event network-changed-6f4cb2f5-fcb3-4349-b8a6-ec85658ffe5b {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:11:47 user nova-compute[82479]: DEBUG nova.compute.manager [req-b8cbd7e8-2477-45b2-8b35-fb5dbdbca587 req-9ba07121-6c14-48ef-a558-dd2b1b530531 service nova] [instance: 493c65ce-aceb-4273-926e-d3633e676008] Refreshing instance network info cache due to event network-changed-6f4cb2f5-fcb3-4349-b8a6-ec85658ffe5b. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:11:47 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-b8cbd7e8-2477-45b2-8b35-fb5dbdbca587 req-9ba07121-6c14-48ef-a558-dd2b1b530531 service nova] Acquiring lock "refresh_cache-493c65ce-aceb-4273-926e-d3633e676008" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:11:47 user nova-compute[82479]: DEBUG nova.network.neutron [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 493c65ce-aceb-4273-926e-d3633e676008] Instance cache missing network info. {{(pid=82479) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 00:11:48 user nova-compute[82479]: DEBUG nova.network.neutron [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 493c65ce-aceb-4273-926e-d3633e676008] Updating instance_info_cache with network_info: [{"id": "6f4cb2f5-fcb3-4349-b8a6-ec85658ffe5b", "address": "fa:16:3e:1b:0f:d8", "network": {"id": "49f71fbc-7d65-4cc6-9efe-3918d5dbd51a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2079147315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dffbe999e60a4add9f23c83f9b0a4252", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f4cb2f5-fc", "ovs_interfaceid": "6f4cb2f5-fcb3-4349-b8a6-ec85658ffe5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:11:48 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Releasing lock "refresh_cache-493c65ce-aceb-4273-926e-d3633e676008" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:11:48 user nova-compute[82479]: DEBUG nova.compute.manager [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 493c65ce-aceb-4273-926e-d3633e676008] Instance network_info: |[{"id": "6f4cb2f5-fcb3-4349-b8a6-ec85658ffe5b", "address": "fa:16:3e:1b:0f:d8", "network": {"id": "49f71fbc-7d65-4cc6-9efe-3918d5dbd51a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2079147315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dffbe999e60a4add9f23c83f9b0a4252", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f4cb2f5-fc", "ovs_interfaceid": "6f4cb2f5-fcb3-4349-b8a6-ec85658ffe5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 00:11:48 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-b8cbd7e8-2477-45b2-8b35-fb5dbdbca587 req-9ba07121-6c14-48ef-a558-dd2b1b530531 service nova] Acquired lock "refresh_cache-493c65ce-aceb-4273-926e-d3633e676008" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:11:48 user nova-compute[82479]: DEBUG nova.network.neutron [req-b8cbd7e8-2477-45b2-8b35-fb5dbdbca587 req-9ba07121-6c14-48ef-a558-dd2b1b530531 service nova] [instance: 493c65ce-aceb-4273-926e-d3633e676008] Refreshing network info cache for port 6f4cb2f5-fcb3-4349-b8a6-ec85658ffe5b {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:11:48 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 493c65ce-aceb-4273-926e-d3633e676008] Start _get_guest_xml network_info=[{"id": "6f4cb2f5-fcb3-4349-b8a6-ec85658ffe5b", "address": "fa:16:3e:1b:0f:d8", "network": {"id": "49f71fbc-7d65-4cc6-9efe-3918d5dbd51a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2079147315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dffbe999e60a4add9f23c83f9b0a4252", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f4cb2f5-fc", "ovs_interfaceid": "6f4cb2f5-fcb3-4349-b8a6-ec85658ffe5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 00:11:48 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:11:48 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:11:48 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82479) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 00:11:48 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T00:02:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 00:11:48 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Flavor limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 00:11:48 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Image limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 00:11:48 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Flavor pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 00:11:48 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Image pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 00:11:48 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 00:11:48 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 00:11:48 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 00:11:48 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Got 1 possible topologies {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 00:11:48 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 00:11:48 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 00:11:48 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:11:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-558458744',display_name='tempest-VolumesAdminNegativeTest-server-558458744',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-558458744',id=20,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dffbe999e60a4add9f23c83f9b0a4252',ramdisk_id='',reservation_id='r-2jrouibe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1377720460',owner_user_name='tempest-VolumesAdminNegativeTest-1377720460-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:11:46Z,user_data=None,user_id='74d7e3d598e74c288e6a44996303b85e',uuid=493c65ce-aceb-4273-926e-d3633e676008,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f4cb2f5-fcb3-4349-b8a6-ec85658ffe5b", "address": "fa:16:3e:1b:0f:d8", "network": {"id": "49f71fbc-7d65-4cc6-9efe-3918d5dbd51a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2079147315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dffbe999e60a4add9f23c83f9b0a4252", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f4cb2f5-fc", "ovs_interfaceid": "6f4cb2f5-fcb3-4349-b8a6-ec85658ffe5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82479) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 00:11:48 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Converting VIF {"id": "6f4cb2f5-fcb3-4349-b8a6-ec85658ffe5b", "address": "fa:16:3e:1b:0f:d8", "network": {"id": "49f71fbc-7d65-4cc6-9efe-3918d5dbd51a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2079147315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dffbe999e60a4add9f23c83f9b0a4252", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f4cb2f5-fc", "ovs_interfaceid": "6f4cb2f5-fcb3-4349-b8a6-ec85658ffe5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:11:48 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:0f:d8,bridge_name='br-int',has_traffic_filtering=True,id=6f4cb2f5-fcb3-4349-b8a6-ec85658ffe5b,network=Network(49f71fbc-7d65-4cc6-9efe-3918d5dbd51a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f4cb2f5-fc') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:11:48 user nova-compute[82479]: DEBUG nova.objects.instance [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lazy-loading 'pci_devices' on Instance uuid 493c65ce-aceb-4273-926e-d3633e676008 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:11:48 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 493c65ce-aceb-4273-926e-d3633e676008] End _get_guest_xml xml=<domain type="kvm">
Apr 14 00:11:48 user nova-compute[82479]:   <uuid>493c65ce-aceb-4273-926e-d3633e676008</uuid>
Apr 14 00:11:48 user nova-compute[82479]:   <name>instance-00000014</name>
Apr 14 00:11:48 user nova-compute[82479]:   <memory>131072</memory>
Apr 14 00:11:48 user nova-compute[82479]:   <vcpu>1</vcpu>
Apr 14 00:11:48 user nova-compute[82479]:   <metadata>
Apr 14 00:11:48 user nova-compute[82479]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 00:11:48 user nova-compute[82479]:       <nova:package version="0.0.0"/>
Apr 14 00:11:48 user nova-compute[82479]:       <nova:name>tempest-VolumesAdminNegativeTest-server-558458744</nova:name>
Apr 14 00:11:48 user nova-compute[82479]:       <nova:creationTime>2023-04-14 00:11:48</nova:creationTime>
Apr 14 00:11:48 user nova-compute[82479]:       <nova:flavor name="m1.nano">
Apr 14 00:11:48 user nova-compute[82479]:         <nova:memory>128</nova:memory>
Apr 14 00:11:48 user nova-compute[82479]:         <nova:disk>1</nova:disk>
Apr 14 00:11:48 user nova-compute[82479]:         <nova:swap>0</nova:swap>
Apr 14 00:11:48 user nova-compute[82479]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 00:11:48 user nova-compute[82479]:         <nova:vcpus>1</nova:vcpus>
Apr 14 00:11:48 user nova-compute[82479]:       </nova:flavor>
Apr 14 00:11:48 user nova-compute[82479]:       <nova:owner>
Apr 14 00:11:48 user nova-compute[82479]:         <nova:user uuid="74d7e3d598e74c288e6a44996303b85e">tempest-VolumesAdminNegativeTest-1377720460-project-member</nova:user>
Apr 14 00:11:48 user nova-compute[82479]:         <nova:project uuid="dffbe999e60a4add9f23c83f9b0a4252">tempest-VolumesAdminNegativeTest-1377720460</nova:project>
Apr 14 00:11:48 user nova-compute[82479]:       </nova:owner>
Apr 14 00:11:48 user nova-compute[82479]:       <nova:root type="image" uuid="6db62068-7278-4cd8-b41f-d0140d89e199"/>
Apr 14 00:11:48 user nova-compute[82479]:       <nova:ports>
Apr 14 00:11:48 user nova-compute[82479]:         <nova:port uuid="6f4cb2f5-fcb3-4349-b8a6-ec85658ffe5b">
Apr 14 00:11:48 user nova-compute[82479]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 14 00:11:48 user nova-compute[82479]:         </nova:port>
Apr 14 00:11:48 user nova-compute[82479]:       </nova:ports>
Apr 14 00:11:48 user nova-compute[82479]:     </nova:instance>
Apr 14 00:11:48 user nova-compute[82479]:   </metadata>
Apr 14 00:11:48 user nova-compute[82479]:   <sysinfo type="smbios">
Apr 14 00:11:48 user nova-compute[82479]:     <system>
Apr 14 00:11:48 user nova-compute[82479]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 00:11:48 user nova-compute[82479]:       <entry name="product">OpenStack Nova</entry>
Apr 14 00:11:48 user nova-compute[82479]:       <entry name="version">0.0.0</entry>
Apr 14 00:11:48 user nova-compute[82479]:       <entry name="serial">493c65ce-aceb-4273-926e-d3633e676008</entry>
Apr 14 00:11:48 user nova-compute[82479]:       <entry name="uuid">493c65ce-aceb-4273-926e-d3633e676008</entry>
Apr 14 00:11:48 user nova-compute[82479]:       <entry name="family">Virtual Machine</entry>
Apr 14 00:11:48 user nova-compute[82479]:     </system>
Apr 14 00:11:48 user nova-compute[82479]:   </sysinfo>
Apr 14 00:11:48 user nova-compute[82479]:   <os>
Apr 14 00:11:48 user nova-compute[82479]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 00:11:48 user nova-compute[82479]:     <boot dev="hd"/>
Apr 14 00:11:48 user nova-compute[82479]:     <smbios mode="sysinfo"/>
Apr 14 00:11:48 user nova-compute[82479]:   </os>
Apr 14 00:11:48 user nova-compute[82479]:   <features>
Apr 14 00:11:48 user nova-compute[82479]:     <acpi/>
Apr 14 00:11:48 user nova-compute[82479]:     <apic/>
Apr 14 00:11:48 user nova-compute[82479]:     <vmcoreinfo/>
Apr 14 00:11:48 user nova-compute[82479]:   </features>
Apr 14 00:11:48 user nova-compute[82479]:   <clock offset="utc">
Apr 14 00:11:48 user nova-compute[82479]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 00:11:48 user nova-compute[82479]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 00:11:48 user nova-compute[82479]:     <timer name="hpet" present="no"/>
Apr 14 00:11:48 user nova-compute[82479]:   </clock>
Apr 14 00:11:48 user nova-compute[82479]:   <cpu mode="custom" match="exact">
Apr 14 00:11:48 user nova-compute[82479]:     <model>Nehalem</model>
Apr 14 00:11:48 user nova-compute[82479]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 00:11:48 user nova-compute[82479]:   </cpu>
Apr 14 00:11:48 user nova-compute[82479]:   <devices>
Apr 14 00:11:48 user nova-compute[82479]:     <disk type="file" device="disk">
Apr 14 00:11:48 user nova-compute[82479]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 00:11:48 user nova-compute[82479]:       <source file="/opt/stack/data/nova/instances/493c65ce-aceb-4273-926e-d3633e676008/disk"/>
Apr 14 00:11:48 user nova-compute[82479]:       <target dev="vda" bus="virtio"/>
Apr 14 00:11:48 user nova-compute[82479]:     </disk>
Apr 14 00:11:48 user nova-compute[82479]:     <interface type="ethernet">
Apr 14 00:11:48 user nova-compute[82479]:       <mac address="fa:16:3e:1b:0f:d8"/>
Apr 14 00:11:48 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:11:48 user nova-compute[82479]:       <mtu size="1442"/>
Apr 14 00:11:48 user nova-compute[82479]:       <target dev="tap6f4cb2f5-fc"/>
Apr 14 00:11:48 user nova-compute[82479]:     </interface>
Apr 14 00:11:48 user nova-compute[82479]:     <serial type="pty">
Apr 14 00:11:48 user nova-compute[82479]:       <log file="/opt/stack/data/nova/instances/493c65ce-aceb-4273-926e-d3633e676008/console.log" append="off"/>
Apr 14 00:11:48 user nova-compute[82479]:     </serial>
Apr 14 00:11:48 user nova-compute[82479]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 00:11:48 user nova-compute[82479]:     <video>
Apr 14 00:11:48 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:11:48 user nova-compute[82479]:     </video>
Apr 14 00:11:48 user nova-compute[82479]:     <rng model="virtio">
Apr 14 00:11:48 user nova-compute[82479]:       <backend model="random">/dev/urandom</backend>
Apr 14 00:11:48 user nova-compute[82479]:     </rng>
Apr 14 00:11:48 user nova-compute[82479]:     <controller type="usb" index="0" model="none"/>
Apr 14 00:11:48 user nova-compute[82479]:     <memballoon model="virtio">
Apr 14 00:11:48 user nova-compute[82479]:       <stats period="10"/>
Apr 14 00:11:48 user nova-compute[82479]:     </memballoon>
Apr 14 00:11:48 user nova-compute[82479]:   </devices>
Apr 14 00:11:48 user nova-compute[82479]: </domain>
Apr 14 00:11:48 user nova-compute[82479]:  {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 00:11:48 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:11:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-558458744',display_name='tempest-VolumesAdminNegativeTest-server-558458744',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-558458744',id=20,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dffbe999e60a4add9f23c83f9b0a4252',ramdisk_id='',reservation_id='r-2jrouibe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1377720460',owner_user_name='tempest-VolumesAdminNegativeTest-1377720460-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:11:46Z,user_data=None,user_id='74d7e3d598e74c288e6a44996303b85e',uuid=493c65ce-aceb-4273-926e-d3633e676008,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f4cb2f5-fcb3-4349-b8a6-ec85658ffe5b", "address": "fa:16:3e:1b:0f:d8", "network": {"id": "49f71fbc-7d65-4cc6-9efe-3918d5dbd51a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2079147315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dffbe999e60a4add9f23c83f9b0a4252", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f4cb2f5-fc", "ovs_interfaceid": "6f4cb2f5-fcb3-4349-b8a6-ec85658ffe5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 00:11:48 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Converting VIF {"id": "6f4cb2f5-fcb3-4349-b8a6-ec85658ffe5b", "address": "fa:16:3e:1b:0f:d8", "network": {"id": "49f71fbc-7d65-4cc6-9efe-3918d5dbd51a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2079147315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dffbe999e60a4add9f23c83f9b0a4252", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f4cb2f5-fc", "ovs_interfaceid": "6f4cb2f5-fcb3-4349-b8a6-ec85658ffe5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:11:48 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:0f:d8,bridge_name='br-int',has_traffic_filtering=True,id=6f4cb2f5-fcb3-4349-b8a6-ec85658ffe5b,network=Network(49f71fbc-7d65-4cc6-9efe-3918d5dbd51a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f4cb2f5-fc') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:11:48 user nova-compute[82479]: DEBUG os_vif [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:0f:d8,bridge_name='br-int',has_traffic_filtering=True,id=6f4cb2f5-fcb3-4349-b8a6-ec85658ffe5b,network=Network(49f71fbc-7d65-4cc6-9efe-3918d5dbd51a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f4cb2f5-fc') {{(pid=82479) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 00:11:48 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:11:48 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:11:48 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 00:11:48 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:11:48 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6f4cb2f5-fc, may_exist=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:11:48 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6f4cb2f5-fc, col_values=(('external_ids', {'iface-id': '6f4cb2f5-fcb3-4349-b8a6-ec85658ffe5b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:0f:d8', 'vm-uuid': '493c65ce-aceb-4273-926e-d3633e676008'}),)) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:11:48 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:11:48 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:11:48 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:11:48 user nova-compute[82479]: INFO os_vif [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:0f:d8,bridge_name='br-int',has_traffic_filtering=True,id=6f4cb2f5-fcb3-4349-b8a6-ec85658ffe5b,network=Network(49f71fbc-7d65-4cc6-9efe-3918d5dbd51a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f4cb2f5-fc')
Apr 14 00:11:48 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:11:48 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] No VIF found with MAC fa:16:3e:1b:0f:d8, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:11:48 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:11:48 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:11:48 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:11:48 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:11:48 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:11:48 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Auditing locally available compute resources for user (node: user) {{(pid=82479) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 00:11:48 user nova-compute[82479]: DEBUG nova.network.neutron [req-b8cbd7e8-2477-45b2-8b35-fb5dbdbca587 req-9ba07121-6c14-48ef-a558-dd2b1b530531 service nova] [instance: 493c65ce-aceb-4273-926e-d3633e676008] Updated VIF entry in instance network info cache for port 6f4cb2f5-fcb3-4349-b8a6-ec85658ffe5b. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:11:48 user nova-compute[82479]: DEBUG nova.network.neutron [req-b8cbd7e8-2477-45b2-8b35-fb5dbdbca587 req-9ba07121-6c14-48ef-a558-dd2b1b530531 service nova] [instance: 493c65ce-aceb-4273-926e-d3633e676008] Updating instance_info_cache with network_info: [{"id": "6f4cb2f5-fcb3-4349-b8a6-ec85658ffe5b", "address": "fa:16:3e:1b:0f:d8", "network": {"id": "49f71fbc-7d65-4cc6-9efe-3918d5dbd51a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2079147315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dffbe999e60a4add9f23c83f9b0a4252", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f4cb2f5-fc", "ovs_interfaceid": "6f4cb2f5-fcb3-4349-b8a6-ec85658ffe5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:11:48 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-b8cbd7e8-2477-45b2-8b35-fb5dbdbca587 req-9ba07121-6c14-48ef-a558-dd2b1b530531 service nova] Releasing lock "refresh_cache-493c65ce-aceb-4273-926e-d3633e676008" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:11:49 user nova-compute[82479]: INFO nova.compute.manager [None req-e9cbf181-0f06-4a2b-a2b2-21cfda242dcd tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Rescuing
Apr 14 00:11:49 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e9cbf181-0f06-4a2b-a2b2-21cfda242dcd tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "refresh_cache-d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:11:49 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e9cbf181-0f06-4a2b-a2b2-21cfda242dcd tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquired lock "refresh_cache-d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:11:49 user nova-compute[82479]: DEBUG nova.network.neutron [None req-e9cbf181-0f06-4a2b-a2b2-21cfda242dcd tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 00:11:49 user nova-compute[82479]: DEBUG nova.network.neutron [None req-e9cbf181-0f06-4a2b-a2b2-21cfda242dcd tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Updating instance_info_cache with network_info: [{"id": "caaa85dc-5a5f-4480-b6be-b2bc234cd455", "address": "fa:16:3e:73:2a:e3", "network": {"id": "08106daa-a35e-4376-8c46-2b4baa51c6ea", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321730350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524265958bd24a6cb94aa3115eb2b6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaaa85dc-5a", "ovs_interfaceid": "caaa85dc-5a5f-4480-b6be-b2bc234cd455", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:11:49 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e9cbf181-0f06-4a2b-a2b2-21cfda242dcd tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Releasing lock "refresh_cache-d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:11:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:11:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:11:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:11:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:11:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:11:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:11:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:11:49 user nova-compute[82479]: DEBUG nova.compute.manager [req-321068df-700c-4c6c-904e-1e2ec4c5e04f req-18c10a73-051d-4785-9cce-7108c3065f91 service nova] [instance: 493c65ce-aceb-4273-926e-d3633e676008] Received event network-vif-plugged-6f4cb2f5-fcb3-4349-b8a6-ec85658ffe5b {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:11:49 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-321068df-700c-4c6c-904e-1e2ec4c5e04f req-18c10a73-051d-4785-9cce-7108c3065f91 service nova] Acquiring lock "493c65ce-aceb-4273-926e-d3633e676008-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:11:49 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-321068df-700c-4c6c-904e-1e2ec4c5e04f req-18c10a73-051d-4785-9cce-7108c3065f91 service nova] Lock "493c65ce-aceb-4273-926e-d3633e676008-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:11:49 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-321068df-700c-4c6c-904e-1e2ec4c5e04f req-18c10a73-051d-4785-9cce-7108c3065f91 service nova] Lock "493c65ce-aceb-4273-926e-d3633e676008-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:11:49 user nova-compute[82479]: DEBUG nova.compute.manager [req-321068df-700c-4c6c-904e-1e2ec4c5e04f req-18c10a73-051d-4785-9cce-7108c3065f91 service nova] [instance: 493c65ce-aceb-4273-926e-d3633e676008] No waiting events found dispatching network-vif-plugged-6f4cb2f5-fcb3-4349-b8a6-ec85658ffe5b {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:11:49 user nova-compute[82479]: WARNING nova.compute.manager [req-321068df-700c-4c6c-904e-1e2ec4c5e04f req-18c10a73-051d-4785-9cce-7108c3065f91 service nova] [instance: 493c65ce-aceb-4273-926e-d3633e676008] Received unexpected event network-vif-plugged-6f4cb2f5-fcb3-4349-b8a6-ec85658ffe5b for instance with vm_state building and task_state spawning.
Apr 14 00:11:50 user nova-compute[82479]: DEBUG nova.compute.manager [req-a8c27260-b7f2-45c5-91be-3d59eadb3bdc req-122f4f60-8896-41f2-a866-37189a5a6ed3 service nova] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Received event network-vif-unplugged-caaa85dc-5a5f-4480-b6be-b2bc234cd455 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:11:50 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-a8c27260-b7f2-45c5-91be-3d59eadb3bdc req-122f4f60-8896-41f2-a866-37189a5a6ed3 service nova] Acquiring lock "d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:11:50 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-a8c27260-b7f2-45c5-91be-3d59eadb3bdc req-122f4f60-8896-41f2-a866-37189a5a6ed3 service nova] Lock "d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:11:50 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-a8c27260-b7f2-45c5-91be-3d59eadb3bdc req-122f4f60-8896-41f2-a866-37189a5a6ed3 service nova] Lock "d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:11:50 user nova-compute[82479]: DEBUG nova.compute.manager [req-a8c27260-b7f2-45c5-91be-3d59eadb3bdc req-122f4f60-8896-41f2-a866-37189a5a6ed3 service nova] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] No waiting events found dispatching network-vif-unplugged-caaa85dc-5a5f-4480-b6be-b2bc234cd455 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:11:50 user nova-compute[82479]: WARNING nova.compute.manager [req-a8c27260-b7f2-45c5-91be-3d59eadb3bdc req-122f4f60-8896-41f2-a866-37189a5a6ed3 service nova] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Received unexpected event network-vif-unplugged-caaa85dc-5a5f-4480-b6be-b2bc234cd455 for instance with vm_state active and task_state rescuing.
Apr 14 00:11:50 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:11:50 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:11:50 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:11:50 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:11:50 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:11:50 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Instance destroyed successfully.
Apr 14 00:11:50 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-e9cbf181-0f06-4a2b-a2b2-21cfda242dcd tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Attempting rescue
Apr 14 00:11:50 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-e9cbf181-0f06-4a2b-a2b2-21cfda242dcd tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=82479) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 14 00:11:50 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-e9cbf181-0f06-4a2b-a2b2-21cfda242dcd tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Instance directory exists: not creating {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 00:11:50 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-e9cbf181-0f06-4a2b-a2b2-21cfda242dcd tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Creating image(s)
Apr 14 00:11:50 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e9cbf181-0f06-4a2b-a2b2-21cfda242dcd tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "/opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:11:50 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e9cbf181-0f06-4a2b-a2b2-21cfda242dcd tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "/opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:11:50 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e9cbf181-0f06-4a2b-a2b2-21cfda242dcd tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "/opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:11:50 user nova-compute[82479]: DEBUG nova.objects.instance [None req-e9cbf181-0f06-4a2b-a2b2-21cfda242dcd tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lazy-loading 'trusted_certs' on Instance uuid d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:11:50 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e9cbf181-0f06-4a2b-a2b2-21cfda242dcd tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "3e200e101633f2016e569ae4c0a352380507d1e4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:11:50 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e9cbf181-0f06-4a2b-a2b2-21cfda242dcd tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "3e200e101633f2016e569ae4c0a352380507d1e4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:11:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-e9cbf181-0f06-4a2b-a2b2-21cfda242dcd tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:50 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:11:50 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:11:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-e9cbf181-0f06-4a2b-a2b2-21cfda242dcd tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.165s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-e9cbf181-0f06-4a2b-a2b2-21cfda242dcd tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk.rescue {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:50 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:11:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-e9cbf181-0f06-4a2b-a2b2-21cfda242dcd tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk.rescue" returned: 0 in 0.069s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:50 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e9cbf181-0f06-4a2b-a2b2-21cfda242dcd tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "3e200e101633f2016e569ae4c0a352380507d1e4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:11:50 user nova-compute[82479]: DEBUG nova.objects.instance [None req-e9cbf181-0f06-4a2b-a2b2-21cfda242dcd tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lazy-loading 'migration_context' on Instance uuid d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:11:50 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-e9cbf181-0f06-4a2b-a2b2-21cfda242dcd tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Created local disks {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 00:11:50 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-e9cbf181-0f06-4a2b-a2b2-21cfda242dcd tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Start _get_guest_xml network_info=[{"id": "caaa85dc-5a5f-4480-b6be-b2bc234cd455", "address": "fa:16:3e:73:2a:e3", "network": {"id": "08106daa-a35e-4376-8c46-2b4baa51c6ea", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321730350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1321730350-network", "vif_mac": "fa:16:3e:73:2a:e3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524265958bd24a6cb94aa3115eb2b6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaaa85dc-5a", "ovs_interfaceid": "caaa85dc-5a5f-4480-b6be-b2bc234cd455", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 00:11:50 user nova-compute[82479]: DEBUG nova.objects.instance [None req-e9cbf181-0f06-4a2b-a2b2-21cfda242dcd tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lazy-loading 'resources' on Instance uuid d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:11:50 user nova-compute[82479]: DEBUG nova.objects.instance [None req-e9cbf181-0f06-4a2b-a2b2-21cfda242dcd tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lazy-loading 'numa_topology' on Instance uuid d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:11:50 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:11:50 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:11:50 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] skipping disk /dev/sdj (vdc) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:11:50 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:11:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17c6c147-fb62-4204-a416-792b94d3f7dd/disk.rescue --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:50 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-e9cbf181-0f06-4a2b-a2b2-21cfda242dcd tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:11:50 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-e9cbf181-0f06-4a2b-a2b2-21cfda242dcd tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:11:50 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-e9cbf181-0f06-4a2b-a2b2-21cfda242dcd tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82479) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 00:11:50 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-e9cbf181-0f06-4a2b-a2b2-21cfda242dcd tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T00:02:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 00:11:50 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-e9cbf181-0f06-4a2b-a2b2-21cfda242dcd tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Flavor limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 00:11:50 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-e9cbf181-0f06-4a2b-a2b2-21cfda242dcd tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Image limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 00:11:50 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-e9cbf181-0f06-4a2b-a2b2-21cfda242dcd tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Flavor pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 00:11:50 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-e9cbf181-0f06-4a2b-a2b2-21cfda242dcd tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Image pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 00:11:50 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-e9cbf181-0f06-4a2b-a2b2-21cfda242dcd tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 00:11:50 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-e9cbf181-0f06-4a2b-a2b2-21cfda242dcd tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 00:11:50 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-e9cbf181-0f06-4a2b-a2b2-21cfda242dcd tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 00:11:50 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-e9cbf181-0f06-4a2b-a2b2-21cfda242dcd tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Got 1 possible topologies {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 00:11:50 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-e9cbf181-0f06-4a2b-a2b2-21cfda242dcd tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 00:11:50 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-e9cbf181-0f06-4a2b-a2b2-21cfda242dcd tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 00:11:50 user nova-compute[82479]: DEBUG nova.objects.instance [None req-e9cbf181-0f06-4a2b-a2b2-21cfda242dcd tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lazy-loading 'vcpu_model' on Instance uuid d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:11:50 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-e9cbf181-0f06-4a2b-a2b2-21cfda242dcd tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:09:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-969325789',display_name='tempest-ServerRescueNegativeTestJSON-server-969325789',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-969325789',id=18,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:10:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='524265958bd24a6cb94aa3115eb2b6c7',ramdisk_id='',reservation_id='r-vvqygcuz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1055458768',owner_user_name='tempest-ServerRescueNegativeTestJSON-1055458768-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:10:07Z,user_data=None,user_id='f43f3171ccad4167ac783bbdfe2df478',uuid=d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "caaa85dc-5a5f-4480-b6be-b2bc234cd455", "address": "fa:16:3e:73:2a:e3", "network": {"id": "08106daa-a35e-4376-8c46-2b4baa51c6ea", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321730350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1321730350-network", "vif_mac": "fa:16:3e:73:2a:e3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524265958bd24a6cb94aa3115eb2b6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaaa85dc-5a", "ovs_interfaceid": "caaa85dc-5a5f-4480-b6be-b2bc234cd455", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82479) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 00:11:50 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-e9cbf181-0f06-4a2b-a2b2-21cfda242dcd tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Converting VIF {"id": "caaa85dc-5a5f-4480-b6be-b2bc234cd455", "address": "fa:16:3e:73:2a:e3", "network": {"id": "08106daa-a35e-4376-8c46-2b4baa51c6ea", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321730350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1321730350-network", "vif_mac": "fa:16:3e:73:2a:e3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524265958bd24a6cb94aa3115eb2b6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaaa85dc-5a", "ovs_interfaceid": "caaa85dc-5a5f-4480-b6be-b2bc234cd455", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:11:50 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-e9cbf181-0f06-4a2b-a2b2-21cfda242dcd tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:73:2a:e3,bridge_name='br-int',has_traffic_filtering=True,id=caaa85dc-5a5f-4480-b6be-b2bc234cd455,network=Network(08106daa-a35e-4376-8c46-2b4baa51c6ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcaaa85dc-5a') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:11:50 user nova-compute[82479]: DEBUG nova.objects.instance [None req-e9cbf181-0f06-4a2b-a2b2-21cfda242dcd tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lazy-loading 'pci_devices' on Instance uuid d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:11:50 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-e9cbf181-0f06-4a2b-a2b2-21cfda242dcd tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] End _get_guest_xml xml=<domain type="kvm">
Apr 14 00:11:50 user nova-compute[82479]:   <uuid>d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c</uuid>
Apr 14 00:11:50 user nova-compute[82479]:   <name>instance-00000012</name>
Apr 14 00:11:50 user nova-compute[82479]:   <memory>131072</memory>
Apr 14 00:11:50 user nova-compute[82479]:   <vcpu>1</vcpu>
Apr 14 00:11:50 user nova-compute[82479]:   <metadata>
Apr 14 00:11:50 user nova-compute[82479]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 00:11:50 user nova-compute[82479]:       <nova:package version="0.0.0"/>
Apr 14 00:11:50 user nova-compute[82479]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-969325789</nova:name>
Apr 14 00:11:50 user nova-compute[82479]:       <nova:creationTime>2023-04-14 00:11:50</nova:creationTime>
Apr 14 00:11:50 user nova-compute[82479]:       <nova:flavor name="m1.nano">
Apr 14 00:11:50 user nova-compute[82479]:         <nova:memory>128</nova:memory>
Apr 14 00:11:50 user nova-compute[82479]:         <nova:disk>1</nova:disk>
Apr 14 00:11:50 user nova-compute[82479]:         <nova:swap>0</nova:swap>
Apr 14 00:11:50 user nova-compute[82479]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 00:11:50 user nova-compute[82479]:         <nova:vcpus>1</nova:vcpus>
Apr 14 00:11:50 user nova-compute[82479]:       </nova:flavor>
Apr 14 00:11:50 user nova-compute[82479]:       <nova:owner>
Apr 14 00:11:50 user nova-compute[82479]:         <nova:user uuid="f43f3171ccad4167ac783bbdfe2df478">tempest-ServerRescueNegativeTestJSON-1055458768-project-member</nova:user>
Apr 14 00:11:50 user nova-compute[82479]:         <nova:project uuid="524265958bd24a6cb94aa3115eb2b6c7">tempest-ServerRescueNegativeTestJSON-1055458768</nova:project>
Apr 14 00:11:50 user nova-compute[82479]:       </nova:owner>
Apr 14 00:11:50 user nova-compute[82479]:       <nova:root type="image" uuid="6db62068-7278-4cd8-b41f-d0140d89e199"/>
Apr 14 00:11:50 user nova-compute[82479]:       <nova:ports>
Apr 14 00:11:50 user nova-compute[82479]:         <nova:port uuid="caaa85dc-5a5f-4480-b6be-b2bc234cd455">
Apr 14 00:11:50 user nova-compute[82479]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 14 00:11:50 user nova-compute[82479]:         </nova:port>
Apr 14 00:11:50 user nova-compute[82479]:       </nova:ports>
Apr 14 00:11:50 user nova-compute[82479]:     </nova:instance>
Apr 14 00:11:50 user nova-compute[82479]:   </metadata>
Apr 14 00:11:50 user nova-compute[82479]:   <sysinfo type="smbios">
Apr 14 00:11:50 user nova-compute[82479]:     <system>
Apr 14 00:11:50 user nova-compute[82479]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 00:11:50 user nova-compute[82479]:       <entry name="product">OpenStack Nova</entry>
Apr 14 00:11:50 user nova-compute[82479]:       <entry name="version">0.0.0</entry>
Apr 14 00:11:50 user nova-compute[82479]:       <entry name="serial">d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c</entry>
Apr 14 00:11:50 user nova-compute[82479]:       <entry name="uuid">d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c</entry>
Apr 14 00:11:50 user nova-compute[82479]:       <entry name="family">Virtual Machine</entry>
Apr 14 00:11:50 user nova-compute[82479]:     </system>
Apr 14 00:11:50 user nova-compute[82479]:   </sysinfo>
Apr 14 00:11:50 user nova-compute[82479]:   <os>
Apr 14 00:11:50 user nova-compute[82479]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 00:11:50 user nova-compute[82479]:     <smbios mode="sysinfo"/>
Apr 14 00:11:50 user nova-compute[82479]:   </os>
Apr 14 00:11:50 user nova-compute[82479]:   <features>
Apr 14 00:11:50 user nova-compute[82479]:     <acpi/>
Apr 14 00:11:50 user nova-compute[82479]:     <apic/>
Apr 14 00:11:50 user nova-compute[82479]:     <vmcoreinfo/>
Apr 14 00:11:50 user nova-compute[82479]:   </features>
Apr 14 00:11:50 user nova-compute[82479]:   <clock offset="utc">
Apr 14 00:11:50 user nova-compute[82479]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 00:11:50 user nova-compute[82479]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 00:11:50 user nova-compute[82479]:     <timer name="hpet" present="no"/>
Apr 14 00:11:50 user nova-compute[82479]:   </clock>
Apr 14 00:11:50 user nova-compute[82479]:   <cpu mode="custom" match="exact">
Apr 14 00:11:50 user nova-compute[82479]:     <model>Nehalem</model>
Apr 14 00:11:50 user nova-compute[82479]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 00:11:50 user nova-compute[82479]:   </cpu>
Apr 14 00:11:50 user nova-compute[82479]:   <devices>
Apr 14 00:11:50 user nova-compute[82479]:     <disk type="file" device="disk">
Apr 14 00:11:50 user nova-compute[82479]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 00:11:50 user nova-compute[82479]:       <source file="/opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk.rescue"/>
Apr 14 00:11:50 user nova-compute[82479]:       <target dev="vda" bus="virtio"/>
Apr 14 00:11:50 user nova-compute[82479]:     </disk>
Apr 14 00:11:50 user nova-compute[82479]:     <disk type="file" device="disk">
Apr 14 00:11:50 user nova-compute[82479]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 00:11:50 user nova-compute[82479]:       <source file="/opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk"/>
Apr 14 00:11:50 user nova-compute[82479]:       <target dev="vdb" bus="virtio"/>
Apr 14 00:11:50 user nova-compute[82479]:     </disk>
Apr 14 00:11:50 user nova-compute[82479]:     <interface type="ethernet">
Apr 14 00:11:50 user nova-compute[82479]:       <mac address="fa:16:3e:73:2a:e3"/>
Apr 14 00:11:50 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:11:50 user nova-compute[82479]:       <mtu size="1442"/>
Apr 14 00:11:50 user nova-compute[82479]:       <target dev="tapcaaa85dc-5a"/>
Apr 14 00:11:50 user nova-compute[82479]:     </interface>
Apr 14 00:11:50 user nova-compute[82479]:     <serial type="pty">
Apr 14 00:11:50 user nova-compute[82479]:       <log file="/opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/console.log" append="off"/>
Apr 14 00:11:50 user nova-compute[82479]:     </serial>
Apr 14 00:11:50 user nova-compute[82479]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 00:11:50 user nova-compute[82479]:     <video>
Apr 14 00:11:50 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:11:50 user nova-compute[82479]:     </video>
Apr 14 00:11:50 user nova-compute[82479]:     <rng model="virtio">
Apr 14 00:11:50 user nova-compute[82479]:       <backend model="random">/dev/urandom</backend>
Apr 14 00:11:50 user nova-compute[82479]:     </rng>
Apr 14 00:11:50 user nova-compute[82479]:     <controller type="usb" index="0" model="none"/>
Apr 14 00:11:50 user nova-compute[82479]:     <memballoon model="virtio">
Apr 14 00:11:50 user nova-compute[82479]:       <stats period="10"/>
Apr 14 00:11:50 user nova-compute[82479]:     </memballoon>
Apr 14 00:11:50 user nova-compute[82479]:   </devices>
Apr 14 00:11:50 user nova-compute[82479]: </domain>
Apr 14 00:11:50 user nova-compute[82479]:  {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 00:11:50 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Instance destroyed successfully.
Apr 14 00:11:50 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:11:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17c6c147-fb62-4204-a416-792b94d3f7dd/disk.rescue --force-share --output=json" returned: 0 in 0.154s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17c6c147-fb62-4204-a416-792b94d3f7dd/disk.rescue --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:50 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:11:51 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-e9cbf181-0f06-4a2b-a2b2-21cfda242dcd tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:11:51 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-e9cbf181-0f06-4a2b-a2b2-21cfda242dcd tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:11:51 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-e9cbf181-0f06-4a2b-a2b2-21cfda242dcd tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] No VIF found with MAC fa:16:3e:73:2a:e3, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:11:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17c6c147-fb62-4204-a416-792b94d3f7dd/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11c3384a-e699-4b10-9f8b-861291e96465/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11c3384a-e699-4b10-9f8b-861291e96465/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11c3384a-e699-4b10-9f8b-861291e96465/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11c3384a-e699-4b10-9f8b-861291e96465/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8feba40a-03c7-4c60-b862-ee14fb8c9b05/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8feba40a-03c7-4c60-b862-ee14fb8c9b05/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8feba40a-03c7-4c60-b862-ee14fb8c9b05/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8feba40a-03c7-4c60-b862-ee14fb8c9b05/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:52 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01a65362-36ea-4817-8e83-f75d6daf808b/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:52 user nova-compute[82479]: DEBUG nova.compute.manager [req-7fd9fce6-de17-44fe-8911-d7b50b03817d req-e04d045e-15c5-42e4-985c-80f1109be038 service nova] [instance: 493c65ce-aceb-4273-926e-d3633e676008] Received event network-vif-plugged-6f4cb2f5-fcb3-4349-b8a6-ec85658ffe5b {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:11:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-7fd9fce6-de17-44fe-8911-d7b50b03817d req-e04d045e-15c5-42e4-985c-80f1109be038 service nova] Acquiring lock "493c65ce-aceb-4273-926e-d3633e676008-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:11:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-7fd9fce6-de17-44fe-8911-d7b50b03817d req-e04d045e-15c5-42e4-985c-80f1109be038 service nova] Lock "493c65ce-aceb-4273-926e-d3633e676008-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:11:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-7fd9fce6-de17-44fe-8911-d7b50b03817d req-e04d045e-15c5-42e4-985c-80f1109be038 service nova] Lock "493c65ce-aceb-4273-926e-d3633e676008-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:11:52 user nova-compute[82479]: DEBUG nova.compute.manager [req-7fd9fce6-de17-44fe-8911-d7b50b03817d req-e04d045e-15c5-42e4-985c-80f1109be038 service nova] [instance: 493c65ce-aceb-4273-926e-d3633e676008] No waiting events found dispatching network-vif-plugged-6f4cb2f5-fcb3-4349-b8a6-ec85658ffe5b {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:11:52 user nova-compute[82479]: WARNING nova.compute.manager [req-7fd9fce6-de17-44fe-8911-d7b50b03817d req-e04d045e-15c5-42e4-985c-80f1109be038 service nova] [instance: 493c65ce-aceb-4273-926e-d3633e676008] Received unexpected event network-vif-plugged-6f4cb2f5-fcb3-4349-b8a6-ec85658ffe5b for instance with vm_state building and task_state spawning.
Apr 14 00:11:52 user nova-compute[82479]: DEBUG nova.compute.manager [req-ff0ad516-2591-408c-bbfb-34ae5162976f req-3d00626f-fae9-4d8b-9c2c-e6e00b862a9e service nova] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Received event network-vif-plugged-caaa85dc-5a5f-4480-b6be-b2bc234cd455 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:11:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-ff0ad516-2591-408c-bbfb-34ae5162976f req-3d00626f-fae9-4d8b-9c2c-e6e00b862a9e service nova] Acquiring lock "d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:11:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-ff0ad516-2591-408c-bbfb-34ae5162976f req-3d00626f-fae9-4d8b-9c2c-e6e00b862a9e service nova] Lock "d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:11:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-ff0ad516-2591-408c-bbfb-34ae5162976f req-3d00626f-fae9-4d8b-9c2c-e6e00b862a9e service nova] Lock "d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:11:52 user nova-compute[82479]: DEBUG nova.compute.manager [req-ff0ad516-2591-408c-bbfb-34ae5162976f req-3d00626f-fae9-4d8b-9c2c-e6e00b862a9e service nova] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] No waiting events found dispatching network-vif-plugged-caaa85dc-5a5f-4480-b6be-b2bc234cd455 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:11:52 user nova-compute[82479]: WARNING nova.compute.manager [req-ff0ad516-2591-408c-bbfb-34ae5162976f req-3d00626f-fae9-4d8b-9c2c-e6e00b862a9e service nova] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Received unexpected event network-vif-plugged-caaa85dc-5a5f-4480-b6be-b2bc234cd455 for instance with vm_state active and task_state rescuing.
Apr 14 00:11:52 user nova-compute[82479]: DEBUG nova.compute.manager [req-ff0ad516-2591-408c-bbfb-34ae5162976f req-3d00626f-fae9-4d8b-9c2c-e6e00b862a9e service nova] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Received event network-vif-plugged-caaa85dc-5a5f-4480-b6be-b2bc234cd455 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:11:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-ff0ad516-2591-408c-bbfb-34ae5162976f req-3d00626f-fae9-4d8b-9c2c-e6e00b862a9e service nova] Acquiring lock "d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:11:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-ff0ad516-2591-408c-bbfb-34ae5162976f req-3d00626f-fae9-4d8b-9c2c-e6e00b862a9e service nova] Lock "d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:11:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-ff0ad516-2591-408c-bbfb-34ae5162976f req-3d00626f-fae9-4d8b-9c2c-e6e00b862a9e service nova] Lock "d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:11:52 user nova-compute[82479]: DEBUG nova.compute.manager [req-ff0ad516-2591-408c-bbfb-34ae5162976f req-3d00626f-fae9-4d8b-9c2c-e6e00b862a9e service nova] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] No waiting events found dispatching network-vif-plugged-caaa85dc-5a5f-4480-b6be-b2bc234cd455 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:11:52 user nova-compute[82479]: WARNING nova.compute.manager [req-ff0ad516-2591-408c-bbfb-34ae5162976f req-3d00626f-fae9-4d8b-9c2c-e6e00b862a9e service nova] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Received unexpected event network-vif-plugged-caaa85dc-5a5f-4480-b6be-b2bc234cd455 for instance with vm_state active and task_state rescuing.
Apr 14 00:11:52 user nova-compute[82479]: DEBUG nova.compute.manager [req-ff0ad516-2591-408c-bbfb-34ae5162976f req-3d00626f-fae9-4d8b-9c2c-e6e00b862a9e service nova] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Received event network-vif-plugged-caaa85dc-5a5f-4480-b6be-b2bc234cd455 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:11:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-ff0ad516-2591-408c-bbfb-34ae5162976f req-3d00626f-fae9-4d8b-9c2c-e6e00b862a9e service nova] Acquiring lock "d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:11:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-ff0ad516-2591-408c-bbfb-34ae5162976f req-3d00626f-fae9-4d8b-9c2c-e6e00b862a9e service nova] Lock "d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:11:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-ff0ad516-2591-408c-bbfb-34ae5162976f req-3d00626f-fae9-4d8b-9c2c-e6e00b862a9e service nova] Lock "d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:11:52 user nova-compute[82479]: DEBUG nova.compute.manager [req-ff0ad516-2591-408c-bbfb-34ae5162976f req-3d00626f-fae9-4d8b-9c2c-e6e00b862a9e service nova] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] No waiting events found dispatching network-vif-plugged-caaa85dc-5a5f-4480-b6be-b2bc234cd455 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:11:52 user nova-compute[82479]: WARNING nova.compute.manager [req-ff0ad516-2591-408c-bbfb-34ae5162976f req-3d00626f-fae9-4d8b-9c2c-e6e00b862a9e service nova] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Received unexpected event network-vif-plugged-caaa85dc-5a5f-4480-b6be-b2bc234cd455 for instance with vm_state active and task_state rescuing.
Apr 14 00:11:52 user nova-compute[82479]: DEBUG nova.compute.manager [req-ff0ad516-2591-408c-bbfb-34ae5162976f req-3d00626f-fae9-4d8b-9c2c-e6e00b862a9e service nova] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Received event network-vif-unplugged-caaa85dc-5a5f-4480-b6be-b2bc234cd455 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:11:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-ff0ad516-2591-408c-bbfb-34ae5162976f req-3d00626f-fae9-4d8b-9c2c-e6e00b862a9e service nova] Acquiring lock "d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:11:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-ff0ad516-2591-408c-bbfb-34ae5162976f req-3d00626f-fae9-4d8b-9c2c-e6e00b862a9e service nova] Lock "d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:11:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-ff0ad516-2591-408c-bbfb-34ae5162976f req-3d00626f-fae9-4d8b-9c2c-e6e00b862a9e service nova] Lock "d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:11:52 user nova-compute[82479]: DEBUG nova.compute.manager [req-ff0ad516-2591-408c-bbfb-34ae5162976f req-3d00626f-fae9-4d8b-9c2c-e6e00b862a9e service nova] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] No waiting events found dispatching network-vif-unplugged-caaa85dc-5a5f-4480-b6be-b2bc234cd455 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:11:52 user nova-compute[82479]: WARNING nova.compute.manager [req-ff0ad516-2591-408c-bbfb-34ae5162976f req-3d00626f-fae9-4d8b-9c2c-e6e00b862a9e service nova] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Received unexpected event network-vif-unplugged-caaa85dc-5a5f-4480-b6be-b2bc234cd455 for instance with vm_state active and task_state rescuing.
Apr 14 00:11:52 user nova-compute[82479]: DEBUG nova.compute.manager [req-ff0ad516-2591-408c-bbfb-34ae5162976f req-3d00626f-fae9-4d8b-9c2c-e6e00b862a9e service nova] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Received event network-vif-plugged-caaa85dc-5a5f-4480-b6be-b2bc234cd455 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:11:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-ff0ad516-2591-408c-bbfb-34ae5162976f req-3d00626f-fae9-4d8b-9c2c-e6e00b862a9e service nova] Acquiring lock "d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:11:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-ff0ad516-2591-408c-bbfb-34ae5162976f req-3d00626f-fae9-4d8b-9c2c-e6e00b862a9e service nova] Lock "d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:11:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-ff0ad516-2591-408c-bbfb-34ae5162976f req-3d00626f-fae9-4d8b-9c2c-e6e00b862a9e service nova] Lock "d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:11:52 user nova-compute[82479]: DEBUG nova.compute.manager [req-ff0ad516-2591-408c-bbfb-34ae5162976f req-3d00626f-fae9-4d8b-9c2c-e6e00b862a9e service nova] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] No waiting events found dispatching network-vif-plugged-caaa85dc-5a5f-4480-b6be-b2bc234cd455 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:11:52 user nova-compute[82479]: WARNING nova.compute.manager [req-ff0ad516-2591-408c-bbfb-34ae5162976f req-3d00626f-fae9-4d8b-9c2c-e6e00b862a9e service nova] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Received unexpected event network-vif-plugged-caaa85dc-5a5f-4480-b6be-b2bc234cd455 for instance with vm_state active and task_state rescuing.
Apr 14 00:11:52 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01a65362-36ea-4817-8e83-f75d6daf808b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:52 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01a65362-36ea-4817-8e83-f75d6daf808b/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:52 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681431112.2448196, 493c65ce-aceb-4273-926e-d3633e676008 => Resumed> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:11:52 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 493c65ce-aceb-4273-926e-d3633e676008] VM Resumed (Lifecycle Event)
Apr 14 00:11:52 user nova-compute[82479]: DEBUG nova.compute.manager [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 493c65ce-aceb-4273-926e-d3633e676008] Instance event wait completed in 0 seconds for  {{(pid=82479) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 00:11:52 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 493c65ce-aceb-4273-926e-d3633e676008] Guest created on hypervisor {{(pid=82479) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 00:11:52 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 493c65ce-aceb-4273-926e-d3633e676008] Instance spawned successfully.
Apr 14 00:11:52 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 493c65ce-aceb-4273-926e-d3633e676008] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 00:11:52 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 493c65ce-aceb-4273-926e-d3633e676008] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:11:52 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 493c65ce-aceb-4273-926e-d3633e676008] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:11:52 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 493c65ce-aceb-4273-926e-d3633e676008] Found default for hw_cdrom_bus of ide {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:11:52 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 493c65ce-aceb-4273-926e-d3633e676008] Found default for hw_disk_bus of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:11:52 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 493c65ce-aceb-4273-926e-d3633e676008] Found default for hw_input_bus of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:11:52 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 493c65ce-aceb-4273-926e-d3633e676008] Found default for hw_pointer_model of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:11:52 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 493c65ce-aceb-4273-926e-d3633e676008] Found default for hw_video_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:11:52 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 493c65ce-aceb-4273-926e-d3633e676008] Found default for hw_vif_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:11:52 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 493c65ce-aceb-4273-926e-d3633e676008] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:11:52 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681431112.2454588, 493c65ce-aceb-4273-926e-d3633e676008 => Started> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:11:52 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 493c65ce-aceb-4273-926e-d3633e676008] VM Started (Lifecycle Event)
Apr 14 00:11:52 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:11:52 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01a65362-36ea-4817-8e83-f75d6daf808b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:52 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 493c65ce-aceb-4273-926e-d3633e676008] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:11:52 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 493c65ce-aceb-4273-926e-d3633e676008] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:11:52 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:11:52 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:11:52 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 493c65ce-aceb-4273-926e-d3633e676008] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:11:52 user nova-compute[82479]: INFO nova.compute.manager [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 493c65ce-aceb-4273-926e-d3633e676008] Took 6.50 seconds to spawn the instance on the hypervisor.
Apr 14 00:11:52 user nova-compute[82479]: DEBUG nova.compute.manager [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 493c65ce-aceb-4273-926e-d3633e676008] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:11:52 user nova-compute[82479]: INFO nova.compute.manager [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 493c65ce-aceb-4273-926e-d3633e676008] Took 7.43 seconds to build instance.
Apr 14 00:11:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-86552202-115f-4cee-96ef-e5853b616c10 tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "493c65ce-aceb-4273-926e-d3633e676008" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.546s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:11:52 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:11:52 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:11:52 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk.rescue --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:52 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk.rescue --force-share --output=json" returned: 0 in 0.158s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:52 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk.rescue --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:53 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:11:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb358a6-7e79-4acf-8fbe-7cc4e67a707b/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb358a6-7e79-4acf-8fbe-7cc4e67a707b/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb358a6-7e79-4acf-8fbe-7cc4e67a707b/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:54 user nova-compute[82479]: DEBUG nova.compute.manager [req-b298f4e4-5d27-43ce-be19-78e1b4867073 req-dd3188c0-91dc-40f0-bd9f-e1bb5b2ab001 service nova] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Received event network-vif-plugged-caaa85dc-5a5f-4480-b6be-b2bc234cd455 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:11:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-b298f4e4-5d27-43ce-be19-78e1b4867073 req-dd3188c0-91dc-40f0-bd9f-e1bb5b2ab001 service nova] Acquiring lock "d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:11:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-b298f4e4-5d27-43ce-be19-78e1b4867073 req-dd3188c0-91dc-40f0-bd9f-e1bb5b2ab001 service nova] Lock "d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:11:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-b298f4e4-5d27-43ce-be19-78e1b4867073 req-dd3188c0-91dc-40f0-bd9f-e1bb5b2ab001 service nova] Lock "d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:11:54 user nova-compute[82479]: DEBUG nova.compute.manager [req-b298f4e4-5d27-43ce-be19-78e1b4867073 req-dd3188c0-91dc-40f0-bd9f-e1bb5b2ab001 service nova] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] No waiting events found dispatching network-vif-plugged-caaa85dc-5a5f-4480-b6be-b2bc234cd455 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:11:54 user nova-compute[82479]: WARNING nova.compute.manager [req-b298f4e4-5d27-43ce-be19-78e1b4867073 req-dd3188c0-91dc-40f0-bd9f-e1bb5b2ab001 service nova] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Received unexpected event network-vif-plugged-caaa85dc-5a5f-4480-b6be-b2bc234cd455 for instance with vm_state active and task_state rescuing.
Apr 14 00:11:54 user nova-compute[82479]: DEBUG nova.compute.manager [req-b298f4e4-5d27-43ce-be19-78e1b4867073 req-dd3188c0-91dc-40f0-bd9f-e1bb5b2ab001 service nova] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Received event network-vif-plugged-caaa85dc-5a5f-4480-b6be-b2bc234cd455 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:11:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-b298f4e4-5d27-43ce-be19-78e1b4867073 req-dd3188c0-91dc-40f0-bd9f-e1bb5b2ab001 service nova] Acquiring lock "d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:11:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-b298f4e4-5d27-43ce-be19-78e1b4867073 req-dd3188c0-91dc-40f0-bd9f-e1bb5b2ab001 service nova] Lock "d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:11:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-b298f4e4-5d27-43ce-be19-78e1b4867073 req-dd3188c0-91dc-40f0-bd9f-e1bb5b2ab001 service nova] Lock "d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:11:54 user nova-compute[82479]: DEBUG nova.compute.manager [req-b298f4e4-5d27-43ce-be19-78e1b4867073 req-dd3188c0-91dc-40f0-bd9f-e1bb5b2ab001 service nova] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] No waiting events found dispatching network-vif-plugged-caaa85dc-5a5f-4480-b6be-b2bc234cd455 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:11:54 user nova-compute[82479]: WARNING nova.compute.manager [req-b298f4e4-5d27-43ce-be19-78e1b4867073 req-dd3188c0-91dc-40f0-bd9f-e1bb5b2ab001 service nova] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Received unexpected event network-vif-plugged-caaa85dc-5a5f-4480-b6be-b2bc234cd455 for instance with vm_state active and task_state rescuing.
Apr 14 00:11:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb358a6-7e79-4acf-8fbe-7cc4e67a707b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:54 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:11:54 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Removed pending event for d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c due to event {{(pid=82479) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 00:11:54 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681431114.6899865, d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c => Resumed> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:11:54 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] VM Resumed (Lifecycle Event)
Apr 14 00:11:54 user nova-compute[82479]: DEBUG nova.compute.manager [None req-e9cbf181-0f06-4a2b-a2b2-21cfda242dcd tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:11:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fba4ee-4aae-4ee3-8114-b53510f5442c/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:54 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:11:54 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:11:54 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 14 00:11:54 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681431114.6922736, d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c => Started> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:11:54 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] VM Started (Lifecycle Event)
Apr 14 00:11:54 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:11:54 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:11:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fba4ee-4aae-4ee3-8114-b53510f5442c/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fba4ee-4aae-4ee3-8114-b53510f5442c/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fba4ee-4aae-4ee3-8114-b53510f5442c/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:55 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:11:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/493c65ce-aceb-4273-926e-d3633e676008/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/493c65ce-aceb-4273-926e-d3633e676008/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/493c65ce-aceb-4273-926e-d3633e676008/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/493c65ce-aceb-4273-926e-d3633e676008/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:55 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:11:55 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:11:55 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:11:56 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Hypervisor/Node resource view: name=user free_ram=7382MB free_disk=26.11334228515625GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82479) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 00:11:56 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:11:56 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:11:56 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d826eff7-76b0-4e5c-af3e-6af0bbebd504 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:11:56 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d826eff7-76b0-4e5c-af3e-6af0bbebd504 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:11:56 user nova-compute[82479]: INFO nova.compute.manager [None req-d826eff7-76b0-4e5c-af3e-6af0bbebd504 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Detaching volume 49172d5a-2944-486a-a080-04548e55ac0d
Apr 14 00:11:56 user nova-compute[82479]: INFO nova.virt.block_device [None req-d826eff7-76b0-4e5c-af3e-6af0bbebd504 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Attempting to driver detach volume 49172d5a-2944-486a-a080-04548e55ac0d from mountpoint /dev/vdb
Apr 14 00:11:56 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-d826eff7-76b0-4e5c-af3e-6af0bbebd504 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Attempting to detach device vdb from instance b3475e7e-ceb4-452a-a045-dbf43c5944dd from the persistent domain config. {{(pid=82479) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 00:11:56 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-d826eff7-76b0-4e5c-af3e-6af0bbebd504 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 00:11:56 user nova-compute[82479]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:11:56 user nova-compute[82479]:   <source dev="/dev/sde"/>
Apr 14 00:11:56 user nova-compute[82479]:   <target dev="vdb" bus="virtio"/>
Apr 14 00:11:56 user nova-compute[82479]:   <serial>49172d5a-2944-486a-a080-04548e55ac0d</serial>
Apr 14 00:11:56 user nova-compute[82479]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 00:11:56 user nova-compute[82479]: </disk>
Apr 14 00:11:56 user nova-compute[82479]:  {{(pid=82479) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 00:11:56 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-d826eff7-76b0-4e5c-af3e-6af0bbebd504 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Successfully detached device vdb from instance b3475e7e-ceb4-452a-a045-dbf43c5944dd from the persistent domain config.
Apr 14 00:11:56 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-d826eff7-76b0-4e5c-af3e-6af0bbebd504 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b3475e7e-ceb4-452a-a045-dbf43c5944dd from the live domain config. {{(pid=82479) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 00:11:56 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-d826eff7-76b0-4e5c-af3e-6af0bbebd504 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 00:11:56 user nova-compute[82479]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:11:56 user nova-compute[82479]:   <source dev="/dev/sde"/>
Apr 14 00:11:56 user nova-compute[82479]:   <target dev="vdb" bus="virtio"/>
Apr 14 00:11:56 user nova-compute[82479]:   <serial>49172d5a-2944-486a-a080-04548e55ac0d</serial>
Apr 14 00:11:56 user nova-compute[82479]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 00:11:56 user nova-compute[82479]: </disk>
Apr 14 00:11:56 user nova-compute[82479]:  {{(pid=82479) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 00:11:56 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 23718fd0-58b8-47f9-b1ef-a26a90741ecc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:11:56 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:11:56 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 01a65362-36ea-4817-8e83-f75d6daf808b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:11:56 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance b3475e7e-ceb4-452a-a045-dbf43c5944dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:11:56 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 11c3384a-e699-4b10-9f8b-861291e96465 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:11:56 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance e3fba4ee-4aae-4ee3-8114-b53510f5442c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:11:56 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 17c6c147-fb62-4204-a416-792b94d3f7dd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:11:56 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 8feba40a-03c7-4c60-b862-ee14fb8c9b05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:11:56 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:11:56 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:11:56 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:11:56 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:11:56 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 493c65ce-aceb-4273-926e-d3633e676008 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:11:56 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 00:11:56 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Final resource view: name=user phys_ram=16023MB used_ram=2176MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 00:11:56 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:11:56 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:11:56 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Compute_service record updated for user:user {{(pid=82479) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 00:11:56 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.659s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:11:56 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Received event <DeviceRemovedEvent: 1681431116.666829, b3475e7e-ceb4-452a-a045-dbf43c5944dd => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82479) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 00:11:56 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-d826eff7-76b0-4e5c-af3e-6af0bbebd504 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b3475e7e-ceb4-452a-a045-dbf43c5944dd {{(pid=82479) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 00:11:56 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-d826eff7-76b0-4e5c-af3e-6af0bbebd504 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Successfully detached device vdb from instance b3475e7e-ceb4-452a-a045-dbf43c5944dd from the live domain config.
Apr 14 00:11:56 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d826eff7-76b0-4e5c-af3e-6af0bbebd504 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] calling os-brick to detach iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 00:11:56 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d826eff7-76b0-4e5c-af3e-6af0bbebd504 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, {'target_iqn': 'iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mpSjLhaD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:11:56 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-d826eff7-76b0-4e5c-af3e-6af0bbebd504 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:11:56 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-d826eff7-76b0-4e5c-af3e-6af0bbebd504 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:11:56 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-d826eff7-76b0-4e5c-af3e-6af0bbebd504 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:11:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:56 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8aba372-48bf-41b1-b4d3-90f8cecfbcd8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:11:56 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d826eff7-76b0-4e5c-af3e-6af0bbebd504 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 00:11:56 user nova-compute[82479]: No targets found.
Apr 14 00:11:56 user nova-compute[82479]: iSNS:
Apr 14 00:11:56 user nova-compute[82479]: No targets found.
Apr 14 00:11:56 user nova-compute[82479]: STATIC:
Apr 14 00:11:56 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0
Apr 14 00:11:56 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:11:56 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:11:56 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc
Apr 14 00:11:56 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:11:56 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:11:56 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d
Apr 14 00:11:56 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:11:56 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:11:56 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc
Apr 14 00:11:56 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:11:56 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:11:56 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593
Apr 14 00:11:56 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:11:56 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:11:56 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62
Apr 14 00:11:56 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:11:56 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:11:56 user nova-compute[82479]: FIRMWARE:
Apr 14 00:11:56 user nova-compute[82479]: No targets found.
Apr 14 00:11:56 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:11:56 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d826eff7-76b0-4e5c-af3e-6af0bbebd504 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 00:11:56 user nova-compute[82479]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 00:11:56 user nova-compute[82479]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82479) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 00:11:56 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d826eff7-76b0-4e5c-af3e-6af0bbebd504 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d', 0)] {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 00:11:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:56 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5c13ab-3a17-4404-8f70-52463abea0ef]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:11:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:56 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1110dd7-0d66-4dc4-b8f5-ce0ee0c2973d]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:11:56 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d826eff7-76b0-4e5c-af3e-6af0bbebd504 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:11:56 user nova-compute[82479]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d (non-flash)
Apr 14 00:11:56 user nova-compute[82479]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 (non-flash)
Apr 14 00:11:56 user nova-compute[82479]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 (non-flash)
Apr 14 00:11:56 user nova-compute[82479]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 (non-flash)
Apr 14 00:11:56 user nova-compute[82479]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc (non-flash)
Apr 14 00:11:56 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:11:56 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d826eff7-76b0-4e5c-af3e-6af0bbebd504 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:11:56 user nova-compute[82479]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d (non-flash)
Apr 14 00:11:56 user nova-compute[82479]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 (non-flash)
Apr 14 00:11:56 user nova-compute[82479]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 (non-flash)
Apr 14 00:11:56 user nova-compute[82479]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 (non-flash)
Apr 14 00:11:56 user nova-compute[82479]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc (non-flash)
Apr 14 00:11:56 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:11:56 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d826eff7-76b0-4e5c-af3e-6af0bbebd504 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f333025cf70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d'): ({'sde'}, set())}) {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 00:11:56 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-d826eff7-76b0-4e5c-af3e-6af0bbebd504 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Removing single pathed devices sde {{(pid=82479) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 00:11:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:56 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcef96c3-f7bb-4ab4-ad60-6e3c348943c4]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:11:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:56 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[707343f2-3aff-4b92-8e8a-3e832bdb2747]: (4, ('ok\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:11:56 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-d826eff7-76b0-4e5c-af3e-6af0bbebd504 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Flushing IO for device /dev/sde {{(pid=82479) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 00:11:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:56 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[dabbff7b-a33c-4afd-9253-3aabc2fd1e32]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:11:56 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-d826eff7-76b0-4e5c-af3e-6af0bbebd504 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=82479) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 00:11:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:56 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1faf6cc-f6e7-4f73-a369-21ec12fb223f]: (4, ('1', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:11:56 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-d826eff7-76b0-4e5c-af3e-6af0bbebd504 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 00:11:56 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-d826eff7-76b0-4e5c-af3e-6af0bbebd504 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] SCSI volumes sde have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 00:11:56 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d826eff7-76b0-4e5c-af3e-6af0bbebd504 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d')] {{(pid=82479) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 00:11:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:56 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8f6cd2-797a-48cc-b981-46dc4cf7d386]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:11:56 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d826eff7-76b0-4e5c-af3e-6af0bbebd504 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:11:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d -p 172.16.0.220:3260 --logout {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:56 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6655cc1-458f-42de-bd7b-c174ddd227c2]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:11:56 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d826eff7-76b0-4e5c-af3e-6af0bbebd504 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d, portal: 172.16.0.220,3260]
Apr 14 00:11:56 user nova-compute[82479]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d, portal: 172.16.0.220,3260] successful.
Apr 14 00:11:56 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:11:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d -p 172.16.0.220:3260 --op delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:11:57 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:11:57 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[886d2c6a-941d-4a10-be5b-cb656561e327]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:11:57 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d826eff7-76b0-4e5c-af3e-6af0bbebd504 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:11:57 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-d826eff7-76b0-4e5c-af3e-6af0bbebd504 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:11:57 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d826eff7-76b0-4e5c-af3e-6af0bbebd504 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] <== disconnect_volume: return (353ms) None {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:11:57 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d826eff7-76b0-4e5c-af3e-6af0bbebd504 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Disconnected iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 00:11:57 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:11:57 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:11:57 user nova-compute[82479]: DEBUG nova.objects.instance [None req-d826eff7-76b0-4e5c-af3e-6af0bbebd504 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lazy-loading 'flavor' on Instance uuid b3475e7e-ceb4-452a-a045-dbf43c5944dd {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:11:57 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d826eff7-76b0-4e5c-af3e-6af0bbebd504 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.892s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:11:58 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:00 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:03 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:03 user nova-compute[82479]: DEBUG nova.compute.manager [req-72e2751d-6474-4e03-8677-7065dccbd4e7 req-0c2df690-44ef-40d8-a400-7d2084919036 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Received event network-changed-1c533ad9-47bf-4eb9-b931-d855ad4ce53e {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:12:03 user nova-compute[82479]: DEBUG nova.compute.manager [req-72e2751d-6474-4e03-8677-7065dccbd4e7 req-0c2df690-44ef-40d8-a400-7d2084919036 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Refreshing instance network info cache due to event network-changed-1c533ad9-47bf-4eb9-b931-d855ad4ce53e. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:12:03 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-72e2751d-6474-4e03-8677-7065dccbd4e7 req-0c2df690-44ef-40d8-a400-7d2084919036 service nova] Acquiring lock "refresh_cache-6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:12:03 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-72e2751d-6474-4e03-8677-7065dccbd4e7 req-0c2df690-44ef-40d8-a400-7d2084919036 service nova] Acquired lock "refresh_cache-6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:12:03 user nova-compute[82479]: DEBUG nova.network.neutron [req-72e2751d-6474-4e03-8677-7065dccbd4e7 req-0c2df690-44ef-40d8-a400-7d2084919036 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Refreshing network info cache for port 1c533ad9-47bf-4eb9-b931-d855ad4ce53e {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:12:04 user nova-compute[82479]: DEBUG nova.network.neutron [req-72e2751d-6474-4e03-8677-7065dccbd4e7 req-0c2df690-44ef-40d8-a400-7d2084919036 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Updated VIF entry in instance network info cache for port 1c533ad9-47bf-4eb9-b931-d855ad4ce53e. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:12:04 user nova-compute[82479]: DEBUG nova.network.neutron [req-72e2751d-6474-4e03-8677-7065dccbd4e7 req-0c2df690-44ef-40d8-a400-7d2084919036 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Updating instance_info_cache with network_info: [{"id": "1c533ad9-47bf-4eb9-b931-d855ad4ce53e", "address": "fa:16:3e:bf:3e:c1", "network": {"id": "4368ab10-ccfd-46d6-a0eb-296895d3ba19", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1929715000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c533ad9-47", "ovs_interfaceid": "1c533ad9-47bf-4eb9-b931-d855ad4ce53e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e9ec2eab-0d7a-4be3-acab-a27bce761738", "address": "fa:16:3e:93:27:43", "network": {"id": "0b416634-9a5d-4d0a-a891-fca1700a2d6b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1990875628", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9ec2eab-0d", "ovs_interfaceid": "e9ec2eab-0d7a-4be3-acab-a27bce761738", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "127b1d7d-d92a-4e24-9470-1758579376bf", "address": "fa:16:3e:bf:72:3f", "network": {"id": "0b416634-9a5d-4d0a-a891-fca1700a2d6b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1990875628", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127b1d7d-d9", "ovs_interfaceid": "127b1d7d-d92a-4e24-9470-1758579376bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9dedd1d2-74e4-4aae-8114-9ecd78686a4d", "address": "fa:16:3e:3a:bb:81", "network": {"id": "0b416634-9a5d-4d0a-a891-fca1700a2d6b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1990875628", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dedd1d2-74", "ovs_interfaceid": "9dedd1d2-74e4-4aae-8114-9ecd78686a4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d3174ebb-df19-4943-98c4-89c97607f42b", "address": "fa:16:3e:ad:34:97", "network": {"id": "0b416634-9a5d-4d0a-a891-fca1700a2d6b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1990875628", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3174ebb-df", "ovs_interfaceid": "d3174ebb-df19-4943-98c4-89c97607f42b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dff47f62-64b6-4ee5-b163-c74fc50ce6c9", "address": "fa:16:3e:fe:ff:79", "network": {"id": "700ca002-00ac-4a55-b2a5-f31c7ca9bcfa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1927044898", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff47f62-64", "ovs_interfaceid": "dff47f62-64b6-4ee5-b163-c74fc50ce6c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3839e2a9-bfeb-4103-9d7c-bcf45f9eaf14", "address": "fa:16:3e:c1:ce:a4", "network": {"id": "700ca002-00ac-4a55-b2a5-f31c7ca9bcfa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1927044898", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3839e2a9-bf", "ovs_interfaceid": "3839e2a9-bfeb-4103-9d7c-bcf45f9eaf14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:12:04 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-72e2751d-6474-4e03-8677-7065dccbd4e7 req-0c2df690-44ef-40d8-a400-7d2084919036 service nova] Releasing lock "refresh_cache-6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:12:05 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Acquiring lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:12:05 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:12:05 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Acquiring lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:12:05 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:12:05 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:12:05 user nova-compute[82479]: INFO nova.compute.manager [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Terminating instance
Apr 14 00:12:05 user nova-compute[82479]: DEBUG nova.compute.manager [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Start destroying the instance on the hypervisor. {{(pid=82479) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 00:12:05 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:05 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:05 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:05 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:05 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:05 user nova-compute[82479]: DEBUG nova.compute.manager [req-d2f7611e-d6f2-41c2-8183-9690f053867b req-b82b8a4c-f9e0-4d55-92d8-7725058ead0f service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Received event network-vif-unplugged-1c533ad9-47bf-4eb9-b931-d855ad4ce53e {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:12:05 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-d2f7611e-d6f2-41c2-8183-9690f053867b req-b82b8a4c-f9e0-4d55-92d8-7725058ead0f service nova] Acquiring lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:12:05 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-d2f7611e-d6f2-41c2-8183-9690f053867b req-b82b8a4c-f9e0-4d55-92d8-7725058ead0f service nova] Lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:12:05 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-d2f7611e-d6f2-41c2-8183-9690f053867b req-b82b8a4c-f9e0-4d55-92d8-7725058ead0f service nova] Lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:12:05 user nova-compute[82479]: DEBUG nova.compute.manager [req-d2f7611e-d6f2-41c2-8183-9690f053867b req-b82b8a4c-f9e0-4d55-92d8-7725058ead0f service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] No waiting events found dispatching network-vif-unplugged-1c533ad9-47bf-4eb9-b931-d855ad4ce53e {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:12:05 user nova-compute[82479]: DEBUG nova.compute.manager [req-d2f7611e-d6f2-41c2-8183-9690f053867b req-b82b8a4c-f9e0-4d55-92d8-7725058ead0f service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Received event network-vif-unplugged-1c533ad9-47bf-4eb9-b931-d855ad4ce53e for instance with task_state deleting. {{(pid=82479) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 00:12:05 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:05 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:05 user nova-compute[82479]: DEBUG nova.compute.manager [req-75c28741-7f73-43e5-9976-7c0ba614f8b3 req-eeee634f-331e-4452-9065-5ecf07b5bbde service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Received event network-vif-unplugged-e9ec2eab-0d7a-4be3-acab-a27bce761738 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:12:05 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-75c28741-7f73-43e5-9976-7c0ba614f8b3 req-eeee634f-331e-4452-9065-5ecf07b5bbde service nova] Acquiring lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:12:05 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-75c28741-7f73-43e5-9976-7c0ba614f8b3 req-eeee634f-331e-4452-9065-5ecf07b5bbde service nova] Lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:12:05 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-75c28741-7f73-43e5-9976-7c0ba614f8b3 req-eeee634f-331e-4452-9065-5ecf07b5bbde service nova] Lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:12:05 user nova-compute[82479]: DEBUG nova.compute.manager [req-75c28741-7f73-43e5-9976-7c0ba614f8b3 req-eeee634f-331e-4452-9065-5ecf07b5bbde service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] No waiting events found dispatching network-vif-unplugged-e9ec2eab-0d7a-4be3-acab-a27bce761738 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:12:05 user nova-compute[82479]: DEBUG nova.compute.manager [req-75c28741-7f73-43e5-9976-7c0ba614f8b3 req-eeee634f-331e-4452-9065-5ecf07b5bbde service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Received event network-vif-unplugged-e9ec2eab-0d7a-4be3-acab-a27bce761738 for instance with task_state deleting. {{(pid=82479) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 00:12:05 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:05 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:06 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:06 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:06 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:06 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:06 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:06 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:06 user nova-compute[82479]: DEBUG nova.compute.manager [req-6e586fe5-4c62-44ef-b43c-c237d85f2ac6 req-8cfbe67f-4f2c-4948-9480-48c2d73aac36 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Received event network-vif-unplugged-9dedd1d2-74e4-4aae-8114-9ecd78686a4d {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:12:06 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-6e586fe5-4c62-44ef-b43c-c237d85f2ac6 req-8cfbe67f-4f2c-4948-9480-48c2d73aac36 service nova] Acquiring lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:12:06 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-6e586fe5-4c62-44ef-b43c-c237d85f2ac6 req-8cfbe67f-4f2c-4948-9480-48c2d73aac36 service nova] Lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:12:06 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-6e586fe5-4c62-44ef-b43c-c237d85f2ac6 req-8cfbe67f-4f2c-4948-9480-48c2d73aac36 service nova] Lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:12:06 user nova-compute[82479]: DEBUG nova.compute.manager [req-6e586fe5-4c62-44ef-b43c-c237d85f2ac6 req-8cfbe67f-4f2c-4948-9480-48c2d73aac36 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] No waiting events found dispatching network-vif-unplugged-9dedd1d2-74e4-4aae-8114-9ecd78686a4d {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:12:06 user nova-compute[82479]: DEBUG nova.compute.manager [req-6e586fe5-4c62-44ef-b43c-c237d85f2ac6 req-8cfbe67f-4f2c-4948-9480-48c2d73aac36 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Received event network-vif-unplugged-9dedd1d2-74e4-4aae-8114-9ecd78686a4d for instance with task_state deleting. {{(pid=82479) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 00:12:06 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:06 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:06 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:06 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:06 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:07 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Instance destroyed successfully.
Apr 14 00:12:07 user nova-compute[82479]: DEBUG nova.objects.instance [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Lazy-loading 'resources' on Instance uuid 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T00:10:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1988157619',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1988157619',id=19,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzFzYtOkhtTfUxmZfatH6CLkRspJ29CcFKsj7Jii/QnXAw3odYM7Fg7NrRwCCXWDFq4MfAcHuoGwdJI+7pLDpdqmMb7XOB25SJmdfg0Ga4BVIZeAS8DmBQk03SznYKaXw==',key_name='tempest-keypair-84265846',keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:10:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='be44ce9922f14c6fa75dc0f99b544851',ramdisk_id='',reservation_id='r-evii7suo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1295697559',owner_user_name='tempest-TaggedBootDevicesTest_v242-1295697559-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T00:10:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85f2e1744d6c460a81c97f39a76ef5c7',uuid=6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1c533ad9-47bf-4eb9-b931-d855ad4ce53e", "address": "fa:16:3e:bf:3e:c1", "network": {"id": "4368ab10-ccfd-46d6-a0eb-296895d3ba19", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1929715000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c533ad9-47", "ovs_interfaceid": "1c533ad9-47bf-4eb9-b931-d855ad4ce53e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Converting VIF {"id": "1c533ad9-47bf-4eb9-b931-d855ad4ce53e", "address": "fa:16:3e:bf:3e:c1", "network": {"id": "4368ab10-ccfd-46d6-a0eb-296895d3ba19", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1929715000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c533ad9-47", "ovs_interfaceid": "1c533ad9-47bf-4eb9-b931-d855ad4ce53e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bf:3e:c1,bridge_name='br-int',has_traffic_filtering=True,id=1c533ad9-47bf-4eb9-b931-d855ad4ce53e,network=Network(4368ab10-ccfd-46d6-a0eb-296895d3ba19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c533ad9-47') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG os_vif [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:3e:c1,bridge_name='br-int',has_traffic_filtering=True,id=1c533ad9-47bf-4eb9-b931-d855ad4ce53e,network=Network(4368ab10-ccfd-46d6-a0eb-296895d3ba19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c533ad9-47') {{(pid=82479) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1c533ad9-47, bridge=br-int, if_exists=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:07 user nova-compute[82479]: INFO os_vif [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:3e:c1,bridge_name='br-int',has_traffic_filtering=True,id=1c533ad9-47bf-4eb9-b931-d855ad4ce53e,network=Network(4368ab10-ccfd-46d6-a0eb-296895d3ba19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c533ad9-47')
Apr 14 00:12:07 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T00:10:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1988157619',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1988157619',id=19,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzFzYtOkhtTfUxmZfatH6CLkRspJ29CcFKsj7Jii/QnXAw3odYM7Fg7NrRwCCXWDFq4MfAcHuoGwdJI+7pLDpdqmMb7XOB25SJmdfg0Ga4BVIZeAS8DmBQk03SznYKaXw==',key_name='tempest-keypair-84265846',keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:10:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='be44ce9922f14c6fa75dc0f99b544851',ramdisk_id='',reservation_id='r-evii7suo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1295697559',owner_user_name='tempest-TaggedBootDevicesTest_v242-1295697559-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T00:10:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85f2e1744d6c460a81c97f39a76ef5c7',uuid=6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e9ec2eab-0d7a-4be3-acab-a27bce761738", "address": "fa:16:3e:93:27:43", "network": {"id": "0b416634-9a5d-4d0a-a891-fca1700a2d6b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1990875628", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9ec2eab-0d", "ovs_interfaceid": "e9ec2eab-0d7a-4be3-acab-a27bce761738", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82479) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Converting VIF {"id": "e9ec2eab-0d7a-4be3-acab-a27bce761738", "address": "fa:16:3e:93:27:43", "network": {"id": "0b416634-9a5d-4d0a-a891-fca1700a2d6b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1990875628", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9ec2eab-0d", "ovs_interfaceid": "e9ec2eab-0d7a-4be3-acab-a27bce761738", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:27:43,bridge_name='br-int',has_traffic_filtering=True,id=e9ec2eab-0d7a-4be3-acab-a27bce761738,network=Network(0b416634-9a5d-4d0a-a891-fca1700a2d6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape9ec2eab-0d') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG os_vif [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:27:43,bridge_name='br-int',has_traffic_filtering=True,id=e9ec2eab-0d7a-4be3-acab-a27bce761738,network=Network(0b416634-9a5d-4d0a-a891-fca1700a2d6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape9ec2eab-0d') {{(pid=82479) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape9ec2eab-0d, bridge=br-int, if_exists=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:07 user nova-compute[82479]: INFO os_vif [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:27:43,bridge_name='br-int',has_traffic_filtering=True,id=e9ec2eab-0d7a-4be3-acab-a27bce761738,network=Network(0b416634-9a5d-4d0a-a891-fca1700a2d6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape9ec2eab-0d')
Apr 14 00:12:07 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T00:10:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1988157619',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1988157619',id=19,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzFzYtOkhtTfUxmZfatH6CLkRspJ29CcFKsj7Jii/QnXAw3odYM7Fg7NrRwCCXWDFq4MfAcHuoGwdJI+7pLDpdqmMb7XOB25SJmdfg0Ga4BVIZeAS8DmBQk03SznYKaXw==',key_name='tempest-keypair-84265846',keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:10:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='be44ce9922f14c6fa75dc0f99b544851',ramdisk_id='',reservation_id='r-evii7suo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1295697559',owner_user_name='tempest-TaggedBootDevicesTest_v242-1295697559-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T00:10:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85f2e1744d6c460a81c97f39a76ef5c7',uuid=6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "127b1d7d-d92a-4e24-9470-1758579376bf", "address": "fa:16:3e:bf:72:3f", "network": {"id": "0b416634-9a5d-4d0a-a891-fca1700a2d6b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1990875628", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127b1d7d-d9", "ovs_interfaceid": "127b1d7d-d92a-4e24-9470-1758579376bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82479) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Converting VIF {"id": "127b1d7d-d92a-4e24-9470-1758579376bf", "address": "fa:16:3e:bf:72:3f", "network": {"id": "0b416634-9a5d-4d0a-a891-fca1700a2d6b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1990875628", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127b1d7d-d9", "ovs_interfaceid": "127b1d7d-d92a-4e24-9470-1758579376bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:72:3f,bridge_name='br-int',has_traffic_filtering=True,id=127b1d7d-d92a-4e24-9470-1758579376bf,network=Network(0b416634-9a5d-4d0a-a891-fca1700a2d6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap127b1d7d-d9') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG os_vif [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:72:3f,bridge_name='br-int',has_traffic_filtering=True,id=127b1d7d-d92a-4e24-9470-1758579376bf,network=Network(0b416634-9a5d-4d0a-a891-fca1700a2d6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap127b1d7d-d9') {{(pid=82479) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap127b1d7d-d9, bridge=br-int, if_exists=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:07 user nova-compute[82479]: INFO os_vif [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:72:3f,bridge_name='br-int',has_traffic_filtering=True,id=127b1d7d-d92a-4e24-9470-1758579376bf,network=Network(0b416634-9a5d-4d0a-a891-fca1700a2d6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap127b1d7d-d9')
Apr 14 00:12:07 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T00:10:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1988157619',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1988157619',id=19,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzFzYtOkhtTfUxmZfatH6CLkRspJ29CcFKsj7Jii/QnXAw3odYM7Fg7NrRwCCXWDFq4MfAcHuoGwdJI+7pLDpdqmMb7XOB25SJmdfg0Ga4BVIZeAS8DmBQk03SznYKaXw==',key_name='tempest-keypair-84265846',keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:10:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='be44ce9922f14c6fa75dc0f99b544851',ramdisk_id='',reservation_id='r-evii7suo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1295697559',owner_user_name='tempest-TaggedBootDevicesTest_v242-1295697559-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T00:10:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85f2e1744d6c460a81c97f39a76ef5c7',uuid=6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9dedd1d2-74e4-4aae-8114-9ecd78686a4d", "address": "fa:16:3e:3a:bb:81", "network": {"id": "0b416634-9a5d-4d0a-a891-fca1700a2d6b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1990875628", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dedd1d2-74", "ovs_interfaceid": "9dedd1d2-74e4-4aae-8114-9ecd78686a4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Converting VIF {"id": "9dedd1d2-74e4-4aae-8114-9ecd78686a4d", "address": "fa:16:3e:3a:bb:81", "network": {"id": "0b416634-9a5d-4d0a-a891-fca1700a2d6b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1990875628", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dedd1d2-74", "ovs_interfaceid": "9dedd1d2-74e4-4aae-8114-9ecd78686a4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:bb:81,bridge_name='br-int',has_traffic_filtering=True,id=9dedd1d2-74e4-4aae-8114-9ecd78686a4d,network=Network(0b416634-9a5d-4d0a-a891-fca1700a2d6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dedd1d2-74') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG os_vif [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:bb:81,bridge_name='br-int',has_traffic_filtering=True,id=9dedd1d2-74e4-4aae-8114-9ecd78686a4d,network=Network(0b416634-9a5d-4d0a-a891-fca1700a2d6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dedd1d2-74') {{(pid=82479) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9dedd1d2-74, bridge=br-int, if_exists=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:07 user nova-compute[82479]: INFO os_vif [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:bb:81,bridge_name='br-int',has_traffic_filtering=True,id=9dedd1d2-74e4-4aae-8114-9ecd78686a4d,network=Network(0b416634-9a5d-4d0a-a891-fca1700a2d6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dedd1d2-74')
Apr 14 00:12:07 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T00:10:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1988157619',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1988157619',id=19,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzFzYtOkhtTfUxmZfatH6CLkRspJ29CcFKsj7Jii/QnXAw3odYM7Fg7NrRwCCXWDFq4MfAcHuoGwdJI+7pLDpdqmMb7XOB25SJmdfg0Ga4BVIZeAS8DmBQk03SznYKaXw==',key_name='tempest-keypair-84265846',keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:10:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='be44ce9922f14c6fa75dc0f99b544851',ramdisk_id='',reservation_id='r-evii7suo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1295697559',owner_user_name='tempest-TaggedBootDevicesTest_v242-1295697559-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T00:10:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85f2e1744d6c460a81c97f39a76ef5c7',uuid=6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d3174ebb-df19-4943-98c4-89c97607f42b", "address": "fa:16:3e:ad:34:97", "network": {"id": "0b416634-9a5d-4d0a-a891-fca1700a2d6b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1990875628", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3174ebb-df", "ovs_interfaceid": "d3174ebb-df19-4943-98c4-89c97607f42b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Converting VIF {"id": "d3174ebb-df19-4943-98c4-89c97607f42b", "address": "fa:16:3e:ad:34:97", "network": {"id": "0b416634-9a5d-4d0a-a891-fca1700a2d6b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1990875628", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3174ebb-df", "ovs_interfaceid": "d3174ebb-df19-4943-98c4-89c97607f42b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:34:97,bridge_name='br-int',has_traffic_filtering=True,id=d3174ebb-df19-4943-98c4-89c97607f42b,network=Network(0b416634-9a5d-4d0a-a891-fca1700a2d6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3174ebb-df') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG os_vif [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:34:97,bridge_name='br-int',has_traffic_filtering=True,id=d3174ebb-df19-4943-98c4-89c97607f42b,network=Network(0b416634-9a5d-4d0a-a891-fca1700a2d6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3174ebb-df') {{(pid=82479) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd3174ebb-df, bridge=br-int, if_exists=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:07 user nova-compute[82479]: INFO os_vif [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:34:97,bridge_name='br-int',has_traffic_filtering=True,id=d3174ebb-df19-4943-98c4-89c97607f42b,network=Network(0b416634-9a5d-4d0a-a891-fca1700a2d6b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3174ebb-df')
Apr 14 00:12:07 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T00:10:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1988157619',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1988157619',id=19,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzFzYtOkhtTfUxmZfatH6CLkRspJ29CcFKsj7Jii/QnXAw3odYM7Fg7NrRwCCXWDFq4MfAcHuoGwdJI+7pLDpdqmMb7XOB25SJmdfg0Ga4BVIZeAS8DmBQk03SznYKaXw==',key_name='tempest-keypair-84265846',keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:10:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='be44ce9922f14c6fa75dc0f99b544851',ramdisk_id='',reservation_id='r-evii7suo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1295697559',owner_user_name='tempest-TaggedBootDevicesTest_v242-1295697559-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T00:10:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85f2e1744d6c460a81c97f39a76ef5c7',uuid=6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dff47f62-64b6-4ee5-b163-c74fc50ce6c9", "address": "fa:16:3e:fe:ff:79", "network": {"id": "700ca002-00ac-4a55-b2a5-f31c7ca9bcfa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1927044898", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff47f62-64", "ovs_interfaceid": "dff47f62-64b6-4ee5-b163-c74fc50ce6c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Converting VIF {"id": "dff47f62-64b6-4ee5-b163-c74fc50ce6c9", "address": "fa:16:3e:fe:ff:79", "network": {"id": "700ca002-00ac-4a55-b2a5-f31c7ca9bcfa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1927044898", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff47f62-64", "ovs_interfaceid": "dff47f62-64b6-4ee5-b163-c74fc50ce6c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:ff:79,bridge_name='br-int',has_traffic_filtering=True,id=dff47f62-64b6-4ee5-b163-c74fc50ce6c9,network=Network(700ca002-00ac-4a55-b2a5-f31c7ca9bcfa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdff47f62-64') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG os_vif [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:ff:79,bridge_name='br-int',has_traffic_filtering=True,id=dff47f62-64b6-4ee5-b163-c74fc50ce6c9,network=Network(700ca002-00ac-4a55-b2a5-f31c7ca9bcfa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdff47f62-64') {{(pid=82479) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdff47f62-64, bridge=br-int, if_exists=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:07 user nova-compute[82479]: INFO os_vif [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:ff:79,bridge_name='br-int',has_traffic_filtering=True,id=dff47f62-64b6-4ee5-b163-c74fc50ce6c9,network=Network(700ca002-00ac-4a55-b2a5-f31c7ca9bcfa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdff47f62-64')
Apr 14 00:12:07 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T00:10:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1988157619',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1988157619',id=19,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzFzYtOkhtTfUxmZfatH6CLkRspJ29CcFKsj7Jii/QnXAw3odYM7Fg7NrRwCCXWDFq4MfAcHuoGwdJI+7pLDpdqmMb7XOB25SJmdfg0Ga4BVIZeAS8DmBQk03SznYKaXw==',key_name='tempest-keypair-84265846',keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:10:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='be44ce9922f14c6fa75dc0f99b544851',ramdisk_id='',reservation_id='r-evii7suo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1295697559',owner_user_name='tempest-TaggedBootDevicesTest_v242-1295697559-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T00:10:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85f2e1744d6c460a81c97f39a76ef5c7',uuid=6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3839e2a9-bfeb-4103-9d7c-bcf45f9eaf14", "address": "fa:16:3e:c1:ce:a4", "network": {"id": "700ca002-00ac-4a55-b2a5-f31c7ca9bcfa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1927044898", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3839e2a9-bf", "ovs_interfaceid": "3839e2a9-bfeb-4103-9d7c-bcf45f9eaf14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Converting VIF {"id": "3839e2a9-bfeb-4103-9d7c-bcf45f9eaf14", "address": "fa:16:3e:c1:ce:a4", "network": {"id": "700ca002-00ac-4a55-b2a5-f31c7ca9bcfa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1927044898", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3839e2a9-bf", "ovs_interfaceid": "3839e2a9-bfeb-4103-9d7c-bcf45f9eaf14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:ce:a4,bridge_name='br-int',has_traffic_filtering=True,id=3839e2a9-bfeb-4103-9d7c-bcf45f9eaf14,network=Network(700ca002-00ac-4a55-b2a5-f31c7ca9bcfa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3839e2a9-bf') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG os_vif [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:ce:a4,bridge_name='br-int',has_traffic_filtering=True,id=3839e2a9-bfeb-4103-9d7c-bcf45f9eaf14,network=Network(700ca002-00ac-4a55-b2a5-f31c7ca9bcfa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3839e2a9-bf') {{(pid=82479) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3839e2a9-bf, bridge=br-int, if_exists=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:07 user nova-compute[82479]: INFO os_vif [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:ce:a4,bridge_name='br-int',has_traffic_filtering=True,id=3839e2a9-bfeb-4103-9d7c-bcf45f9eaf14,network=Network(700ca002-00ac-4a55-b2a5-f31c7ca9bcfa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3839e2a9-bf')
Apr 14 00:12:07 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] calling os-brick to detach iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, {'target_iqn': 'iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jPSrRZvK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj': {}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:12:07 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:12:07 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[30914ba4-5541-4722-9e15-d1d31e226987]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 00:12:07 user nova-compute[82479]: No targets found.
Apr 14 00:12:07 user nova-compute[82479]: iSNS:
Apr 14 00:12:07 user nova-compute[82479]: No targets found.
Apr 14 00:12:07 user nova-compute[82479]: STATIC:
Apr 14 00:12:07 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0
Apr 14 00:12:07 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:12:07 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:12:07 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc
Apr 14 00:12:07 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:12:07 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:12:07 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc
Apr 14 00:12:07 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:12:07 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:12:07 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593
Apr 14 00:12:07 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:12:07 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:12:07 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62
Apr 14 00:12:07 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:12:07 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:12:07 user nova-compute[82479]: FIRMWARE:
Apr 14 00:12:07 user nova-compute[82479]: No targets found.
Apr 14 00:12:07 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 00:12:07 user nova-compute[82479]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 00:12:07 user nova-compute[82479]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82479) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc', 0)] {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6218cb3-2839-4f57-afc7-41c76dc0a4f5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd7ff57-b777-49f4-8a15-345ae55fe230]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:12:07 user nova-compute[82479]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 (non-flash)
Apr 14 00:12:07 user nova-compute[82479]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 (non-flash)
Apr 14 00:12:07 user nova-compute[82479]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 (non-flash)
Apr 14 00:12:07 user nova-compute[82479]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc (non-flash)
Apr 14 00:12:07 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:12:07 user nova-compute[82479]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 (non-flash)
Apr 14 00:12:07 user nova-compute[82479]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 (non-flash)
Apr 14 00:12:07 user nova-compute[82479]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 (non-flash)
Apr 14 00:12:07 user nova-compute[82479]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc (non-flash)
Apr 14 00:12:07 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f33381f5ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc'): ({'sdj'}, set())}) {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Removing single pathed devices sdj {{(pid=82479) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG nova.compute.manager [req-ff5e38cb-a124-403e-b358-b06b7f5f2692 req-0eb75fbf-4dc2-4aa5-bb95-1e567bbeceeb service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Received event network-vif-plugged-1c533ad9-47bf-4eb9-b931-d855ad4ce53e {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-ff5e38cb-a124-403e-b358-b06b7f5f2692 req-0eb75fbf-4dc2-4aa5-bb95-1e567bbeceeb service nova] Acquiring lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-ff5e38cb-a124-403e-b358-b06b7f5f2692 req-0eb75fbf-4dc2-4aa5-bb95-1e567bbeceeb service nova] Lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-ff5e38cb-a124-403e-b358-b06b7f5f2692 req-0eb75fbf-4dc2-4aa5-bb95-1e567bbeceeb service nova] Lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG nova.compute.manager [req-ff5e38cb-a124-403e-b358-b06b7f5f2692 req-0eb75fbf-4dc2-4aa5-bb95-1e567bbeceeb service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] No waiting events found dispatching network-vif-plugged-1c533ad9-47bf-4eb9-b931-d855ad4ce53e {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:12:07 user nova-compute[82479]: WARNING nova.compute.manager [req-ff5e38cb-a124-403e-b358-b06b7f5f2692 req-0eb75fbf-4dc2-4aa5-bb95-1e567bbeceeb service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Received unexpected event network-vif-plugged-1c533ad9-47bf-4eb9-b931-d855ad4ce53e for instance with vm_state active and task_state deleting.
Apr 14 00:12:07 user nova-compute[82479]: DEBUG nova.compute.manager [req-ff5e38cb-a124-403e-b358-b06b7f5f2692 req-0eb75fbf-4dc2-4aa5-bb95-1e567bbeceeb service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Received event network-vif-unplugged-3839e2a9-bfeb-4103-9d7c-bcf45f9eaf14 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-ff5e38cb-a124-403e-b358-b06b7f5f2692 req-0eb75fbf-4dc2-4aa5-bb95-1e567bbeceeb service nova] Acquiring lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-ff5e38cb-a124-403e-b358-b06b7f5f2692 req-0eb75fbf-4dc2-4aa5-bb95-1e567bbeceeb service nova] Lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-ff5e38cb-a124-403e-b358-b06b7f5f2692 req-0eb75fbf-4dc2-4aa5-bb95-1e567bbeceeb service nova] Lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG nova.compute.manager [req-ff5e38cb-a124-403e-b358-b06b7f5f2692 req-0eb75fbf-4dc2-4aa5-bb95-1e567bbeceeb service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] No waiting events found dispatching network-vif-unplugged-3839e2a9-bfeb-4103-9d7c-bcf45f9eaf14 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG nova.compute.manager [req-ff5e38cb-a124-403e-b358-b06b7f5f2692 req-0eb75fbf-4dc2-4aa5-bb95-1e567bbeceeb service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Received event network-vif-unplugged-3839e2a9-bfeb-4103-9d7c-bcf45f9eaf14 for instance with task_state deleting. {{(pid=82479) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG nova.compute.manager [req-ff5e38cb-a124-403e-b358-b06b7f5f2692 req-0eb75fbf-4dc2-4aa5-bb95-1e567bbeceeb service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Received event network-vif-plugged-3839e2a9-bfeb-4103-9d7c-bcf45f9eaf14 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-ff5e38cb-a124-403e-b358-b06b7f5f2692 req-0eb75fbf-4dc2-4aa5-bb95-1e567bbeceeb service nova] Acquiring lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-ff5e38cb-a124-403e-b358-b06b7f5f2692 req-0eb75fbf-4dc2-4aa5-bb95-1e567bbeceeb service nova] Lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-ff5e38cb-a124-403e-b358-b06b7f5f2692 req-0eb75fbf-4dc2-4aa5-bb95-1e567bbeceeb service nova] Lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG nova.compute.manager [req-ff5e38cb-a124-403e-b358-b06b7f5f2692 req-0eb75fbf-4dc2-4aa5-bb95-1e567bbeceeb service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] No waiting events found dispatching network-vif-plugged-3839e2a9-bfeb-4103-9d7c-bcf45f9eaf14 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:12:07 user nova-compute[82479]: WARNING nova.compute.manager [req-ff5e38cb-a124-403e-b358-b06b7f5f2692 req-0eb75fbf-4dc2-4aa5-bb95-1e567bbeceeb service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Received unexpected event network-vif-plugged-3839e2a9-bfeb-4103-9d7c-bcf45f9eaf14 for instance with vm_state active and task_state deleting.
Apr 14 00:12:07 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[82868cdd-e6bf-46cd-8c43-8af6deccb914]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[413d141e-7efa-4415-bf8d-9f57eaeb5579]: (4, ('ok\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Flushing IO for device /dev/sdj {{(pid=82479) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.013s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43f7909-b421-4bad-9e9d-40c3bc7d083a]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=82479) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.049s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[450a5b76-7a6e-4e37-9b85-7947a7cf3b92]: (4, ('1', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] SCSI volumes sdj have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc')] {{(pid=82479) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 00:12:07 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[831a53ff-2a2d-42bb-a826-bcc23c9525c2]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG nova.compute.manager [req-11598116-4117-4794-9eb9-8914ffb63d92 req-39ab1780-b3d4-4392-9513-4759857dd685 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Received event network-vif-plugged-e9ec2eab-0d7a-4be3-acab-a27bce761738 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-11598116-4117-4794-9eb9-8914ffb63d92 req-39ab1780-b3d4-4392-9513-4759857dd685 service nova] Acquiring lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-11598116-4117-4794-9eb9-8914ffb63d92 req-39ab1780-b3d4-4392-9513-4759857dd685 service nova] Lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-11598116-4117-4794-9eb9-8914ffb63d92 req-39ab1780-b3d4-4392-9513-4759857dd685 service nova] Lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG nova.compute.manager [req-11598116-4117-4794-9eb9-8914ffb63d92 req-39ab1780-b3d4-4392-9513-4759857dd685 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] No waiting events found dispatching network-vif-plugged-e9ec2eab-0d7a-4be3-acab-a27bce761738 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:12:08 user nova-compute[82479]: WARNING nova.compute.manager [req-11598116-4117-4794-9eb9-8914ffb63d92 req-39ab1780-b3d4-4392-9513-4759857dd685 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Received unexpected event network-vif-plugged-e9ec2eab-0d7a-4be3-acab-a27bce761738 for instance with vm_state active and task_state deleting.
Apr 14 00:12:08 user nova-compute[82479]: DEBUG nova.compute.manager [req-11598116-4117-4794-9eb9-8914ffb63d92 req-39ab1780-b3d4-4392-9513-4759857dd685 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Received event network-vif-unplugged-127b1d7d-d92a-4e24-9470-1758579376bf {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-11598116-4117-4794-9eb9-8914ffb63d92 req-39ab1780-b3d4-4392-9513-4759857dd685 service nova] Acquiring lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-11598116-4117-4794-9eb9-8914ffb63d92 req-39ab1780-b3d4-4392-9513-4759857dd685 service nova] Lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-11598116-4117-4794-9eb9-8914ffb63d92 req-39ab1780-b3d4-4392-9513-4759857dd685 service nova] Lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG nova.compute.manager [req-11598116-4117-4794-9eb9-8914ffb63d92 req-39ab1780-b3d4-4392-9513-4759857dd685 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] No waiting events found dispatching network-vif-unplugged-127b1d7d-d92a-4e24-9470-1758579376bf {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG nova.compute.manager [req-11598116-4117-4794-9eb9-8914ffb63d92 req-39ab1780-b3d4-4392-9513-4759857dd685 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Received event network-vif-unplugged-127b1d7d-d92a-4e24-9470-1758579376bf for instance with task_state deleting. {{(pid=82479) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG nova.compute.manager [req-11598116-4117-4794-9eb9-8914ffb63d92 req-39ab1780-b3d4-4392-9513-4759857dd685 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Received event network-vif-plugged-127b1d7d-d92a-4e24-9470-1758579376bf {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-11598116-4117-4794-9eb9-8914ffb63d92 req-39ab1780-b3d4-4392-9513-4759857dd685 service nova] Acquiring lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-11598116-4117-4794-9eb9-8914ffb63d92 req-39ab1780-b3d4-4392-9513-4759857dd685 service nova] Lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-11598116-4117-4794-9eb9-8914ffb63d92 req-39ab1780-b3d4-4392-9513-4759857dd685 service nova] Lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG nova.compute.manager [req-11598116-4117-4794-9eb9-8914ffb63d92 req-39ab1780-b3d4-4392-9513-4759857dd685 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] No waiting events found dispatching network-vif-plugged-127b1d7d-d92a-4e24-9470-1758579376bf {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:12:08 user nova-compute[82479]: WARNING nova.compute.manager [req-11598116-4117-4794-9eb9-8914ffb63d92 req-39ab1780-b3d4-4392-9513-4759857dd685 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Received unexpected event network-vif-plugged-127b1d7d-d92a-4e24-9470-1758579376bf for instance with vm_state active and task_state deleting.
Apr 14 00:12:08 user nova-compute[82479]: DEBUG nova.compute.manager [req-11598116-4117-4794-9eb9-8914ffb63d92 req-39ab1780-b3d4-4392-9513-4759857dd685 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Received event network-vif-unplugged-d3174ebb-df19-4943-98c4-89c97607f42b {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-11598116-4117-4794-9eb9-8914ffb63d92 req-39ab1780-b3d4-4392-9513-4759857dd685 service nova] Acquiring lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-11598116-4117-4794-9eb9-8914ffb63d92 req-39ab1780-b3d4-4392-9513-4759857dd685 service nova] Lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-11598116-4117-4794-9eb9-8914ffb63d92 req-39ab1780-b3d4-4392-9513-4759857dd685 service nova] Lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG nova.compute.manager [req-11598116-4117-4794-9eb9-8914ffb63d92 req-39ab1780-b3d4-4392-9513-4759857dd685 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] No waiting events found dispatching network-vif-unplugged-d3174ebb-df19-4943-98c4-89c97607f42b {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG nova.compute.manager [req-11598116-4117-4794-9eb9-8914ffb63d92 req-39ab1780-b3d4-4392-9513-4759857dd685 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Received event network-vif-unplugged-d3174ebb-df19-4943-98c4-89c97607f42b for instance with task_state deleting. {{(pid=82479) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG nova.compute.manager [req-11598116-4117-4794-9eb9-8914ffb63d92 req-39ab1780-b3d4-4392-9513-4759857dd685 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Received event network-vif-plugged-d3174ebb-df19-4943-98c4-89c97607f42b {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-11598116-4117-4794-9eb9-8914ffb63d92 req-39ab1780-b3d4-4392-9513-4759857dd685 service nova] Acquiring lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-11598116-4117-4794-9eb9-8914ffb63d92 req-39ab1780-b3d4-4392-9513-4759857dd685 service nova] Lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-11598116-4117-4794-9eb9-8914ffb63d92 req-39ab1780-b3d4-4392-9513-4759857dd685 service nova] Lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG nova.compute.manager [req-11598116-4117-4794-9eb9-8914ffb63d92 req-39ab1780-b3d4-4392-9513-4759857dd685 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] No waiting events found dispatching network-vif-plugged-d3174ebb-df19-4943-98c4-89c97607f42b {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:12:08 user nova-compute[82479]: WARNING nova.compute.manager [req-11598116-4117-4794-9eb9-8914ffb63d92 req-39ab1780-b3d4-4392-9513-4759857dd685 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Received unexpected event network-vif-plugged-d3174ebb-df19-4943-98c4-89c97607f42b for instance with vm_state active and task_state deleting.
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc -p 172.16.0.220:3260 --logout {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[383cab73-cf11-45b2-9f59-74f924c1e2ee]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc, portal: 172.16.0.220,3260]
Apr 14 00:12:08 user nova-compute[82479]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc, portal: 172.16.0.220,3260] successful.
Apr 14 00:12:08 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc -p 172.16.0.220:3260 --op delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d57698-1ebc-4b6c-a8b8-335b2012f570]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] <== disconnect_volume: return (324ms) None {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Disconnected iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] calling os-brick to detach iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, {'target_iqn': 'iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XKCdSwHe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh': {}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:12:08 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:12:08 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[57752108-5813-4c44-8f07-771c115cd4d0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 00:12:08 user nova-compute[82479]: No targets found.
Apr 14 00:12:08 user nova-compute[82479]: iSNS:
Apr 14 00:12:08 user nova-compute[82479]: No targets found.
Apr 14 00:12:08 user nova-compute[82479]: STATIC:
Apr 14 00:12:08 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0
Apr 14 00:12:08 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:12:08 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:12:08 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc
Apr 14 00:12:08 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:12:08 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:12:08 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593
Apr 14 00:12:08 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:12:08 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:12:08 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62
Apr 14 00:12:08 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:12:08 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:12:08 user nova-compute[82479]: FIRMWARE:
Apr 14 00:12:08 user nova-compute[82479]: No targets found.
Apr 14 00:12:08 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 00:12:08 user nova-compute[82479]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 00:12:08 user nova-compute[82479]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82479) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62', 0)] {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[0411a99a-4010-4a25-8f7b-491138228357]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[738b482e-cc63-4ed3-b769-cff665ca9d74]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:12:08 user nova-compute[82479]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 (non-flash)
Apr 14 00:12:08 user nova-compute[82479]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 (non-flash)
Apr 14 00:12:08 user nova-compute[82479]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 (non-flash)
Apr 14 00:12:08 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:12:08 user nova-compute[82479]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 (non-flash)
Apr 14 00:12:08 user nova-compute[82479]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 (non-flash)
Apr 14 00:12:08 user nova-compute[82479]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 (non-flash)
Apr 14 00:12:08 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f333025c430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62'): ({'sdh'}, set())}) {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Removing single pathed devices sdh {{(pid=82479) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[764f9bea-f203-444e-b0e6-37244bf6fd48]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce03814-8613-485f-b7da-fb7b442f9c1b]: (4, ('ok\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Flushing IO for device /dev/sdh {{(pid=82479) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b7b56b-27f9-4f8b-a3f5-758eb8d0ef1e]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=82479) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.045s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[50bde0c4-00cd-4c69-8027-0e126d614fbd]: (4, ('1', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] SCSI volumes sdh have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62')] {{(pid=82479) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c31fe05-ca3f-4337-a268-d4c656e2086d]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 -p 172.16.0.220:3260 --logout {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[e529b66e-eab7-4670-8a58-5499648af938]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62, portal: 172.16.0.220,3260]
Apr 14 00:12:08 user nova-compute[82479]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62, portal: 172.16.0.220,3260] successful.
Apr 14 00:12:08 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 -p 172.16.0.220:3260 --op delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG nova.compute.manager [req-46d23d24-e6a8-4099-9d69-bc4cc34dd1b7 req-6de7f535-9128-4e49-a671-051fd234af85 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Received event network-vif-plugged-9dedd1d2-74e4-4aae-8114-9ecd78686a4d {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-46d23d24-e6a8-4099-9d69-bc4cc34dd1b7 req-6de7f535-9128-4e49-a671-051fd234af85 service nova] Acquiring lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-46d23d24-e6a8-4099-9d69-bc4cc34dd1b7 req-6de7f535-9128-4e49-a671-051fd234af85 service nova] Lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-46d23d24-e6a8-4099-9d69-bc4cc34dd1b7 req-6de7f535-9128-4e49-a671-051fd234af85 service nova] Lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG nova.compute.manager [req-46d23d24-e6a8-4099-9d69-bc4cc34dd1b7 req-6de7f535-9128-4e49-a671-051fd234af85 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] No waiting events found dispatching network-vif-plugged-9dedd1d2-74e4-4aae-8114-9ecd78686a4d {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:12:08 user nova-compute[82479]: WARNING nova.compute.manager [req-46d23d24-e6a8-4099-9d69-bc4cc34dd1b7 req-6de7f535-9128-4e49-a671-051fd234af85 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Received unexpected event network-vif-plugged-9dedd1d2-74e4-4aae-8114-9ecd78686a4d for instance with vm_state active and task_state deleting.
Apr 14 00:12:08 user nova-compute[82479]: DEBUG nova.compute.manager [req-46d23d24-e6a8-4099-9d69-bc4cc34dd1b7 req-6de7f535-9128-4e49-a671-051fd234af85 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Received event network-vif-unplugged-dff47f62-64b6-4ee5-b163-c74fc50ce6c9 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-46d23d24-e6a8-4099-9d69-bc4cc34dd1b7 req-6de7f535-9128-4e49-a671-051fd234af85 service nova] Acquiring lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-46d23d24-e6a8-4099-9d69-bc4cc34dd1b7 req-6de7f535-9128-4e49-a671-051fd234af85 service nova] Lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-46d23d24-e6a8-4099-9d69-bc4cc34dd1b7 req-6de7f535-9128-4e49-a671-051fd234af85 service nova] Lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG nova.compute.manager [req-46d23d24-e6a8-4099-9d69-bc4cc34dd1b7 req-6de7f535-9128-4e49-a671-051fd234af85 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] No waiting events found dispatching network-vif-unplugged-dff47f62-64b6-4ee5-b163-c74fc50ce6c9 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG nova.compute.manager [req-46d23d24-e6a8-4099-9d69-bc4cc34dd1b7 req-6de7f535-9128-4e49-a671-051fd234af85 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Received event network-vif-unplugged-dff47f62-64b6-4ee5-b163-c74fc50ce6c9 for instance with task_state deleting. {{(pid=82479) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG nova.compute.manager [req-46d23d24-e6a8-4099-9d69-bc4cc34dd1b7 req-6de7f535-9128-4e49-a671-051fd234af85 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Received event network-vif-plugged-dff47f62-64b6-4ee5-b163-c74fc50ce6c9 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-46d23d24-e6a8-4099-9d69-bc4cc34dd1b7 req-6de7f535-9128-4e49-a671-051fd234af85 service nova] Acquiring lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-46d23d24-e6a8-4099-9d69-bc4cc34dd1b7 req-6de7f535-9128-4e49-a671-051fd234af85 service nova] Lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-46d23d24-e6a8-4099-9d69-bc4cc34dd1b7 req-6de7f535-9128-4e49-a671-051fd234af85 service nova] Lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG nova.compute.manager [req-46d23d24-e6a8-4099-9d69-bc4cc34dd1b7 req-6de7f535-9128-4e49-a671-051fd234af85 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] No waiting events found dispatching network-vif-plugged-dff47f62-64b6-4ee5-b163-c74fc50ce6c9 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:12:08 user nova-compute[82479]: WARNING nova.compute.manager [req-46d23d24-e6a8-4099-9d69-bc4cc34dd1b7 req-6de7f535-9128-4e49-a671-051fd234af85 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Received unexpected event network-vif-plugged-dff47f62-64b6-4ee5-b163-c74fc50ce6c9 for instance with vm_state active and task_state deleting.
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[64740126-9fa9-4690-8346-19c44d42e5be]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] <== disconnect_volume: return (314ms) None {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Disconnected iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] calling os-brick to detach iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, {'target_iqn': 'iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KBCYoGZf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi': {}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:12:08 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:12:08 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e6051e-fc5c-4e1f-853f-4d0080d47731]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 00:12:08 user nova-compute[82479]: No targets found.
Apr 14 00:12:08 user nova-compute[82479]: iSNS:
Apr 14 00:12:08 user nova-compute[82479]: No targets found.
Apr 14 00:12:08 user nova-compute[82479]: STATIC:
Apr 14 00:12:08 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0
Apr 14 00:12:08 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:12:08 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:12:08 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc
Apr 14 00:12:08 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:12:08 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:12:08 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593
Apr 14 00:12:08 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:12:08 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:12:08 user nova-compute[82479]: FIRMWARE:
Apr 14 00:12:08 user nova-compute[82479]: No targets found.
Apr 14 00:12:08 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 00:12:08 user nova-compute[82479]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 00:12:08 user nova-compute[82479]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82479) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0', 0)] {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f6a019-4e92-45be-a6d5-9c496b0dfb71]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[c394fba1-8542-478b-a3ec-c11ec8dda8ab]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:12:08 user nova-compute[82479]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 (non-flash)
Apr 14 00:12:08 user nova-compute[82479]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 (non-flash)
Apr 14 00:12:08 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:12:08 user nova-compute[82479]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 (non-flash)
Apr 14 00:12:08 user nova-compute[82479]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 (non-flash)
Apr 14 00:12:08 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f33381f6050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0'): ({'sdi'}, set())}) {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Removing single pathed devices sdi {{(pid=82479) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7dc8b8-3a9e-4382-b929-2fbd71da2c19]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd3563ae-d870-4a2a-b689-2f9a816d52ab]: (4, ('ok\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Flushing IO for device /dev/sdi {{(pid=82479) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[895b76ff-1656-457d-a545-28b9c44c8482]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=82479) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.040s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[2050224a-9905-489c-ad47-2bfff230df06]: (4, ('1', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] SCSI volumes sdi have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0')] {{(pid=82479) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74baac9-49d0-4766-9439-e2f4ef6889b4]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 -p 172.16.0.220:3260 --logout {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[921378c1-49fe-47f4-ab70-2c7cd0887ce6]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0, portal: 172.16.0.220,3260]
Apr 14 00:12:08 user nova-compute[82479]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0, portal: 172.16.0.220,3260] successful.
Apr 14 00:12:08 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 -p 172.16.0.220:3260 --op delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[546ff266-b1a5-4da2-ba34-3ead2f7317d9]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] <== disconnect_volume: return (287ms) None {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Disconnected iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 00:12:08 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Deleting instance files /opt/stack/data/nova/instances/6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c_del
Apr 14 00:12:08 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Deletion of /opt/stack/data/nova/instances/6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c_del complete
Apr 14 00:12:08 user nova-compute[82479]: INFO nova.compute.manager [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Took 3.33 seconds to destroy the instance on the hypervisor.
Apr 14 00:12:08 user nova-compute[82479]: DEBUG oslo.service.loopingcall [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82479) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG nova.compute.manager [-] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Deallocating network for instance {{(pid=82479) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 00:12:08 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] deallocate_for_instance() {{(pid=82479) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 00:12:10 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-fe9917e1-8fd8-4314-90c9-3d42c5b01f4a tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Acquiring lock "3a6b9f89-e462-47d8-84a1-0ac4ade3ab97" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:12:10 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-fe9917e1-8fd8-4314-90c9-3d42c5b01f4a tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "3a6b9f89-e462-47d8-84a1-0ac4ade3ab97" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:12:10 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-fe9917e1-8fd8-4314-90c9-3d42c5b01f4a tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Acquiring lock "3a6b9f89-e462-47d8-84a1-0ac4ade3ab97-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:12:10 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-fe9917e1-8fd8-4314-90c9-3d42c5b01f4a tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "3a6b9f89-e462-47d8-84a1-0ac4ade3ab97-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:12:10 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-fe9917e1-8fd8-4314-90c9-3d42c5b01f4a tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "3a6b9f89-e462-47d8-84a1-0ac4ade3ab97-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:12:10 user nova-compute[82479]: INFO nova.compute.manager [None req-fe9917e1-8fd8-4314-90c9-3d42c5b01f4a tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Terminating instance
Apr 14 00:12:10 user nova-compute[82479]: DEBUG nova.compute.manager [None req-fe9917e1-8fd8-4314-90c9-3d42c5b01f4a tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Start destroying the instance on the hypervisor. {{(pid=82479) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 00:12:10 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:10 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:10 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:10 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:10 user nova-compute[82479]: DEBUG nova.compute.manager [req-38d71c4b-9c45-4e6c-b78f-111bad7b1a28 req-a48ef26c-dd8c-4d79-b261-af4cbf776618 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Received event network-vif-deleted-3839e2a9-bfeb-4103-9d7c-bcf45f9eaf14 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:12:10 user nova-compute[82479]: INFO nova.compute.manager [req-38d71c4b-9c45-4e6c-b78f-111bad7b1a28 req-a48ef26c-dd8c-4d79-b261-af4cbf776618 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Neutron deleted interface 3839e2a9-bfeb-4103-9d7c-bcf45f9eaf14; detaching it from the instance and deleting it from the info cache
Apr 14 00:12:10 user nova-compute[82479]: DEBUG nova.network.neutron [req-38d71c4b-9c45-4e6c-b78f-111bad7b1a28 req-a48ef26c-dd8c-4d79-b261-af4cbf776618 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Updating instance_info_cache with network_info: [{"id": "1c533ad9-47bf-4eb9-b931-d855ad4ce53e", "address": "fa:16:3e:bf:3e:c1", "network": {"id": "4368ab10-ccfd-46d6-a0eb-296895d3ba19", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1929715000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c533ad9-47", "ovs_interfaceid": "1c533ad9-47bf-4eb9-b931-d855ad4ce53e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e9ec2eab-0d7a-4be3-acab-a27bce761738", "address": "fa:16:3e:93:27:43", "network": {"id": "0b416634-9a5d-4d0a-a891-fca1700a2d6b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1990875628", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9ec2eab-0d", "ovs_interfaceid": "e9ec2eab-0d7a-4be3-acab-a27bce761738", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "127b1d7d-d92a-4e24-9470-1758579376bf", "address": "fa:16:3e:bf:72:3f", "network": {"id": "0b416634-9a5d-4d0a-a891-fca1700a2d6b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1990875628", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap127b1d7d-d9", "ovs_interfaceid": "127b1d7d-d92a-4e24-9470-1758579376bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9dedd1d2-74e4-4aae-8114-9ecd78686a4d", "address": "fa:16:3e:3a:bb:81", "network": {"id": "0b416634-9a5d-4d0a-a891-fca1700a2d6b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1990875628", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dedd1d2-74", "ovs_interfaceid": "9dedd1d2-74e4-4aae-8114-9ecd78686a4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d3174ebb-df19-4943-98c4-89c97607f42b", "address": "fa:16:3e:ad:34:97", "network": {"id": "0b416634-9a5d-4d0a-a891-fca1700a2d6b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1990875628", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3174ebb-df", "ovs_interfaceid": "d3174ebb-df19-4943-98c4-89c97607f42b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dff47f62-64b6-4ee5-b163-c74fc50ce6c9", "address": "fa:16:3e:fe:ff:79", "network": {"id": "700ca002-00ac-4a55-b2a5-f31c7ca9bcfa", "bridge": "br-int", "label": "tempest-device-tagging-net2-1927044898", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be44ce9922f14c6fa75dc0f99b544851", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff47f62-64", "ovs_interfaceid": "dff47f62-64b6-4ee5-b163-c74fc50ce6c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:12:10 user nova-compute[82479]: DEBUG nova.compute.manager [req-38d71c4b-9c45-4e6c-b78f-111bad7b1a28 req-a48ef26c-dd8c-4d79-b261-af4cbf776618 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Detach interface failed, port_id=3839e2a9-bfeb-4103-9d7c-bcf45f9eaf14, reason: Instance 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c could not be found. {{(pid=82479) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 00:12:10 user nova-compute[82479]: DEBUG nova.compute.manager [req-7e4d8d8a-2946-481b-b1b2-c860af35e242 req-c620aae0-5a47-4628-a195-0c461e325d04 service nova] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Received event network-vif-unplugged-4085de4c-cb9e-452b-9504-b7c7f8621213 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:12:10 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-7e4d8d8a-2946-481b-b1b2-c860af35e242 req-c620aae0-5a47-4628-a195-0c461e325d04 service nova] Acquiring lock "3a6b9f89-e462-47d8-84a1-0ac4ade3ab97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:12:10 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-7e4d8d8a-2946-481b-b1b2-c860af35e242 req-c620aae0-5a47-4628-a195-0c461e325d04 service nova] Lock "3a6b9f89-e462-47d8-84a1-0ac4ade3ab97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:12:10 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-7e4d8d8a-2946-481b-b1b2-c860af35e242 req-c620aae0-5a47-4628-a195-0c461e325d04 service nova] Lock "3a6b9f89-e462-47d8-84a1-0ac4ade3ab97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:12:10 user nova-compute[82479]: DEBUG nova.compute.manager [req-7e4d8d8a-2946-481b-b1b2-c860af35e242 req-c620aae0-5a47-4628-a195-0c461e325d04 service nova] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] No waiting events found dispatching network-vif-unplugged-4085de4c-cb9e-452b-9504-b7c7f8621213 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:12:10 user nova-compute[82479]: DEBUG nova.compute.manager [req-7e4d8d8a-2946-481b-b1b2-c860af35e242 req-c620aae0-5a47-4628-a195-0c461e325d04 service nova] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Received event network-vif-unplugged-4085de4c-cb9e-452b-9504-b7c7f8621213 for instance with task_state deleting. {{(pid=82479) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 00:12:10 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:11 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Instance destroyed successfully.
Apr 14 00:12:11 user nova-compute[82479]: DEBUG nova.objects.instance [None req-fe9917e1-8fd8-4314-90c9-3d42c5b01f4a tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lazy-loading 'resources' on Instance uuid 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:12:11 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-fe9917e1-8fd8-4314-90c9-3d42c5b01f4a tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:04:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1358925619',display_name='tempest-ServerStableDeviceRescueTest-server-1358925619',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1358925619',id=3,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZuJ+sB897ViN2VTH0JXlcH9ndfvRNhk01+KgyuP9jwhkZ5ef42HmlxNSsq22e8Y5akz0iE7TkYd8Z+WgwsB4uFLI7jFktxjc9ufhBjq2ACCm1woK6wgYMrlECKBNQ8fA==',key_name='tempest-keypair-1540032684',keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:09:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c931198e56de4cf08db59bcc40f2a260',ramdisk_id='',reservation_id='r-g35xdtri',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-481368698',owner_user_name='tempest-ServerStableDeviceRescueTest-481368698-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T00:10:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='97374cd3cdc448cd8710561d44756ead',uuid=3a6b9f89-e462-47d8-84a1-0ac4ade3ab97,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4085de4c-cb9e-452b-9504-b7c7f8621213", "address": "fa:16:3e:2b:ab:7d", "network": {"id": "10c34d1a-edc4-4b0c-96a7-b29a7c292e74", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-573422654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931198e56de4cf08db59bcc40f2a260", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4085de4c-cb", "ovs_interfaceid": "4085de4c-cb9e-452b-9504-b7c7f8621213", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 00:12:11 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-fe9917e1-8fd8-4314-90c9-3d42c5b01f4a tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Converting VIF {"id": "4085de4c-cb9e-452b-9504-b7c7f8621213", "address": "fa:16:3e:2b:ab:7d", "network": {"id": "10c34d1a-edc4-4b0c-96a7-b29a7c292e74", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-573422654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931198e56de4cf08db59bcc40f2a260", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4085de4c-cb", "ovs_interfaceid": "4085de4c-cb9e-452b-9504-b7c7f8621213", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:12:11 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-fe9917e1-8fd8-4314-90c9-3d42c5b01f4a tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:ab:7d,bridge_name='br-int',has_traffic_filtering=True,id=4085de4c-cb9e-452b-9504-b7c7f8621213,network=Network(10c34d1a-edc4-4b0c-96a7-b29a7c292e74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4085de4c-cb') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:12:11 user nova-compute[82479]: DEBUG os_vif [None req-fe9917e1-8fd8-4314-90c9-3d42c5b01f4a tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:ab:7d,bridge_name='br-int',has_traffic_filtering=True,id=4085de4c-cb9e-452b-9504-b7c7f8621213,network=Network(10c34d1a-edc4-4b0c-96a7-b29a7c292e74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4085de4c-cb') {{(pid=82479) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 00:12:11 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:11 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4085de4c-cb, bridge=br-int, if_exists=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:12:11 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:11 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:12:11 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:11 user nova-compute[82479]: INFO os_vif [None req-fe9917e1-8fd8-4314-90c9-3d42c5b01f4a tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:ab:7d,bridge_name='br-int',has_traffic_filtering=True,id=4085de4c-cb9e-452b-9504-b7c7f8621213,network=Network(10c34d1a-edc4-4b0c-96a7-b29a7c292e74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4085de4c-cb')
Apr 14 00:12:11 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-fe9917e1-8fd8-4314-90c9-3d42c5b01f4a tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Deleting instance files /opt/stack/data/nova/instances/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97_del
Apr 14 00:12:11 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-fe9917e1-8fd8-4314-90c9-3d42c5b01f4a tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Deletion of /opt/stack/data/nova/instances/3a6b9f89-e462-47d8-84a1-0ac4ade3ab97_del complete
Apr 14 00:12:11 user nova-compute[82479]: INFO nova.compute.manager [None req-fe9917e1-8fd8-4314-90c9-3d42c5b01f4a tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 14 00:12:11 user nova-compute[82479]: DEBUG oslo.service.loopingcall [None req-fe9917e1-8fd8-4314-90c9-3d42c5b01f4a tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82479) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 00:12:11 user nova-compute[82479]: DEBUG nova.compute.manager [-] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Deallocating network for instance {{(pid=82479) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 00:12:11 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] deallocate_for_instance() {{(pid=82479) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 00:12:12 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8ab51440-d973-4b6d-bc05-c5f0dbea64af tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "e3fba4ee-4aae-4ee3-8114-b53510f5442c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:12:12 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8ab51440-d973-4b6d-bc05-c5f0dbea64af tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "e3fba4ee-4aae-4ee3-8114-b53510f5442c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:12:12 user nova-compute[82479]: INFO nova.compute.manager [None req-8ab51440-d973-4b6d-bc05-c5f0dbea64af tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Detaching volume 43ba2057-0822-4741-b91d-718067f21593
Apr 14 00:12:12 user nova-compute[82479]: INFO nova.virt.block_device [None req-8ab51440-d973-4b6d-bc05-c5f0dbea64af tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Attempting to driver detach volume 43ba2057-0822-4741-b91d-718067f21593 from mountpoint /dev/vdb
Apr 14 00:12:12 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-8ab51440-d973-4b6d-bc05-c5f0dbea64af tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Attempting to detach device vdb from instance e3fba4ee-4aae-4ee3-8114-b53510f5442c from the persistent domain config. {{(pid=82479) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 00:12:12 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-8ab51440-d973-4b6d-bc05-c5f0dbea64af tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 00:12:12 user nova-compute[82479]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:12:12 user nova-compute[82479]:   <source dev="/dev/sdg"/>
Apr 14 00:12:12 user nova-compute[82479]:   <target dev="vdb" bus="virtio"/>
Apr 14 00:12:12 user nova-compute[82479]:   <serial>43ba2057-0822-4741-b91d-718067f21593</serial>
Apr 14 00:12:12 user nova-compute[82479]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 00:12:12 user nova-compute[82479]: </disk>
Apr 14 00:12:12 user nova-compute[82479]:  {{(pid=82479) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 00:12:12 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-8ab51440-d973-4b6d-bc05-c5f0dbea64af tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Successfully detached device vdb from instance e3fba4ee-4aae-4ee3-8114-b53510f5442c from the persistent domain config.
Apr 14 00:12:12 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-8ab51440-d973-4b6d-bc05-c5f0dbea64af tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e3fba4ee-4aae-4ee3-8114-b53510f5442c from the live domain config. {{(pid=82479) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 00:12:12 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-8ab51440-d973-4b6d-bc05-c5f0dbea64af tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 00:12:12 user nova-compute[82479]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:12:12 user nova-compute[82479]:   <source dev="/dev/sdg"/>
Apr 14 00:12:12 user nova-compute[82479]:   <target dev="vdb" bus="virtio"/>
Apr 14 00:12:12 user nova-compute[82479]:   <serial>43ba2057-0822-4741-b91d-718067f21593</serial>
Apr 14 00:12:12 user nova-compute[82479]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 00:12:12 user nova-compute[82479]: </disk>
Apr 14 00:12:12 user nova-compute[82479]:  {{(pid=82479) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 00:12:12 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Updating instance_info_cache with network_info: [] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:12:12 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Took 1.18 seconds to deallocate network for instance.
Apr 14 00:12:12 user nova-compute[82479]: DEBUG nova.compute.manager [req-17a9a730-e799-4801-81ff-91ac828e0e53 req-3114e63f-8292-47c9-be19-22348c342f2f service nova] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Received event network-vif-deleted-4085de4c-cb9e-452b-9504-b7c7f8621213 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:12:12 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-fe9917e1-8fd8-4314-90c9-3d42c5b01f4a tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:12:12 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-fe9917e1-8fd8-4314-90c9-3d42c5b01f4a tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:12:12 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Received event <DeviceRemovedEvent: 1681431132.574694, e3fba4ee-4aae-4ee3-8114-b53510f5442c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82479) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 00:12:12 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-8ab51440-d973-4b6d-bc05-c5f0dbea64af tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e3fba4ee-4aae-4ee3-8114-b53510f5442c {{(pid=82479) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 00:12:12 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-8ab51440-d973-4b6d-bc05-c5f0dbea64af tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Successfully detached device vdb from instance e3fba4ee-4aae-4ee3-8114-b53510f5442c from the live domain config.
Apr 14 00:12:12 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ab51440-d973-4b6d-bc05-c5f0dbea64af tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] calling os-brick to detach iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 00:12:12 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab51440-d973-4b6d-bc05-c5f0dbea64af tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, {'target_iqn': 'iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dNQGcVbh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:12:12 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-8ab51440-d973-4b6d-bc05-c5f0dbea64af tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:12:12 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-8ab51440-d973-4b6d-bc05-c5f0dbea64af tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:12:12 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-8ab51440-d973-4b6d-bc05-c5f0dbea64af tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:12:12 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:12:12 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:12:12 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[624616f4-7be9-4210-ab01-355dbfbdef11]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:12:12 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab51440-d973-4b6d-bc05-c5f0dbea64af tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 00:12:12 user nova-compute[82479]: No targets found.
Apr 14 00:12:12 user nova-compute[82479]: iSNS:
Apr 14 00:12:12 user nova-compute[82479]: No targets found.
Apr 14 00:12:12 user nova-compute[82479]: STATIC:
Apr 14 00:12:12 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc
Apr 14 00:12:12 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:12:12 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:12:12 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593
Apr 14 00:12:12 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:12:12 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:12:12 user nova-compute[82479]: FIRMWARE:
Apr 14 00:12:12 user nova-compute[82479]: No targets found.
Apr 14 00:12:12 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:12:12 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab51440-d973-4b6d-bc05-c5f0dbea64af tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 00:12:12 user nova-compute[82479]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 00:12:12 user nova-compute[82479]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82479) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 00:12:12 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab51440-d973-4b6d-bc05-c5f0dbea64af tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593', 0)] {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 00:12:12 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:12:12 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:12:12 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[9588d477-85b9-49fd-a533-fbab30224671]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:12:12 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:12:12 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Updating instance_info_cache with network_info: [] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:12:12 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:12:12 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9b96d7-80b2-4bb1-958b-7cd56bdbb576]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:12:12 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab51440-d973-4b6d-bc05-c5f0dbea64af tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:12:12 user nova-compute[82479]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 (non-flash)
Apr 14 00:12:12 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:12:12 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab51440-d973-4b6d-bc05-c5f0dbea64af tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:12:12 user nova-compute[82479]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 (non-flash)
Apr 14 00:12:12 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:12:12 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab51440-d973-4b6d-bc05-c5f0dbea64af tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3338268670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593'): ({'sdg'}, set())}) {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 00:12:12 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-8ab51440-d973-4b6d-bc05-c5f0dbea64af tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Removing single pathed devices sdg {{(pid=82479) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 00:12:12 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Took 3.88 seconds to deallocate network for instance.
Apr 14 00:12:12 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:12:12 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:12:12 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a27314-0f63-42fe-a5fd-43bd5d02b0e2]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:12:12 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:12:12 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:12:12 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[7940f89e-065d-4e4c-8b70-0d293d00e172]: (4, ('ok\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:12:12 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-8ab51440-d973-4b6d-bc05-c5f0dbea64af tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Flushing IO for device /dev/sdg {{(pid=82479) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 00:12:12 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:12:12 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:12:12 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca04ea25-87fa-4c7e-b2a1-b174d3ad938c]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:12:12 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-8ab51440-d973-4b6d-bc05-c5f0dbea64af tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=82479) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 00:12:12 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:12:12 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.041s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:12:12 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[13bee8ec-8cfc-4942-9389-0f0ec276f186]: (4, ('1', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:12:12 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-8ab51440-d973-4b6d-bc05-c5f0dbea64af tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 00:12:12 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-8ab51440-d973-4b6d-bc05-c5f0dbea64af tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] SCSI volumes sdg have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 00:12:12 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab51440-d973-4b6d-bc05-c5f0dbea64af tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593')] {{(pid=82479) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 00:12:12 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:12:12 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-fe9917e1-8fd8-4314-90c9-3d42c5b01f4a tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:12:12 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:12:12 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[f249faf8-1833-4a4c-a65c-8d9c0eed91f1]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:12:12 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab51440-d973-4b6d-bc05-c5f0dbea64af tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:12:12 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 -p 172.16.0.220:3260 --logout {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:12:12 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-fe9917e1-8fd8-4314-90c9-3d42c5b01f4a tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:12:12 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-fe9917e1-8fd8-4314-90c9-3d42c5b01f4a tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.508s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:12:12 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:12:12 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf0ddd7-c5f5-439f-98a3-e33c3a8261c5]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:12:12 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab51440-d973-4b6d-bc05-c5f0dbea64af tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593, portal: 172.16.0.220,3260]
Apr 14 00:12:12 user nova-compute[82479]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593, portal: 172.16.0.220,3260] successful.
Apr 14 00:12:12 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:12:12 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 -p 172.16.0.220:3260 --op delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:12:12 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:12:12 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4784bc3-2560-4353-823c-96880fcfd21f]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:12:12 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab51440-d973-4b6d-bc05-c5f0dbea64af tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:12:12 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-8ab51440-d973-4b6d-bc05-c5f0dbea64af tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:12:12 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab51440-d973-4b6d-bc05-c5f0dbea64af tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] <== disconnect_volume: return (326ms) None {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:12:12 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ab51440-d973-4b6d-bc05-c5f0dbea64af tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Disconnected iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 00:12:12 user nova-compute[82479]: INFO nova.scheduler.client.report [None req-fe9917e1-8fd8-4314-90c9-3d42c5b01f4a tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Deleted allocations for instance 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97
Apr 14 00:12:12 user nova-compute[82479]: DEBUG nova.compute.manager [req-03f34237-cee6-4ef8-ac00-1b3a03c1f69a req-75121e26-bf7e-47fc-8bdb-ba659b0ee923 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Received event network-vif-deleted-1c533ad9-47bf-4eb9-b931-d855ad4ce53e {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:12:12 user nova-compute[82479]: DEBUG nova.compute.manager [req-03f34237-cee6-4ef8-ac00-1b3a03c1f69a req-75121e26-bf7e-47fc-8bdb-ba659b0ee923 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Received event network-vif-deleted-dff47f62-64b6-4ee5-b163-c74fc50ce6c9 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:12:12 user nova-compute[82479]: DEBUG nova.compute.manager [req-03f34237-cee6-4ef8-ac00-1b3a03c1f69a req-75121e26-bf7e-47fc-8bdb-ba659b0ee923 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Received event network-vif-deleted-d3174ebb-df19-4943-98c4-89c97607f42b {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:12:12 user nova-compute[82479]: DEBUG nova.compute.manager [req-03f34237-cee6-4ef8-ac00-1b3a03c1f69a req-75121e26-bf7e-47fc-8bdb-ba659b0ee923 service nova] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Received event network-vif-deleted-9dedd1d2-74e4-4aae-8114-9ecd78686a4d {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:12:12 user nova-compute[82479]: DEBUG nova.compute.manager [req-14a6d691-5671-47d4-a166-fdb6804b9b6b req-523c1b81-30b2-41a2-b8b5-c01ee09b92a3 service nova] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Received event network-vif-plugged-4085de4c-cb9e-452b-9504-b7c7f8621213 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:12:12 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-14a6d691-5671-47d4-a166-fdb6804b9b6b req-523c1b81-30b2-41a2-b8b5-c01ee09b92a3 service nova] Acquiring lock "3a6b9f89-e462-47d8-84a1-0ac4ade3ab97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:12:13 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-14a6d691-5671-47d4-a166-fdb6804b9b6b req-523c1b81-30b2-41a2-b8b5-c01ee09b92a3 service nova] Lock "3a6b9f89-e462-47d8-84a1-0ac4ade3ab97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:12:13 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-14a6d691-5671-47d4-a166-fdb6804b9b6b req-523c1b81-30b2-41a2-b8b5-c01ee09b92a3 service nova] Lock "3a6b9f89-e462-47d8-84a1-0ac4ade3ab97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:12:13 user nova-compute[82479]: DEBUG nova.compute.manager [req-14a6d691-5671-47d4-a166-fdb6804b9b6b req-523c1b81-30b2-41a2-b8b5-c01ee09b92a3 service nova] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] No waiting events found dispatching network-vif-plugged-4085de4c-cb9e-452b-9504-b7c7f8621213 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:12:13 user nova-compute[82479]: WARNING nova.compute.manager [req-14a6d691-5671-47d4-a166-fdb6804b9b6b req-523c1b81-30b2-41a2-b8b5-c01ee09b92a3 service nova] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Received unexpected event network-vif-plugged-4085de4c-cb9e-452b-9504-b7c7f8621213 for instance with vm_state deleted and task_state None.
Apr 14 00:12:13 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-fe9917e1-8fd8-4314-90c9-3d42c5b01f4a tempest-ServerStableDeviceRescueTest-481368698 tempest-ServerStableDeviceRescueTest-481368698-project-member] Lock "3a6b9f89-e462-47d8-84a1-0ac4ade3ab97" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.771s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:12:13 user nova-compute[82479]: DEBUG nova.objects.instance [None req-8ab51440-d973-4b6d-bc05-c5f0dbea64af tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lazy-loading 'flavor' on Instance uuid e3fba4ee-4aae-4ee3-8114-b53510f5442c {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:12:13 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8ab51440-d973-4b6d-bc05-c5f0dbea64af tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "e3fba4ee-4aae-4ee3-8114-b53510f5442c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.717s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:12:14 user nova-compute[82479]: INFO nova.compute.manager [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Took 2.27 seconds to detach 3 volumes for instance.
Apr 14 00:12:14 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:12:14 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:12:15 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:12:15 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:12:15 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.345s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:12:15 user nova-compute[82479]: INFO nova.scheduler.client.report [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Deleted allocations for instance 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c
Apr 14 00:12:15 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-80790372-ac22-443b-aedf-380c1684705d tempest-TaggedBootDevicesTest_v242-1295697559 tempest-TaggedBootDevicesTest_v242-1295697559-project-member] Lock "6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.035s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:12:16 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:16 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:21 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:21 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:22 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6c35b78e-41e3-40c1-b265-8e1fa5e859c6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:12:22 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6c35b78e-41e3-40c1-b265-8e1fa5e859c6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:12:22 user nova-compute[82479]: DEBUG nova.compute.manager [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Starting instance... {{(pid=82479) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 00:12:22 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:12:22 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:12:22 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82479) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 00:12:22 user nova-compute[82479]: INFO nova.compute.claims [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Claim successful on node user
Apr 14 00:12:22 user nova-compute[82479]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681431127.3724344, 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c => Stopped> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:12:22 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] VM Stopped (Lifecycle Event)
Apr 14 00:12:22 user nova-compute[82479]: DEBUG nova.compute.manager [None req-52bafb9c-9545-49e8-befa-3a52d500500d None None] [instance: 6c0c2ec9-243d-479b-8a94-b4aeea3c6a2c] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:12:22 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:12:22 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:12:22 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.492s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:12:22 user nova-compute[82479]: DEBUG nova.compute.manager [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Start building networks asynchronously for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 00:12:22 user nova-compute[82479]: DEBUG nova.compute.manager [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Allocating IP information in the background. {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 00:12:22 user nova-compute[82479]: DEBUG nova.network.neutron [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] allocate_for_instance() {{(pid=82479) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 00:12:22 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 00:12:22 user nova-compute[82479]: DEBUG nova.compute.manager [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Start building block device mappings for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 00:12:22 user nova-compute[82479]: DEBUG nova.policy [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2f8b18d40ecd4b4e976cf2018af8220c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f20caf676a64b9b97027f3fc9bc724c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82479) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 00:12:22 user nova-compute[82479]: DEBUG nova.compute.manager [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Start spawning the instance on the hypervisor. {{(pid=82479) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 00:12:22 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Creating instance directory {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 00:12:22 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Creating image(s)
Apr 14 00:12:22 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "/opt/stack/data/nova/instances/6c35b78e-41e3-40c1-b265-8e1fa5e859c6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:12:22 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "/opt/stack/data/nova/instances/6c35b78e-41e3-40c1-b265-8e1fa5e859c6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:12:22 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "/opt/stack/data/nova/instances/6c35b78e-41e3-40c1-b265-8e1fa5e859c6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:12:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:12:23 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.131s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:12:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "3e200e101633f2016e569ae4c0a352380507d1e4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:12:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "3e200e101633f2016e569ae4c0a352380507d1e4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:12:23 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:12:23 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.137s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:12:23 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/6c35b78e-41e3-40c1-b265-8e1fa5e859c6/disk 1073741824 {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:12:23 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/6c35b78e-41e3-40c1-b265-8e1fa5e859c6/disk 1073741824" returned: 0 in 0.049s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:12:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "3e200e101633f2016e569ae4c0a352380507d1e4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.193s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:12:23 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:12:23 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.167s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:12:23 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6c35b78e-41e3-40c1-b265-8e1fa5e859c6/disk. size=1073741824 {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 00:12:23 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c35b78e-41e3-40c1-b265-8e1fa5e859c6/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:12:23 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c35b78e-41e3-40c1-b265-8e1fa5e859c6/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:12:23 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:23 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Cannot resize image /opt/stack/data/nova/instances/6c35b78e-41e3-40c1-b265-8e1fa5e859c6/disk to a smaller size. {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 00:12:23 user nova-compute[82479]: DEBUG nova.objects.instance [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lazy-loading 'migration_context' on Instance uuid 6c35b78e-41e3-40c1-b265-8e1fa5e859c6 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:12:23 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Created local disks {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 00:12:23 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Ensure instance console log exists: /opt/stack/data/nova/instances/6c35b78e-41e3-40c1-b265-8e1fa5e859c6/console.log {{(pid=82479) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 00:12:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:12:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:12:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:12:23 user nova-compute[82479]: DEBUG nova.network.neutron [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Successfully created port: 62d9fce8-6815-4a29-ab53-d1205a2db648 {{(pid=82479) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 00:12:23 user nova-compute[82479]: DEBUG nova.compute.manager [req-5025b892-e9c2-4c87-bbbc-124614e47864 req-a1338a74-a331-45d8-a219-bea31987840b service nova] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Received event network-changed-e4c19308-c4ea-4a47-a0e2-9a8616e8c39c {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:12:23 user nova-compute[82479]: DEBUG nova.compute.manager [req-5025b892-e9c2-4c87-bbbc-124614e47864 req-a1338a74-a331-45d8-a219-bea31987840b service nova] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Refreshing instance network info cache due to event network-changed-e4c19308-c4ea-4a47-a0e2-9a8616e8c39c. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:12:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-5025b892-e9c2-4c87-bbbc-124614e47864 req-a1338a74-a331-45d8-a219-bea31987840b service nova] Acquiring lock "refresh_cache-6fb358a6-7e79-4acf-8fbe-7cc4e67a707b" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:12:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-5025b892-e9c2-4c87-bbbc-124614e47864 req-a1338a74-a331-45d8-a219-bea31987840b service nova] Acquired lock "refresh_cache-6fb358a6-7e79-4acf-8fbe-7cc4e67a707b" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:12:23 user nova-compute[82479]: DEBUG nova.network.neutron [req-5025b892-e9c2-4c87-bbbc-124614e47864 req-a1338a74-a331-45d8-a219-bea31987840b service nova] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Refreshing network info cache for port e4c19308-c4ea-4a47-a0e2-9a8616e8c39c {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:12:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-c0212312-a380-469e-92d6-268d53ce8940 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquiring lock "6fb358a6-7e79-4acf-8fbe-7cc4e67a707b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:12:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-c0212312-a380-469e-92d6-268d53ce8940 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6fb358a6-7e79-4acf-8fbe-7cc4e67a707b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:12:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-c0212312-a380-469e-92d6-268d53ce8940 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquiring lock "6fb358a6-7e79-4acf-8fbe-7cc4e67a707b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:12:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-c0212312-a380-469e-92d6-268d53ce8940 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6fb358a6-7e79-4acf-8fbe-7cc4e67a707b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:12:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-c0212312-a380-469e-92d6-268d53ce8940 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6fb358a6-7e79-4acf-8fbe-7cc4e67a707b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:12:23 user nova-compute[82479]: INFO nova.compute.manager [None req-c0212312-a380-469e-92d6-268d53ce8940 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Terminating instance
Apr 14 00:12:23 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c0212312-a380-469e-92d6-268d53ce8940 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Start destroying the instance on the hypervisor. {{(pid=82479) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 00:12:24 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:24 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:24 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:24 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:24 user nova-compute[82479]: DEBUG nova.compute.manager [req-fa6a3518-a0ff-47c0-9162-92014e3b116f req-2ea06aff-1169-4f7b-beca-c1d631d79ef6 service nova] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Received event network-vif-unplugged-e4c19308-c4ea-4a47-a0e2-9a8616e8c39c {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:12:24 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-fa6a3518-a0ff-47c0-9162-92014e3b116f req-2ea06aff-1169-4f7b-beca-c1d631d79ef6 service nova] Acquiring lock "6fb358a6-7e79-4acf-8fbe-7cc4e67a707b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:12:24 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-fa6a3518-a0ff-47c0-9162-92014e3b116f req-2ea06aff-1169-4f7b-beca-c1d631d79ef6 service nova] Lock "6fb358a6-7e79-4acf-8fbe-7cc4e67a707b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:12:24 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-fa6a3518-a0ff-47c0-9162-92014e3b116f req-2ea06aff-1169-4f7b-beca-c1d631d79ef6 service nova] Lock "6fb358a6-7e79-4acf-8fbe-7cc4e67a707b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:12:24 user nova-compute[82479]: DEBUG nova.compute.manager [req-fa6a3518-a0ff-47c0-9162-92014e3b116f req-2ea06aff-1169-4f7b-beca-c1d631d79ef6 service nova] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] No waiting events found dispatching network-vif-unplugged-e4c19308-c4ea-4a47-a0e2-9a8616e8c39c {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:12:24 user nova-compute[82479]: DEBUG nova.compute.manager [req-fa6a3518-a0ff-47c0-9162-92014e3b116f req-2ea06aff-1169-4f7b-beca-c1d631d79ef6 service nova] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Received event network-vif-unplugged-e4c19308-c4ea-4a47-a0e2-9a8616e8c39c for instance with task_state deleting. {{(pid=82479) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 00:12:24 user nova-compute[82479]: DEBUG nova.network.neutron [req-5025b892-e9c2-4c87-bbbc-124614e47864 req-a1338a74-a331-45d8-a219-bea31987840b service nova] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Updated VIF entry in instance network info cache for port e4c19308-c4ea-4a47-a0e2-9a8616e8c39c. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:12:24 user nova-compute[82479]: DEBUG nova.network.neutron [req-5025b892-e9c2-4c87-bbbc-124614e47864 req-a1338a74-a331-45d8-a219-bea31987840b service nova] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Updating instance_info_cache with network_info: [{"id": "e4c19308-c4ea-4a47-a0e2-9a8616e8c39c", "address": "fa:16:3e:f8:1a:b2", "network": {"id": "f185dffe-f180-4107-8752-182e71fc07c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1954392221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f138770c7b4407d83c449500fc000a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4c19308-c4", "ovs_interfaceid": "e4c19308-c4ea-4a47-a0e2-9a8616e8c39c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:12:24 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-5025b892-e9c2-4c87-bbbc-124614e47864 req-a1338a74-a331-45d8-a219-bea31987840b service nova] Releasing lock "refresh_cache-6fb358a6-7e79-4acf-8fbe-7cc4e67a707b" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:12:24 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Instance destroyed successfully.
Apr 14 00:12:24 user nova-compute[82479]: DEBUG nova.objects.instance [None req-c0212312-a380-469e-92d6-268d53ce8940 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lazy-loading 'resources' on Instance uuid 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:12:24 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-c0212312-a380-469e-92d6-268d53ce8940 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:09:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1199162286',display_name='tempest-TestStampPattern-server-1199162286',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1199162286',id=16,image_ref='16275777-e8d4-4654-a571-dc2e6d715cf8',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDlLkyaARZkQB95QySk+2VUQZ09Ejf2MBAGMaTBkstJSwxWK7dIH2obGUK+EG+vNkZ0wlDST0FmsMBpmophXdr02YiHRimuo8UQxusvxIG9HcXOIpUbG3VMNRBCqhYxCUw==',key_name='tempest-TestStampPattern-2105733066',keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:09:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1f138770c7b4407d83c449500fc000a5',ramdisk_id='',reservation_id='r-eksxdm68',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='11c3384a-e699-4b10-9f8b-861291e96465',image_min_disk='1',image_min_ram='0',image_owner_id='1f138770c7b4407d83c449500fc000a5',image_owner_project_name='tempest-TestStampPattern-1381824337',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1381824337-project-member',image_user_id='6fe75acb64a94a2a88d370f43fa6b776',owner_project_name='tempest-TestStampPattern-1381824337',owner_user_name='tempest-TestStampPattern-1381824337-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T00:09:39Z,user_data=None,user_id='6fe75acb64a94a2a88d370f43fa6b776',uuid=6fb358a6-7e79-4acf-8fbe-7cc4e67a707b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e4c19308-c4ea-4a47-a0e2-9a8616e8c39c", "address": "fa:16:3e:f8:1a:b2", "network": {"id": "f185dffe-f180-4107-8752-182e71fc07c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1954392221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f138770c7b4407d83c449500fc000a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4c19308-c4", "ovs_interfaceid": "e4c19308-c4ea-4a47-a0e2-9a8616e8c39c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 00:12:24 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-c0212312-a380-469e-92d6-268d53ce8940 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Converting VIF {"id": "e4c19308-c4ea-4a47-a0e2-9a8616e8c39c", "address": "fa:16:3e:f8:1a:b2", "network": {"id": "f185dffe-f180-4107-8752-182e71fc07c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1954392221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f138770c7b4407d83c449500fc000a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4c19308-c4", "ovs_interfaceid": "e4c19308-c4ea-4a47-a0e2-9a8616e8c39c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:12:24 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-c0212312-a380-469e-92d6-268d53ce8940 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f8:1a:b2,bridge_name='br-int',has_traffic_filtering=True,id=e4c19308-c4ea-4a47-a0e2-9a8616e8c39c,network=Network(f185dffe-f180-4107-8752-182e71fc07c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4c19308-c4') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:12:24 user nova-compute[82479]: DEBUG os_vif [None req-c0212312-a380-469e-92d6-268d53ce8940 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:1a:b2,bridge_name='br-int',has_traffic_filtering=True,id=e4c19308-c4ea-4a47-a0e2-9a8616e8c39c,network=Network(f185dffe-f180-4107-8752-182e71fc07c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4c19308-c4') {{(pid=82479) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 00:12:24 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:24 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape4c19308-c4, bridge=br-int, if_exists=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:12:24 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:24 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:12:24 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:24 user nova-compute[82479]: INFO os_vif [None req-c0212312-a380-469e-92d6-268d53ce8940 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:1a:b2,bridge_name='br-int',has_traffic_filtering=True,id=e4c19308-c4ea-4a47-a0e2-9a8616e8c39c,network=Network(f185dffe-f180-4107-8752-182e71fc07c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4c19308-c4')
Apr 14 00:12:24 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-c0212312-a380-469e-92d6-268d53ce8940 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Deleting instance files /opt/stack/data/nova/instances/6fb358a6-7e79-4acf-8fbe-7cc4e67a707b_del
Apr 14 00:12:24 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-c0212312-a380-469e-92d6-268d53ce8940 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Deletion of /opt/stack/data/nova/instances/6fb358a6-7e79-4acf-8fbe-7cc4e67a707b_del complete
Apr 14 00:12:24 user nova-compute[82479]: INFO nova.compute.manager [None req-c0212312-a380-469e-92d6-268d53ce8940 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Took 0.89 seconds to destroy the instance on the hypervisor.
Apr 14 00:12:24 user nova-compute[82479]: DEBUG oslo.service.loopingcall [None req-c0212312-a380-469e-92d6-268d53ce8940 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82479) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 00:12:24 user nova-compute[82479]: DEBUG nova.compute.manager [-] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Deallocating network for instance {{(pid=82479) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 00:12:24 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] deallocate_for_instance() {{(pid=82479) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 00:12:24 user nova-compute[82479]: DEBUG nova.network.neutron [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Successfully updated port: 62d9fce8-6815-4a29-ab53-d1205a2db648 {{(pid=82479) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 00:12:24 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "refresh_cache-6c35b78e-41e3-40c1-b265-8e1fa5e859c6" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:12:24 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquired lock "refresh_cache-6c35b78e-41e3-40c1-b265-8e1fa5e859c6" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:12:24 user nova-compute[82479]: DEBUG nova.network.neutron [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 00:12:24 user nova-compute[82479]: DEBUG nova.network.neutron [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Instance cache missing network info. {{(pid=82479) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 00:12:25 user nova-compute[82479]: INFO nova.compute.manager [None req-96fc8037-09f3-45f3-bb9f-0e66f4e016c6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Unrescuing
Apr 14 00:12:25 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-96fc8037-09f3-45f3-bb9f-0e66f4e016c6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "refresh_cache-17c6c147-fb62-4204-a416-792b94d3f7dd" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:12:25 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-96fc8037-09f3-45f3-bb9f-0e66f4e016c6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquired lock "refresh_cache-17c6c147-fb62-4204-a416-792b94d3f7dd" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:12:25 user nova-compute[82479]: DEBUG nova.network.neutron [None req-96fc8037-09f3-45f3-bb9f-0e66f4e016c6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 00:12:25 user nova-compute[82479]: DEBUG nova.network.neutron [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Updating instance_info_cache with network_info: [{"id": "62d9fce8-6815-4a29-ab53-d1205a2db648", "address": "fa:16:3e:46:a4:3f", "network": {"id": "66316d10-fed3-4fb9-877e-a01542ca5855", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-93456010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f20caf676a64b9b97027f3fc9bc724c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62d9fce8-68", "ovs_interfaceid": "62d9fce8-6815-4a29-ab53-d1205a2db648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:12:25 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Releasing lock "refresh_cache-6c35b78e-41e3-40c1-b265-8e1fa5e859c6" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:12:25 user nova-compute[82479]: DEBUG nova.compute.manager [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Instance network_info: |[{"id": "62d9fce8-6815-4a29-ab53-d1205a2db648", "address": "fa:16:3e:46:a4:3f", "network": {"id": "66316d10-fed3-4fb9-877e-a01542ca5855", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-93456010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f20caf676a64b9b97027f3fc9bc724c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62d9fce8-68", "ovs_interfaceid": "62d9fce8-6815-4a29-ab53-d1205a2db648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 00:12:25 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Start _get_guest_xml network_info=[{"id": "62d9fce8-6815-4a29-ab53-d1205a2db648", "address": "fa:16:3e:46:a4:3f", "network": {"id": "66316d10-fed3-4fb9-877e-a01542ca5855", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-93456010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f20caf676a64b9b97027f3fc9bc724c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62d9fce8-68", "ovs_interfaceid": "62d9fce8-6815-4a29-ab53-d1205a2db648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 00:12:25 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:12:25 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:12:25 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82479) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 00:12:25 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T00:02:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 00:12:25 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Flavor limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 00:12:25 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Image limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 00:12:25 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Flavor pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 00:12:25 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Image pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 00:12:25 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 00:12:25 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 00:12:25 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 00:12:25 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Got 1 possible topologies {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 00:12:25 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 00:12:25 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 00:12:25 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:12:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1217758263',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1217758263',id=21,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL4UEOyJwYDEnyxQAY/gseNadkyiHeTpfezaewpCqENgdXuLtykmPySbfnvUAXob1mjZ2nh6y7mHb/UX7vHeRXLyyBaoGtHKG1dH84NmufncEafrHDE/Zf0amaymIZieug==',key_name='tempest-keypair-749403403',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f20caf676a64b9b97027f3fc9bc724c',ramdisk_id='',reservation_id='r-5zzsx975',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1395403129',owner_user_name='tempest-AttachVolumeShelveTestJSON-1395403129-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:12:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f8b18d40ecd4b4e976cf2018af8220c',uuid=6c35b78e-41e3-40c1-b265-8e1fa5e859c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62d9fce8-6815-4a29-ab53-d1205a2db648", "address": "fa:16:3e:46:a4:3f", "network": {"id": "66316d10-fed3-4fb9-877e-a01542ca5855", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-93456010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f20caf676a64b9b97027f3fc9bc724c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62d9fce8-68", "ovs_interfaceid": "62d9fce8-6815-4a29-ab53-d1205a2db648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82479) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 00:12:25 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Converting VIF {"id": "62d9fce8-6815-4a29-ab53-d1205a2db648", "address": "fa:16:3e:46:a4:3f", "network": {"id": "66316d10-fed3-4fb9-877e-a01542ca5855", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-93456010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f20caf676a64b9b97027f3fc9bc724c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62d9fce8-68", "ovs_interfaceid": "62d9fce8-6815-4a29-ab53-d1205a2db648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:12:25 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:a4:3f,bridge_name='br-int',has_traffic_filtering=True,id=62d9fce8-6815-4a29-ab53-d1205a2db648,network=Network(66316d10-fed3-4fb9-877e-a01542ca5855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62d9fce8-68') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:12:25 user nova-compute[82479]: DEBUG nova.objects.instance [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lazy-loading 'pci_devices' on Instance uuid 6c35b78e-41e3-40c1-b265-8e1fa5e859c6 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:12:25 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] End _get_guest_xml xml=<domain type="kvm">
Apr 14 00:12:25 user nova-compute[82479]:   <uuid>6c35b78e-41e3-40c1-b265-8e1fa5e859c6</uuid>
Apr 14 00:12:25 user nova-compute[82479]:   <name>instance-00000015</name>
Apr 14 00:12:25 user nova-compute[82479]:   <memory>131072</memory>
Apr 14 00:12:25 user nova-compute[82479]:   <vcpu>1</vcpu>
Apr 14 00:12:25 user nova-compute[82479]:   <metadata>
Apr 14 00:12:25 user nova-compute[82479]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 00:12:25 user nova-compute[82479]:       <nova:package version="0.0.0"/>
Apr 14 00:12:25 user nova-compute[82479]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1217758263</nova:name>
Apr 14 00:12:25 user nova-compute[82479]:       <nova:creationTime>2023-04-14 00:12:25</nova:creationTime>
Apr 14 00:12:25 user nova-compute[82479]:       <nova:flavor name="m1.nano">
Apr 14 00:12:25 user nova-compute[82479]:         <nova:memory>128</nova:memory>
Apr 14 00:12:25 user nova-compute[82479]:         <nova:disk>1</nova:disk>
Apr 14 00:12:25 user nova-compute[82479]:         <nova:swap>0</nova:swap>
Apr 14 00:12:25 user nova-compute[82479]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 00:12:25 user nova-compute[82479]:         <nova:vcpus>1</nova:vcpus>
Apr 14 00:12:25 user nova-compute[82479]:       </nova:flavor>
Apr 14 00:12:25 user nova-compute[82479]:       <nova:owner>
Apr 14 00:12:25 user nova-compute[82479]:         <nova:user uuid="2f8b18d40ecd4b4e976cf2018af8220c">tempest-AttachVolumeShelveTestJSON-1395403129-project-member</nova:user>
Apr 14 00:12:25 user nova-compute[82479]:         <nova:project uuid="4f20caf676a64b9b97027f3fc9bc724c">tempest-AttachVolumeShelveTestJSON-1395403129</nova:project>
Apr 14 00:12:25 user nova-compute[82479]:       </nova:owner>
Apr 14 00:12:25 user nova-compute[82479]:       <nova:root type="image" uuid="6db62068-7278-4cd8-b41f-d0140d89e199"/>
Apr 14 00:12:25 user nova-compute[82479]:       <nova:ports>
Apr 14 00:12:25 user nova-compute[82479]:         <nova:port uuid="62d9fce8-6815-4a29-ab53-d1205a2db648">
Apr 14 00:12:25 user nova-compute[82479]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 14 00:12:25 user nova-compute[82479]:         </nova:port>
Apr 14 00:12:25 user nova-compute[82479]:       </nova:ports>
Apr 14 00:12:25 user nova-compute[82479]:     </nova:instance>
Apr 14 00:12:25 user nova-compute[82479]:   </metadata>
Apr 14 00:12:25 user nova-compute[82479]:   <sysinfo type="smbios">
Apr 14 00:12:25 user nova-compute[82479]:     <system>
Apr 14 00:12:25 user nova-compute[82479]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 00:12:25 user nova-compute[82479]:       <entry name="product">OpenStack Nova</entry>
Apr 14 00:12:25 user nova-compute[82479]:       <entry name="version">0.0.0</entry>
Apr 14 00:12:25 user nova-compute[82479]:       <entry name="serial">6c35b78e-41e3-40c1-b265-8e1fa5e859c6</entry>
Apr 14 00:12:25 user nova-compute[82479]:       <entry name="uuid">6c35b78e-41e3-40c1-b265-8e1fa5e859c6</entry>
Apr 14 00:12:25 user nova-compute[82479]:       <entry name="family">Virtual Machine</entry>
Apr 14 00:12:25 user nova-compute[82479]:     </system>
Apr 14 00:12:25 user nova-compute[82479]:   </sysinfo>
Apr 14 00:12:25 user nova-compute[82479]:   <os>
Apr 14 00:12:25 user nova-compute[82479]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 00:12:25 user nova-compute[82479]:     <boot dev="hd"/>
Apr 14 00:12:25 user nova-compute[82479]:     <smbios mode="sysinfo"/>
Apr 14 00:12:25 user nova-compute[82479]:   </os>
Apr 14 00:12:25 user nova-compute[82479]:   <features>
Apr 14 00:12:25 user nova-compute[82479]:     <acpi/>
Apr 14 00:12:25 user nova-compute[82479]:     <apic/>
Apr 14 00:12:25 user nova-compute[82479]:     <vmcoreinfo/>
Apr 14 00:12:25 user nova-compute[82479]:   </features>
Apr 14 00:12:25 user nova-compute[82479]:   <clock offset="utc">
Apr 14 00:12:25 user nova-compute[82479]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 00:12:25 user nova-compute[82479]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 00:12:25 user nova-compute[82479]:     <timer name="hpet" present="no"/>
Apr 14 00:12:25 user nova-compute[82479]:   </clock>
Apr 14 00:12:25 user nova-compute[82479]:   <cpu mode="custom" match="exact">
Apr 14 00:12:25 user nova-compute[82479]:     <model>Nehalem</model>
Apr 14 00:12:25 user nova-compute[82479]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 00:12:25 user nova-compute[82479]:   </cpu>
Apr 14 00:12:25 user nova-compute[82479]:   <devices>
Apr 14 00:12:25 user nova-compute[82479]:     <disk type="file" device="disk">
Apr 14 00:12:25 user nova-compute[82479]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 00:12:25 user nova-compute[82479]:       <source file="/opt/stack/data/nova/instances/6c35b78e-41e3-40c1-b265-8e1fa5e859c6/disk"/>
Apr 14 00:12:25 user nova-compute[82479]:       <target dev="vda" bus="virtio"/>
Apr 14 00:12:25 user nova-compute[82479]:     </disk>
Apr 14 00:12:25 user nova-compute[82479]:     <interface type="ethernet">
Apr 14 00:12:25 user nova-compute[82479]:       <mac address="fa:16:3e:46:a4:3f"/>
Apr 14 00:12:25 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:12:25 user nova-compute[82479]:       <mtu size="1442"/>
Apr 14 00:12:25 user nova-compute[82479]:       <target dev="tap62d9fce8-68"/>
Apr 14 00:12:25 user nova-compute[82479]:     </interface>
Apr 14 00:12:25 user nova-compute[82479]:     <serial type="pty">
Apr 14 00:12:25 user nova-compute[82479]:       <log file="/opt/stack/data/nova/instances/6c35b78e-41e3-40c1-b265-8e1fa5e859c6/console.log" append="off"/>
Apr 14 00:12:25 user nova-compute[82479]:     </serial>
Apr 14 00:12:25 user nova-compute[82479]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 00:12:25 user nova-compute[82479]:     <video>
Apr 14 00:12:25 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:12:25 user nova-compute[82479]:     </video>
Apr 14 00:12:25 user nova-compute[82479]:     <rng model="virtio">
Apr 14 00:12:25 user nova-compute[82479]:       <backend model="random">/dev/urandom</backend>
Apr 14 00:12:25 user nova-compute[82479]:     </rng>
Apr 14 00:12:25 user nova-compute[82479]:     <controller type="usb" index="0" model="none"/>
Apr 14 00:12:25 user nova-compute[82479]:     <memballoon model="virtio">
Apr 14 00:12:25 user nova-compute[82479]:       <stats period="10"/>
Apr 14 00:12:25 user nova-compute[82479]:     </memballoon>
Apr 14 00:12:25 user nova-compute[82479]:   </devices>
Apr 14 00:12:25 user nova-compute[82479]: </domain>
Apr 14 00:12:25 user nova-compute[82479]:  {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 00:12:25 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:12:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1217758263',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1217758263',id=21,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL4UEOyJwYDEnyxQAY/gseNadkyiHeTpfezaewpCqENgdXuLtykmPySbfnvUAXob1mjZ2nh6y7mHb/UX7vHeRXLyyBaoGtHKG1dH84NmufncEafrHDE/Zf0amaymIZieug==',key_name='tempest-keypair-749403403',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f20caf676a64b9b97027f3fc9bc724c',ramdisk_id='',reservation_id='r-5zzsx975',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1395403129',owner_user_name='tempest-AttachVolumeShelveTestJSON-1395403129-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:12:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f8b18d40ecd4b4e976cf2018af8220c',uuid=6c35b78e-41e3-40c1-b265-8e1fa5e859c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62d9fce8-6815-4a29-ab53-d1205a2db648", "address": "fa:16:3e:46:a4:3f", "network": {"id": "66316d10-fed3-4fb9-877e-a01542ca5855", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-93456010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f20caf676a64b9b97027f3fc9bc724c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62d9fce8-68", "ovs_interfaceid": "62d9fce8-6815-4a29-ab53-d1205a2db648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 00:12:25 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Converting VIF {"id": "62d9fce8-6815-4a29-ab53-d1205a2db648", "address": "fa:16:3e:46:a4:3f", "network": {"id": "66316d10-fed3-4fb9-877e-a01542ca5855", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-93456010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f20caf676a64b9b97027f3fc9bc724c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62d9fce8-68", "ovs_interfaceid": "62d9fce8-6815-4a29-ab53-d1205a2db648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:12:25 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:a4:3f,bridge_name='br-int',has_traffic_filtering=True,id=62d9fce8-6815-4a29-ab53-d1205a2db648,network=Network(66316d10-fed3-4fb9-877e-a01542ca5855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62d9fce8-68') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:12:25 user nova-compute[82479]: DEBUG os_vif [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:a4:3f,bridge_name='br-int',has_traffic_filtering=True,id=62d9fce8-6815-4a29-ab53-d1205a2db648,network=Network(66316d10-fed3-4fb9-877e-a01542ca5855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62d9fce8-68') {{(pid=82479) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 00:12:25 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:25 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:12:25 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 00:12:25 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:25 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap62d9fce8-68, may_exist=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:12:25 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap62d9fce8-68, col_values=(('external_ids', {'iface-id': '62d9fce8-6815-4a29-ab53-d1205a2db648', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:a4:3f', 'vm-uuid': '6c35b78e-41e3-40c1-b265-8e1fa5e859c6'}),)) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:12:25 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:25 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:12:25 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:25 user nova-compute[82479]: INFO os_vif [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:a4:3f,bridge_name='br-int',has_traffic_filtering=True,id=62d9fce8-6815-4a29-ab53-d1205a2db648,network=Network(66316d10-fed3-4fb9-877e-a01542ca5855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62d9fce8-68')
Apr 14 00:12:25 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:12:25 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] No VIF found with MAC fa:16:3e:46:a4:3f, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:12:25 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Updating instance_info_cache with network_info: [] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:12:25 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Took 0.70 seconds to deallocate network for instance.
Apr 14 00:12:25 user nova-compute[82479]: DEBUG nova.compute.manager [req-6a4e4f37-cd00-49ec-ba5f-6c8a23ca30da req-5de06b3c-5b66-41cd-8e5a-02e5c1c27564 service nova] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Received event network-vif-deleted-e4c19308-c4ea-4a47-a0e2-9a8616e8c39c {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:12:25 user nova-compute[82479]: INFO nova.compute.manager [req-6a4e4f37-cd00-49ec-ba5f-6c8a23ca30da req-5de06b3c-5b66-41cd-8e5a-02e5c1c27564 service nova] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Neutron deleted interface e4c19308-c4ea-4a47-a0e2-9a8616e8c39c; detaching it from the instance and deleting it from the info cache
Apr 14 00:12:25 user nova-compute[82479]: DEBUG nova.network.neutron [req-6a4e4f37-cd00-49ec-ba5f-6c8a23ca30da req-5de06b3c-5b66-41cd-8e5a-02e5c1c27564 service nova] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Updating instance_info_cache with network_info: [] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:12:25 user nova-compute[82479]: DEBUG nova.compute.manager [req-6a4e4f37-cd00-49ec-ba5f-6c8a23ca30da req-5de06b3c-5b66-41cd-8e5a-02e5c1c27564 service nova] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Detach interface failed, port_id=e4c19308-c4ea-4a47-a0e2-9a8616e8c39c, reason: Instance 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b could not be found. {{(pid=82479) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 00:12:25 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-c0212312-a380-469e-92d6-268d53ce8940 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:12:25 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-c0212312-a380-469e-92d6-268d53ce8940 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:12:25 user nova-compute[82479]: DEBUG nova.network.neutron [None req-96fc8037-09f3-45f3-bb9f-0e66f4e016c6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Updating instance_info_cache with network_info: [{"id": "102987de-d5e4-4ccd-b4fd-7ca7c131e379", "address": "fa:16:3e:23:dd:a5", "network": {"id": "491696ea-38ef-4c19-9d94-a61223c1fa00", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1323121698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3f111e24414976beddba7ef90c4793", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap102987de-d5", "ovs_interfaceid": "102987de-d5e4-4ccd-b4fd-7ca7c131e379", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:12:25 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-96fc8037-09f3-45f3-bb9f-0e66f4e016c6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Releasing lock "refresh_cache-17c6c147-fb62-4204-a416-792b94d3f7dd" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:12:25 user nova-compute[82479]: DEBUG nova.objects.instance [None req-96fc8037-09f3-45f3-bb9f-0e66f4e016c6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lazy-loading 'flavor' on Instance uuid 17c6c147-fb62-4204-a416-792b94d3f7dd {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:12:25 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:25 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-c0212312-a380-469e-92d6-268d53ce8940 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:12:25 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-c0212312-a380-469e-92d6-268d53ce8940 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:12:26 user nova-compute[82479]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681431131.0115652, 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97 => Stopped> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:12:26 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] VM Stopped (Lifecycle Event)
Apr 14 00:12:26 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-c0212312-a380-469e-92d6-268d53ce8940 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.370s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:12:26 user nova-compute[82479]: DEBUG nova.compute.manager [None req-0181adbc-0616-4f98-b179-c10f013871f8 None None] [instance: 3a6b9f89-e462-47d8-84a1-0ac4ade3ab97] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:12:26 user nova-compute[82479]: INFO nova.scheduler.client.report [None req-c0212312-a380-469e-92d6-268d53ce8940 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Deleted allocations for instance 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b
Apr 14 00:12:26 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-c0212312-a380-469e-92d6-268d53ce8940 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "6fb358a6-7e79-4acf-8fbe-7cc4e67a707b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.185s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:12:26 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:26 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:26 user nova-compute[82479]: DEBUG nova.compute.manager [req-6bbf6069-d04f-426a-bbea-0600dd45d136 req-41496c7e-f2f5-429f-aa22-3ffdfa465ed6 service nova] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Received event network-vif-plugged-e4c19308-c4ea-4a47-a0e2-9a8616e8c39c {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:12:26 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-6bbf6069-d04f-426a-bbea-0600dd45d136 req-41496c7e-f2f5-429f-aa22-3ffdfa465ed6 service nova] Acquiring lock "6fb358a6-7e79-4acf-8fbe-7cc4e67a707b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:12:26 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-6bbf6069-d04f-426a-bbea-0600dd45d136 req-41496c7e-f2f5-429f-aa22-3ffdfa465ed6 service nova] Lock "6fb358a6-7e79-4acf-8fbe-7cc4e67a707b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:12:26 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-6bbf6069-d04f-426a-bbea-0600dd45d136 req-41496c7e-f2f5-429f-aa22-3ffdfa465ed6 service nova] Lock "6fb358a6-7e79-4acf-8fbe-7cc4e67a707b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:12:26 user nova-compute[82479]: DEBUG nova.compute.manager [req-6bbf6069-d04f-426a-bbea-0600dd45d136 req-41496c7e-f2f5-429f-aa22-3ffdfa465ed6 service nova] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] No waiting events found dispatching network-vif-plugged-e4c19308-c4ea-4a47-a0e2-9a8616e8c39c {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:12:26 user nova-compute[82479]: WARNING nova.compute.manager [req-6bbf6069-d04f-426a-bbea-0600dd45d136 req-41496c7e-f2f5-429f-aa22-3ffdfa465ed6 service nova] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Received unexpected event network-vif-plugged-e4c19308-c4ea-4a47-a0e2-9a8616e8c39c for instance with vm_state deleted and task_state None.
Apr 14 00:12:26 user nova-compute[82479]: DEBUG nova.compute.manager [req-6bbf6069-d04f-426a-bbea-0600dd45d136 req-41496c7e-f2f5-429f-aa22-3ffdfa465ed6 service nova] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Received event network-changed-62d9fce8-6815-4a29-ab53-d1205a2db648 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:12:26 user nova-compute[82479]: DEBUG nova.compute.manager [req-6bbf6069-d04f-426a-bbea-0600dd45d136 req-41496c7e-f2f5-429f-aa22-3ffdfa465ed6 service nova] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Refreshing instance network info cache due to event network-changed-62d9fce8-6815-4a29-ab53-d1205a2db648. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:12:26 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-6bbf6069-d04f-426a-bbea-0600dd45d136 req-41496c7e-f2f5-429f-aa22-3ffdfa465ed6 service nova] Acquiring lock "refresh_cache-6c35b78e-41e3-40c1-b265-8e1fa5e859c6" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:12:26 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-6bbf6069-d04f-426a-bbea-0600dd45d136 req-41496c7e-f2f5-429f-aa22-3ffdfa465ed6 service nova] Acquired lock "refresh_cache-6c35b78e-41e3-40c1-b265-8e1fa5e859c6" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:12:26 user nova-compute[82479]: DEBUG nova.network.neutron [req-6bbf6069-d04f-426a-bbea-0600dd45d136 req-41496c7e-f2f5-429f-aa22-3ffdfa465ed6 service nova] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Refreshing network info cache for port 62d9fce8-6815-4a29-ab53-d1205a2db648 {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:12:26 user nova-compute[82479]: DEBUG nova.network.neutron [req-6bbf6069-d04f-426a-bbea-0600dd45d136 req-41496c7e-f2f5-429f-aa22-3ffdfa465ed6 service nova] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Updated VIF entry in instance network info cache for port 62d9fce8-6815-4a29-ab53-d1205a2db648. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:12:26 user nova-compute[82479]: DEBUG nova.network.neutron [req-6bbf6069-d04f-426a-bbea-0600dd45d136 req-41496c7e-f2f5-429f-aa22-3ffdfa465ed6 service nova] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Updating instance_info_cache with network_info: [{"id": "62d9fce8-6815-4a29-ab53-d1205a2db648", "address": "fa:16:3e:46:a4:3f", "network": {"id": "66316d10-fed3-4fb9-877e-a01542ca5855", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-93456010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f20caf676a64b9b97027f3fc9bc724c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62d9fce8-68", "ovs_interfaceid": "62d9fce8-6815-4a29-ab53-d1205a2db648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:12:26 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-6bbf6069-d04f-426a-bbea-0600dd45d136 req-41496c7e-f2f5-429f-aa22-3ffdfa465ed6 service nova] Releasing lock "refresh_cache-6c35b78e-41e3-40c1-b265-8e1fa5e859c6" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:12:26 user nova-compute[82479]: DEBUG nova.compute.manager [req-6bbf6069-d04f-426a-bbea-0600dd45d136 req-41496c7e-f2f5-429f-aa22-3ffdfa465ed6 service nova] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Received event network-vif-unplugged-102987de-d5e4-4ccd-b4fd-7ca7c131e379 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:12:26 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-6bbf6069-d04f-426a-bbea-0600dd45d136 req-41496c7e-f2f5-429f-aa22-3ffdfa465ed6 service nova] Acquiring lock "17c6c147-fb62-4204-a416-792b94d3f7dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:12:26 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-6bbf6069-d04f-426a-bbea-0600dd45d136 req-41496c7e-f2f5-429f-aa22-3ffdfa465ed6 service nova] Lock "17c6c147-fb62-4204-a416-792b94d3f7dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:12:26 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-6bbf6069-d04f-426a-bbea-0600dd45d136 req-41496c7e-f2f5-429f-aa22-3ffdfa465ed6 service nova] Lock "17c6c147-fb62-4204-a416-792b94d3f7dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:12:26 user nova-compute[82479]: DEBUG nova.compute.manager [req-6bbf6069-d04f-426a-bbea-0600dd45d136 req-41496c7e-f2f5-429f-aa22-3ffdfa465ed6 service nova] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] No waiting events found dispatching network-vif-unplugged-102987de-d5e4-4ccd-b4fd-7ca7c131e379 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:12:26 user nova-compute[82479]: WARNING nova.compute.manager [req-6bbf6069-d04f-426a-bbea-0600dd45d136 req-41496c7e-f2f5-429f-aa22-3ffdfa465ed6 service nova] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Received unexpected event network-vif-unplugged-102987de-d5e4-4ccd-b4fd-7ca7c131e379 for instance with vm_state rescued and task_state unrescuing.
Apr 14 00:12:26 user nova-compute[82479]: DEBUG nova.compute.manager [req-6bbf6069-d04f-426a-bbea-0600dd45d136 req-41496c7e-f2f5-429f-aa22-3ffdfa465ed6 service nova] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Received event network-vif-plugged-102987de-d5e4-4ccd-b4fd-7ca7c131e379 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:12:26 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-6bbf6069-d04f-426a-bbea-0600dd45d136 req-41496c7e-f2f5-429f-aa22-3ffdfa465ed6 service nova] Acquiring lock "17c6c147-fb62-4204-a416-792b94d3f7dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:12:26 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-6bbf6069-d04f-426a-bbea-0600dd45d136 req-41496c7e-f2f5-429f-aa22-3ffdfa465ed6 service nova] Lock "17c6c147-fb62-4204-a416-792b94d3f7dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:12:26 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-6bbf6069-d04f-426a-bbea-0600dd45d136 req-41496c7e-f2f5-429f-aa22-3ffdfa465ed6 service nova] Lock "17c6c147-fb62-4204-a416-792b94d3f7dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:12:26 user nova-compute[82479]: DEBUG nova.compute.manager [req-6bbf6069-d04f-426a-bbea-0600dd45d136 req-41496c7e-f2f5-429f-aa22-3ffdfa465ed6 service nova] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] No waiting events found dispatching network-vif-plugged-102987de-d5e4-4ccd-b4fd-7ca7c131e379 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:12:26 user nova-compute[82479]: WARNING nova.compute.manager [req-6bbf6069-d04f-426a-bbea-0600dd45d136 req-41496c7e-f2f5-429f-aa22-3ffdfa465ed6 service nova] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Received unexpected event network-vif-plugged-102987de-d5e4-4ccd-b4fd-7ca7c131e379 for instance with vm_state rescued and task_state unrescuing.
Apr 14 00:12:27 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Instance destroyed successfully.
Apr 14 00:12:27 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:27 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:27 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:27 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:27 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:27 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:27 user nova-compute[82479]: DEBUG nova.compute.manager [req-eadf111b-deb2-4272-98b5-1f6a9feed288 req-60ee0140-a17e-488c-bf85-4d1f55b9828e service nova] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Received event network-vif-plugged-62d9fce8-6815-4a29-ab53-d1205a2db648 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:12:27 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-eadf111b-deb2-4272-98b5-1f6a9feed288 req-60ee0140-a17e-488c-bf85-4d1f55b9828e service nova] Acquiring lock "6c35b78e-41e3-40c1-b265-8e1fa5e859c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:12:27 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-eadf111b-deb2-4272-98b5-1f6a9feed288 req-60ee0140-a17e-488c-bf85-4d1f55b9828e service nova] Lock "6c35b78e-41e3-40c1-b265-8e1fa5e859c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:12:27 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-eadf111b-deb2-4272-98b5-1f6a9feed288 req-60ee0140-a17e-488c-bf85-4d1f55b9828e service nova] Lock "6c35b78e-41e3-40c1-b265-8e1fa5e859c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:12:27 user nova-compute[82479]: DEBUG nova.compute.manager [req-eadf111b-deb2-4272-98b5-1f6a9feed288 req-60ee0140-a17e-488c-bf85-4d1f55b9828e service nova] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] No waiting events found dispatching network-vif-plugged-62d9fce8-6815-4a29-ab53-d1205a2db648 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:12:27 user nova-compute[82479]: WARNING nova.compute.manager [req-eadf111b-deb2-4272-98b5-1f6a9feed288 req-60ee0140-a17e-488c-bf85-4d1f55b9828e service nova] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Received unexpected event network-vif-plugged-62d9fce8-6815-4a29-ab53-d1205a2db648 for instance with vm_state building and task_state spawning.
Apr 14 00:12:27 user nova-compute[82479]: DEBUG nova.compute.manager [req-eadf111b-deb2-4272-98b5-1f6a9feed288 req-60ee0140-a17e-488c-bf85-4d1f55b9828e service nova] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Received event network-vif-plugged-62d9fce8-6815-4a29-ab53-d1205a2db648 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:12:27 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-eadf111b-deb2-4272-98b5-1f6a9feed288 req-60ee0140-a17e-488c-bf85-4d1f55b9828e service nova] Acquiring lock "6c35b78e-41e3-40c1-b265-8e1fa5e859c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:12:27 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-eadf111b-deb2-4272-98b5-1f6a9feed288 req-60ee0140-a17e-488c-bf85-4d1f55b9828e service nova] Lock "6c35b78e-41e3-40c1-b265-8e1fa5e859c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:12:27 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-eadf111b-deb2-4272-98b5-1f6a9feed288 req-60ee0140-a17e-488c-bf85-4d1f55b9828e service nova] Lock "6c35b78e-41e3-40c1-b265-8e1fa5e859c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:12:27 user nova-compute[82479]: DEBUG nova.compute.manager [req-eadf111b-deb2-4272-98b5-1f6a9feed288 req-60ee0140-a17e-488c-bf85-4d1f55b9828e service nova] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] No waiting events found dispatching network-vif-plugged-62d9fce8-6815-4a29-ab53-d1205a2db648 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:12:27 user nova-compute[82479]: WARNING nova.compute.manager [req-eadf111b-deb2-4272-98b5-1f6a9feed288 req-60ee0140-a17e-488c-bf85-4d1f55b9828e service nova] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Received unexpected event network-vif-plugged-62d9fce8-6815-4a29-ab53-d1205a2db648 for instance with vm_state building and task_state spawning.
Apr 14 00:12:27 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:27 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:28 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:28 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:28 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:28 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:28 user nova-compute[82479]: DEBUG nova.compute.manager [req-c2518392-d65b-4db4-aab4-bae0c804961c req-53bc0b4a-db04-4327-bb54-ae2eb25e23e6 service nova] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Received event network-vif-plugged-102987de-d5e4-4ccd-b4fd-7ca7c131e379 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:12:28 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-c2518392-d65b-4db4-aab4-bae0c804961c req-53bc0b4a-db04-4327-bb54-ae2eb25e23e6 service nova] Acquiring lock "17c6c147-fb62-4204-a416-792b94d3f7dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:12:28 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-c2518392-d65b-4db4-aab4-bae0c804961c req-53bc0b4a-db04-4327-bb54-ae2eb25e23e6 service nova] Lock "17c6c147-fb62-4204-a416-792b94d3f7dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:12:28 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-c2518392-d65b-4db4-aab4-bae0c804961c req-53bc0b4a-db04-4327-bb54-ae2eb25e23e6 service nova] Lock "17c6c147-fb62-4204-a416-792b94d3f7dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:12:28 user nova-compute[82479]: DEBUG nova.compute.manager [req-c2518392-d65b-4db4-aab4-bae0c804961c req-53bc0b4a-db04-4327-bb54-ae2eb25e23e6 service nova] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] No waiting events found dispatching network-vif-plugged-102987de-d5e4-4ccd-b4fd-7ca7c131e379 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:12:28 user nova-compute[82479]: WARNING nova.compute.manager [req-c2518392-d65b-4db4-aab4-bae0c804961c req-53bc0b4a-db04-4327-bb54-ae2eb25e23e6 service nova] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Received unexpected event network-vif-plugged-102987de-d5e4-4ccd-b4fd-7ca7c131e379 for instance with vm_state rescued and task_state unrescuing.
Apr 14 00:12:28 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:28 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:30 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681431150.148767, 6c35b78e-41e3-40c1-b265-8e1fa5e859c6 => Resumed> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:12:30 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] VM Resumed (Lifecycle Event)
Apr 14 00:12:30 user nova-compute[82479]: DEBUG nova.compute.manager [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Instance event wait completed in 0 seconds for  {{(pid=82479) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 00:12:30 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Guest created on hypervisor {{(pid=82479) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 00:12:30 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Instance spawned successfully.
Apr 14 00:12:30 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 00:12:30 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:12:30 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:12:30 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Found default for hw_cdrom_bus of ide {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:12:30 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Found default for hw_disk_bus of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:12:30 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Found default for hw_input_bus of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:12:30 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Found default for hw_pointer_model of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:12:30 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Found default for hw_video_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:12:30 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Found default for hw_vif_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:12:30 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:12:30 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681431150.1516051, 6c35b78e-41e3-40c1-b265-8e1fa5e859c6 => Started> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:12:30 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] VM Started (Lifecycle Event)
Apr 14 00:12:30 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:12:30 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:12:30 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:12:30 user nova-compute[82479]: INFO nova.compute.manager [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Took 7.28 seconds to spawn the instance on the hypervisor.
Apr 14 00:12:30 user nova-compute[82479]: DEBUG nova.compute.manager [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:12:30 user nova-compute[82479]: INFO nova.compute.manager [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Took 8.14 seconds to build instance.
Apr 14 00:12:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ae054e25-10f2-464b-aea5-ffe75b5e2e54 tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6c35b78e-41e3-40c1-b265-8e1fa5e859c6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.263s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:12:30 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:30 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Removed pending event for 17c6c147-fb62-4204-a416-792b94d3f7dd due to event {{(pid=82479) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 00:12:30 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681431150.6838067, 17c6c147-fb62-4204-a416-792b94d3f7dd => Resumed> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:12:30 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] VM Resumed (Lifecycle Event)
Apr 14 00:12:30 user nova-compute[82479]: DEBUG nova.compute.manager [None req-96fc8037-09f3-45f3-bb9f-0e66f4e016c6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:12:30 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:12:30 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:12:30 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 14 00:12:30 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681431150.684941, 17c6c147-fb62-4204-a416-792b94d3f7dd => Started> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:12:30 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] VM Started (Lifecycle Event)
Apr 14 00:12:30 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:12:30 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:12:30 user nova-compute[82479]: DEBUG nova.compute.manager [req-8a776272-2429-4d60-8457-9df1f6abc16a req-faf08426-016b-4d56-8cec-499c23ad70ae service nova] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Received event network-vif-plugged-102987de-d5e4-4ccd-b4fd-7ca7c131e379 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:12:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-8a776272-2429-4d60-8457-9df1f6abc16a req-faf08426-016b-4d56-8cec-499c23ad70ae service nova] Acquiring lock "17c6c147-fb62-4204-a416-792b94d3f7dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:12:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-8a776272-2429-4d60-8457-9df1f6abc16a req-faf08426-016b-4d56-8cec-499c23ad70ae service nova] Lock "17c6c147-fb62-4204-a416-792b94d3f7dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:12:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-8a776272-2429-4d60-8457-9df1f6abc16a req-faf08426-016b-4d56-8cec-499c23ad70ae service nova] Lock "17c6c147-fb62-4204-a416-792b94d3f7dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:12:30 user nova-compute[82479]: DEBUG nova.compute.manager [req-8a776272-2429-4d60-8457-9df1f6abc16a req-faf08426-016b-4d56-8cec-499c23ad70ae service nova] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] No waiting events found dispatching network-vif-plugged-102987de-d5e4-4ccd-b4fd-7ca7c131e379 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:12:30 user nova-compute[82479]: WARNING nova.compute.manager [req-8a776272-2429-4d60-8457-9df1f6abc16a req-faf08426-016b-4d56-8cec-499c23ad70ae service nova] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Received unexpected event network-vif-plugged-102987de-d5e4-4ccd-b4fd-7ca7c131e379 for instance with vm_state active and task_state None.
Apr 14 00:12:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:35 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:36 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:38 user nova-compute[82479]: DEBUG nova.objects.instance [None req-2d6664e2-8ee3-4a82-b971-032ff22d6f71 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lazy-loading 'flavor' on Instance uuid 01a65362-36ea-4817-8e83-f75d6daf808b {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:12:38 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-2d6664e2-8ee3-4a82-b971-032ff22d6f71 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "refresh_cache-01a65362-36ea-4817-8e83-f75d6daf808b" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:12:38 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-2d6664e2-8ee3-4a82-b971-032ff22d6f71 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquired lock "refresh_cache-01a65362-36ea-4817-8e83-f75d6daf808b" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:12:38 user nova-compute[82479]: DEBUG nova.network.neutron [None req-2d6664e2-8ee3-4a82-b971-032ff22d6f71 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 00:12:38 user nova-compute[82479]: DEBUG nova.objects.instance [None req-2d6664e2-8ee3-4a82-b971-032ff22d6f71 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lazy-loading 'info_cache' on Instance uuid 01a65362-36ea-4817-8e83-f75d6daf808b {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:12:39 user nova-compute[82479]: DEBUG nova.network.neutron [None req-2d6664e2-8ee3-4a82-b971-032ff22d6f71 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Updating instance_info_cache with network_info: [{"id": "b5dfa187-0a42-4319-990f-1d3b22691c27", "address": "fa:16:3e:7b:38:3d", "network": {"id": "368d9445-850e-4f74-b5cc-86d1eaa95d63", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374332689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec1aab0338ff4bd195a37a4199a378eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5dfa187-0a", "ovs_interfaceid": "b5dfa187-0a42-4319-990f-1d3b22691c27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:12:39 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-2d6664e2-8ee3-4a82-b971-032ff22d6f71 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Releasing lock "refresh_cache-01a65362-36ea-4817-8e83-f75d6daf808b" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:12:39 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Instance destroyed successfully.
Apr 14 00:12:39 user nova-compute[82479]: DEBUG nova.objects.instance [None req-2d6664e2-8ee3-4a82-b971-032ff22d6f71 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lazy-loading 'resources' on Instance uuid 01a65362-36ea-4817-8e83-f75d6daf808b {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:12:39 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-2d6664e2-8ee3-4a82-b971-032ff22d6f71 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:04:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-874047723',display_name='tempest-AttachVolumeTestJSON-server-874047723',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-874047723',id=5,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFj5BOE0cuvlxZawRQVfnfugrJsq+vAMk/RiiLDSf3KCRmtu0WTqB0nwANMnYIuDZO4AsUPttsoe/j3WMHFiNDVdBMIPFOCGE/kkjYyw9NwqNVOKFmKjVIZ3x8l2xusRtg==',key_name='tempest-keypair-608426082',keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:05:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='ec1aab0338ff4bd195a37a4199a378eb',ramdisk_id='',reservation_id='r-n5aqf0fe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1885059489',owner_user_name='tempest-AttachVolumeTestJSON-1885059489-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T00:10:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44530987616b417d87ce5909d8de1871',uuid=01a65362-36ea-4817-8e83-f75d6daf808b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "b5dfa187-0a42-4319-990f-1d3b22691c27", "address": "fa:16:3e:7b:38:3d", "network": {"id": "368d9445-850e-4f74-b5cc-86d1eaa95d63", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374332689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec1aab0338ff4bd195a37a4199a378eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5dfa187-0a", "ovs_interfaceid": "b5dfa187-0a42-4319-990f-1d3b22691c27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 00:12:39 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-2d6664e2-8ee3-4a82-b971-032ff22d6f71 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Converting VIF {"id": "b5dfa187-0a42-4319-990f-1d3b22691c27", "address": "fa:16:3e:7b:38:3d", "network": {"id": "368d9445-850e-4f74-b5cc-86d1eaa95d63", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374332689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec1aab0338ff4bd195a37a4199a378eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5dfa187-0a", "ovs_interfaceid": "b5dfa187-0a42-4319-990f-1d3b22691c27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:12:39 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-2d6664e2-8ee3-4a82-b971-032ff22d6f71 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:38:3d,bridge_name='br-int',has_traffic_filtering=True,id=b5dfa187-0a42-4319-990f-1d3b22691c27,network=Network(368d9445-850e-4f74-b5cc-86d1eaa95d63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5dfa187-0a') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:12:39 user nova-compute[82479]: DEBUG os_vif [None req-2d6664e2-8ee3-4a82-b971-032ff22d6f71 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:38:3d,bridge_name='br-int',has_traffic_filtering=True,id=b5dfa187-0a42-4319-990f-1d3b22691c27,network=Network(368d9445-850e-4f74-b5cc-86d1eaa95d63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5dfa187-0a') {{(pid=82479) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 00:12:39 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:39 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb5dfa187-0a, bridge=br-int, if_exists=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:12:39 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:39 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:39 user nova-compute[82479]: INFO os_vif [None req-2d6664e2-8ee3-4a82-b971-032ff22d6f71 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:38:3d,bridge_name='br-int',has_traffic_filtering=True,id=b5dfa187-0a42-4319-990f-1d3b22691c27,network=Network(368d9445-850e-4f74-b5cc-86d1eaa95d63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5dfa187-0a')
Apr 14 00:12:39 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-2d6664e2-8ee3-4a82-b971-032ff22d6f71 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Start _get_guest_xml network_info=[{"id": "b5dfa187-0a42-4319-990f-1d3b22691c27", "address": "fa:16:3e:7b:38:3d", "network": {"id": "368d9445-850e-4f74-b5cc-86d1eaa95d63", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374332689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec1aab0338ff4bd195a37a4199a378eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5dfa187-0a", "ovs_interfaceid": "b5dfa187-0a42-4319-990f-1d3b22691c27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 00:12:39 user nova-compute[82479]: DEBUG nova.objects.instance [None req-2d6664e2-8ee3-4a82-b971-032ff22d6f71 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lazy-loading 'numa_topology' on Instance uuid 01a65362-36ea-4817-8e83-f75d6daf808b {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:12:39 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-2d6664e2-8ee3-4a82-b971-032ff22d6f71 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:12:39 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-2d6664e2-8ee3-4a82-b971-032ff22d6f71 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:12:39 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-2d6664e2-8ee3-4a82-b971-032ff22d6f71 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82479) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 00:12:39 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-2d6664e2-8ee3-4a82-b971-032ff22d6f71 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T00:02:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 00:12:39 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-2d6664e2-8ee3-4a82-b971-032ff22d6f71 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Flavor limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 00:12:39 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-2d6664e2-8ee3-4a82-b971-032ff22d6f71 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Image limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 00:12:39 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-2d6664e2-8ee3-4a82-b971-032ff22d6f71 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Flavor pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 00:12:39 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-2d6664e2-8ee3-4a82-b971-032ff22d6f71 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Image pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 00:12:39 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-2d6664e2-8ee3-4a82-b971-032ff22d6f71 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 00:12:39 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-2d6664e2-8ee3-4a82-b971-032ff22d6f71 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 00:12:39 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-2d6664e2-8ee3-4a82-b971-032ff22d6f71 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 00:12:39 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-2d6664e2-8ee3-4a82-b971-032ff22d6f71 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Got 1 possible topologies {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 00:12:39 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-2d6664e2-8ee3-4a82-b971-032ff22d6f71 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 00:12:39 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-2d6664e2-8ee3-4a82-b971-032ff22d6f71 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 00:12:39 user nova-compute[82479]: DEBUG nova.objects.instance [None req-2d6664e2-8ee3-4a82-b971-032ff22d6f71 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lazy-loading 'vcpu_model' on Instance uuid 01a65362-36ea-4817-8e83-f75d6daf808b {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:12:39 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-2d6664e2-8ee3-4a82-b971-032ff22d6f71 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:04:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-874047723',display_name='tempest-AttachVolumeTestJSON-server-874047723',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-874047723',id=5,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFj5BOE0cuvlxZawRQVfnfugrJsq+vAMk/RiiLDSf3KCRmtu0WTqB0nwANMnYIuDZO4AsUPttsoe/j3WMHFiNDVdBMIPFOCGE/kkjYyw9NwqNVOKFmKjVIZ3x8l2xusRtg==',key_name='tempest-keypair-608426082',keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:05:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='ec1aab0338ff4bd195a37a4199a378eb',ramdisk_id='',reservation_id='r-n5aqf0fe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1885059489',owner_user_name='tempest-AttachVolumeTestJSON-1885059489-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T00:10:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44530987616b417d87ce5909d8de1871',uuid=01a65362-36ea-4817-8e83-f75d6daf808b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "b5dfa187-0a42-4319-990f-1d3b22691c27", "address": "fa:16:3e:7b:38:3d", "network": {"id": "368d9445-850e-4f74-b5cc-86d1eaa95d63", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374332689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec1aab0338ff4bd195a37a4199a378eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5dfa187-0a", "ovs_interfaceid": "b5dfa187-0a42-4319-990f-1d3b22691c27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82479) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 00:12:39 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-2d6664e2-8ee3-4a82-b971-032ff22d6f71 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Converting VIF {"id": "b5dfa187-0a42-4319-990f-1d3b22691c27", "address": "fa:16:3e:7b:38:3d", "network": {"id": "368d9445-850e-4f74-b5cc-86d1eaa95d63", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374332689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec1aab0338ff4bd195a37a4199a378eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5dfa187-0a", "ovs_interfaceid": "b5dfa187-0a42-4319-990f-1d3b22691c27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:12:39 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-2d6664e2-8ee3-4a82-b971-032ff22d6f71 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:38:3d,bridge_name='br-int',has_traffic_filtering=True,id=b5dfa187-0a42-4319-990f-1d3b22691c27,network=Network(368d9445-850e-4f74-b5cc-86d1eaa95d63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5dfa187-0a') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:12:39 user nova-compute[82479]: DEBUG nova.objects.instance [None req-2d6664e2-8ee3-4a82-b971-032ff22d6f71 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lazy-loading 'pci_devices' on Instance uuid 01a65362-36ea-4817-8e83-f75d6daf808b {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:12:39 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-2d6664e2-8ee3-4a82-b971-032ff22d6f71 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] End _get_guest_xml xml=<domain type="kvm">
Apr 14 00:12:39 user nova-compute[82479]:   <uuid>01a65362-36ea-4817-8e83-f75d6daf808b</uuid>
Apr 14 00:12:39 user nova-compute[82479]:   <name>instance-00000005</name>
Apr 14 00:12:39 user nova-compute[82479]:   <memory>131072</memory>
Apr 14 00:12:39 user nova-compute[82479]:   <vcpu>1</vcpu>
Apr 14 00:12:39 user nova-compute[82479]:   <metadata>
Apr 14 00:12:39 user nova-compute[82479]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 00:12:39 user nova-compute[82479]:       <nova:package version="0.0.0"/>
Apr 14 00:12:39 user nova-compute[82479]:       <nova:name>tempest-AttachVolumeTestJSON-server-874047723</nova:name>
Apr 14 00:12:39 user nova-compute[82479]:       <nova:creationTime>2023-04-14 00:12:39</nova:creationTime>
Apr 14 00:12:39 user nova-compute[82479]:       <nova:flavor name="m1.nano">
Apr 14 00:12:39 user nova-compute[82479]:         <nova:memory>128</nova:memory>
Apr 14 00:12:39 user nova-compute[82479]:         <nova:disk>1</nova:disk>
Apr 14 00:12:39 user nova-compute[82479]:         <nova:swap>0</nova:swap>
Apr 14 00:12:39 user nova-compute[82479]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 00:12:39 user nova-compute[82479]:         <nova:vcpus>1</nova:vcpus>
Apr 14 00:12:39 user nova-compute[82479]:       </nova:flavor>
Apr 14 00:12:39 user nova-compute[82479]:       <nova:owner>
Apr 14 00:12:39 user nova-compute[82479]:         <nova:user uuid="44530987616b417d87ce5909d8de1871">tempest-AttachVolumeTestJSON-1885059489-project-member</nova:user>
Apr 14 00:12:39 user nova-compute[82479]:         <nova:project uuid="ec1aab0338ff4bd195a37a4199a378eb">tempest-AttachVolumeTestJSON-1885059489</nova:project>
Apr 14 00:12:39 user nova-compute[82479]:       </nova:owner>
Apr 14 00:12:39 user nova-compute[82479]:       <nova:root type="image" uuid="6db62068-7278-4cd8-b41f-d0140d89e199"/>
Apr 14 00:12:39 user nova-compute[82479]:       <nova:ports>
Apr 14 00:12:39 user nova-compute[82479]:         <nova:port uuid="b5dfa187-0a42-4319-990f-1d3b22691c27">
Apr 14 00:12:39 user nova-compute[82479]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 14 00:12:39 user nova-compute[82479]:         </nova:port>
Apr 14 00:12:39 user nova-compute[82479]:       </nova:ports>
Apr 14 00:12:39 user nova-compute[82479]:     </nova:instance>
Apr 14 00:12:39 user nova-compute[82479]:   </metadata>
Apr 14 00:12:39 user nova-compute[82479]:   <sysinfo type="smbios">
Apr 14 00:12:39 user nova-compute[82479]:     <system>
Apr 14 00:12:39 user nova-compute[82479]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 00:12:39 user nova-compute[82479]:       <entry name="product">OpenStack Nova</entry>
Apr 14 00:12:39 user nova-compute[82479]:       <entry name="version">0.0.0</entry>
Apr 14 00:12:39 user nova-compute[82479]:       <entry name="serial">01a65362-36ea-4817-8e83-f75d6daf808b</entry>
Apr 14 00:12:39 user nova-compute[82479]:       <entry name="uuid">01a65362-36ea-4817-8e83-f75d6daf808b</entry>
Apr 14 00:12:39 user nova-compute[82479]:       <entry name="family">Virtual Machine</entry>
Apr 14 00:12:39 user nova-compute[82479]:     </system>
Apr 14 00:12:39 user nova-compute[82479]:   </sysinfo>
Apr 14 00:12:39 user nova-compute[82479]:   <os>
Apr 14 00:12:39 user nova-compute[82479]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 00:12:39 user nova-compute[82479]:     <boot dev="hd"/>
Apr 14 00:12:39 user nova-compute[82479]:     <smbios mode="sysinfo"/>
Apr 14 00:12:39 user nova-compute[82479]:   </os>
Apr 14 00:12:39 user nova-compute[82479]:   <features>
Apr 14 00:12:39 user nova-compute[82479]:     <acpi/>
Apr 14 00:12:39 user nova-compute[82479]:     <apic/>
Apr 14 00:12:39 user nova-compute[82479]:     <vmcoreinfo/>
Apr 14 00:12:39 user nova-compute[82479]:   </features>
Apr 14 00:12:39 user nova-compute[82479]:   <clock offset="utc">
Apr 14 00:12:39 user nova-compute[82479]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 00:12:39 user nova-compute[82479]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 00:12:39 user nova-compute[82479]:     <timer name="hpet" present="no"/>
Apr 14 00:12:39 user nova-compute[82479]:   </clock>
Apr 14 00:12:39 user nova-compute[82479]:   <cpu mode="custom" match="exact">
Apr 14 00:12:39 user nova-compute[82479]:     <model>Nehalem</model>
Apr 14 00:12:39 user nova-compute[82479]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 00:12:39 user nova-compute[82479]:   </cpu>
Apr 14 00:12:39 user nova-compute[82479]:   <devices>
Apr 14 00:12:39 user nova-compute[82479]:     <disk type="file" device="disk">
Apr 14 00:12:39 user nova-compute[82479]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 00:12:39 user nova-compute[82479]:       <source file="/opt/stack/data/nova/instances/01a65362-36ea-4817-8e83-f75d6daf808b/disk"/>
Apr 14 00:12:39 user nova-compute[82479]:       <target dev="vda" bus="virtio"/>
Apr 14 00:12:39 user nova-compute[82479]:     </disk>
Apr 14 00:12:39 user nova-compute[82479]:     <interface type="ethernet">
Apr 14 00:12:39 user nova-compute[82479]:       <mac address="fa:16:3e:7b:38:3d"/>
Apr 14 00:12:39 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:12:39 user nova-compute[82479]:       <mtu size="1442"/>
Apr 14 00:12:39 user nova-compute[82479]:       <target dev="tapb5dfa187-0a"/>
Apr 14 00:12:39 user nova-compute[82479]:     </interface>
Apr 14 00:12:39 user nova-compute[82479]:     <serial type="pty">
Apr 14 00:12:39 user nova-compute[82479]:       <log file="/opt/stack/data/nova/instances/01a65362-36ea-4817-8e83-f75d6daf808b/console.log" append="off"/>
Apr 14 00:12:39 user nova-compute[82479]:     </serial>
Apr 14 00:12:39 user nova-compute[82479]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 00:12:39 user nova-compute[82479]:     <video>
Apr 14 00:12:39 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:12:39 user nova-compute[82479]:     </video>
Apr 14 00:12:39 user nova-compute[82479]:     <rng model="virtio">
Apr 14 00:12:39 user nova-compute[82479]:       <backend model="random">/dev/urandom</backend>
Apr 14 00:12:39 user nova-compute[82479]:     </rng>
Apr 14 00:12:39 user nova-compute[82479]:     <controller type="usb" index="0" model="none"/>
Apr 14 00:12:39 user nova-compute[82479]:     <memballoon model="virtio">
Apr 14 00:12:39 user nova-compute[82479]:       <stats period="10"/>
Apr 14 00:12:39 user nova-compute[82479]:     </memballoon>
Apr 14 00:12:39 user nova-compute[82479]:   </devices>
Apr 14 00:12:39 user nova-compute[82479]: </domain>
Apr 14 00:12:39 user nova-compute[82479]:  {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 00:12:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-2d6664e2-8ee3-4a82-b971-032ff22d6f71 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01a65362-36ea-4817-8e83-f75d6daf808b/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:12:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-2d6664e2-8ee3-4a82-b971-032ff22d6f71 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01a65362-36ea-4817-8e83-f75d6daf808b/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:12:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-2d6664e2-8ee3-4a82-b971-032ff22d6f71 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01a65362-36ea-4817-8e83-f75d6daf808b/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:12:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-2d6664e2-8ee3-4a82-b971-032ff22d6f71 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01a65362-36ea-4817-8e83-f75d6daf808b/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:12:39 user nova-compute[82479]: DEBUG nova.objects.instance [None req-2d6664e2-8ee3-4a82-b971-032ff22d6f71 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lazy-loading 'trusted_certs' on Instance uuid 01a65362-36ea-4817-8e83-f75d6daf808b {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:12:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-2d6664e2-8ee3-4a82-b971-032ff22d6f71 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:12:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-2d6664e2-8ee3-4a82-b971-032ff22d6f71 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.137s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:12:39 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-2d6664e2-8ee3-4a82-b971-032ff22d6f71 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Checking if we can resize image /opt/stack/data/nova/instances/01a65362-36ea-4817-8e83-f75d6daf808b/disk. size=1073741824 {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 00:12:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-2d6664e2-8ee3-4a82-b971-032ff22d6f71 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01a65362-36ea-4817-8e83-f75d6daf808b/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:12:39 user nova-compute[82479]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681431144.7387075, 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b => Stopped> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:12:39 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] VM Stopped (Lifecycle Event)
Apr 14 00:12:39 user nova-compute[82479]: DEBUG nova.compute.manager [None req-b74a53e2-ad17-4574-b7aa-feb3fd21fd7b None None] [instance: 6fb358a6-7e79-4acf-8fbe-7cc4e67a707b] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:12:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-2d6664e2-8ee3-4a82-b971-032ff22d6f71 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01a65362-36ea-4817-8e83-f75d6daf808b/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:12:39 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-2d6664e2-8ee3-4a82-b971-032ff22d6f71 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Cannot resize image /opt/stack/data/nova/instances/01a65362-36ea-4817-8e83-f75d6daf808b/disk to a smaller size. {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 00:12:39 user nova-compute[82479]: DEBUG nova.objects.instance [None req-2d6664e2-8ee3-4a82-b971-032ff22d6f71 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lazy-loading 'migration_context' on Instance uuid 01a65362-36ea-4817-8e83-f75d6daf808b {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:12:39 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-2d6664e2-8ee3-4a82-b971-032ff22d6f71 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:04:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-874047723',display_name='tempest-AttachVolumeTestJSON-server-874047723',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-874047723',id=5,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFj5BOE0cuvlxZawRQVfnfugrJsq+vAMk/RiiLDSf3KCRmtu0WTqB0nwANMnYIuDZO4AsUPttsoe/j3WMHFiNDVdBMIPFOCGE/kkjYyw9NwqNVOKFmKjVIZ3x8l2xusRtg==',key_name='tempest-keypair-608426082',keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:05:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='ec1aab0338ff4bd195a37a4199a378eb',ramdisk_id='',reservation_id='r-n5aqf0fe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1885059489',owner_user_name='tempest-AttachVolumeTestJSON-1885059489-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:10:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44530987616b417d87ce5909d8de1871',uuid=01a65362-36ea-4817-8e83-f75d6daf808b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "b5dfa187-0a42-4319-990f-1d3b22691c27", "address": "fa:16:3e:7b:38:3d", "network": {"id": "368d9445-850e-4f74-b5cc-86d1eaa95d63", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374332689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec1aab0338ff4bd195a37a4199a378eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5dfa187-0a", "ovs_interfaceid": "b5dfa187-0a42-4319-990f-1d3b22691c27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 00:12:39 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-2d6664e2-8ee3-4a82-b971-032ff22d6f71 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Converting VIF {"id": "b5dfa187-0a42-4319-990f-1d3b22691c27", "address": "fa:16:3e:7b:38:3d", "network": {"id": "368d9445-850e-4f74-b5cc-86d1eaa95d63", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374332689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec1aab0338ff4bd195a37a4199a378eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5dfa187-0a", "ovs_interfaceid": "b5dfa187-0a42-4319-990f-1d3b22691c27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:12:39 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-2d6664e2-8ee3-4a82-b971-032ff22d6f71 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:38:3d,bridge_name='br-int',has_traffic_filtering=True,id=b5dfa187-0a42-4319-990f-1d3b22691c27,network=Network(368d9445-850e-4f74-b5cc-86d1eaa95d63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5dfa187-0a') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:12:39 user nova-compute[82479]: DEBUG os_vif [None req-2d6664e2-8ee3-4a82-b971-032ff22d6f71 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:38:3d,bridge_name='br-int',has_traffic_filtering=True,id=b5dfa187-0a42-4319-990f-1d3b22691c27,network=Network(368d9445-850e-4f74-b5cc-86d1eaa95d63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5dfa187-0a') {{(pid=82479) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 00:12:39 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:39 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:12:39 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 00:12:39 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:39 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb5dfa187-0a, may_exist=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:12:39 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb5dfa187-0a, col_values=(('external_ids', {'iface-id': 'b5dfa187-0a42-4319-990f-1d3b22691c27', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:38:3d', 'vm-uuid': '01a65362-36ea-4817-8e83-f75d6daf808b'}),)) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:12:39 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:39 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:12:39 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:39 user nova-compute[82479]: INFO os_vif [None req-2d6664e2-8ee3-4a82-b971-032ff22d6f71 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:38:3d,bridge_name='br-int',has_traffic_filtering=True,id=b5dfa187-0a42-4319-990f-1d3b22691c27,network=Network(368d9445-850e-4f74-b5cc-86d1eaa95d63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5dfa187-0a')
Apr 14 00:12:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:41 user nova-compute[82479]: DEBUG nova.compute.manager [req-c3ac062e-a2ee-4b92-a7be-0807abbb611a req-bf44ed79-aedc-484f-97da-493f892e5dec service nova] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Received event network-vif-plugged-b5dfa187-0a42-4319-990f-1d3b22691c27 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:12:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-c3ac062e-a2ee-4b92-a7be-0807abbb611a req-bf44ed79-aedc-484f-97da-493f892e5dec service nova] Acquiring lock "01a65362-36ea-4817-8e83-f75d6daf808b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:12:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-c3ac062e-a2ee-4b92-a7be-0807abbb611a req-bf44ed79-aedc-484f-97da-493f892e5dec service nova] Lock "01a65362-36ea-4817-8e83-f75d6daf808b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:12:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-c3ac062e-a2ee-4b92-a7be-0807abbb611a req-bf44ed79-aedc-484f-97da-493f892e5dec service nova] Lock "01a65362-36ea-4817-8e83-f75d6daf808b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:12:41 user nova-compute[82479]: DEBUG nova.compute.manager [req-c3ac062e-a2ee-4b92-a7be-0807abbb611a req-bf44ed79-aedc-484f-97da-493f892e5dec service nova] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] No waiting events found dispatching network-vif-plugged-b5dfa187-0a42-4319-990f-1d3b22691c27 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:12:41 user nova-compute[82479]: WARNING nova.compute.manager [req-c3ac062e-a2ee-4b92-a7be-0807abbb611a req-bf44ed79-aedc-484f-97da-493f892e5dec service nova] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Received unexpected event network-vif-plugged-b5dfa187-0a42-4319-990f-1d3b22691c27 for instance with vm_state stopped and task_state powering-on.
Apr 14 00:12:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:42 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:12:43 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681431163.4020154, 01a65362-36ea-4817-8e83-f75d6daf808b => Resumed> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:12:43 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] VM Resumed (Lifecycle Event)
Apr 14 00:12:43 user nova-compute[82479]: DEBUG nova.compute.manager [None req-2d6664e2-8ee3-4a82-b971-032ff22d6f71 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Instance event wait completed in 0 seconds for  {{(pid=82479) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 00:12:43 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Instance rebooted successfully.
Apr 14 00:12:43 user nova-compute[82479]: DEBUG nova.compute.manager [None req-2d6664e2-8ee3-4a82-b971-032ff22d6f71 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:12:43 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:12:43 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:12:43 user nova-compute[82479]: DEBUG nova.compute.manager [req-c18a0e9e-97c6-4c6d-959c-e952aaf9fadb req-4021133f-ae60-4fcd-af2c-7b2d2ddf2131 service nova] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Received event network-vif-plugged-b5dfa187-0a42-4319-990f-1d3b22691c27 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:12:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-c18a0e9e-97c6-4c6d-959c-e952aaf9fadb req-4021133f-ae60-4fcd-af2c-7b2d2ddf2131 service nova] Acquiring lock "01a65362-36ea-4817-8e83-f75d6daf808b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:12:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-c18a0e9e-97c6-4c6d-959c-e952aaf9fadb req-4021133f-ae60-4fcd-af2c-7b2d2ddf2131 service nova] Lock "01a65362-36ea-4817-8e83-f75d6daf808b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:12:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-c18a0e9e-97c6-4c6d-959c-e952aaf9fadb req-4021133f-ae60-4fcd-af2c-7b2d2ddf2131 service nova] Lock "01a65362-36ea-4817-8e83-f75d6daf808b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:12:43 user nova-compute[82479]: DEBUG nova.compute.manager [req-c18a0e9e-97c6-4c6d-959c-e952aaf9fadb req-4021133f-ae60-4fcd-af2c-7b2d2ddf2131 service nova] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] No waiting events found dispatching network-vif-plugged-b5dfa187-0a42-4319-990f-1d3b22691c27 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:12:43 user nova-compute[82479]: WARNING nova.compute.manager [req-c18a0e9e-97c6-4c6d-959c-e952aaf9fadb req-4021133f-ae60-4fcd-af2c-7b2d2ddf2131 service nova] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Received unexpected event network-vif-plugged-b5dfa187-0a42-4319-990f-1d3b22691c27 for instance with vm_state stopped and task_state powering-on.
Apr 14 00:12:43 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] During sync_power_state the instance has a pending task (powering-on). Skip.
Apr 14 00:12:43 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681431163.4054687, 01a65362-36ea-4817-8e83-f75d6daf808b => Started> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:12:43 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] VM Started (Lifecycle Event)
Apr 14 00:12:43 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:12:43 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:12:43 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:12:44 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:12:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:45 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:12:45 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Starting heal instance info cache {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 00:12:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "refresh_cache-01a65362-36ea-4817-8e83-f75d6daf808b" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:12:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquired lock "refresh_cache-01a65362-36ea-4817-8e83-f75d6daf808b" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:12:45 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Forcefully refreshing network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 00:12:46 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:46 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Updating instance_info_cache with network_info: [{"id": "b5dfa187-0a42-4319-990f-1d3b22691c27", "address": "fa:16:3e:7b:38:3d", "network": {"id": "368d9445-850e-4f74-b5cc-86d1eaa95d63", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374332689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec1aab0338ff4bd195a37a4199a378eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5dfa187-0a", "ovs_interfaceid": "b5dfa187-0a42-4319-990f-1d3b22691c27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:12:46 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Releasing lock "refresh_cache-01a65362-36ea-4817-8e83-f75d6daf808b" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:12:46 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Updated the network info_cache for instance {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 00:12:46 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:12:49 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:12:49 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:12:49 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:12:49 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82479) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 00:12:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:50 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:12:50 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:12:50 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:12:50 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:12:50 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Auditing locally available compute resources for user (node: user) {{(pid=82479) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 00:12:50 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:12:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11c3384a-e699-4b10-9f8b-861291e96465/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:12:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11c3384a-e699-4b10-9f8b-861291e96465/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:12:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11c3384a-e699-4b10-9f8b-861291e96465/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:12:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11c3384a-e699-4b10-9f8b-861291e96465/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:12:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8feba40a-03c7-4c60-b862-ee14fb8c9b05/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:12:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8feba40a-03c7-4c60-b862-ee14fb8c9b05/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:12:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8feba40a-03c7-4c60-b862-ee14fb8c9b05/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:12:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8feba40a-03c7-4c60-b862-ee14fb8c9b05/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:12:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01a65362-36ea-4817-8e83-f75d6daf808b/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:12:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01a65362-36ea-4817-8e83-f75d6daf808b/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:12:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01a65362-36ea-4817-8e83-f75d6daf808b/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:12:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01a65362-36ea-4817-8e83-f75d6daf808b/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:12:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk.rescue --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:12:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:12:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk.rescue --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:12:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:12:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:12:52 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:12:52 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:12:52 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:12:52 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:12:52 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:12:52 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:12:52 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:12:52 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:12:52 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:12:52 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:12:52 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:12:52 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:12:52 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:12:52 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:12:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:12:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fba4ee-4aae-4ee3-8114-b53510f5442c/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:12:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fba4ee-4aae-4ee3-8114-b53510f5442c/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:12:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fba4ee-4aae-4ee3-8114-b53510f5442c/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:12:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e3fba4ee-4aae-4ee3-8114-b53510f5442c/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:12:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/493c65ce-aceb-4273-926e-d3633e676008/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:12:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/493c65ce-aceb-4273-926e-d3633e676008/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:12:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/493c65ce-aceb-4273-926e-d3633e676008/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:12:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/493c65ce-aceb-4273-926e-d3633e676008/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:12:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c35b78e-41e3-40c1-b265-8e1fa5e859c6/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:12:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c35b78e-41e3-40c1-b265-8e1fa5e859c6/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:12:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c35b78e-41e3-40c1-b265-8e1fa5e859c6/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:12:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c35b78e-41e3-40c1-b265-8e1fa5e859c6/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:12:54 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:12:54 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:12:54 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Hypervisor/Node resource view: name=user free_ram=7482MB free_disk=26.134647369384766GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82479) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 00:12:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:12:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:12:54 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 23718fd0-58b8-47f9-b1ef-a26a90741ecc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:12:54 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 01a65362-36ea-4817-8e83-f75d6daf808b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:12:54 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance b3475e7e-ceb4-452a-a045-dbf43c5944dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:12:54 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 11c3384a-e699-4b10-9f8b-861291e96465 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:12:54 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance e3fba4ee-4aae-4ee3-8114-b53510f5442c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:12:54 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 17c6c147-fb62-4204-a416-792b94d3f7dd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:12:54 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 8feba40a-03c7-4c60-b862-ee14fb8c9b05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:12:54 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:12:54 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:12:54 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 493c65ce-aceb-4273-926e-d3633e676008 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:12:54 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 6c35b78e-41e3-40c1-b265-8e1fa5e859c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:12:54 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 00:12:54 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 00:12:54 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:54 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:12:54 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:12:54 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Compute_service record updated for user:user {{(pid=82479) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 00:12:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.531s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:12:56 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:56 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:12:58 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:12:59 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:13:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:13:02 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0a396382-bd21-4988-9462-31728fbc7dd0 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "e3fba4ee-4aae-4ee3-8114-b53510f5442c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:13:02 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0a396382-bd21-4988-9462-31728fbc7dd0 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "e3fba4ee-4aae-4ee3-8114-b53510f5442c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:13:02 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0a396382-bd21-4988-9462-31728fbc7dd0 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "e3fba4ee-4aae-4ee3-8114-b53510f5442c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:13:02 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0a396382-bd21-4988-9462-31728fbc7dd0 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "e3fba4ee-4aae-4ee3-8114-b53510f5442c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:13:02 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0a396382-bd21-4988-9462-31728fbc7dd0 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "e3fba4ee-4aae-4ee3-8114-b53510f5442c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:13:02 user nova-compute[82479]: INFO nova.compute.manager [None req-0a396382-bd21-4988-9462-31728fbc7dd0 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Terminating instance
Apr 14 00:13:02 user nova-compute[82479]: DEBUG nova.compute.manager [None req-0a396382-bd21-4988-9462-31728fbc7dd0 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Start destroying the instance on the hypervisor. {{(pid=82479) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 00:13:02 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:13:02 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:13:02 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:13:02 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:13:02 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:13:02 user nova-compute[82479]: DEBUG nova.compute.manager [req-09f5346b-5b6b-4f6a-8dd7-1003f967e5c1 req-525d93d8-d2a1-4dac-9b31-efdf692b579f service nova] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Received event network-vif-unplugged-526b82aa-8f72-4ad7-8c1f-2aac7a4a2111 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:13:02 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-09f5346b-5b6b-4f6a-8dd7-1003f967e5c1 req-525d93d8-d2a1-4dac-9b31-efdf692b579f service nova] Acquiring lock "e3fba4ee-4aae-4ee3-8114-b53510f5442c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:13:02 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-09f5346b-5b6b-4f6a-8dd7-1003f967e5c1 req-525d93d8-d2a1-4dac-9b31-efdf692b579f service nova] Lock "e3fba4ee-4aae-4ee3-8114-b53510f5442c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:13:02 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-09f5346b-5b6b-4f6a-8dd7-1003f967e5c1 req-525d93d8-d2a1-4dac-9b31-efdf692b579f service nova] Lock "e3fba4ee-4aae-4ee3-8114-b53510f5442c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:13:02 user nova-compute[82479]: DEBUG nova.compute.manager [req-09f5346b-5b6b-4f6a-8dd7-1003f967e5c1 req-525d93d8-d2a1-4dac-9b31-efdf692b579f service nova] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] No waiting events found dispatching network-vif-unplugged-526b82aa-8f72-4ad7-8c1f-2aac7a4a2111 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:13:02 user nova-compute[82479]: DEBUG nova.compute.manager [req-09f5346b-5b6b-4f6a-8dd7-1003f967e5c1 req-525d93d8-d2a1-4dac-9b31-efdf692b579f service nova] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Received event network-vif-unplugged-526b82aa-8f72-4ad7-8c1f-2aac7a4a2111 for instance with task_state deleting. {{(pid=82479) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 00:13:03 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Instance destroyed successfully.
Apr 14 00:13:03 user nova-compute[82479]: DEBUG nova.objects.instance [None req-0a396382-bd21-4988-9462-31728fbc7dd0 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lazy-loading 'resources' on Instance uuid e3fba4ee-4aae-4ee3-8114-b53510f5442c {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:13:03 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-0a396382-bd21-4988-9462-31728fbc7dd0 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:07:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-614109817',display_name='tempest-AttachVolumeNegativeTest-server-614109817',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-614109817',id=11,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOVEOzN9EIzsoteVdO36ZxbbHQObkqlbYQQgZP7fHoK8FtNsMR54wb4Xcjl8NdjbV4Y1Ha6eHcMsgRwIH0Ep73QGv8X38xH2qztJvPxXuGkfTuWADRX823xouKZXmw7pw==',key_name='tempest-keypair-911498178',keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:07:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='44c9d67ad2fa4cb9ab309b98f8fe051a',ramdisk_id='',reservation_id='r-1kkgq9es',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-719597397',owner_user_name='tempest-AttachVolumeNegativeTest-719597397-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T00:07:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb293fdfc658466aaa7134269fa46a7c',uuid=e3fba4ee-4aae-4ee3-8114-b53510f5442c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "526b82aa-8f72-4ad7-8c1f-2aac7a4a2111", "address": "fa:16:3e:1f:09:96", "network": {"id": "6d80f923-8aef-45df-921b-f77ed4ff0e75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-696070096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44c9d67ad2fa4cb9ab309b98f8fe051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap526b82aa-8f", "ovs_interfaceid": "526b82aa-8f72-4ad7-8c1f-2aac7a4a2111", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 00:13:03 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-0a396382-bd21-4988-9462-31728fbc7dd0 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Converting VIF {"id": "526b82aa-8f72-4ad7-8c1f-2aac7a4a2111", "address": "fa:16:3e:1f:09:96", "network": {"id": "6d80f923-8aef-45df-921b-f77ed4ff0e75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-696070096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44c9d67ad2fa4cb9ab309b98f8fe051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap526b82aa-8f", "ovs_interfaceid": "526b82aa-8f72-4ad7-8c1f-2aac7a4a2111", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:13:03 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-0a396382-bd21-4988-9462-31728fbc7dd0 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:09:96,bridge_name='br-int',has_traffic_filtering=True,id=526b82aa-8f72-4ad7-8c1f-2aac7a4a2111,network=Network(6d80f923-8aef-45df-921b-f77ed4ff0e75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap526b82aa-8f') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:13:03 user nova-compute[82479]: DEBUG os_vif [None req-0a396382-bd21-4988-9462-31728fbc7dd0 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:09:96,bridge_name='br-int',has_traffic_filtering=True,id=526b82aa-8f72-4ad7-8c1f-2aac7a4a2111,network=Network(6d80f923-8aef-45df-921b-f77ed4ff0e75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap526b82aa-8f') {{(pid=82479) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 00:13:03 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:13:03 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap526b82aa-8f, bridge=br-int, if_exists=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:13:03 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:13:03 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:13:03 user nova-compute[82479]: INFO os_vif [None req-0a396382-bd21-4988-9462-31728fbc7dd0 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:09:96,bridge_name='br-int',has_traffic_filtering=True,id=526b82aa-8f72-4ad7-8c1f-2aac7a4a2111,network=Network(6d80f923-8aef-45df-921b-f77ed4ff0e75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap526b82aa-8f')
Apr 14 00:13:03 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-0a396382-bd21-4988-9462-31728fbc7dd0 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Deleting instance files /opt/stack/data/nova/instances/e3fba4ee-4aae-4ee3-8114-b53510f5442c_del
Apr 14 00:13:03 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-0a396382-bd21-4988-9462-31728fbc7dd0 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Deletion of /opt/stack/data/nova/instances/e3fba4ee-4aae-4ee3-8114-b53510f5442c_del complete
Apr 14 00:13:03 user nova-compute[82479]: INFO nova.compute.manager [None req-0a396382-bd21-4988-9462-31728fbc7dd0 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Took 0.87 seconds to destroy the instance on the hypervisor.
Apr 14 00:13:03 user nova-compute[82479]: DEBUG oslo.service.loopingcall [None req-0a396382-bd21-4988-9462-31728fbc7dd0 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82479) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 00:13:03 user nova-compute[82479]: DEBUG nova.compute.manager [-] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Deallocating network for instance {{(pid=82479) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 00:13:03 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] deallocate_for_instance() {{(pid=82479) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 00:13:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:13:04 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Updating instance_info_cache with network_info: [] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:13:04 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Took 1.00 seconds to deallocate network for instance.
Apr 14 00:13:04 user nova-compute[82479]: DEBUG nova.compute.manager [req-16de2856-f540-45d2-83db-40ab83ed1cfb req-8df2b9f4-918a-4dd8-8052-b0306c33c069 service nova] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Received event network-vif-deleted-526b82aa-8f72-4ad7-8c1f-2aac7a4a2111 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:13:04 user nova-compute[82479]: INFO nova.compute.manager [req-16de2856-f540-45d2-83db-40ab83ed1cfb req-8df2b9f4-918a-4dd8-8052-b0306c33c069 service nova] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Neutron deleted interface 526b82aa-8f72-4ad7-8c1f-2aac7a4a2111; detaching it from the instance and deleting it from the info cache
Apr 14 00:13:04 user nova-compute[82479]: DEBUG nova.network.neutron [req-16de2856-f540-45d2-83db-40ab83ed1cfb req-8df2b9f4-918a-4dd8-8052-b0306c33c069 service nova] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Updating instance_info_cache with network_info: [] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:13:04 user nova-compute[82479]: DEBUG nova.compute.manager [req-16de2856-f540-45d2-83db-40ab83ed1cfb req-8df2b9f4-918a-4dd8-8052-b0306c33c069 service nova] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Detach interface failed, port_id=526b82aa-8f72-4ad7-8c1f-2aac7a4a2111, reason: Instance e3fba4ee-4aae-4ee3-8114-b53510f5442c could not be found. {{(pid=82479) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 00:13:04 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0a396382-bd21-4988-9462-31728fbc7dd0 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:13:04 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0a396382-bd21-4988-9462-31728fbc7dd0 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:13:04 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-0a396382-bd21-4988-9462-31728fbc7dd0 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:13:04 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-0a396382-bd21-4988-9462-31728fbc7dd0 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:13:04 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0a396382-bd21-4988-9462-31728fbc7dd0 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.376s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:13:04 user nova-compute[82479]: INFO nova.scheduler.client.report [None req-0a396382-bd21-4988-9462-31728fbc7dd0 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Deleted allocations for instance e3fba4ee-4aae-4ee3-8114-b53510f5442c
Apr 14 00:13:04 user nova-compute[82479]: DEBUG nova.compute.manager [req-4a705cc2-6ce3-441f-936f-b96981119500 req-9ab21089-1411-43f2-bdf1-36142987c756 service nova] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Received event network-vif-plugged-526b82aa-8f72-4ad7-8c1f-2aac7a4a2111 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:13:04 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-4a705cc2-6ce3-441f-936f-b96981119500 req-9ab21089-1411-43f2-bdf1-36142987c756 service nova] Acquiring lock "e3fba4ee-4aae-4ee3-8114-b53510f5442c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:13:04 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-4a705cc2-6ce3-441f-936f-b96981119500 req-9ab21089-1411-43f2-bdf1-36142987c756 service nova] Lock "e3fba4ee-4aae-4ee3-8114-b53510f5442c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:13:04 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-4a705cc2-6ce3-441f-936f-b96981119500 req-9ab21089-1411-43f2-bdf1-36142987c756 service nova] Lock "e3fba4ee-4aae-4ee3-8114-b53510f5442c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:13:04 user nova-compute[82479]: DEBUG nova.compute.manager [req-4a705cc2-6ce3-441f-936f-b96981119500 req-9ab21089-1411-43f2-bdf1-36142987c756 service nova] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] No waiting events found dispatching network-vif-plugged-526b82aa-8f72-4ad7-8c1f-2aac7a4a2111 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:13:04 user nova-compute[82479]: WARNING nova.compute.manager [req-4a705cc2-6ce3-441f-936f-b96981119500 req-9ab21089-1411-43f2-bdf1-36142987c756 service nova] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Received unexpected event network-vif-plugged-526b82aa-8f72-4ad7-8c1f-2aac7a4a2111 for instance with vm_state deleted and task_state None.
Apr 14 00:13:04 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0a396382-bd21-4988-9462-31728fbc7dd0 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "e3fba4ee-4aae-4ee3-8114-b53510f5442c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.450s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:13:08 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:13:10 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:13:11 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:13:13 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:13:13 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:13:16 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:13:18 user nova-compute[82479]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681431183.2743444, e3fba4ee-4aae-4ee3-8114-b53510f5442c => Stopped> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:13:18 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] VM Stopped (Lifecycle Event)
Apr 14 00:13:18 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c32bb464-21bb-4c33-8812-4e77019a8ed9 None None] [instance: e3fba4ee-4aae-4ee3-8114-b53510f5442c] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:13:18 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:13:19 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Acquiring lock "13860c45-6a4b-48ea-9d0f-d50656585637" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:13:19 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lock "13860c45-6a4b-48ea-9d0f-d50656585637" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:13:19 user nova-compute[82479]: DEBUG nova.compute.manager [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] Starting instance... {{(pid=82479) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 00:13:19 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:13:19 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:13:19 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82479) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 00:13:19 user nova-compute[82479]: INFO nova.compute.claims [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] Claim successful on node user
Apr 14 00:13:20 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:13:20 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:13:20 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.515s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:13:20 user nova-compute[82479]: DEBUG nova.compute.manager [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] Start building networks asynchronously for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 00:13:20 user nova-compute[82479]: DEBUG nova.compute.manager [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] Allocating IP information in the background. {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 00:13:20 user nova-compute[82479]: DEBUG nova.network.neutron [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] allocate_for_instance() {{(pid=82479) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 00:13:20 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 00:13:20 user nova-compute[82479]: DEBUG nova.compute.manager [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] Start building block device mappings for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 00:13:20 user nova-compute[82479]: DEBUG nova.compute.manager [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] Start spawning the instance on the hypervisor. {{(pid=82479) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 00:13:20 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] Creating instance directory {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 00:13:20 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] Creating image(s)
Apr 14 00:13:20 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Acquiring lock "/opt/stack/data/nova/instances/13860c45-6a4b-48ea-9d0f-d50656585637/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:13:20 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lock "/opt/stack/data/nova/instances/13860c45-6a4b-48ea-9d0f-d50656585637/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:13:20 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lock "/opt/stack/data/nova/instances/13860c45-6a4b-48ea-9d0f-d50656585637/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:13:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:13:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.148s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:13:20 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Acquiring lock "3e200e101633f2016e569ae4c0a352380507d1e4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:13:20 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lock "3e200e101633f2016e569ae4c0a352380507d1e4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:13:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:13:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.149s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:13:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/13860c45-6a4b-48ea-9d0f-d50656585637/disk 1073741824 {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:13:20 user nova-compute[82479]: DEBUG nova.policy [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '719f2342cc1d452daae3a4ded790f69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e9bf71f0644907979ec775c62a0b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82479) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 00:13:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/13860c45-6a4b-48ea-9d0f-d50656585637/disk 1073741824" returned: 0 in 0.069s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:13:20 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lock "3e200e101633f2016e569ae4c0a352380507d1e4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:13:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:13:20 user nova-compute[82479]: DEBUG nova.compute.manager [req-2d6c369b-f826-4267-9081-b1d3b56a6647 req-6eb00511-bb9d-4e3f-86b4-e634b430bd09 service nova] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Received event network-changed-cce0e09c-d491-4698-b846-d75a670cc38e {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:13:21 user nova-compute[82479]: DEBUG nova.compute.manager [req-2d6c369b-f826-4267-9081-b1d3b56a6647 req-6eb00511-bb9d-4e3f-86b4-e634b430bd09 service nova] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Refreshing instance network info cache due to event network-changed-cce0e09c-d491-4698-b846-d75a670cc38e. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:13:21 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-2d6c369b-f826-4267-9081-b1d3b56a6647 req-6eb00511-bb9d-4e3f-86b4-e634b430bd09 service nova] Acquiring lock "refresh_cache-11c3384a-e699-4b10-9f8b-861291e96465" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:13:21 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-2d6c369b-f826-4267-9081-b1d3b56a6647 req-6eb00511-bb9d-4e3f-86b4-e634b430bd09 service nova] Acquired lock "refresh_cache-11c3384a-e699-4b10-9f8b-861291e96465" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:13:21 user nova-compute[82479]: DEBUG nova.network.neutron [req-2d6c369b-f826-4267-9081-b1d3b56a6647 req-6eb00511-bb9d-4e3f-86b4-e634b430bd09 service nova] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Refreshing network info cache for port cce0e09c-d491-4698-b846-d75a670cc38e {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:13:21 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.138s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:13:21 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Checking if we can resize image /opt/stack/data/nova/instances/13860c45-6a4b-48ea-9d0f-d50656585637/disk. size=1073741824 {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 00:13:21 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13860c45-6a4b-48ea-9d0f-d50656585637/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:13:21 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f676572e-bde8-44e2-a0b1-19205eeef3b4 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquiring lock "11c3384a-e699-4b10-9f8b-861291e96465" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:13:21 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f676572e-bde8-44e2-a0b1-19205eeef3b4 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "11c3384a-e699-4b10-9f8b-861291e96465" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:13:21 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f676572e-bde8-44e2-a0b1-19205eeef3b4 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquiring lock "11c3384a-e699-4b10-9f8b-861291e96465-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:13:21 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f676572e-bde8-44e2-a0b1-19205eeef3b4 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "11c3384a-e699-4b10-9f8b-861291e96465-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:13:21 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f676572e-bde8-44e2-a0b1-19205eeef3b4 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "11c3384a-e699-4b10-9f8b-861291e96465-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:13:21 user nova-compute[82479]: INFO nova.compute.manager [None req-f676572e-bde8-44e2-a0b1-19205eeef3b4 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Terminating instance
Apr 14 00:13:21 user nova-compute[82479]: DEBUG nova.compute.manager [None req-f676572e-bde8-44e2-a0b1-19205eeef3b4 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Start destroying the instance on the hypervisor. {{(pid=82479) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 00:13:21 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13860c45-6a4b-48ea-9d0f-d50656585637/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:13:21 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Cannot resize image /opt/stack/data/nova/instances/13860c45-6a4b-48ea-9d0f-d50656585637/disk to a smaller size. {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 00:13:21 user nova-compute[82479]: DEBUG nova.objects.instance [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lazy-loading 'migration_context' on Instance uuid 13860c45-6a4b-48ea-9d0f-d50656585637 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:13:21 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:13:21 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] Created local disks {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 00:13:21 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] Ensure instance console log exists: /opt/stack/data/nova/instances/13860c45-6a4b-48ea-9d0f-d50656585637/console.log {{(pid=82479) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 00:13:21 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:13:21 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:13:21 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:13:21 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:13:21 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:13:21 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:13:21 user nova-compute[82479]: DEBUG nova.compute.manager [req-76961db4-172c-4d0d-92be-44f40476cd47 req-2b2d13ff-ecaa-4fef-921e-9a5081cea7dd service nova] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Received event network-vif-unplugged-cce0e09c-d491-4698-b846-d75a670cc38e {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:13:21 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-76961db4-172c-4d0d-92be-44f40476cd47 req-2b2d13ff-ecaa-4fef-921e-9a5081cea7dd service nova] Acquiring lock "11c3384a-e699-4b10-9f8b-861291e96465-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:13:21 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-76961db4-172c-4d0d-92be-44f40476cd47 req-2b2d13ff-ecaa-4fef-921e-9a5081cea7dd service nova] Lock "11c3384a-e699-4b10-9f8b-861291e96465-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:13:21 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-76961db4-172c-4d0d-92be-44f40476cd47 req-2b2d13ff-ecaa-4fef-921e-9a5081cea7dd service nova] Lock "11c3384a-e699-4b10-9f8b-861291e96465-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:13:21 user nova-compute[82479]: DEBUG nova.compute.manager [req-76961db4-172c-4d0d-92be-44f40476cd47 req-2b2d13ff-ecaa-4fef-921e-9a5081cea7dd service nova] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] No waiting events found dispatching network-vif-unplugged-cce0e09c-d491-4698-b846-d75a670cc38e {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:13:21 user nova-compute[82479]: DEBUG nova.compute.manager [req-76961db4-172c-4d0d-92be-44f40476cd47 req-2b2d13ff-ecaa-4fef-921e-9a5081cea7dd service nova] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Received event network-vif-unplugged-cce0e09c-d491-4698-b846-d75a670cc38e for instance with task_state deleting. {{(pid=82479) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 00:13:21 user nova-compute[82479]: DEBUG nova.network.neutron [req-2d6c369b-f826-4267-9081-b1d3b56a6647 req-6eb00511-bb9d-4e3f-86b4-e634b430bd09 service nova] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Updated VIF entry in instance network info cache for port cce0e09c-d491-4698-b846-d75a670cc38e. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:13:21 user nova-compute[82479]: DEBUG nova.network.neutron [req-2d6c369b-f826-4267-9081-b1d3b56a6647 req-6eb00511-bb9d-4e3f-86b4-e634b430bd09 service nova] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Updating instance_info_cache with network_info: [{"id": "cce0e09c-d491-4698-b846-d75a670cc38e", "address": "fa:16:3e:77:7f:4e", "network": {"id": "f185dffe-f180-4107-8752-182e71fc07c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1954392221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f138770c7b4407d83c449500fc000a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcce0e09c-d4", "ovs_interfaceid": "cce0e09c-d491-4698-b846-d75a670cc38e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:13:21 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-2d6c369b-f826-4267-9081-b1d3b56a6647 req-6eb00511-bb9d-4e3f-86b4-e634b430bd09 service nova] Releasing lock "refresh_cache-11c3384a-e699-4b10-9f8b-861291e96465" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:13:21 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Instance destroyed successfully.
Apr 14 00:13:21 user nova-compute[82479]: DEBUG nova.objects.instance [None req-f676572e-bde8-44e2-a0b1-19205eeef3b4 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lazy-loading 'resources' on Instance uuid 11c3384a-e699-4b10-9f8b-861291e96465 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:13:21 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-f676572e-bde8-44e2-a0b1-19205eeef3b4 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:06:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-250370213',display_name='tempest-TestStampPattern-server-250370213',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-250370213',id=10,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDlLkyaARZkQB95QySk+2VUQZ09Ejf2MBAGMaTBkstJSwxWK7dIH2obGUK+EG+vNkZ0wlDST0FmsMBpmophXdr02YiHRimuo8UQxusvxIG9HcXOIpUbG3VMNRBCqhYxCUw==',key_name='tempest-TestStampPattern-2105733066',keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:06:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1f138770c7b4407d83c449500fc000a5',ramdisk_id='',reservation_id='r-adbi2ts2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1381824337',owner_user_name='tempest-TestStampPattern-1381824337-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T00:09:25Z,user_data=None,user_id='6fe75acb64a94a2a88d370f43fa6b776',uuid=11c3384a-e699-4b10-9f8b-861291e96465,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cce0e09c-d491-4698-b846-d75a670cc38e", "address": "fa:16:3e:77:7f:4e", "network": {"id": "f185dffe-f180-4107-8752-182e71fc07c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1954392221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f138770c7b4407d83c449500fc000a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcce0e09c-d4", "ovs_interfaceid": "cce0e09c-d491-4698-b846-d75a670cc38e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 00:13:21 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-f676572e-bde8-44e2-a0b1-19205eeef3b4 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Converting VIF {"id": "cce0e09c-d491-4698-b846-d75a670cc38e", "address": "fa:16:3e:77:7f:4e", "network": {"id": "f185dffe-f180-4107-8752-182e71fc07c1", "bridge": "br-int", "label": "tempest-TestStampPattern-1954392221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f138770c7b4407d83c449500fc000a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcce0e09c-d4", "ovs_interfaceid": "cce0e09c-d491-4698-b846-d75a670cc38e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:13:21 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-f676572e-bde8-44e2-a0b1-19205eeef3b4 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:77:7f:4e,bridge_name='br-int',has_traffic_filtering=True,id=cce0e09c-d491-4698-b846-d75a670cc38e,network=Network(f185dffe-f180-4107-8752-182e71fc07c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcce0e09c-d4') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:13:21 user nova-compute[82479]: DEBUG os_vif [None req-f676572e-bde8-44e2-a0b1-19205eeef3b4 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:7f:4e,bridge_name='br-int',has_traffic_filtering=True,id=cce0e09c-d491-4698-b846-d75a670cc38e,network=Network(f185dffe-f180-4107-8752-182e71fc07c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcce0e09c-d4') {{(pid=82479) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 00:13:21 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:13:21 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcce0e09c-d4, bridge=br-int, if_exists=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:13:21 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:13:21 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:13:21 user nova-compute[82479]: INFO os_vif [None req-f676572e-bde8-44e2-a0b1-19205eeef3b4 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:7f:4e,bridge_name='br-int',has_traffic_filtering=True,id=cce0e09c-d491-4698-b846-d75a670cc38e,network=Network(f185dffe-f180-4107-8752-182e71fc07c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcce0e09c-d4')
Apr 14 00:13:21 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-f676572e-bde8-44e2-a0b1-19205eeef3b4 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Deleting instance files /opt/stack/data/nova/instances/11c3384a-e699-4b10-9f8b-861291e96465_del
Apr 14 00:13:21 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-f676572e-bde8-44e2-a0b1-19205eeef3b4 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Deletion of /opt/stack/data/nova/instances/11c3384a-e699-4b10-9f8b-861291e96465_del complete
Apr 14 00:13:21 user nova-compute[82479]: DEBUG nova.network.neutron [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] Successfully created port: d102c4a9-79bd-4968-9a16-9eedcbce0056 {{(pid=82479) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 00:13:22 user nova-compute[82479]: INFO nova.compute.manager [None req-f676572e-bde8-44e2-a0b1-19205eeef3b4 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Took 0.92 seconds to destroy the instance on the hypervisor.
Apr 14 00:13:22 user nova-compute[82479]: DEBUG oslo.service.loopingcall [None req-f676572e-bde8-44e2-a0b1-19205eeef3b4 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82479) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 00:13:22 user nova-compute[82479]: DEBUG nova.compute.manager [-] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Deallocating network for instance {{(pid=82479) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 00:13:22 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] deallocate_for_instance() {{(pid=82479) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 00:13:22 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Updating instance_info_cache with network_info: [] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:13:22 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Took 0.83 seconds to deallocate network for instance.
Apr 14 00:13:22 user nova-compute[82479]: DEBUG nova.compute.manager [req-fdef61da-860a-4542-a9b1-d6ca05615448 req-d8c13de2-dbe7-47bc-be0c-44f212361cbe service nova] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Received event network-vif-deleted-cce0e09c-d491-4698-b846-d75a670cc38e {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:13:22 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f676572e-bde8-44e2-a0b1-19205eeef3b4 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:13:22 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f676572e-bde8-44e2-a0b1-19205eeef3b4 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:13:23 user nova-compute[82479]: DEBUG nova.network.neutron [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] Successfully updated port: d102c4a9-79bd-4968-9a16-9eedcbce0056 {{(pid=82479) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 00:13:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Acquiring lock "refresh_cache-13860c45-6a4b-48ea-9d0f-d50656585637" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:13:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Acquired lock "refresh_cache-13860c45-6a4b-48ea-9d0f-d50656585637" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:13:23 user nova-compute[82479]: DEBUG nova.network.neutron [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 00:13:23 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-f676572e-bde8-44e2-a0b1-19205eeef3b4 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:13:23 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-f676572e-bde8-44e2-a0b1-19205eeef3b4 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:13:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f676572e-bde8-44e2-a0b1-19205eeef3b4 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.379s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:13:23 user nova-compute[82479]: DEBUG nova.network.neutron [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] Instance cache missing network info. {{(pid=82479) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 00:13:23 user nova-compute[82479]: INFO nova.scheduler.client.report [None req-f676572e-bde8-44e2-a0b1-19205eeef3b4 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Deleted allocations for instance 11c3384a-e699-4b10-9f8b-861291e96465
Apr 14 00:13:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f676572e-bde8-44e2-a0b1-19205eeef3b4 tempest-TestStampPattern-1381824337 tempest-TestStampPattern-1381824337-project-member] Lock "11c3384a-e699-4b10-9f8b-861291e96465" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.340s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:13:23 user nova-compute[82479]: DEBUG nova.compute.manager [req-4d5b648b-4ca9-4b0d-b3f6-2bf22cba1fa2 req-123ff766-126d-428a-b5d6-c655792817e6 service nova] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Received event network-vif-plugged-cce0e09c-d491-4698-b846-d75a670cc38e {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:13:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-4d5b648b-4ca9-4b0d-b3f6-2bf22cba1fa2 req-123ff766-126d-428a-b5d6-c655792817e6 service nova] Acquiring lock "11c3384a-e699-4b10-9f8b-861291e96465-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:13:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-4d5b648b-4ca9-4b0d-b3f6-2bf22cba1fa2 req-123ff766-126d-428a-b5d6-c655792817e6 service nova] Lock "11c3384a-e699-4b10-9f8b-861291e96465-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:13:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-4d5b648b-4ca9-4b0d-b3f6-2bf22cba1fa2 req-123ff766-126d-428a-b5d6-c655792817e6 service nova] Lock "11c3384a-e699-4b10-9f8b-861291e96465-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:13:23 user nova-compute[82479]: DEBUG nova.compute.manager [req-4d5b648b-4ca9-4b0d-b3f6-2bf22cba1fa2 req-123ff766-126d-428a-b5d6-c655792817e6 service nova] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] No waiting events found dispatching network-vif-plugged-cce0e09c-d491-4698-b846-d75a670cc38e {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:13:23 user nova-compute[82479]: WARNING nova.compute.manager [req-4d5b648b-4ca9-4b0d-b3f6-2bf22cba1fa2 req-123ff766-126d-428a-b5d6-c655792817e6 service nova] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Received unexpected event network-vif-plugged-cce0e09c-d491-4698-b846-d75a670cc38e for instance with vm_state deleted and task_state None.
Apr 14 00:13:23 user nova-compute[82479]: DEBUG nova.network.neutron [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] Updating instance_info_cache with network_info: [{"id": "d102c4a9-79bd-4968-9a16-9eedcbce0056", "address": "fa:16:3e:c1:dc:21", "network": {"id": "e3acf139-a0c8-4b33-aae5-26131d3dccb5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1150180978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "67e9bf71f0644907979ec775c62a0b39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd102c4a9-79", "ovs_interfaceid": "d102c4a9-79bd-4968-9a16-9eedcbce0056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:13:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Releasing lock "refresh_cache-13860c45-6a4b-48ea-9d0f-d50656585637" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:13:23 user nova-compute[82479]: DEBUG nova.compute.manager [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] Instance network_info: |[{"id": "d102c4a9-79bd-4968-9a16-9eedcbce0056", "address": "fa:16:3e:c1:dc:21", "network": {"id": "e3acf139-a0c8-4b33-aae5-26131d3dccb5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1150180978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "67e9bf71f0644907979ec775c62a0b39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd102c4a9-79", "ovs_interfaceid": "d102c4a9-79bd-4968-9a16-9eedcbce0056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 00:13:23 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] Start _get_guest_xml network_info=[{"id": "d102c4a9-79bd-4968-9a16-9eedcbce0056", "address": "fa:16:3e:c1:dc:21", "network": {"id": "e3acf139-a0c8-4b33-aae5-26131d3dccb5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1150180978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "67e9bf71f0644907979ec775c62a0b39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd102c4a9-79", "ovs_interfaceid": "d102c4a9-79bd-4968-9a16-9eedcbce0056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 00:13:23 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:13:23 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:13:23 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82479) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 00:13:23 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T00:02:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 00:13:23 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Flavor limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 00:13:23 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Image limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 00:13:23 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Flavor pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 00:13:23 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Image pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 00:13:23 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 00:13:23 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 00:13:23 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 00:13:23 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Got 1 possible topologies {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 00:13:23 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 00:13:23 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 00:13:23 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:13:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-580695201',display_name='tempest-VolumesActionsTest-instance-580695201',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-580695201',id=22,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67e9bf71f0644907979ec775c62a0b39',ramdisk_id='',reservation_id='r-yscy0g1l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-422643142',owner_user_name='tempest-VolumesActionsTest-422643142-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:13:20Z,user_data=None,user_id='719f2342cc1d452daae3a4ded790f69a',uuid=13860c45-6a4b-48ea-9d0f-d50656585637,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d102c4a9-79bd-4968-9a16-9eedcbce0056", "address": "fa:16:3e:c1:dc:21", "network": {"id": "e3acf139-a0c8-4b33-aae5-26131d3dccb5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1150180978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "67e9bf71f0644907979ec775c62a0b39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd102c4a9-79", "ovs_interfaceid": "d102c4a9-79bd-4968-9a16-9eedcbce0056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82479) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 00:13:23 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Converting VIF {"id": "d102c4a9-79bd-4968-9a16-9eedcbce0056", "address": "fa:16:3e:c1:dc:21", "network": {"id": "e3acf139-a0c8-4b33-aae5-26131d3dccb5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1150180978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "67e9bf71f0644907979ec775c62a0b39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd102c4a9-79", "ovs_interfaceid": "d102c4a9-79bd-4968-9a16-9eedcbce0056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:13:23 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:dc:21,bridge_name='br-int',has_traffic_filtering=True,id=d102c4a9-79bd-4968-9a16-9eedcbce0056,network=Network(e3acf139-a0c8-4b33-aae5-26131d3dccb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd102c4a9-79') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:13:23 user nova-compute[82479]: DEBUG nova.objects.instance [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lazy-loading 'pci_devices' on Instance uuid 13860c45-6a4b-48ea-9d0f-d50656585637 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:13:23 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] End _get_guest_xml xml=<domain type="kvm">
Apr 14 00:13:23 user nova-compute[82479]:   <uuid>13860c45-6a4b-48ea-9d0f-d50656585637</uuid>
Apr 14 00:13:23 user nova-compute[82479]:   <name>instance-00000016</name>
Apr 14 00:13:23 user nova-compute[82479]:   <memory>131072</memory>
Apr 14 00:13:23 user nova-compute[82479]:   <vcpu>1</vcpu>
Apr 14 00:13:23 user nova-compute[82479]:   <metadata>
Apr 14 00:13:23 user nova-compute[82479]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 00:13:23 user nova-compute[82479]:       <nova:package version="0.0.0"/>
Apr 14 00:13:23 user nova-compute[82479]:       <nova:name>tempest-VolumesActionsTest-instance-580695201</nova:name>
Apr 14 00:13:23 user nova-compute[82479]:       <nova:creationTime>2023-04-14 00:13:23</nova:creationTime>
Apr 14 00:13:23 user nova-compute[82479]:       <nova:flavor name="m1.nano">
Apr 14 00:13:23 user nova-compute[82479]:         <nova:memory>128</nova:memory>
Apr 14 00:13:23 user nova-compute[82479]:         <nova:disk>1</nova:disk>
Apr 14 00:13:23 user nova-compute[82479]:         <nova:swap>0</nova:swap>
Apr 14 00:13:23 user nova-compute[82479]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 00:13:23 user nova-compute[82479]:         <nova:vcpus>1</nova:vcpus>
Apr 14 00:13:23 user nova-compute[82479]:       </nova:flavor>
Apr 14 00:13:23 user nova-compute[82479]:       <nova:owner>
Apr 14 00:13:23 user nova-compute[82479]:         <nova:user uuid="719f2342cc1d452daae3a4ded790f69a">tempest-VolumesActionsTest-422643142-project-member</nova:user>
Apr 14 00:13:23 user nova-compute[82479]:         <nova:project uuid="67e9bf71f0644907979ec775c62a0b39">tempest-VolumesActionsTest-422643142</nova:project>
Apr 14 00:13:23 user nova-compute[82479]:       </nova:owner>
Apr 14 00:13:23 user nova-compute[82479]:       <nova:root type="image" uuid="6db62068-7278-4cd8-b41f-d0140d89e199"/>
Apr 14 00:13:23 user nova-compute[82479]:       <nova:ports>
Apr 14 00:13:23 user nova-compute[82479]:         <nova:port uuid="d102c4a9-79bd-4968-9a16-9eedcbce0056">
Apr 14 00:13:23 user nova-compute[82479]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 14 00:13:23 user nova-compute[82479]:         </nova:port>
Apr 14 00:13:23 user nova-compute[82479]:       </nova:ports>
Apr 14 00:13:23 user nova-compute[82479]:     </nova:instance>
Apr 14 00:13:23 user nova-compute[82479]:   </metadata>
Apr 14 00:13:23 user nova-compute[82479]:   <sysinfo type="smbios">
Apr 14 00:13:23 user nova-compute[82479]:     <system>
Apr 14 00:13:23 user nova-compute[82479]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 00:13:23 user nova-compute[82479]:       <entry name="product">OpenStack Nova</entry>
Apr 14 00:13:23 user nova-compute[82479]:       <entry name="version">0.0.0</entry>
Apr 14 00:13:23 user nova-compute[82479]:       <entry name="serial">13860c45-6a4b-48ea-9d0f-d50656585637</entry>
Apr 14 00:13:23 user nova-compute[82479]:       <entry name="uuid">13860c45-6a4b-48ea-9d0f-d50656585637</entry>
Apr 14 00:13:23 user nova-compute[82479]:       <entry name="family">Virtual Machine</entry>
Apr 14 00:13:23 user nova-compute[82479]:     </system>
Apr 14 00:13:23 user nova-compute[82479]:   </sysinfo>
Apr 14 00:13:23 user nova-compute[82479]:   <os>
Apr 14 00:13:23 user nova-compute[82479]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 00:13:23 user nova-compute[82479]:     <boot dev="hd"/>
Apr 14 00:13:23 user nova-compute[82479]:     <smbios mode="sysinfo"/>
Apr 14 00:13:23 user nova-compute[82479]:   </os>
Apr 14 00:13:23 user nova-compute[82479]:   <features>
Apr 14 00:13:23 user nova-compute[82479]:     <acpi/>
Apr 14 00:13:23 user nova-compute[82479]:     <apic/>
Apr 14 00:13:23 user nova-compute[82479]:     <vmcoreinfo/>
Apr 14 00:13:23 user nova-compute[82479]:   </features>
Apr 14 00:13:23 user nova-compute[82479]:   <clock offset="utc">
Apr 14 00:13:23 user nova-compute[82479]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 00:13:23 user nova-compute[82479]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 00:13:23 user nova-compute[82479]:     <timer name="hpet" present="no"/>
Apr 14 00:13:23 user nova-compute[82479]:   </clock>
Apr 14 00:13:23 user nova-compute[82479]:   <cpu mode="custom" match="exact">
Apr 14 00:13:23 user nova-compute[82479]:     <model>Nehalem</model>
Apr 14 00:13:23 user nova-compute[82479]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 00:13:23 user nova-compute[82479]:   </cpu>
Apr 14 00:13:23 user nova-compute[82479]:   <devices>
Apr 14 00:13:23 user nova-compute[82479]:     <disk type="file" device="disk">
Apr 14 00:13:23 user nova-compute[82479]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 00:13:23 user nova-compute[82479]:       <source file="/opt/stack/data/nova/instances/13860c45-6a4b-48ea-9d0f-d50656585637/disk"/>
Apr 14 00:13:23 user nova-compute[82479]:       <target dev="vda" bus="virtio"/>
Apr 14 00:13:23 user nova-compute[82479]:     </disk>
Apr 14 00:13:23 user nova-compute[82479]:     <interface type="ethernet">
Apr 14 00:13:23 user nova-compute[82479]:       <mac address="fa:16:3e:c1:dc:21"/>
Apr 14 00:13:23 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:13:23 user nova-compute[82479]:       <mtu size="1442"/>
Apr 14 00:13:23 user nova-compute[82479]:       <target dev="tapd102c4a9-79"/>
Apr 14 00:13:23 user nova-compute[82479]:     </interface>
Apr 14 00:13:23 user nova-compute[82479]:     <serial type="pty">
Apr 14 00:13:23 user nova-compute[82479]:       <log file="/opt/stack/data/nova/instances/13860c45-6a4b-48ea-9d0f-d50656585637/console.log" append="off"/>
Apr 14 00:13:23 user nova-compute[82479]:     </serial>
Apr 14 00:13:23 user nova-compute[82479]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 00:13:23 user nova-compute[82479]:     <video>
Apr 14 00:13:23 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:13:23 user nova-compute[82479]:     </video>
Apr 14 00:13:23 user nova-compute[82479]:     <rng model="virtio">
Apr 14 00:13:23 user nova-compute[82479]:       <backend model="random">/dev/urandom</backend>
Apr 14 00:13:23 user nova-compute[82479]:     </rng>
Apr 14 00:13:23 user nova-compute[82479]:     <controller type="usb" index="0" model="none"/>
Apr 14 00:13:23 user nova-compute[82479]:     <memballoon model="virtio">
Apr 14 00:13:23 user nova-compute[82479]:       <stats period="10"/>
Apr 14 00:13:23 user nova-compute[82479]:     </memballoon>
Apr 14 00:13:23 user nova-compute[82479]:   </devices>
Apr 14 00:13:23 user nova-compute[82479]: </domain>
Apr 14 00:13:23 user nova-compute[82479]:  {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 00:13:23 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:13:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-580695201',display_name='tempest-VolumesActionsTest-instance-580695201',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-580695201',id=22,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67e9bf71f0644907979ec775c62a0b39',ramdisk_id='',reservation_id='r-yscy0g1l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-422643142',owner_user_name='tempest-VolumesActionsTest-422643142-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:13:20Z,user_data=None,user_id='719f2342cc1d452daae3a4ded790f69a',uuid=13860c45-6a4b-48ea-9d0f-d50656585637,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d102c4a9-79bd-4968-9a16-9eedcbce0056", "address": "fa:16:3e:c1:dc:21", "network": {"id": "e3acf139-a0c8-4b33-aae5-26131d3dccb5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1150180978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "67e9bf71f0644907979ec775c62a0b39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd102c4a9-79", "ovs_interfaceid": "d102c4a9-79bd-4968-9a16-9eedcbce0056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 00:13:23 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Converting VIF {"id": "d102c4a9-79bd-4968-9a16-9eedcbce0056", "address": "fa:16:3e:c1:dc:21", "network": {"id": "e3acf139-a0c8-4b33-aae5-26131d3dccb5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1150180978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "67e9bf71f0644907979ec775c62a0b39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd102c4a9-79", "ovs_interfaceid": "d102c4a9-79bd-4968-9a16-9eedcbce0056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:13:23 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:dc:21,bridge_name='br-int',has_traffic_filtering=True,id=d102c4a9-79bd-4968-9a16-9eedcbce0056,network=Network(e3acf139-a0c8-4b33-aae5-26131d3dccb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd102c4a9-79') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:13:23 user nova-compute[82479]: DEBUG os_vif [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:dc:21,bridge_name='br-int',has_traffic_filtering=True,id=d102c4a9-79bd-4968-9a16-9eedcbce0056,network=Network(e3acf139-a0c8-4b33-aae5-26131d3dccb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd102c4a9-79') {{(pid=82479) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 00:13:23 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:13:23 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:13:23 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 00:13:23 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:13:23 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd102c4a9-79, may_exist=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:13:23 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd102c4a9-79, col_values=(('external_ids', {'iface-id': 'd102c4a9-79bd-4968-9a16-9eedcbce0056', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:dc:21', 'vm-uuid': '13860c45-6a4b-48ea-9d0f-d50656585637'}),)) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:13:23 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:13:23 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:13:23 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:13:23 user nova-compute[82479]: INFO os_vif [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:dc:21,bridge_name='br-int',has_traffic_filtering=True,id=d102c4a9-79bd-4968-9a16-9eedcbce0056,network=Network(e3acf139-a0c8-4b33-aae5-26131d3dccb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd102c4a9-79')
Apr 14 00:13:23 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:13:23 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] No VIF found with MAC fa:16:3e:c1:dc:21, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:13:24 user nova-compute[82479]: DEBUG nova.compute.manager [req-0387e40a-b1a1-4f7e-bcf4-ac08324c28b9 req-b79d8688-7e9c-4138-97bf-678026aa6098 service nova] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] Received event network-changed-d102c4a9-79bd-4968-9a16-9eedcbce0056 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:13:24 user nova-compute[82479]: DEBUG nova.compute.manager [req-0387e40a-b1a1-4f7e-bcf4-ac08324c28b9 req-b79d8688-7e9c-4138-97bf-678026aa6098 service nova] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] Refreshing instance network info cache due to event network-changed-d102c4a9-79bd-4968-9a16-9eedcbce0056. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:13:24 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0387e40a-b1a1-4f7e-bcf4-ac08324c28b9 req-b79d8688-7e9c-4138-97bf-678026aa6098 service nova] Acquiring lock "refresh_cache-13860c45-6a4b-48ea-9d0f-d50656585637" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:13:24 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0387e40a-b1a1-4f7e-bcf4-ac08324c28b9 req-b79d8688-7e9c-4138-97bf-678026aa6098 service nova] Acquired lock "refresh_cache-13860c45-6a4b-48ea-9d0f-d50656585637" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:13:24 user nova-compute[82479]: DEBUG nova.network.neutron [req-0387e40a-b1a1-4f7e-bcf4-ac08324c28b9 req-b79d8688-7e9c-4138-97bf-678026aa6098 service nova] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] Refreshing network info cache for port d102c4a9-79bd-4968-9a16-9eedcbce0056 {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:13:25 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:13:25 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:13:25 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:13:25 user nova-compute[82479]: DEBUG nova.network.neutron [req-0387e40a-b1a1-4f7e-bcf4-ac08324c28b9 req-b79d8688-7e9c-4138-97bf-678026aa6098 service nova] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] Updated VIF entry in instance network info cache for port d102c4a9-79bd-4968-9a16-9eedcbce0056. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:13:25 user nova-compute[82479]: DEBUG nova.network.neutron [req-0387e40a-b1a1-4f7e-bcf4-ac08324c28b9 req-b79d8688-7e9c-4138-97bf-678026aa6098 service nova] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] Updating instance_info_cache with network_info: [{"id": "d102c4a9-79bd-4968-9a16-9eedcbce0056", "address": "fa:16:3e:c1:dc:21", "network": {"id": "e3acf139-a0c8-4b33-aae5-26131d3dccb5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1150180978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "67e9bf71f0644907979ec775c62a0b39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd102c4a9-79", "ovs_interfaceid": "d102c4a9-79bd-4968-9a16-9eedcbce0056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:13:25 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0387e40a-b1a1-4f7e-bcf4-ac08324c28b9 req-b79d8688-7e9c-4138-97bf-678026aa6098 service nova] Releasing lock "refresh_cache-13860c45-6a4b-48ea-9d0f-d50656585637" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:13:26 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:13:27 user nova-compute[82479]: DEBUG nova.compute.manager [req-cdf8ae8f-9662-44e8-ae49-77ddb383643b req-574395f3-23b6-40be-a739-9db52082b1ed service nova] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] Received event network-vif-plugged-d102c4a9-79bd-4968-9a16-9eedcbce0056 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:13:27 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-cdf8ae8f-9662-44e8-ae49-77ddb383643b req-574395f3-23b6-40be-a739-9db52082b1ed service nova] Acquiring lock "13860c45-6a4b-48ea-9d0f-d50656585637-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:13:27 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-cdf8ae8f-9662-44e8-ae49-77ddb383643b req-574395f3-23b6-40be-a739-9db52082b1ed service nova] Lock "13860c45-6a4b-48ea-9d0f-d50656585637-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:13:27 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-cdf8ae8f-9662-44e8-ae49-77ddb383643b req-574395f3-23b6-40be-a739-9db52082b1ed service nova] Lock "13860c45-6a4b-48ea-9d0f-d50656585637-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:13:27 user nova-compute[82479]: DEBUG nova.compute.manager [req-cdf8ae8f-9662-44e8-ae49-77ddb383643b req-574395f3-23b6-40be-a739-9db52082b1ed service nova] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] No waiting events found dispatching network-vif-plugged-d102c4a9-79bd-4968-9a16-9eedcbce0056 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:13:27 user nova-compute[82479]: WARNING nova.compute.manager [req-cdf8ae8f-9662-44e8-ae49-77ddb383643b req-574395f3-23b6-40be-a739-9db52082b1ed service nova] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] Received unexpected event network-vif-plugged-d102c4a9-79bd-4968-9a16-9eedcbce0056 for instance with vm_state building and task_state spawning.
Apr 14 00:13:27 user nova-compute[82479]: DEBUG nova.compute.manager [req-cdf8ae8f-9662-44e8-ae49-77ddb383643b req-574395f3-23b6-40be-a739-9db52082b1ed service nova] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] Received event network-vif-plugged-d102c4a9-79bd-4968-9a16-9eedcbce0056 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:13:27 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-cdf8ae8f-9662-44e8-ae49-77ddb383643b req-574395f3-23b6-40be-a739-9db52082b1ed service nova] Acquiring lock "13860c45-6a4b-48ea-9d0f-d50656585637-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:13:27 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-cdf8ae8f-9662-44e8-ae49-77ddb383643b req-574395f3-23b6-40be-a739-9db52082b1ed service nova] Lock "13860c45-6a4b-48ea-9d0f-d50656585637-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:13:27 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-cdf8ae8f-9662-44e8-ae49-77ddb383643b req-574395f3-23b6-40be-a739-9db52082b1ed service nova] Lock "13860c45-6a4b-48ea-9d0f-d50656585637-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:13:27 user nova-compute[82479]: DEBUG nova.compute.manager [req-cdf8ae8f-9662-44e8-ae49-77ddb383643b req-574395f3-23b6-40be-a739-9db52082b1ed service nova] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] No waiting events found dispatching network-vif-plugged-d102c4a9-79bd-4968-9a16-9eedcbce0056 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:13:27 user nova-compute[82479]: WARNING nova.compute.manager [req-cdf8ae8f-9662-44e8-ae49-77ddb383643b req-574395f3-23b6-40be-a739-9db52082b1ed service nova] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] Received unexpected event network-vif-plugged-d102c4a9-79bd-4968-9a16-9eedcbce0056 for instance with vm_state building and task_state spawning.
Apr 14 00:13:27 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681431207.368425, 13860c45-6a4b-48ea-9d0f-d50656585637 => Resumed> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:13:27 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] VM Resumed (Lifecycle Event)
Apr 14 00:13:27 user nova-compute[82479]: DEBUG nova.compute.manager [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] Instance event wait completed in 0 seconds for  {{(pid=82479) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 00:13:27 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] Guest created on hypervisor {{(pid=82479) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 00:13:27 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] Instance spawned successfully.
Apr 14 00:13:27 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 00:13:27 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:13:27 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:13:27 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] Found default for hw_cdrom_bus of ide {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:13:27 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] Found default for hw_disk_bus of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:13:27 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] Found default for hw_input_bus of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:13:27 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] Found default for hw_pointer_model of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:13:27 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] Found default for hw_video_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:13:27 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] Found default for hw_vif_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:13:27 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:13:27 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681431207.3694792, 13860c45-6a4b-48ea-9d0f-d50656585637 => Started> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:13:27 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] VM Started (Lifecycle Event)
Apr 14 00:13:27 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:13:27 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:13:27 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:13:27 user nova-compute[82479]: INFO nova.compute.manager [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] Took 6.94 seconds to spawn the instance on the hypervisor.
Apr 14 00:13:27 user nova-compute[82479]: DEBUG nova.compute.manager [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:13:27 user nova-compute[82479]: INFO nova.compute.manager [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] Took 7.77 seconds to build instance.
Apr 14 00:13:27 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e1b1bfee-e4ae-4171-81dc-7dc1385a7685 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lock "13860c45-6a4b-48ea-9d0f-d50656585637" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.878s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:13:28 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:13:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:13:33 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:13:33 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:13:36 user nova-compute[82479]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681431201.9075444, 11c3384a-e699-4b10-9f8b-861291e96465 => Stopped> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:13:36 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] VM Stopped (Lifecycle Event)
Apr 14 00:13:36 user nova-compute[82479]: DEBUG nova.compute.manager [None req-abf21353-a139-4a61-9320-0f79221422d5 None None] [instance: 11c3384a-e699-4b10-9f8b-861291e96465] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:13:37 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Acquiring lock "7553ffb8-704b-4b9c-8a15-13357f4ac9e7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:13:37 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Lock "7553ffb8-704b-4b9c-8a15-13357f4ac9e7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:13:37 user nova-compute[82479]: DEBUG nova.compute.manager [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] Starting instance... {{(pid=82479) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 00:13:37 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:13:37 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:13:37 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82479) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 00:13:37 user nova-compute[82479]: INFO nova.compute.claims [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] Claim successful on node user
Apr 14 00:13:38 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:13:38 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:13:38 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.439s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:13:38 user nova-compute[82479]: DEBUG nova.compute.manager [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] Start building networks asynchronously for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 00:13:38 user nova-compute[82479]: DEBUG nova.compute.manager [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] Allocating IP information in the background. {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 00:13:38 user nova-compute[82479]: DEBUG nova.network.neutron [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] allocate_for_instance() {{(pid=82479) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 00:13:38 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 00:13:38 user nova-compute[82479]: DEBUG nova.compute.manager [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] Start building block device mappings for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 00:13:38 user nova-compute[82479]: DEBUG nova.compute.manager [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] Start spawning the instance on the hypervisor. {{(pid=82479) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 00:13:38 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] Creating instance directory {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 00:13:38 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] Creating image(s)
Apr 14 00:13:38 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Acquiring lock "/opt/stack/data/nova/instances/7553ffb8-704b-4b9c-8a15-13357f4ac9e7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:13:38 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Lock "/opt/stack/data/nova/instances/7553ffb8-704b-4b9c-8a15-13357f4ac9e7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:13:38 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Lock "/opt/stack/data/nova/instances/7553ffb8-704b-4b9c-8a15-13357f4ac9e7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:13:38 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:13:38 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:13:38 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.139s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:13:38 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Acquiring lock "3e200e101633f2016e569ae4c0a352380507d1e4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:13:38 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Lock "3e200e101633f2016e569ae4c0a352380507d1e4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:13:38 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:13:38 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.144s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:13:38 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/7553ffb8-704b-4b9c-8a15-13357f4ac9e7/disk 1073741824 {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:13:38 user nova-compute[82479]: DEBUG nova.policy [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bb07ce4305014dfaacd6283e4fcab068', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d9d27c26e8e4b529040d8909aec1a04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82479) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 00:13:38 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/7553ffb8-704b-4b9c-8a15-13357f4ac9e7/disk 1073741824" returned: 0 in 0.061s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:13:38 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Lock "3e200e101633f2016e569ae4c0a352380507d1e4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.210s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:13:38 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:13:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.147s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:13:39 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7553ffb8-704b-4b9c-8a15-13357f4ac9e7/disk. size=1073741824 {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 00:13:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7553ffb8-704b-4b9c-8a15-13357f4ac9e7/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:13:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7553ffb8-704b-4b9c-8a15-13357f4ac9e7/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:13:39 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Cannot resize image /opt/stack/data/nova/instances/7553ffb8-704b-4b9c-8a15-13357f4ac9e7/disk to a smaller size. {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 00:13:39 user nova-compute[82479]: DEBUG nova.objects.instance [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Lazy-loading 'migration_context' on Instance uuid 7553ffb8-704b-4b9c-8a15-13357f4ac9e7 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:13:39 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] Created local disks {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 00:13:39 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] Ensure instance console log exists: /opt/stack/data/nova/instances/7553ffb8-704b-4b9c-8a15-13357f4ac9e7/console.log {{(pid=82479) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 00:13:39 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:13:39 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:13:39 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:13:40 user nova-compute[82479]: DEBUG nova.network.neutron [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] Successfully created port: b4182f27-1858-4ce4-abfb-83ccbc0ac556 {{(pid=82479) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 00:13:40 user nova-compute[82479]: DEBUG nova.network.neutron [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] Successfully updated port: b4182f27-1858-4ce4-abfb-83ccbc0ac556 {{(pid=82479) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 00:13:40 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Acquiring lock "refresh_cache-7553ffb8-704b-4b9c-8a15-13357f4ac9e7" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:13:40 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Acquired lock "refresh_cache-7553ffb8-704b-4b9c-8a15-13357f4ac9e7" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:13:40 user nova-compute[82479]: DEBUG nova.network.neutron [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 00:13:40 user nova-compute[82479]: DEBUG nova.compute.manager [req-b2614126-4f26-48e6-8d76-c3ce8730f7f9 req-8384409d-61d8-415a-8dfc-e983cf725dc9 service nova] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] Received event network-changed-b4182f27-1858-4ce4-abfb-83ccbc0ac556 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:13:40 user nova-compute[82479]: DEBUG nova.compute.manager [req-b2614126-4f26-48e6-8d76-c3ce8730f7f9 req-8384409d-61d8-415a-8dfc-e983cf725dc9 service nova] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] Refreshing instance network info cache due to event network-changed-b4182f27-1858-4ce4-abfb-83ccbc0ac556. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:13:40 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-b2614126-4f26-48e6-8d76-c3ce8730f7f9 req-8384409d-61d8-415a-8dfc-e983cf725dc9 service nova] Acquiring lock "refresh_cache-7553ffb8-704b-4b9c-8a15-13357f4ac9e7" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:13:40 user nova-compute[82479]: DEBUG nova.network.neutron [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] Instance cache missing network info. {{(pid=82479) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 00:13:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-adec964d-ecff-49cd-a5a7-0206915d47ba tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Acquiring lock "493c65ce-aceb-4273-926e-d3633e676008" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:13:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-adec964d-ecff-49cd-a5a7-0206915d47ba tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "493c65ce-aceb-4273-926e-d3633e676008" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:13:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-adec964d-ecff-49cd-a5a7-0206915d47ba tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Acquiring lock "493c65ce-aceb-4273-926e-d3633e676008-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:13:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-adec964d-ecff-49cd-a5a7-0206915d47ba tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "493c65ce-aceb-4273-926e-d3633e676008-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:13:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-adec964d-ecff-49cd-a5a7-0206915d47ba tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "493c65ce-aceb-4273-926e-d3633e676008-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:13:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:13:41 user nova-compute[82479]: INFO nova.compute.manager [None req-adec964d-ecff-49cd-a5a7-0206915d47ba tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 493c65ce-aceb-4273-926e-d3633e676008] Terminating instance
Apr 14 00:13:41 user nova-compute[82479]: DEBUG nova.compute.manager [None req-adec964d-ecff-49cd-a5a7-0206915d47ba tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 493c65ce-aceb-4273-926e-d3633e676008] Start destroying the instance on the hypervisor. {{(pid=82479) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 00:13:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:13:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:13:41 user nova-compute[82479]: DEBUG nova.network.neutron [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] Updating instance_info_cache with network_info: [{"id": "b4182f27-1858-4ce4-abfb-83ccbc0ac556", "address": "fa:16:3e:f2:0b:5e", "network": {"id": "a7c293b2-01c9-43bb-99b1-fd78cdf3b101", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ccfc655ef7b947398980b9772e4864df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4182f27-18", "ovs_interfaceid": "b4182f27-1858-4ce4-abfb-83ccbc0ac556", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:13:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Releasing lock "refresh_cache-7553ffb8-704b-4b9c-8a15-13357f4ac9e7" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:13:41 user nova-compute[82479]: DEBUG nova.compute.manager [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] Instance network_info: |[{"id": "b4182f27-1858-4ce4-abfb-83ccbc0ac556", "address": "fa:16:3e:f2:0b:5e", "network": {"id": "a7c293b2-01c9-43bb-99b1-fd78cdf3b101", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ccfc655ef7b947398980b9772e4864df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4182f27-18", "ovs_interfaceid": "b4182f27-1858-4ce4-abfb-83ccbc0ac556", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 00:13:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-b2614126-4f26-48e6-8d76-c3ce8730f7f9 req-8384409d-61d8-415a-8dfc-e983cf725dc9 service nova] Acquired lock "refresh_cache-7553ffb8-704b-4b9c-8a15-13357f4ac9e7" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:13:41 user nova-compute[82479]: DEBUG nova.network.neutron [req-b2614126-4f26-48e6-8d76-c3ce8730f7f9 req-8384409d-61d8-415a-8dfc-e983cf725dc9 service nova] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] Refreshing network info cache for port b4182f27-1858-4ce4-abfb-83ccbc0ac556 {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:13:41 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] Start _get_guest_xml network_info=[{"id": "b4182f27-1858-4ce4-abfb-83ccbc0ac556", "address": "fa:16:3e:f2:0b:5e", "network": {"id": "a7c293b2-01c9-43bb-99b1-fd78cdf3b101", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ccfc655ef7b947398980b9772e4864df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4182f27-18", "ovs_interfaceid": "b4182f27-1858-4ce4-abfb-83ccbc0ac556", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 00:13:41 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:13:41 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:13:41 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82479) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 00:13:41 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T00:02:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 00:13:41 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Flavor limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 00:13:41 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Image limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 00:13:41 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Flavor pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 00:13:41 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Image pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 00:13:41 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 00:13:41 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 00:13:41 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 00:13:41 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Got 1 possible topologies {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 00:13:41 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 00:13:41 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 00:13:41 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:13:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-749728094',display_name='tempest-VolumesNegativeTest-instance-749728094',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-749728094',id=23,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3d9d27c26e8e4b529040d8909aec1a04',ramdisk_id='',reservation_id='r-3iyh0jnd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1085100121',owner_user_name='tempest-VolumesNegativeTest-1085100121-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:13:39Z,user_data=None,user_id='bb07ce4305014dfaacd6283e4fcab068',uuid=7553ffb8-704b-4b9c-8a15-13357f4ac9e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4182f27-1858-4ce4-abfb-83ccbc0ac556", "address": "fa:16:3e:f2:0b:5e", "network": {"id": "a7c293b2-01c9-43bb-99b1-fd78cdf3b101", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ccfc655ef7b947398980b9772e4864df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4182f27-18", "ovs_interfaceid": "b4182f27-1858-4ce4-abfb-83ccbc0ac556", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82479) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 00:13:41 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Converting VIF {"id": "b4182f27-1858-4ce4-abfb-83ccbc0ac556", "address": "fa:16:3e:f2:0b:5e", "network": {"id": "a7c293b2-01c9-43bb-99b1-fd78cdf3b101", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ccfc655ef7b947398980b9772e4864df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4182f27-18", "ovs_interfaceid": "b4182f27-1858-4ce4-abfb-83ccbc0ac556", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:13:41 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:0b:5e,bridge_name='br-int',has_traffic_filtering=True,id=b4182f27-1858-4ce4-abfb-83ccbc0ac556,network=Network(a7c293b2-01c9-43bb-99b1-fd78cdf3b101),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4182f27-18') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:13:41 user nova-compute[82479]: DEBUG nova.objects.instance [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Lazy-loading 'pci_devices' on Instance uuid 7553ffb8-704b-4b9c-8a15-13357f4ac9e7 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:13:41 user nova-compute[82479]: DEBUG nova.compute.manager [req-f89db15b-810d-4a8b-96af-bd90ca567bb0 req-d78eced0-2c94-4eda-b03e-0e34dd35beea service nova] [instance: 493c65ce-aceb-4273-926e-d3633e676008] Received event network-vif-unplugged-6f4cb2f5-fcb3-4349-b8a6-ec85658ffe5b {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:13:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-f89db15b-810d-4a8b-96af-bd90ca567bb0 req-d78eced0-2c94-4eda-b03e-0e34dd35beea service nova] Acquiring lock "493c65ce-aceb-4273-926e-d3633e676008-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:13:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-f89db15b-810d-4a8b-96af-bd90ca567bb0 req-d78eced0-2c94-4eda-b03e-0e34dd35beea service nova] Lock "493c65ce-aceb-4273-926e-d3633e676008-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:13:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-f89db15b-810d-4a8b-96af-bd90ca567bb0 req-d78eced0-2c94-4eda-b03e-0e34dd35beea service nova] Lock "493c65ce-aceb-4273-926e-d3633e676008-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:13:41 user nova-compute[82479]: DEBUG nova.compute.manager [req-f89db15b-810d-4a8b-96af-bd90ca567bb0 req-d78eced0-2c94-4eda-b03e-0e34dd35beea service nova] [instance: 493c65ce-aceb-4273-926e-d3633e676008] No waiting events found dispatching network-vif-unplugged-6f4cb2f5-fcb3-4349-b8a6-ec85658ffe5b {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:13:41 user nova-compute[82479]: DEBUG nova.compute.manager [req-f89db15b-810d-4a8b-96af-bd90ca567bb0 req-d78eced0-2c94-4eda-b03e-0e34dd35beea service nova] [instance: 493c65ce-aceb-4273-926e-d3633e676008] Received event network-vif-unplugged-6f4cb2f5-fcb3-4349-b8a6-ec85658ffe5b for instance with task_state deleting. {{(pid=82479) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 00:13:41 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] End _get_guest_xml xml=<domain type="kvm">
Apr 14 00:13:41 user nova-compute[82479]:   <uuid>7553ffb8-704b-4b9c-8a15-13357f4ac9e7</uuid>
Apr 14 00:13:41 user nova-compute[82479]:   <name>instance-00000017</name>
Apr 14 00:13:41 user nova-compute[82479]:   <memory>131072</memory>
Apr 14 00:13:41 user nova-compute[82479]:   <vcpu>1</vcpu>
Apr 14 00:13:41 user nova-compute[82479]:   <metadata>
Apr 14 00:13:41 user nova-compute[82479]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 00:13:41 user nova-compute[82479]:       <nova:package version="0.0.0"/>
Apr 14 00:13:41 user nova-compute[82479]:       <nova:name>tempest-VolumesNegativeTest-instance-749728094</nova:name>
Apr 14 00:13:41 user nova-compute[82479]:       <nova:creationTime>2023-04-14 00:13:41</nova:creationTime>
Apr 14 00:13:41 user nova-compute[82479]:       <nova:flavor name="m1.nano">
Apr 14 00:13:41 user nova-compute[82479]:         <nova:memory>128</nova:memory>
Apr 14 00:13:41 user nova-compute[82479]:         <nova:disk>1</nova:disk>
Apr 14 00:13:41 user nova-compute[82479]:         <nova:swap>0</nova:swap>
Apr 14 00:13:41 user nova-compute[82479]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 00:13:41 user nova-compute[82479]:         <nova:vcpus>1</nova:vcpus>
Apr 14 00:13:41 user nova-compute[82479]:       </nova:flavor>
Apr 14 00:13:41 user nova-compute[82479]:       <nova:owner>
Apr 14 00:13:41 user nova-compute[82479]:         <nova:user uuid="bb07ce4305014dfaacd6283e4fcab068">tempest-VolumesNegativeTest-1085100121-project-member</nova:user>
Apr 14 00:13:41 user nova-compute[82479]:         <nova:project uuid="3d9d27c26e8e4b529040d8909aec1a04">tempest-VolumesNegativeTest-1085100121</nova:project>
Apr 14 00:13:41 user nova-compute[82479]:       </nova:owner>
Apr 14 00:13:41 user nova-compute[82479]:       <nova:root type="image" uuid="6db62068-7278-4cd8-b41f-d0140d89e199"/>
Apr 14 00:13:41 user nova-compute[82479]:       <nova:ports>
Apr 14 00:13:41 user nova-compute[82479]:         <nova:port uuid="b4182f27-1858-4ce4-abfb-83ccbc0ac556">
Apr 14 00:13:41 user nova-compute[82479]:           <nova:ip type="fixed" address="192.168.233.236" ipVersion="4"/>
Apr 14 00:13:41 user nova-compute[82479]:         </nova:port>
Apr 14 00:13:41 user nova-compute[82479]:       </nova:ports>
Apr 14 00:13:41 user nova-compute[82479]:     </nova:instance>
Apr 14 00:13:41 user nova-compute[82479]:   </metadata>
Apr 14 00:13:41 user nova-compute[82479]:   <sysinfo type="smbios">
Apr 14 00:13:41 user nova-compute[82479]:     <system>
Apr 14 00:13:41 user nova-compute[82479]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 00:13:41 user nova-compute[82479]:       <entry name="product">OpenStack Nova</entry>
Apr 14 00:13:41 user nova-compute[82479]:       <entry name="version">0.0.0</entry>
Apr 14 00:13:41 user nova-compute[82479]:       <entry name="serial">7553ffb8-704b-4b9c-8a15-13357f4ac9e7</entry>
Apr 14 00:13:41 user nova-compute[82479]:       <entry name="uuid">7553ffb8-704b-4b9c-8a15-13357f4ac9e7</entry>
Apr 14 00:13:41 user nova-compute[82479]:       <entry name="family">Virtual Machine</entry>
Apr 14 00:13:41 user nova-compute[82479]:     </system>
Apr 14 00:13:41 user nova-compute[82479]:   </sysinfo>
Apr 14 00:13:41 user nova-compute[82479]:   <os>
Apr 14 00:13:41 user nova-compute[82479]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 00:13:41 user nova-compute[82479]:     <boot dev="hd"/>
Apr 14 00:13:41 user nova-compute[82479]:     <smbios mode="sysinfo"/>
Apr 14 00:13:41 user nova-compute[82479]:   </os>
Apr 14 00:13:41 user nova-compute[82479]:   <features>
Apr 14 00:13:41 user nova-compute[82479]:     <acpi/>
Apr 14 00:13:41 user nova-compute[82479]:     <apic/>
Apr 14 00:13:41 user nova-compute[82479]:     <vmcoreinfo/>
Apr 14 00:13:41 user nova-compute[82479]:   </features>
Apr 14 00:13:41 user nova-compute[82479]:   <clock offset="utc">
Apr 14 00:13:41 user nova-compute[82479]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 00:13:41 user nova-compute[82479]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 00:13:41 user nova-compute[82479]:     <timer name="hpet" present="no"/>
Apr 14 00:13:41 user nova-compute[82479]:   </clock>
Apr 14 00:13:41 user nova-compute[82479]:   <cpu mode="custom" match="exact">
Apr 14 00:13:41 user nova-compute[82479]:     <model>Nehalem</model>
Apr 14 00:13:41 user nova-compute[82479]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 00:13:41 user nova-compute[82479]:   </cpu>
Apr 14 00:13:41 user nova-compute[82479]:   <devices>
Apr 14 00:13:41 user nova-compute[82479]:     <disk type="file" device="disk">
Apr 14 00:13:41 user nova-compute[82479]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 00:13:41 user nova-compute[82479]:       <source file="/opt/stack/data/nova/instances/7553ffb8-704b-4b9c-8a15-13357f4ac9e7/disk"/>
Apr 14 00:13:41 user nova-compute[82479]:       <target dev="vda" bus="virtio"/>
Apr 14 00:13:41 user nova-compute[82479]:     </disk>
Apr 14 00:13:41 user nova-compute[82479]:     <interface type="ethernet">
Apr 14 00:13:41 user nova-compute[82479]:       <mac address="fa:16:3e:f2:0b:5e"/>
Apr 14 00:13:41 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:13:41 user nova-compute[82479]:       <mtu size="1442"/>
Apr 14 00:13:41 user nova-compute[82479]:       <target dev="tapb4182f27-18"/>
Apr 14 00:13:41 user nova-compute[82479]:     </interface>
Apr 14 00:13:41 user nova-compute[82479]:     <serial type="pty">
Apr 14 00:13:41 user nova-compute[82479]:       <log file="/opt/stack/data/nova/instances/7553ffb8-704b-4b9c-8a15-13357f4ac9e7/console.log" append="off"/>
Apr 14 00:13:41 user nova-compute[82479]:     </serial>
Apr 14 00:13:41 user nova-compute[82479]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 00:13:41 user nova-compute[82479]:     <video>
Apr 14 00:13:41 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:13:41 user nova-compute[82479]:     </video>
Apr 14 00:13:41 user nova-compute[82479]:     <rng model="virtio">
Apr 14 00:13:41 user nova-compute[82479]:       <backend model="random">/dev/urandom</backend>
Apr 14 00:13:41 user nova-compute[82479]:     </rng>
Apr 14 00:13:41 user nova-compute[82479]:     <controller type="usb" index="0" model="none"/>
Apr 14 00:13:41 user nova-compute[82479]:     <memballoon model="virtio">
Apr 14 00:13:41 user nova-compute[82479]:       <stats period="10"/>
Apr 14 00:13:41 user nova-compute[82479]:     </memballoon>
Apr 14 00:13:41 user nova-compute[82479]:   </devices>
Apr 14 00:13:41 user nova-compute[82479]: </domain>
Apr 14 00:13:41 user nova-compute[82479]:  {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 00:13:41 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:13:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-749728094',display_name='tempest-VolumesNegativeTest-instance-749728094',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-749728094',id=23,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3d9d27c26e8e4b529040d8909aec1a04',ramdisk_id='',reservation_id='r-3iyh0jnd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1085100121',owner_user_name='tempest-VolumesNegativeTest-1085100121-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:13:39Z,user_data=None,user_id='bb07ce4305014dfaacd6283e4fcab068',uuid=7553ffb8-704b-4b9c-8a15-13357f4ac9e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4182f27-1858-4ce4-abfb-83ccbc0ac556", "address": "fa:16:3e:f2:0b:5e", "network": {"id": "a7c293b2-01c9-43bb-99b1-fd78cdf3b101", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ccfc655ef7b947398980b9772e4864df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4182f27-18", "ovs_interfaceid": "b4182f27-1858-4ce4-abfb-83ccbc0ac556", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 00:13:41 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Converting VIF {"id": "b4182f27-1858-4ce4-abfb-83ccbc0ac556", "address": "fa:16:3e:f2:0b:5e", "network": {"id": "a7c293b2-01c9-43bb-99b1-fd78cdf3b101", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ccfc655ef7b947398980b9772e4864df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4182f27-18", "ovs_interfaceid": "b4182f27-1858-4ce4-abfb-83ccbc0ac556", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:13:41 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:0b:5e,bridge_name='br-int',has_traffic_filtering=True,id=b4182f27-1858-4ce4-abfb-83ccbc0ac556,network=Network(a7c293b2-01c9-43bb-99b1-fd78cdf3b101),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4182f27-18') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:13:41 user nova-compute[82479]: DEBUG os_vif [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:0b:5e,bridge_name='br-int',has_traffic_filtering=True,id=b4182f27-1858-4ce4-abfb-83ccbc0ac556,network=Network(a7c293b2-01c9-43bb-99b1-fd78cdf3b101),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4182f27-18') {{(pid=82479) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 00:13:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:13:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:13:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 00:13:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:13:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb4182f27-18, may_exist=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:13:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb4182f27-18, col_values=(('external_ids', {'iface-id': 'b4182f27-1858-4ce4-abfb-83ccbc0ac556', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:0b:5e', 'vm-uuid': '7553ffb8-704b-4b9c-8a15-13357f4ac9e7'}),)) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:13:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:13:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:13:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:13:41 user nova-compute[82479]: INFO os_vif [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:0b:5e,bridge_name='br-int',has_traffic_filtering=True,id=b4182f27-1858-4ce4-abfb-83ccbc0ac556,network=Network(a7c293b2-01c9-43bb-99b1-fd78cdf3b101),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4182f27-18')
Apr 14 00:13:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:13:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:13:41 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:13:41 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] No VIF found with MAC fa:16:3e:f2:0b:5e, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:13:41 user nova-compute[82479]: DEBUG nova.network.neutron [req-b2614126-4f26-48e6-8d76-c3ce8730f7f9 req-8384409d-61d8-415a-8dfc-e983cf725dc9 service nova] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] Updated VIF entry in instance network info cache for port b4182f27-1858-4ce4-abfb-83ccbc0ac556. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:13:41 user nova-compute[82479]: DEBUG nova.network.neutron [req-b2614126-4f26-48e6-8d76-c3ce8730f7f9 req-8384409d-61d8-415a-8dfc-e983cf725dc9 service nova] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] Updating instance_info_cache with network_info: [{"id": "b4182f27-1858-4ce4-abfb-83ccbc0ac556", "address": "fa:16:3e:f2:0b:5e", "network": {"id": "a7c293b2-01c9-43bb-99b1-fd78cdf3b101", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ccfc655ef7b947398980b9772e4864df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4182f27-18", "ovs_interfaceid": "b4182f27-1858-4ce4-abfb-83ccbc0ac556", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:13:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-b2614126-4f26-48e6-8d76-c3ce8730f7f9 req-8384409d-61d8-415a-8dfc-e983cf725dc9 service nova] Releasing lock "refresh_cache-7553ffb8-704b-4b9c-8a15-13357f4ac9e7" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:13:41 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 493c65ce-aceb-4273-926e-d3633e676008] Instance destroyed successfully.
Apr 14 00:13:41 user nova-compute[82479]: DEBUG nova.objects.instance [None req-adec964d-ecff-49cd-a5a7-0206915d47ba tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lazy-loading 'resources' on Instance uuid 493c65ce-aceb-4273-926e-d3633e676008 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:13:41 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-adec964d-ecff-49cd-a5a7-0206915d47ba tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:11:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-558458744',display_name='tempest-VolumesAdminNegativeTest-server-558458744',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-558458744',id=20,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:11:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dffbe999e60a4add9f23c83f9b0a4252',ramdisk_id='',reservation_id='r-2jrouibe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1377720460',owner_user_name='tempest-VolumesAdminNegativeTest-1377720460-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T00:11:53Z,user_data=None,user_id='74d7e3d598e74c288e6a44996303b85e',uuid=493c65ce-aceb-4273-926e-d3633e676008,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f4cb2f5-fcb3-4349-b8a6-ec85658ffe5b", "address": "fa:16:3e:1b:0f:d8", "network": {"id": "49f71fbc-7d65-4cc6-9efe-3918d5dbd51a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2079147315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dffbe999e60a4add9f23c83f9b0a4252", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f4cb2f5-fc", "ovs_interfaceid": "6f4cb2f5-fcb3-4349-b8a6-ec85658ffe5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 00:13:41 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-adec964d-ecff-49cd-a5a7-0206915d47ba tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Converting VIF {"id": "6f4cb2f5-fcb3-4349-b8a6-ec85658ffe5b", "address": "fa:16:3e:1b:0f:d8", "network": {"id": "49f71fbc-7d65-4cc6-9efe-3918d5dbd51a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2079147315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dffbe999e60a4add9f23c83f9b0a4252", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f4cb2f5-fc", "ovs_interfaceid": "6f4cb2f5-fcb3-4349-b8a6-ec85658ffe5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:13:41 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-adec964d-ecff-49cd-a5a7-0206915d47ba tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:0f:d8,bridge_name='br-int',has_traffic_filtering=True,id=6f4cb2f5-fcb3-4349-b8a6-ec85658ffe5b,network=Network(49f71fbc-7d65-4cc6-9efe-3918d5dbd51a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f4cb2f5-fc') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:13:41 user nova-compute[82479]: DEBUG os_vif [None req-adec964d-ecff-49cd-a5a7-0206915d47ba tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:0f:d8,bridge_name='br-int',has_traffic_filtering=True,id=6f4cb2f5-fcb3-4349-b8a6-ec85658ffe5b,network=Network(49f71fbc-7d65-4cc6-9efe-3918d5dbd51a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f4cb2f5-fc') {{(pid=82479) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 00:13:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:13:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6f4cb2f5-fc, bridge=br-int, if_exists=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:13:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:13:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:13:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:13:41 user nova-compute[82479]: INFO os_vif [None req-adec964d-ecff-49cd-a5a7-0206915d47ba tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:0f:d8,bridge_name='br-int',has_traffic_filtering=True,id=6f4cb2f5-fcb3-4349-b8a6-ec85658ffe5b,network=Network(49f71fbc-7d65-4cc6-9efe-3918d5dbd51a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f4cb2f5-fc')
Apr 14 00:13:41 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-adec964d-ecff-49cd-a5a7-0206915d47ba tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 493c65ce-aceb-4273-926e-d3633e676008] Deleting instance files /opt/stack/data/nova/instances/493c65ce-aceb-4273-926e-d3633e676008_del
Apr 14 00:13:41 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-adec964d-ecff-49cd-a5a7-0206915d47ba tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 493c65ce-aceb-4273-926e-d3633e676008] Deletion of /opt/stack/data/nova/instances/493c65ce-aceb-4273-926e-d3633e676008_del complete
Apr 14 00:13:42 user nova-compute[82479]: INFO nova.compute.manager [None req-adec964d-ecff-49cd-a5a7-0206915d47ba tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 493c65ce-aceb-4273-926e-d3633e676008] Took 0.98 seconds to destroy the instance on the hypervisor.
Apr 14 00:13:42 user nova-compute[82479]: DEBUG oslo.service.loopingcall [None req-adec964d-ecff-49cd-a5a7-0206915d47ba tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82479) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 00:13:42 user nova-compute[82479]: DEBUG nova.compute.manager [-] [instance: 493c65ce-aceb-4273-926e-d3633e676008] Deallocating network for instance {{(pid=82479) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 00:13:42 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: 493c65ce-aceb-4273-926e-d3633e676008] deallocate_for_instance() {{(pid=82479) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 00:13:42 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: 493c65ce-aceb-4273-926e-d3633e676008] Updating instance_info_cache with network_info: [] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:13:42 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: 493c65ce-aceb-4273-926e-d3633e676008] Took 0.48 seconds to deallocate network for instance.
Apr 14 00:13:42 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:13:42 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-adec964d-ecff-49cd-a5a7-0206915d47ba tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:13:42 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-adec964d-ecff-49cd-a5a7-0206915d47ba tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:13:42 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:13:42 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-adec964d-ecff-49cd-a5a7-0206915d47ba tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:13:42 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-adec964d-ecff-49cd-a5a7-0206915d47ba tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:13:42 user nova-compute[82479]: DEBUG nova.compute.manager [req-66c38cf8-13d7-47f4-b7ce-9d18d2829491 req-d27f29ea-da6d-4904-9558-ac1ffab07397 service nova] [instance: 493c65ce-aceb-4273-926e-d3633e676008] Received event network-vif-deleted-6f4cb2f5-fcb3-4349-b8a6-ec85658ffe5b {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:13:42 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-adec964d-ecff-49cd-a5a7-0206915d47ba tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.349s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:13:42 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:13:42 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:13:42 user nova-compute[82479]: INFO nova.scheduler.client.report [None req-adec964d-ecff-49cd-a5a7-0206915d47ba tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Deleted allocations for instance 493c65ce-aceb-4273-926e-d3633e676008
Apr 14 00:13:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-adec964d-ecff-49cd-a5a7-0206915d47ba tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "493c65ce-aceb-4273-926e-d3633e676008" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.048s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:13:43 user nova-compute[82479]: DEBUG nova.compute.manager [req-0a547e94-6d5b-4285-8e83-db07bc089b86 req-dd1c447f-162a-4037-a9d7-12fb252ab9e8 service nova] [instance: 493c65ce-aceb-4273-926e-d3633e676008] Received event network-vif-plugged-6f4cb2f5-fcb3-4349-b8a6-ec85658ffe5b {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:13:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0a547e94-6d5b-4285-8e83-db07bc089b86 req-dd1c447f-162a-4037-a9d7-12fb252ab9e8 service nova] Acquiring lock "493c65ce-aceb-4273-926e-d3633e676008-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:13:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0a547e94-6d5b-4285-8e83-db07bc089b86 req-dd1c447f-162a-4037-a9d7-12fb252ab9e8 service nova] Lock "493c65ce-aceb-4273-926e-d3633e676008-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:13:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0a547e94-6d5b-4285-8e83-db07bc089b86 req-dd1c447f-162a-4037-a9d7-12fb252ab9e8 service nova] Lock "493c65ce-aceb-4273-926e-d3633e676008-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:13:43 user nova-compute[82479]: DEBUG nova.compute.manager [req-0a547e94-6d5b-4285-8e83-db07bc089b86 req-dd1c447f-162a-4037-a9d7-12fb252ab9e8 service nova] [instance: 493c65ce-aceb-4273-926e-d3633e676008] No waiting events found dispatching network-vif-plugged-6f4cb2f5-fcb3-4349-b8a6-ec85658ffe5b {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:13:43 user nova-compute[82479]: WARNING nova.compute.manager [req-0a547e94-6d5b-4285-8e83-db07bc089b86 req-dd1c447f-162a-4037-a9d7-12fb252ab9e8 service nova] [instance: 493c65ce-aceb-4273-926e-d3633e676008] Received unexpected event network-vif-plugged-6f4cb2f5-fcb3-4349-b8a6-ec85658ffe5b for instance with vm_state deleted and task_state None.
Apr 14 00:13:43 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:13:43 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:13:43 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:13:44 user nova-compute[82479]: DEBUG nova.compute.manager [req-1147743b-0c17-4a09-b7b3-e7ef98cccb37 req-b2ba8bc7-6053-47dc-8576-1be2a800495d service nova] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] Received event network-vif-plugged-b4182f27-1858-4ce4-abfb-83ccbc0ac556 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:13:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-1147743b-0c17-4a09-b7b3-e7ef98cccb37 req-b2ba8bc7-6053-47dc-8576-1be2a800495d service nova] Acquiring lock "7553ffb8-704b-4b9c-8a15-13357f4ac9e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:13:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-1147743b-0c17-4a09-b7b3-e7ef98cccb37 req-b2ba8bc7-6053-47dc-8576-1be2a800495d service nova] Lock "7553ffb8-704b-4b9c-8a15-13357f4ac9e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:13:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-1147743b-0c17-4a09-b7b3-e7ef98cccb37 req-b2ba8bc7-6053-47dc-8576-1be2a800495d service nova] Lock "7553ffb8-704b-4b9c-8a15-13357f4ac9e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:13:44 user nova-compute[82479]: DEBUG nova.compute.manager [req-1147743b-0c17-4a09-b7b3-e7ef98cccb37 req-b2ba8bc7-6053-47dc-8576-1be2a800495d service nova] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] No waiting events found dispatching network-vif-plugged-b4182f27-1858-4ce4-abfb-83ccbc0ac556 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:13:44 user nova-compute[82479]: WARNING nova.compute.manager [req-1147743b-0c17-4a09-b7b3-e7ef98cccb37 req-b2ba8bc7-6053-47dc-8576-1be2a800495d service nova] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] Received unexpected event network-vif-plugged-b4182f27-1858-4ce4-abfb-83ccbc0ac556 for instance with vm_state building and task_state spawning.
Apr 14 00:13:44 user nova-compute[82479]: DEBUG nova.compute.manager [req-1147743b-0c17-4a09-b7b3-e7ef98cccb37 req-b2ba8bc7-6053-47dc-8576-1be2a800495d service nova] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] Received event network-vif-plugged-b4182f27-1858-4ce4-abfb-83ccbc0ac556 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:13:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-1147743b-0c17-4a09-b7b3-e7ef98cccb37 req-b2ba8bc7-6053-47dc-8576-1be2a800495d service nova] Acquiring lock "7553ffb8-704b-4b9c-8a15-13357f4ac9e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:13:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-1147743b-0c17-4a09-b7b3-e7ef98cccb37 req-b2ba8bc7-6053-47dc-8576-1be2a800495d service nova] Lock "7553ffb8-704b-4b9c-8a15-13357f4ac9e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:13:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-1147743b-0c17-4a09-b7b3-e7ef98cccb37 req-b2ba8bc7-6053-47dc-8576-1be2a800495d service nova] Lock "7553ffb8-704b-4b9c-8a15-13357f4ac9e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:13:44 user nova-compute[82479]: DEBUG nova.compute.manager [req-1147743b-0c17-4a09-b7b3-e7ef98cccb37 req-b2ba8bc7-6053-47dc-8576-1be2a800495d service nova] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] No waiting events found dispatching network-vif-plugged-b4182f27-1858-4ce4-abfb-83ccbc0ac556 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:13:44 user nova-compute[82479]: WARNING nova.compute.manager [req-1147743b-0c17-4a09-b7b3-e7ef98cccb37 req-b2ba8bc7-6053-47dc-8576-1be2a800495d service nova] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] Received unexpected event network-vif-plugged-b4182f27-1858-4ce4-abfb-83ccbc0ac556 for instance with vm_state building and task_state spawning.
Apr 14 00:13:45 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681431225.026987, 7553ffb8-704b-4b9c-8a15-13357f4ac9e7 => Resumed> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:13:45 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] VM Resumed (Lifecycle Event)
Apr 14 00:13:45 user nova-compute[82479]: DEBUG nova.compute.manager [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] Instance event wait completed in 0 seconds for  {{(pid=82479) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 00:13:45 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] Guest created on hypervisor {{(pid=82479) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 00:13:45 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] Instance spawned successfully.
Apr 14 00:13:45 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 00:13:45 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:13:45 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:13:45 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] Found default for hw_cdrom_bus of ide {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:13:45 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] Found default for hw_disk_bus of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:13:45 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] Found default for hw_input_bus of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:13:45 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] Found default for hw_pointer_model of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:13:45 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] Found default for hw_video_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:13:45 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] Found default for hw_vif_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:13:45 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:13:45 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681431225.0296881, 7553ffb8-704b-4b9c-8a15-13357f4ac9e7 => Started> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:13:45 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] VM Started (Lifecycle Event)
Apr 14 00:13:45 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:13:45 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:13:45 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:13:45 user nova-compute[82479]: INFO nova.compute.manager [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] Took 6.50 seconds to spawn the instance on the hypervisor.
Apr 14 00:13:45 user nova-compute[82479]: DEBUG nova.compute.manager [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:13:45 user nova-compute[82479]: INFO nova.compute.manager [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] Took 7.25 seconds to build instance.
Apr 14 00:13:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-bc693910-853b-423c-8766-8d96cd7bcf4f tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Lock "7553ffb8-704b-4b9c-8a15-13357f4ac9e7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.341s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:13:45 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:13:45 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:13:45 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Starting heal instance info cache {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 00:13:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "refresh_cache-b3475e7e-ceb4-452a-a045-dbf43c5944dd" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:13:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquired lock "refresh_cache-b3475e7e-ceb4-452a-a045-dbf43c5944dd" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:13:45 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Forcefully refreshing network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 00:13:46 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:13:46 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Updating instance_info_cache with network_info: [{"id": "617f05b8-c04e-4abf-b4e5-a0234209624a", "address": "fa:16:3e:f9:fd:1a", "network": {"id": "cb8c9bb1-a885-486d-aa6a-de600bc01c2e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1676259779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8663ccad9047f4b11b9ae0646c287a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617f05b8-c0", "ovs_interfaceid": "617f05b8-c04e-4abf-b4e5-a0234209624a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:13:46 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Releasing lock "refresh_cache-b3475e7e-ceb4-452a-a045-dbf43c5944dd" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:13:46 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Updated the network info_cache for instance {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 00:13:46 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:13:46 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:13:49 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:13:49 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:13:49 user nova-compute[82479]: DEBUG nova.objects.instance [None req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lazy-loading 'flavor' on Instance uuid b3475e7e-ceb4-452a-a045-dbf43c5944dd {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:13:49 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:13:49 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:13:49 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:13:49 user nova-compute[82479]: INFO nova.compute.manager [None req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Attaching volume 94d1d134-5857-4a7c-bf52-bd818e828f3e to /dev/vdb
Apr 14 00:13:49 user nova-compute[82479]: DEBUG os_brick.utils [None req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:13:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:13:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:13:49 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ca2bcd-1811-4a83-889f-111f3fa7baf0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fec92fcfdd3\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:13:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:13:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:13:49 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[406cb081-da0e-466a-b615-919551490dec]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:13:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:13:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:13:49 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ad86bd-e830-4d93-a597-67cffb044040]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:13:49 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[034af1ab-6bd9-4eed-9b0f-6380bc092690]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:13:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Running cmd (subprocess): nvme version {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:13:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] 'nvme version' failed. Not Retrying. {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:13:49 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.nvmeof [None req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] nvme not present on system {{(pid=82479) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 00:13:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:13:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:13:49 user nova-compute[82479]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 00:13:49 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[7463dd79-aff7-4530-a14b-99321116d300]: (4, '') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:13:49 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82479) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 00:13:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 00:13:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] LIGHTOS: no hostnqn found. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 00:13:50 user nova-compute[82479]: DEBUG os_brick.utils [None req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fec92fcfdd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:13:50 user nova-compute[82479]: DEBUG nova.virt.block_device [None req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Updating existing volume attachment record: 53719744-a818-4d6a-ad68-ce4423c988fb {{(pid=82479) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 00:13:50 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:13:50 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:13:50 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:13:50 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:13:50 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Auditing locally available compute resources for user (node: user) {{(pid=82479) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 00:13:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13860c45-6a4b-48ea-9d0f-d50656585637/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:13:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13860c45-6a4b-48ea-9d0f-d50656585637/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:13:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13860c45-6a4b-48ea-9d0f-d50656585637/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:13:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13860c45-6a4b-48ea-9d0f-d50656585637/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:13:51 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:13:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8feba40a-03c7-4c60-b862-ee14fb8c9b05/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:13:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8feba40a-03c7-4c60-b862-ee14fb8c9b05/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:13:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8feba40a-03c7-4c60-b862-ee14fb8c9b05/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:13:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8feba40a-03c7-4c60-b862-ee14fb8c9b05/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:13:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01a65362-36ea-4817-8e83-f75d6daf808b/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:13:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01a65362-36ea-4817-8e83-f75d6daf808b/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:13:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01a65362-36ea-4817-8e83-f75d6daf808b/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:13:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01a65362-36ea-4817-8e83-f75d6daf808b/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:13:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk.rescue --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:13:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:13:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk.rescue --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:13:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:13:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:13:52 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:13:52 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:13:52 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:13:52 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:13:52 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:13:52 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:13:52 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:13:52 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:13:52 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:13:52 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:13:52 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:13:52 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:13:52 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7553ffb8-704b-4b9c-8a15-13357f4ac9e7/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:13:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7553ffb8-704b-4b9c-8a15-13357f4ac9e7/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:13:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7553ffb8-704b-4b9c-8a15-13357f4ac9e7/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:13:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7553ffb8-704b-4b9c-8a15-13357f4ac9e7/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:13:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:13:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:13:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:13:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:13:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c35b78e-41e3-40c1-b265-8e1fa5e859c6/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:13:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c35b78e-41e3-40c1-b265-8e1fa5e859c6/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:13:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c35b78e-41e3-40c1-b265-8e1fa5e859c6/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:13:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c35b78e-41e3-40c1-b265-8e1fa5e859c6/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:13:54 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:13:54 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:13:54 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Hypervisor/Node resource view: name=user free_ram=7626MB free_disk=26.23270034790039GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82479) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 00:13:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:13:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:13:54 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 23718fd0-58b8-47f9-b1ef-a26a90741ecc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:13:54 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 01a65362-36ea-4817-8e83-f75d6daf808b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:13:54 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance b3475e7e-ceb4-452a-a045-dbf43c5944dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:13:54 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 17c6c147-fb62-4204-a416-792b94d3f7dd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:13:54 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 8feba40a-03c7-4c60-b862-ee14fb8c9b05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:13:54 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:13:54 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:13:54 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 6c35b78e-41e3-40c1-b265-8e1fa5e859c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:13:54 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 13860c45-6a4b-48ea-9d0f-d50656585637 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:13:54 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 7553ffb8-704b-4b9c-8a15-13357f4ac9e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:13:54 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 00:13:54 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 00:13:54 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Calling os-brick to attach iSCSI Volume {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 00:13:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YrRJCHcL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:13:54 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:13:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:13:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:13:54 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:13:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:13:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:13:54 user nova-compute[82479]: INFO os_brick.initiator.connectors.iscsi [None req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 00:13:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e -p 172.16.0.220:3260 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:13:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:13:54 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb4dbfc-fbec-4bc9-907c-dc0098ea2e13]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:13:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 00:13:54 user nova-compute[82479]:  {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:13:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e -p 172.16.0.220:3260 --interface default --op new {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:13:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:13:54 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46fd931-efae-448d-8bd3-262ad68712f3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e] added\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:13:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e] added
Apr 14 00:13:54 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:13:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:13:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:13:54 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[709f5cd5-39ee-4eec-b50c-4a371f5e9215]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:13:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:13:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:13:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:13:54 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[6036fa7b-00aa-4660-a1a0-6663bd7c79bf]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:13:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:13:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YrRJCHcL {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:13:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YrRJCHcL" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:13:54 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[8818ce46-cd1a-41eb-80d5-ca4de0a59f46]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:13:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YrRJCHcL'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:13:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:13:54 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:13:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:13:54 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb911604-74a0-4c7a-9148-509cbac8bdb1]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:13:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:13:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:13:54 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:13:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:13:54 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0383de9-0b37-4580-9b9f-6a68ba8fedbf]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:13:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:13:54 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:13:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:13:54 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:13:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e -p 172.16.0.220:3260 --login {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:13:54 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Compute_service record updated for user:user {{(pid=82479) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 00:13:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.487s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:13:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:13:54 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[a92085e9-1e56-4561-923d-f3dfcb683a8a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:13:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e, portal: 172.16.0.220,3260]
Apr 14 00:13:54 user nova-compute[82479]: Login to [iface: default, target: iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e, portal: 172.16.0.220,3260] successful.
Apr 14 00:13:54 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:13:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:13:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:13:54 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eebc3fd-d2be-4ee4-bdb9-b2f982c5ee0c]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:13:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:13:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:13:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:13:54 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96a39c1-f5ba-4c15-a871-a5e4d6ef8e26]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:13:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:13:54 user nova-compute[82479]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e (non-flash)
Apr 14 00:13:54 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:13:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:13:54 user nova-compute[82479]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e (non-flash)
Apr 14 00:13:54 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:13:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:13:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Connected to 172.16.0.220:3260 {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 00:13:54 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] HCTL ('33', '-', '-', 0) found on session 23 with lun 0 {{(pid=82479) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 00:13:54 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82479) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 00:13:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:13:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:13:54 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81ff76e-282e-4170-8ead-9fc2e2bc6e5a]: (4, ('- - 0', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:13:54 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Searching for a device in session 23 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82479) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 00:13:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YrRJCHcL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 00:13:55 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:13:55 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:13:55 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:13:55 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:13:55 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82479) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 00:13:55 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:13:55 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '23363343733396464', 'path': '/dev/sdb'} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:13:55 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363343733396464', 'path': '/dev/sdb'} {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 00:13:56 user nova-compute[82479]: DEBUG nova.objects.instance [None req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lazy-loading 'flavor' on Instance uuid b3475e7e-ceb4-452a-a045-dbf43c5944dd {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:13:56 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:13:56 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 00:13:56 user nova-compute[82479]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:13:56 user nova-compute[82479]:   <source dev="/dev/sdb"/>
Apr 14 00:13:56 user nova-compute[82479]:   <target dev="vdb" bus="virtio"/>
Apr 14 00:13:56 user nova-compute[82479]:   <serial>94d1d134-5857-4a7c-bf52-bd818e828f3e</serial>
Apr 14 00:13:56 user nova-compute[82479]: </disk>
Apr 14 00:13:56 user nova-compute[82479]:  {{(pid=82479) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 00:13:56 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:13:56 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:13:56 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] No VIF found with MAC fa:16:3e:f9:fd:1a, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:13:56 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.853s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:13:56 user nova-compute[82479]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681431221.9446123, 493c65ce-aceb-4273-926e-d3633e676008 => Stopped> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:13:56 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: 493c65ce-aceb-4273-926e-d3633e676008] VM Stopped (Lifecycle Event)
Apr 14 00:13:56 user nova-compute[82479]: DEBUG nova.compute.manager [None req-3aadc689-6e8d-47c9-b68b-8a546b68c065 None None] [instance: 493c65ce-aceb-4273-926e-d3633e676008] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:13:57 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:13:57 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:13:57 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:13:57 user nova-compute[82479]: DEBUG nova.compute.manager [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Starting instance... {{(pid=82479) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 00:13:57 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:13:57 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:13:57 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82479) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 00:13:57 user nova-compute[82479]: INFO nova.compute.claims [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Claim successful on node user
Apr 14 00:13:57 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:13:57 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:13:57 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.468s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:13:57 user nova-compute[82479]: DEBUG nova.compute.manager [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Start building networks asynchronously for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 00:13:57 user nova-compute[82479]: DEBUG nova.compute.manager [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Allocating IP information in the background. {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 00:13:57 user nova-compute[82479]: DEBUG nova.network.neutron [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] allocate_for_instance() {{(pid=82479) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 00:13:57 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 00:13:57 user nova-compute[82479]: DEBUG nova.compute.manager [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Start building block device mappings for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 00:13:57 user nova-compute[82479]: DEBUG nova.policy [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fb293fdfc658466aaa7134269fa46a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9d67ad2fa4cb9ab309b98f8fe051a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82479) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 00:13:58 user nova-compute[82479]: DEBUG nova.compute.manager [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Start spawning the instance on the hypervisor. {{(pid=82479) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 00:13:58 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Creating instance directory {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 00:13:58 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Creating image(s)
Apr 14 00:13:58 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "/opt/stack/data/nova/instances/e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:13:58 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "/opt/stack/data/nova/instances/e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:13:58 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "/opt/stack/data/nova/instances/e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:13:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:13:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.177s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:13:58 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "3e200e101633f2016e569ae4c0a352380507d1e4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:13:58 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "3e200e101633f2016e569ae4c0a352380507d1e4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:13:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:13:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.147s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:13:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8/disk 1073741824 {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:13:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8/disk 1073741824" returned: 0 in 0.059s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:13:58 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "3e200e101633f2016e569ae4c0a352380507d1e4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.213s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:13:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:13:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.133s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:13:58 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8/disk. size=1073741824 {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 00:13:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:13:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:13:58 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Cannot resize image /opt/stack/data/nova/instances/e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8/disk to a smaller size. {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 00:13:58 user nova-compute[82479]: DEBUG nova.objects.instance [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lazy-loading 'migration_context' on Instance uuid e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:13:58 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Created local disks {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 00:13:58 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Ensure instance console log exists: /opt/stack/data/nova/instances/e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8/console.log {{(pid=82479) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 00:13:58 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:13:58 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:13:58 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:13:58 user nova-compute[82479]: DEBUG nova.network.neutron [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Successfully created port: adb392b2-602f-421d-b26b-1e8f243cacff {{(pid=82479) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 00:13:59 user nova-compute[82479]: DEBUG nova.compute.manager [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Stashing vm_state: active {{(pid=82479) _prep_resize /opt/stack/nova/nova/compute/manager.py:5499}}
Apr 14 00:13:59 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:13:59 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:13:59 user nova-compute[82479]: DEBUG nova.objects.instance [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lazy-loading 'pci_requests' on Instance uuid b3475e7e-ceb4-452a-a045-dbf43c5944dd {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:13:59 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82479) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 00:13:59 user nova-compute[82479]: INFO nova.compute.claims [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Claim successful on node user
Apr 14 00:13:59 user nova-compute[82479]: DEBUG nova.objects.instance [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lazy-loading 'resources' on Instance uuid b3475e7e-ceb4-452a-a045-dbf43c5944dd {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:13:59 user nova-compute[82479]: DEBUG nova.objects.instance [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lazy-loading 'pci_devices' on Instance uuid b3475e7e-ceb4-452a-a045-dbf43c5944dd {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:13:59 user nova-compute[82479]: INFO nova.compute.resource_tracker [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Updating resource usage from migration 0879efd2-53d7-4b3f-bbf4-18105f4ac7bb
Apr 14 00:13:59 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:13:59 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:13:59 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.508s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:13:59 user nova-compute[82479]: INFO nova.compute.manager [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Migrating
Apr 14 00:13:59 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:13:59 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquired lock "compute-rpcapi-router" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:13:59 user nova-compute[82479]: INFO nova.compute.rpcapi [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Apr 14 00:13:59 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Releasing lock "compute-rpcapi-router" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:13:59 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "refresh_cache-b3475e7e-ceb4-452a-a045-dbf43c5944dd" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:13:59 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquired lock "refresh_cache-b3475e7e-ceb4-452a-a045-dbf43c5944dd" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:13:59 user nova-compute[82479]: DEBUG nova.network.neutron [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 00:14:00 user nova-compute[82479]: DEBUG nova.network.neutron [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Successfully updated port: adb392b2-602f-421d-b26b-1e8f243cacff {{(pid=82479) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 00:14:00 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "refresh_cache-e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:14:00 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquired lock "refresh_cache-e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:14:00 user nova-compute[82479]: DEBUG nova.network.neutron [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 00:14:00 user nova-compute[82479]: DEBUG nova.compute.manager [req-0ff51a11-afe6-4ed6-80c5-0949a5dc4210 req-56ca7825-2977-41ea-abd9-c021eb394fbf service nova] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Received event network-changed-adb392b2-602f-421d-b26b-1e8f243cacff {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:14:00 user nova-compute[82479]: DEBUG nova.compute.manager [req-0ff51a11-afe6-4ed6-80c5-0949a5dc4210 req-56ca7825-2977-41ea-abd9-c021eb394fbf service nova] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Refreshing instance network info cache due to event network-changed-adb392b2-602f-421d-b26b-1e8f243cacff. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:14:00 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0ff51a11-afe6-4ed6-80c5-0949a5dc4210 req-56ca7825-2977-41ea-abd9-c021eb394fbf service nova] Acquiring lock "refresh_cache-e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:14:00 user nova-compute[82479]: DEBUG nova.network.neutron [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Instance cache missing network info. {{(pid=82479) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 00:14:00 user nova-compute[82479]: DEBUG nova.network.neutron [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Updating instance_info_cache with network_info: [{"id": "617f05b8-c04e-4abf-b4e5-a0234209624a", "address": "fa:16:3e:f9:fd:1a", "network": {"id": "cb8c9bb1-a885-486d-aa6a-de600bc01c2e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1676259779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8663ccad9047f4b11b9ae0646c287a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617f05b8-c0", "ovs_interfaceid": "617f05b8-c04e-4abf-b4e5-a0234209624a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:14:00 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Releasing lock "refresh_cache-b3475e7e-ceb4-452a-a045-dbf43c5944dd" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:14:01 user nova-compute[82479]: DEBUG nova.network.neutron [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Updating instance_info_cache with network_info: [{"id": "adb392b2-602f-421d-b26b-1e8f243cacff", "address": "fa:16:3e:3f:64:bc", "network": {"id": "6d80f923-8aef-45df-921b-f77ed4ff0e75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-696070096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44c9d67ad2fa4cb9ab309b98f8fe051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadb392b2-60", "ovs_interfaceid": "adb392b2-602f-421d-b26b-1e8f243cacff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:14:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Releasing lock "refresh_cache-e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:14:01 user nova-compute[82479]: DEBUG nova.compute.manager [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Instance network_info: |[{"id": "adb392b2-602f-421d-b26b-1e8f243cacff", "address": "fa:16:3e:3f:64:bc", "network": {"id": "6d80f923-8aef-45df-921b-f77ed4ff0e75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-696070096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44c9d67ad2fa4cb9ab309b98f8fe051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadb392b2-60", "ovs_interfaceid": "adb392b2-602f-421d-b26b-1e8f243cacff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 00:14:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0ff51a11-afe6-4ed6-80c5-0949a5dc4210 req-56ca7825-2977-41ea-abd9-c021eb394fbf service nova] Acquired lock "refresh_cache-e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:14:01 user nova-compute[82479]: DEBUG nova.network.neutron [req-0ff51a11-afe6-4ed6-80c5-0949a5dc4210 req-56ca7825-2977-41ea-abd9-c021eb394fbf service nova] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Refreshing network info cache for port adb392b2-602f-421d-b26b-1e8f243cacff {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:14:01 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Start _get_guest_xml network_info=[{"id": "adb392b2-602f-421d-b26b-1e8f243cacff", "address": "fa:16:3e:3f:64:bc", "network": {"id": "6d80f923-8aef-45df-921b-f77ed4ff0e75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-696070096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44c9d67ad2fa4cb9ab309b98f8fe051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadb392b2-60", "ovs_interfaceid": "adb392b2-602f-421d-b26b-1e8f243cacff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 00:14:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:01 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:14:01 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:14:01 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82479) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 00:14:01 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T00:02:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 00:14:01 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Flavor limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 00:14:01 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Image limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 00:14:01 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Flavor pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 00:14:01 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Image pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 00:14:01 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 00:14:01 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 00:14:01 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 00:14:01 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Got 1 possible topologies {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 00:14:01 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 00:14:01 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 00:14:01 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:13:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1247623601',display_name='tempest-AttachVolumeNegativeTest-server-1247623601',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1247623601',id=24,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLGkLOYcKKntXB8xBUrq5TfkCx1/xNQj4Ksi6k+fzjiqYC04ZpG2CZF3KkB+DY5NBDh2NzjAuCSlSRLBIT2B1CwX+AbHx15ScaMmXWoEIRyWreJeS2PAr2D8ysrfPRBoiQ==',key_name='tempest-keypair-1854176898',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44c9d67ad2fa4cb9ab309b98f8fe051a',ramdisk_id='',reservation_id='r-ounfao1n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-719597397',owner_user_name='tempest-AttachVolumeNegativeTest-719597397-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:13:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb293fdfc658466aaa7134269fa46a7c',uuid=e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "adb392b2-602f-421d-b26b-1e8f243cacff", "address": "fa:16:3e:3f:64:bc", "network": {"id": "6d80f923-8aef-45df-921b-f77ed4ff0e75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-696070096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44c9d67ad2fa4cb9ab309b98f8fe051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadb392b2-60", "ovs_interfaceid": "adb392b2-602f-421d-b26b-1e8f243cacff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82479) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 00:14:01 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Converting VIF {"id": "adb392b2-602f-421d-b26b-1e8f243cacff", "address": "fa:16:3e:3f:64:bc", "network": {"id": "6d80f923-8aef-45df-921b-f77ed4ff0e75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-696070096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44c9d67ad2fa4cb9ab309b98f8fe051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadb392b2-60", "ovs_interfaceid": "adb392b2-602f-421d-b26b-1e8f243cacff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:14:01 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:64:bc,bridge_name='br-int',has_traffic_filtering=True,id=adb392b2-602f-421d-b26b-1e8f243cacff,network=Network(6d80f923-8aef-45df-921b-f77ed4ff0e75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadb392b2-60') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:14:01 user nova-compute[82479]: DEBUG nova.objects.instance [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lazy-loading 'pci_devices' on Instance uuid e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:14:01 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] End _get_guest_xml xml=<domain type="kvm">
Apr 14 00:14:01 user nova-compute[82479]:   <uuid>e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8</uuid>
Apr 14 00:14:01 user nova-compute[82479]:   <name>instance-00000018</name>
Apr 14 00:14:01 user nova-compute[82479]:   <memory>131072</memory>
Apr 14 00:14:01 user nova-compute[82479]:   <vcpu>1</vcpu>
Apr 14 00:14:01 user nova-compute[82479]:   <metadata>
Apr 14 00:14:01 user nova-compute[82479]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 00:14:01 user nova-compute[82479]:       <nova:package version="0.0.0"/>
Apr 14 00:14:01 user nova-compute[82479]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1247623601</nova:name>
Apr 14 00:14:01 user nova-compute[82479]:       <nova:creationTime>2023-04-14 00:14:01</nova:creationTime>
Apr 14 00:14:01 user nova-compute[82479]:       <nova:flavor name="m1.nano">
Apr 14 00:14:01 user nova-compute[82479]:         <nova:memory>128</nova:memory>
Apr 14 00:14:01 user nova-compute[82479]:         <nova:disk>1</nova:disk>
Apr 14 00:14:01 user nova-compute[82479]:         <nova:swap>0</nova:swap>
Apr 14 00:14:01 user nova-compute[82479]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 00:14:01 user nova-compute[82479]:         <nova:vcpus>1</nova:vcpus>
Apr 14 00:14:01 user nova-compute[82479]:       </nova:flavor>
Apr 14 00:14:01 user nova-compute[82479]:       <nova:owner>
Apr 14 00:14:01 user nova-compute[82479]:         <nova:user uuid="fb293fdfc658466aaa7134269fa46a7c">tempest-AttachVolumeNegativeTest-719597397-project-member</nova:user>
Apr 14 00:14:01 user nova-compute[82479]:         <nova:project uuid="44c9d67ad2fa4cb9ab309b98f8fe051a">tempest-AttachVolumeNegativeTest-719597397</nova:project>
Apr 14 00:14:01 user nova-compute[82479]:       </nova:owner>
Apr 14 00:14:01 user nova-compute[82479]:       <nova:root type="image" uuid="6db62068-7278-4cd8-b41f-d0140d89e199"/>
Apr 14 00:14:01 user nova-compute[82479]:       <nova:ports>
Apr 14 00:14:01 user nova-compute[82479]:         <nova:port uuid="adb392b2-602f-421d-b26b-1e8f243cacff">
Apr 14 00:14:01 user nova-compute[82479]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 14 00:14:01 user nova-compute[82479]:         </nova:port>
Apr 14 00:14:01 user nova-compute[82479]:       </nova:ports>
Apr 14 00:14:01 user nova-compute[82479]:     </nova:instance>
Apr 14 00:14:01 user nova-compute[82479]:   </metadata>
Apr 14 00:14:01 user nova-compute[82479]:   <sysinfo type="smbios">
Apr 14 00:14:01 user nova-compute[82479]:     <system>
Apr 14 00:14:01 user nova-compute[82479]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 00:14:01 user nova-compute[82479]:       <entry name="product">OpenStack Nova</entry>
Apr 14 00:14:01 user nova-compute[82479]:       <entry name="version">0.0.0</entry>
Apr 14 00:14:01 user nova-compute[82479]:       <entry name="serial">e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8</entry>
Apr 14 00:14:01 user nova-compute[82479]:       <entry name="uuid">e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8</entry>
Apr 14 00:14:01 user nova-compute[82479]:       <entry name="family">Virtual Machine</entry>
Apr 14 00:14:01 user nova-compute[82479]:     </system>
Apr 14 00:14:01 user nova-compute[82479]:   </sysinfo>
Apr 14 00:14:01 user nova-compute[82479]:   <os>
Apr 14 00:14:01 user nova-compute[82479]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 00:14:01 user nova-compute[82479]:     <boot dev="hd"/>
Apr 14 00:14:01 user nova-compute[82479]:     <smbios mode="sysinfo"/>
Apr 14 00:14:01 user nova-compute[82479]:   </os>
Apr 14 00:14:01 user nova-compute[82479]:   <features>
Apr 14 00:14:01 user nova-compute[82479]:     <acpi/>
Apr 14 00:14:01 user nova-compute[82479]:     <apic/>
Apr 14 00:14:01 user nova-compute[82479]:     <vmcoreinfo/>
Apr 14 00:14:01 user nova-compute[82479]:   </features>
Apr 14 00:14:01 user nova-compute[82479]:   <clock offset="utc">
Apr 14 00:14:01 user nova-compute[82479]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 00:14:01 user nova-compute[82479]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 00:14:01 user nova-compute[82479]:     <timer name="hpet" present="no"/>
Apr 14 00:14:01 user nova-compute[82479]:   </clock>
Apr 14 00:14:01 user nova-compute[82479]:   <cpu mode="custom" match="exact">
Apr 14 00:14:01 user nova-compute[82479]:     <model>Nehalem</model>
Apr 14 00:14:01 user nova-compute[82479]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 00:14:01 user nova-compute[82479]:   </cpu>
Apr 14 00:14:01 user nova-compute[82479]:   <devices>
Apr 14 00:14:01 user nova-compute[82479]:     <disk type="file" device="disk">
Apr 14 00:14:01 user nova-compute[82479]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 00:14:01 user nova-compute[82479]:       <source file="/opt/stack/data/nova/instances/e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8/disk"/>
Apr 14 00:14:01 user nova-compute[82479]:       <target dev="vda" bus="virtio"/>
Apr 14 00:14:01 user nova-compute[82479]:     </disk>
Apr 14 00:14:01 user nova-compute[82479]:     <interface type="ethernet">
Apr 14 00:14:01 user nova-compute[82479]:       <mac address="fa:16:3e:3f:64:bc"/>
Apr 14 00:14:01 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:14:01 user nova-compute[82479]:       <mtu size="1442"/>
Apr 14 00:14:01 user nova-compute[82479]:       <target dev="tapadb392b2-60"/>
Apr 14 00:14:01 user nova-compute[82479]:     </interface>
Apr 14 00:14:01 user nova-compute[82479]:     <serial type="pty">
Apr 14 00:14:01 user nova-compute[82479]:       <log file="/opt/stack/data/nova/instances/e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8/console.log" append="off"/>
Apr 14 00:14:01 user nova-compute[82479]:     </serial>
Apr 14 00:14:01 user nova-compute[82479]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 00:14:01 user nova-compute[82479]:     <video>
Apr 14 00:14:01 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:14:01 user nova-compute[82479]:     </video>
Apr 14 00:14:01 user nova-compute[82479]:     <rng model="virtio">
Apr 14 00:14:01 user nova-compute[82479]:       <backend model="random">/dev/urandom</backend>
Apr 14 00:14:01 user nova-compute[82479]:     </rng>
Apr 14 00:14:01 user nova-compute[82479]:     <controller type="usb" index="0" model="none"/>
Apr 14 00:14:01 user nova-compute[82479]:     <memballoon model="virtio">
Apr 14 00:14:01 user nova-compute[82479]:       <stats period="10"/>
Apr 14 00:14:01 user nova-compute[82479]:     </memballoon>
Apr 14 00:14:01 user nova-compute[82479]:   </devices>
Apr 14 00:14:01 user nova-compute[82479]: </domain>
Apr 14 00:14:01 user nova-compute[82479]:  {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 00:14:01 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:13:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1247623601',display_name='tempest-AttachVolumeNegativeTest-server-1247623601',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1247623601',id=24,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLGkLOYcKKntXB8xBUrq5TfkCx1/xNQj4Ksi6k+fzjiqYC04ZpG2CZF3KkB+DY5NBDh2NzjAuCSlSRLBIT2B1CwX+AbHx15ScaMmXWoEIRyWreJeS2PAr2D8ysrfPRBoiQ==',key_name='tempest-keypair-1854176898',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44c9d67ad2fa4cb9ab309b98f8fe051a',ramdisk_id='',reservation_id='r-ounfao1n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-719597397',owner_user_name='tempest-AttachVolumeNegativeTest-719597397-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:13:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb293fdfc658466aaa7134269fa46a7c',uuid=e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "adb392b2-602f-421d-b26b-1e8f243cacff", "address": "fa:16:3e:3f:64:bc", "network": {"id": "6d80f923-8aef-45df-921b-f77ed4ff0e75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-696070096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44c9d67ad2fa4cb9ab309b98f8fe051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadb392b2-60", "ovs_interfaceid": "adb392b2-602f-421d-b26b-1e8f243cacff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 00:14:01 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Converting VIF {"id": "adb392b2-602f-421d-b26b-1e8f243cacff", "address": "fa:16:3e:3f:64:bc", "network": {"id": "6d80f923-8aef-45df-921b-f77ed4ff0e75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-696070096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44c9d67ad2fa4cb9ab309b98f8fe051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadb392b2-60", "ovs_interfaceid": "adb392b2-602f-421d-b26b-1e8f243cacff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:14:01 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:64:bc,bridge_name='br-int',has_traffic_filtering=True,id=adb392b2-602f-421d-b26b-1e8f243cacff,network=Network(6d80f923-8aef-45df-921b-f77ed4ff0e75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadb392b2-60') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:14:01 user nova-compute[82479]: DEBUG os_vif [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:64:bc,bridge_name='br-int',has_traffic_filtering=True,id=adb392b2-602f-421d-b26b-1e8f243cacff,network=Network(6d80f923-8aef-45df-921b-f77ed4ff0e75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadb392b2-60') {{(pid=82479) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 00:14:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:14:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 00:14:01 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Starting migrate_disk_and_power_off {{(pid=82479) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11460}}
Apr 14 00:14:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapadb392b2-60, may_exist=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:14:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapadb392b2-60, col_values=(('external_ids', {'iface-id': 'adb392b2-602f-421d-b26b-1e8f243cacff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:64:bc', 'vm-uuid': 'e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8'}),)) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:14:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:14:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:01 user nova-compute[82479]: INFO os_vif [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:64:bc,bridge_name='br-int',has_traffic_filtering=True,id=adb392b2-602f-421d-b26b-1e8f243cacff,network=Network(6d80f923-8aef-45df-921b-f77ed4ff0e75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadb392b2-60')
Apr 14 00:14:01 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:14:01 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] No VIF found with MAC fa:16:3e:3f:64:bc, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:14:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:01 user nova-compute[82479]: DEBUG nova.compute.manager [req-7aa2bc3a-124c-447f-82bb-509f5ab50a94 req-1fe4773d-a16a-4978-a5f5-c9f2689527c9 service nova] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Received event network-vif-unplugged-617f05b8-c04e-4abf-b4e5-a0234209624a {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:14:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-7aa2bc3a-124c-447f-82bb-509f5ab50a94 req-1fe4773d-a16a-4978-a5f5-c9f2689527c9 service nova] Acquiring lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:14:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-7aa2bc3a-124c-447f-82bb-509f5ab50a94 req-1fe4773d-a16a-4978-a5f5-c9f2689527c9 service nova] Lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:14:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-7aa2bc3a-124c-447f-82bb-509f5ab50a94 req-1fe4773d-a16a-4978-a5f5-c9f2689527c9 service nova] Lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:14:01 user nova-compute[82479]: DEBUG nova.compute.manager [req-7aa2bc3a-124c-447f-82bb-509f5ab50a94 req-1fe4773d-a16a-4978-a5f5-c9f2689527c9 service nova] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] No waiting events found dispatching network-vif-unplugged-617f05b8-c04e-4abf-b4e5-a0234209624a {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:14:01 user nova-compute[82479]: WARNING nova.compute.manager [req-7aa2bc3a-124c-447f-82bb-509f5ab50a94 req-1fe4773d-a16a-4978-a5f5-c9f2689527c9 service nova] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Received unexpected event network-vif-unplugged-617f05b8-c04e-4abf-b4e5-a0234209624a for instance with vm_state active and task_state resize_migrating.
Apr 14 00:14:01 user nova-compute[82479]: DEBUG nova.network.neutron [req-0ff51a11-afe6-4ed6-80c5-0949a5dc4210 req-56ca7825-2977-41ea-abd9-c021eb394fbf service nova] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Updated VIF entry in instance network info cache for port adb392b2-602f-421d-b26b-1e8f243cacff. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:14:01 user nova-compute[82479]: DEBUG nova.network.neutron [req-0ff51a11-afe6-4ed6-80c5-0949a5dc4210 req-56ca7825-2977-41ea-abd9-c021eb394fbf service nova] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Updating instance_info_cache with network_info: [{"id": "adb392b2-602f-421d-b26b-1e8f243cacff", "address": "fa:16:3e:3f:64:bc", "network": {"id": "6d80f923-8aef-45df-921b-f77ed4ff0e75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-696070096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44c9d67ad2fa4cb9ab309b98f8fe051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadb392b2-60", "ovs_interfaceid": "adb392b2-602f-421d-b26b-1e8f243cacff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:14:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0ff51a11-afe6-4ed6-80c5-0949a5dc4210 req-56ca7825-2977-41ea-abd9-c021eb394fbf service nova] Releasing lock "refresh_cache-e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:14:02 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Instance destroyed successfully.
Apr 14 00:14:02 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T00:05:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-2144192259',display_name='tempest-ServerActionsTestJSON-server-1662090424',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-2144192259',id=6,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD8E1mkrqLo3jsCiJcIvha4CNzW2T6/HQ38hZ5dGaGtUghmrHejTJlAuKgmy6xusLbaAzGTrJCKVkdgQ5v0CqCqGeNMDA89aLJgLl5KHn3gvI39SkbPja84HarSvbQbbXg==',key_name='tempest-keypair-1040271550',keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:09:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='bf8663ccad9047f4b11b9ae0646c287a',ramdisk_id='',reservation_id='r-amqn5295',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-948553482',owner_user_name='tempest-ServerActionsTestJSON-948553482-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T00:13:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d86662f2c7648daad87118b7e9f757c',uuid=b3475e7e-ceb4-452a-a045-dbf43c5944dd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "617f05b8-c04e-4abf-b4e5-a0234209624a", "address": "fa:16:3e:f9:fd:1a", "network": {"id": "cb8c9bb1-a885-486d-aa6a-de600bc01c2e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1676259779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1676259779-network", "vif_mac": "fa:16:3e:f9:fd:1a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8663ccad9047f4b11b9ae0646c287a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617f05b8-c0", "ovs_interfaceid": "617f05b8-c04e-4abf-b4e5-a0234209624a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 00:14:02 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Converting VIF {"id": "617f05b8-c04e-4abf-b4e5-a0234209624a", "address": "fa:16:3e:f9:fd:1a", "network": {"id": "cb8c9bb1-a885-486d-aa6a-de600bc01c2e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1676259779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1676259779-network", "vif_mac": "fa:16:3e:f9:fd:1a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8663ccad9047f4b11b9ae0646c287a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617f05b8-c0", "ovs_interfaceid": "617f05b8-c04e-4abf-b4e5-a0234209624a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:14:02 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:fd:1a,bridge_name='br-int',has_traffic_filtering=True,id=617f05b8-c04e-4abf-b4e5-a0234209624a,network=Network(cb8c9bb1-a885-486d-aa6a-de600bc01c2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap617f05b8-c0') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:14:02 user nova-compute[82479]: DEBUG os_vif [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:fd:1a,bridge_name='br-int',has_traffic_filtering=True,id=617f05b8-c04e-4abf-b4e5-a0234209624a,network=Network(cb8c9bb1-a885-486d-aa6a-de600bc01c2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap617f05b8-c0') {{(pid=82479) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 00:14:02 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:02 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap617f05b8-c0, bridge=br-int, if_exists=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:14:02 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:02 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:14:02 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:02 user nova-compute[82479]: INFO os_vif [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:fd:1a,bridge_name='br-int',has_traffic_filtering=True,id=617f05b8-c04e-4abf-b4e5-a0234209624a,network=Network(cb8c9bb1-a885-486d-aa6a-de600bc01c2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap617f05b8-c0')
Apr 14 00:14:02 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] calling os-brick to detach iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 00:14:02 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, {'target_iqn': 'iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YrRJCHcL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:14:02 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:14:02 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:14:02 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:14:02 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:14:02 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:14:02 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2e2ec5-1b1f-4c24-90d6-077e5613279a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:14:02 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 00:14:02 user nova-compute[82479]: No targets found.
Apr 14 00:14:02 user nova-compute[82479]: iSNS:
Apr 14 00:14:02 user nova-compute[82479]: No targets found.
Apr 14 00:14:02 user nova-compute[82479]: STATIC:
Apr 14 00:14:02 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc
Apr 14 00:14:02 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:14:02 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:14:02 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e
Apr 14 00:14:02 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:14:02 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:14:02 user nova-compute[82479]: FIRMWARE:
Apr 14 00:14:02 user nova-compute[82479]: No targets found.
Apr 14 00:14:02 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:14:02 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 00:14:02 user nova-compute[82479]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 00:14:02 user nova-compute[82479]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82479) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 00:14:02 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e', 0)] {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 00:14:02 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:14:02 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:14:02 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbfa6f80-797a-4c34-90ed-c118bb506624]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:14:02 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:14:02 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:14:02 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ab1831-fa9d-4d1e-985d-ba313bdd8c13]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:14:02 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:14:02 user nova-compute[82479]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e (non-flash)
Apr 14 00:14:02 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:14:02 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:14:02 user nova-compute[82479]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e (non-flash)
Apr 14 00:14:02 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:14:02 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3344c7a5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e'): ({'sdb'}, set())}) {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 00:14:02 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Removing single pathed devices sdb {{(pid=82479) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 00:14:02 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:14:02 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:14:02 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee9760b-fabc-4b1a-b12f-7a92ae6c8727]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:14:02 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:14:02 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:14:02 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[accffa93-827c-4e77-ae18-8d575a35f187]: (4, ('ok\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:14:02 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Flushing IO for device /dev/sdb {{(pid=82479) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 00:14:02 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:14:02 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:14:02 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccdda193-514e-42f0-8e3e-d32cc2771b37]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:14:02 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82479) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 00:14:02 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:14:02 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.060s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:14:02 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a16747-2cbc-4aaa-955a-73281c75d7ac]: (4, ('1', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:14:02 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 00:14:02 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] SCSI volumes sdb have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 00:14:02 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e')] {{(pid=82479) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 00:14:02 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:14:02 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:14:02 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bee68f6-f924-4899-bd2b-655d120acfb5]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:14:02 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:14:02 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e -p 172.16.0.220:3260 --logout {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:14:02 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:14:02 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb2613ee-9a83-4b0e-9df5-5f49c3f59b8f]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:14:02 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e, portal: 172.16.0.220,3260]
Apr 14 00:14:02 user nova-compute[82479]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e, portal: 172.16.0.220,3260] successful.
Apr 14 00:14:02 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:14:02 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e -p 172.16.0.220:3260 --op delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:14:02 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:02 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:14:02 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb76fd9-4aad-450c-86b8-8a29c2caee48]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:14:02 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:14:02 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:14:02 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] <== disconnect_volume: return (333ms) None {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:14:02 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Disconnected iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 00:14:02 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:14:02 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:03 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:14:03 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:14:03 user nova-compute[82479]: DEBUG nova.compute.manager [req-c1f4fbcb-7332-40cf-968f-4e22a3ca9036 req-4f7387e9-4650-463e-b260-35a06b941bc8 service nova] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Received event network-vif-plugged-adb392b2-602f-421d-b26b-1e8f243cacff {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:14:03 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-c1f4fbcb-7332-40cf-968f-4e22a3ca9036 req-4f7387e9-4650-463e-b260-35a06b941bc8 service nova] Acquiring lock "e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:14:03 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-c1f4fbcb-7332-40cf-968f-4e22a3ca9036 req-4f7387e9-4650-463e-b260-35a06b941bc8 service nova] Lock "e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:14:03 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-c1f4fbcb-7332-40cf-968f-4e22a3ca9036 req-4f7387e9-4650-463e-b260-35a06b941bc8 service nova] Lock "e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:14:03 user nova-compute[82479]: DEBUG nova.compute.manager [req-c1f4fbcb-7332-40cf-968f-4e22a3ca9036 req-4f7387e9-4650-463e-b260-35a06b941bc8 service nova] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] No waiting events found dispatching network-vif-plugged-adb392b2-602f-421d-b26b-1e8f243cacff {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:14:03 user nova-compute[82479]: WARNING nova.compute.manager [req-c1f4fbcb-7332-40cf-968f-4e22a3ca9036 req-4f7387e9-4650-463e-b260-35a06b941bc8 service nova] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Received unexpected event network-vif-plugged-adb392b2-602f-421d-b26b-1e8f243cacff for instance with vm_state building and task_state spawning.
Apr 14 00:14:03 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:14:03 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:14:03 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd_resize/disk /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:14:03 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] CMD "cp -r /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd_resize/disk /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk" returned: 0 in 0.257s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:14:03 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd_resize/disk.info /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk.info {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:14:03 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:03 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] CMD "cp -r /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd_resize/disk.info /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk.info" returned: 0 in 0.047s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:14:03 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:03 user nova-compute[82479]: DEBUG nova.compute.manager [req-f7002059-9168-45e0-b437-aa77bdb7d3b1 req-889ba87a-819b-475c-a2c3-c5d87e375b2a service nova] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Received event network-vif-plugged-617f05b8-c04e-4abf-b4e5-a0234209624a {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:14:03 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-f7002059-9168-45e0-b437-aa77bdb7d3b1 req-889ba87a-819b-475c-a2c3-c5d87e375b2a service nova] Acquiring lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:14:03 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-f7002059-9168-45e0-b437-aa77bdb7d3b1 req-889ba87a-819b-475c-a2c3-c5d87e375b2a service nova] Lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:14:03 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-f7002059-9168-45e0-b437-aa77bdb7d3b1 req-889ba87a-819b-475c-a2c3-c5d87e375b2a service nova] Lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:14:03 user nova-compute[82479]: DEBUG nova.compute.manager [req-f7002059-9168-45e0-b437-aa77bdb7d3b1 req-889ba87a-819b-475c-a2c3-c5d87e375b2a service nova] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] No waiting events found dispatching network-vif-plugged-617f05b8-c04e-4abf-b4e5-a0234209624a {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:14:03 user nova-compute[82479]: WARNING nova.compute.manager [req-f7002059-9168-45e0-b437-aa77bdb7d3b1 req-889ba87a-819b-475c-a2c3-c5d87e375b2a service nova] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Received unexpected event network-vif-plugged-617f05b8-c04e-4abf-b4e5-a0234209624a for instance with vm_state active and task_state resize_migrating.
Apr 14 00:14:04 user nova-compute[82479]: DEBUG nova.network.neutron [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Port 617f05b8-c04e-4abf-b4e5-a0234209624a binding to destination host user is already ACTIVE {{(pid=82479) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 14 00:14:04 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:14:04 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:14:04 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:14:04 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "refresh_cache-b3475e7e-ceb4-452a-a045-dbf43c5944dd" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:14:04 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquired lock "refresh_cache-b3475e7e-ceb4-452a-a045-dbf43c5944dd" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:14:04 user nova-compute[82479]: DEBUG nova.network.neutron [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 00:14:05 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681431245.077975, e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8 => Resumed> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:14:05 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] VM Resumed (Lifecycle Event)
Apr 14 00:14:05 user nova-compute[82479]: DEBUG nova.compute.manager [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Instance event wait completed in 0 seconds for  {{(pid=82479) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 00:14:05 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Guest created on hypervisor {{(pid=82479) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 00:14:05 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Instance spawned successfully.
Apr 14 00:14:05 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 00:14:05 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:14:05 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:14:05 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Found default for hw_cdrom_bus of ide {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:14:05 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Found default for hw_disk_bus of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:14:05 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Found default for hw_input_bus of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:14:05 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Found default for hw_pointer_model of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:14:05 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Found default for hw_video_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:14:05 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Found default for hw_vif_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:14:05 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:14:05 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681431245.0785465, e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8 => Started> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:14:05 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] VM Started (Lifecycle Event)
Apr 14 00:14:05 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:14:05 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:14:05 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:14:05 user nova-compute[82479]: DEBUG nova.compute.manager [req-189af087-9b42-4ac3-8f26-cb12542883b7 req-2427b6c6-d937-438f-8e05-2ba4c67062ff service nova] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Received event network-vif-plugged-adb392b2-602f-421d-b26b-1e8f243cacff {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:14:05 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-189af087-9b42-4ac3-8f26-cb12542883b7 req-2427b6c6-d937-438f-8e05-2ba4c67062ff service nova] Acquiring lock "e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:14:05 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-189af087-9b42-4ac3-8f26-cb12542883b7 req-2427b6c6-d937-438f-8e05-2ba4c67062ff service nova] Lock "e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:14:05 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-189af087-9b42-4ac3-8f26-cb12542883b7 req-2427b6c6-d937-438f-8e05-2ba4c67062ff service nova] Lock "e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:14:05 user nova-compute[82479]: DEBUG nova.compute.manager [req-189af087-9b42-4ac3-8f26-cb12542883b7 req-2427b6c6-d937-438f-8e05-2ba4c67062ff service nova] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] No waiting events found dispatching network-vif-plugged-adb392b2-602f-421d-b26b-1e8f243cacff {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:14:05 user nova-compute[82479]: WARNING nova.compute.manager [req-189af087-9b42-4ac3-8f26-cb12542883b7 req-2427b6c6-d937-438f-8e05-2ba4c67062ff service nova] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Received unexpected event network-vif-plugged-adb392b2-602f-421d-b26b-1e8f243cacff for instance with vm_state building and task_state spawning.
Apr 14 00:14:05 user nova-compute[82479]: INFO nova.compute.manager [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Took 7.13 seconds to spawn the instance on the hypervisor.
Apr 14 00:14:05 user nova-compute[82479]: DEBUG nova.compute.manager [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:14:05 user nova-compute[82479]: INFO nova.compute.manager [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Took 7.98 seconds to build instance.
Apr 14 00:14:05 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a81a4f95-9d27-4ef7-88ed-c6aba08d42df tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.098s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:14:05 user nova-compute[82479]: DEBUG nova.network.neutron [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Updating instance_info_cache with network_info: [{"id": "617f05b8-c04e-4abf-b4e5-a0234209624a", "address": "fa:16:3e:f9:fd:1a", "network": {"id": "cb8c9bb1-a885-486d-aa6a-de600bc01c2e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1676259779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8663ccad9047f4b11b9ae0646c287a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617f05b8-c0", "ovs_interfaceid": "617f05b8-c04e-4abf-b4e5-a0234209624a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:14:05 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Releasing lock "refresh_cache-b3475e7e-ceb4-452a-a045-dbf43c5944dd" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:14:05 user nova-compute[82479]: DEBUG os_brick.utils [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:14:05 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:14:05 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:14:05 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a66e1b6-364b-4fa3-8075-becf04faaceb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fec92fcfdd3\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:14:05 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:14:05 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:14:05 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f68aaac-429e-4d31-aa6d-7644e7ddc67b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:14:05 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:14:05 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:14:05 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[922a77b4-705a-4d38-9fac-fed82b5ecfde]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:14:05 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eff15e6-a375-40de-b450-4622e72ae4a9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:14:05 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Running cmd (subprocess): nvme version {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:14:05 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] 'nvme version' failed. Not Retrying. {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:14:05 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] nvme not present on system {{(pid=82479) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 00:14:05 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:14:05 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:14:05 user nova-compute[82479]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 00:14:05 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30c52e1-92bd-4f4a-aabb-8baaf417531c]: (4, '') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:14:05 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82479) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 00:14:05 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 00:14:05 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] LIGHTOS: no hostnqn found. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 00:14:05 user nova-compute[82479]: DEBUG os_brick.utils [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fec92fcfdd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:14:06 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:07 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Starting finish_migration {{(pid=82479) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11647}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Instance directory exists: not creating {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 00:14:10 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Creating image(s)
Apr 14 00:14:10 user nova-compute[82479]: DEBUG nova.objects.instance [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lazy-loading 'trusted_certs' on Instance uuid b3475e7e-ceb4-452a-a045-dbf43c5944dd {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.134s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk. size=1073741824 {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Cannot resize image /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk to a smaller size. {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Did not create local disks {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Ensure instance console log exists: /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/console.log {{(pid=82479) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Start _get_guest_xml network_info=[{"id": "617f05b8-c04e-4abf-b4e5-a0234209624a", "address": "fa:16:3e:f9:fd:1a", "network": {"id": "cb8c9bb1-a885-486d-aa6a-de600bc01c2e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1676259779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1676259779-network", "vif_mac": "fa:16:3e:f9:fd:1a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8663ccad9047f4b11b9ae0646c287a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617f05b8-c0", "ovs_interfaceid": "617f05b8-c04e-4abf-b4e5-a0234209624a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': None, 'device_type': 'disk', 'delete_on_termination': False, 'attachment_id': '43f78284-e8d9-43a3-94a8-79607874bb6b', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YrRJCHcL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'b3475e7e-ceb4-452a-a045-dbf43c5944dd', 'attached_at': '2023-04-14T00:14:10.000000', 'detached_at': '', 'volume_id': '94d1d134-5857-4a7c-bf52-bd818e828f3e', 'serial': '94d1d134-5857-4a7c-bf52-bd818e828f3e'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 00:14:10 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:14:10 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:14:10 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82479) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T00:02:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=192,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Flavor limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Image limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Flavor pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Image pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Got 1 possible topologies {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG nova.objects.instance [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lazy-loading 'vcpu_model' on Instance uuid b3475e7e-ceb4-452a-a045-dbf43c5944dd {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Calling os-brick to attach iSCSI Volume {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YrRJCHcL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:14:10 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:14:10 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:14:10 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:14:10 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:14:10 user nova-compute[82479]: INFO os_brick.initiator.connectors.iscsi [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 00:14:10 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e -p 172.16.0.220:3260 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[278eefc5-00f7-42ff-9eac-d0507434f4b9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 00:14:10 user nova-compute[82479]:  {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e -p 172.16.0.220:3260 --interface default --op new {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[989a6b70-16fc-4c5e-beb3-d8ea5d9e46ff]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e] added\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e] added
Apr 14 00:14:10 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8e17ab-fae1-423b-a113-4f033b758d81]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[072856b7-d592-47c3-bea5-25bfedeeb713]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YrRJCHcL {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YrRJCHcL" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d64a94c-2d0b-4976-9359-8d08a62261ae]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YrRJCHcL'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[16566380-8b72-41fe-870d-3c5302c4eb8f]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c391bb-838e-4010-a769-90ad3f135dd3]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:14:10 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:14:10 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e -p 172.16.0.220:3260 --login {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[a161aded-18b7-484b-a8d2-f2442a25be1a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e, portal: 172.16.0.220,3260]
Apr 14 00:14:10 user nova-compute[82479]: Login to [iface: default, target: iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e, portal: 172.16.0.220,3260] successful.
Apr 14 00:14:10 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[873a0b23-5152-4015-850f-6cc3f48a11e8]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b8bbf2-0dcd-4b0d-a8fe-d0385a056d29]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:14:10 user nova-compute[82479]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e (non-flash)
Apr 14 00:14:10 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:14:10 user nova-compute[82479]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e (non-flash)
Apr 14 00:14:10 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Connected to 172.16.0.220:3260 {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] HCTL ('33', '-', '-', 0) found on session 24 with lun 0 {{(pid=82479) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82479) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[75467dd8-6705-461c-bf53-ab5b4e2f1792]: (4, ('- - 0', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82479) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 00:14:10 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YrRJCHcL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 00:14:11 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:11 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:14:11 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '23363343733396464', 'path': '/dev/sdb'} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:14:11 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363343733396464', 'path': '/dev/sdb'} {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 00:14:11 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T00:05:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-2144192259',display_name='tempest-ServerActionsTestJSON-server-1662090424',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-2144192259',id=6,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD8E1mkrqLo3jsCiJcIvha4CNzW2T6/HQ38hZ5dGaGtUghmrHejTJlAuKgmy6xusLbaAzGTrJCKVkdgQ5v0CqCqGeNMDA89aLJgLl5KHn3gvI39SkbPja84HarSvbQbbXg==',key_name='tempest-keypair-1040271550',keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:09:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='bf8663ccad9047f4b11b9ae0646c287a',ramdisk_id='',reservation_id='r-amqn5295',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-948553482',owner_user_name='tempest-ServerActionsTestJSON-948553482-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:14:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d86662f2c7648daad87118b7e9f757c',uuid=b3475e7e-ceb4-452a-a045-dbf43c5944dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "617f05b8-c04e-4abf-b4e5-a0234209624a", "address": "fa:16:3e:f9:fd:1a", "network": {"id": "cb8c9bb1-a885-486d-aa6a-de600bc01c2e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1676259779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1676259779-network", "vif_mac": "fa:16:3e:f9:fd:1a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8663ccad9047f4b11b9ae0646c287a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617f05b8-c0", "ovs_interfaceid": "617f05b8-c04e-4abf-b4e5-a0234209624a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82479) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 00:14:11 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Converting VIF {"id": "617f05b8-c04e-4abf-b4e5-a0234209624a", "address": "fa:16:3e:f9:fd:1a", "network": {"id": "cb8c9bb1-a885-486d-aa6a-de600bc01c2e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1676259779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1676259779-network", "vif_mac": "fa:16:3e:f9:fd:1a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8663ccad9047f4b11b9ae0646c287a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617f05b8-c0", "ovs_interfaceid": "617f05b8-c04e-4abf-b4e5-a0234209624a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:14:11 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:fd:1a,bridge_name='br-int',has_traffic_filtering=True,id=617f05b8-c04e-4abf-b4e5-a0234209624a,network=Network(cb8c9bb1-a885-486d-aa6a-de600bc01c2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap617f05b8-c0') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:14:11 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] End _get_guest_xml xml=<domain type="kvm">
Apr 14 00:14:11 user nova-compute[82479]:   <uuid>b3475e7e-ceb4-452a-a045-dbf43c5944dd</uuid>
Apr 14 00:14:11 user nova-compute[82479]:   <name>instance-00000006</name>
Apr 14 00:14:11 user nova-compute[82479]:   <memory>196608</memory>
Apr 14 00:14:11 user nova-compute[82479]:   <vcpu>1</vcpu>
Apr 14 00:14:11 user nova-compute[82479]:   <metadata>
Apr 14 00:14:11 user nova-compute[82479]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 00:14:11 user nova-compute[82479]:       <nova:package version="0.0.0"/>
Apr 14 00:14:11 user nova-compute[82479]:       <nova:name>tempest-ServerActionsTestJSON-server-1662090424</nova:name>
Apr 14 00:14:11 user nova-compute[82479]:       <nova:creationTime>2023-04-14 00:14:10</nova:creationTime>
Apr 14 00:14:11 user nova-compute[82479]:       <nova:flavor name="m1.micro">
Apr 14 00:14:11 user nova-compute[82479]:         <nova:memory>192</nova:memory>
Apr 14 00:14:11 user nova-compute[82479]:         <nova:disk>1</nova:disk>
Apr 14 00:14:11 user nova-compute[82479]:         <nova:swap>0</nova:swap>
Apr 14 00:14:11 user nova-compute[82479]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 00:14:11 user nova-compute[82479]:         <nova:vcpus>1</nova:vcpus>
Apr 14 00:14:11 user nova-compute[82479]:       </nova:flavor>
Apr 14 00:14:11 user nova-compute[82479]:       <nova:owner>
Apr 14 00:14:11 user nova-compute[82479]:         <nova:user uuid="3d86662f2c7648daad87118b7e9f757c">tempest-ServerActionsTestJSON-948553482-project-member</nova:user>
Apr 14 00:14:11 user nova-compute[82479]:         <nova:project uuid="bf8663ccad9047f4b11b9ae0646c287a">tempest-ServerActionsTestJSON-948553482</nova:project>
Apr 14 00:14:11 user nova-compute[82479]:       </nova:owner>
Apr 14 00:14:11 user nova-compute[82479]:       <nova:root type="image" uuid="6db62068-7278-4cd8-b41f-d0140d89e199"/>
Apr 14 00:14:11 user nova-compute[82479]:       <nova:ports>
Apr 14 00:14:11 user nova-compute[82479]:         <nova:port uuid="617f05b8-c04e-4abf-b4e5-a0234209624a">
Apr 14 00:14:11 user nova-compute[82479]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 14 00:14:11 user nova-compute[82479]:         </nova:port>
Apr 14 00:14:11 user nova-compute[82479]:       </nova:ports>
Apr 14 00:14:11 user nova-compute[82479]:     </nova:instance>
Apr 14 00:14:11 user nova-compute[82479]:   </metadata>
Apr 14 00:14:11 user nova-compute[82479]:   <sysinfo type="smbios">
Apr 14 00:14:11 user nova-compute[82479]:     <system>
Apr 14 00:14:11 user nova-compute[82479]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 00:14:11 user nova-compute[82479]:       <entry name="product">OpenStack Nova</entry>
Apr 14 00:14:11 user nova-compute[82479]:       <entry name="version">0.0.0</entry>
Apr 14 00:14:11 user nova-compute[82479]:       <entry name="serial">b3475e7e-ceb4-452a-a045-dbf43c5944dd</entry>
Apr 14 00:14:11 user nova-compute[82479]:       <entry name="uuid">b3475e7e-ceb4-452a-a045-dbf43c5944dd</entry>
Apr 14 00:14:11 user nova-compute[82479]:       <entry name="family">Virtual Machine</entry>
Apr 14 00:14:11 user nova-compute[82479]:     </system>
Apr 14 00:14:11 user nova-compute[82479]:   </sysinfo>
Apr 14 00:14:11 user nova-compute[82479]:   <os>
Apr 14 00:14:11 user nova-compute[82479]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 00:14:11 user nova-compute[82479]:     <boot dev="hd"/>
Apr 14 00:14:11 user nova-compute[82479]:     <smbios mode="sysinfo"/>
Apr 14 00:14:11 user nova-compute[82479]:   </os>
Apr 14 00:14:11 user nova-compute[82479]:   <features>
Apr 14 00:14:11 user nova-compute[82479]:     <acpi/>
Apr 14 00:14:11 user nova-compute[82479]:     <apic/>
Apr 14 00:14:11 user nova-compute[82479]:     <vmcoreinfo/>
Apr 14 00:14:11 user nova-compute[82479]:   </features>
Apr 14 00:14:11 user nova-compute[82479]:   <clock offset="utc">
Apr 14 00:14:11 user nova-compute[82479]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 00:14:11 user nova-compute[82479]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 00:14:11 user nova-compute[82479]:     <timer name="hpet" present="no"/>
Apr 14 00:14:11 user nova-compute[82479]:   </clock>
Apr 14 00:14:11 user nova-compute[82479]:   <cpu mode="custom" match="exact">
Apr 14 00:14:11 user nova-compute[82479]:     <model>Nehalem</model>
Apr 14 00:14:11 user nova-compute[82479]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 00:14:11 user nova-compute[82479]:   </cpu>
Apr 14 00:14:11 user nova-compute[82479]:   <devices>
Apr 14 00:14:11 user nova-compute[82479]:     <disk type="file" device="disk">
Apr 14 00:14:11 user nova-compute[82479]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 00:14:11 user nova-compute[82479]:       <source file="/opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk"/>
Apr 14 00:14:11 user nova-compute[82479]:       <target dev="vda" bus="virtio"/>
Apr 14 00:14:11 user nova-compute[82479]:     </disk>
Apr 14 00:14:11 user nova-compute[82479]:     <disk type="block" device="disk">
Apr 14 00:14:11 user nova-compute[82479]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:14:11 user nova-compute[82479]:       <source dev="/dev/sdb"/>
Apr 14 00:14:11 user nova-compute[82479]:       <target dev="vdb" bus="virtio"/>
Apr 14 00:14:11 user nova-compute[82479]:       <serial>94d1d134-5857-4a7c-bf52-bd818e828f3e</serial>
Apr 14 00:14:11 user nova-compute[82479]:     </disk>
Apr 14 00:14:11 user nova-compute[82479]:     <interface type="ethernet">
Apr 14 00:14:11 user nova-compute[82479]:       <mac address="fa:16:3e:f9:fd:1a"/>
Apr 14 00:14:11 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:14:11 user nova-compute[82479]:       <mtu size="1442"/>
Apr 14 00:14:11 user nova-compute[82479]:       <target dev="tap617f05b8-c0"/>
Apr 14 00:14:11 user nova-compute[82479]:     </interface>
Apr 14 00:14:11 user nova-compute[82479]:     <serial type="pty">
Apr 14 00:14:11 user nova-compute[82479]:       <log file="/opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/console.log" append="off"/>
Apr 14 00:14:11 user nova-compute[82479]:     </serial>
Apr 14 00:14:11 user nova-compute[82479]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 00:14:11 user nova-compute[82479]:     <video>
Apr 14 00:14:11 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:14:11 user nova-compute[82479]:     </video>
Apr 14 00:14:11 user nova-compute[82479]:     <rng model="virtio">
Apr 14 00:14:11 user nova-compute[82479]:       <backend model="random">/dev/urandom</backend>
Apr 14 00:14:11 user nova-compute[82479]:     </rng>
Apr 14 00:14:11 user nova-compute[82479]:     <controller type="usb" index="0" model="none"/>
Apr 14 00:14:11 user nova-compute[82479]:     <memballoon model="virtio">
Apr 14 00:14:11 user nova-compute[82479]:       <stats period="10"/>
Apr 14 00:14:11 user nova-compute[82479]:     </memballoon>
Apr 14 00:14:11 user nova-compute[82479]:   </devices>
Apr 14 00:14:11 user nova-compute[82479]: </domain>
Apr 14 00:14:11 user nova-compute[82479]:  {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 00:14:11 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T00:05:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-2144192259',display_name='tempest-ServerActionsTestJSON-server-1662090424',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-2144192259',id=6,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD8E1mkrqLo3jsCiJcIvha4CNzW2T6/HQ38hZ5dGaGtUghmrHejTJlAuKgmy6xusLbaAzGTrJCKVkdgQ5v0CqCqGeNMDA89aLJgLl5KHn3gvI39SkbPja84HarSvbQbbXg==',key_name='tempest-keypair-1040271550',keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:09:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='bf8663ccad9047f4b11b9ae0646c287a',ramdisk_id='',reservation_id='r-amqn5295',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-948553482',owner_user_name='tempest-ServerActionsTestJSON-948553482-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:14:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d86662f2c7648daad87118b7e9f757c',uuid=b3475e7e-ceb4-452a-a045-dbf43c5944dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "617f05b8-c04e-4abf-b4e5-a0234209624a", "address": "fa:16:3e:f9:fd:1a", "network": {"id": "cb8c9bb1-a885-486d-aa6a-de600bc01c2e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1676259779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1676259779-network", "vif_mac": "fa:16:3e:f9:fd:1a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8663ccad9047f4b11b9ae0646c287a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617f05b8-c0", "ovs_interfaceid": "617f05b8-c04e-4abf-b4e5-a0234209624a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 00:14:11 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Converting VIF {"id": "617f05b8-c04e-4abf-b4e5-a0234209624a", "address": "fa:16:3e:f9:fd:1a", "network": {"id": "cb8c9bb1-a885-486d-aa6a-de600bc01c2e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1676259779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1676259779-network", "vif_mac": "fa:16:3e:f9:fd:1a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8663ccad9047f4b11b9ae0646c287a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617f05b8-c0", "ovs_interfaceid": "617f05b8-c04e-4abf-b4e5-a0234209624a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:14:11 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:fd:1a,bridge_name='br-int',has_traffic_filtering=True,id=617f05b8-c04e-4abf-b4e5-a0234209624a,network=Network(cb8c9bb1-a885-486d-aa6a-de600bc01c2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap617f05b8-c0') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:14:11 user nova-compute[82479]: DEBUG os_vif [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:fd:1a,bridge_name='br-int',has_traffic_filtering=True,id=617f05b8-c04e-4abf-b4e5-a0234209624a,network=Network(cb8c9bb1-a885-486d-aa6a-de600bc01c2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap617f05b8-c0') {{(pid=82479) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 00:14:11 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:11 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:14:11 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 00:14:11 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:11 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap617f05b8-c0, may_exist=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:14:11 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap617f05b8-c0, col_values=(('external_ids', {'iface-id': '617f05b8-c04e-4abf-b4e5-a0234209624a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:fd:1a', 'vm-uuid': 'b3475e7e-ceb4-452a-a045-dbf43c5944dd'}),)) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:14:11 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:11 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:14:11 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:11 user nova-compute[82479]: INFO os_vif [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:fd:1a,bridge_name='br-int',has_traffic_filtering=True,id=617f05b8-c04e-4abf-b4e5-a0234209624a,network=Network(cb8c9bb1-a885-486d-aa6a-de600bc01c2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap617f05b8-c0')
Apr 14 00:14:11 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:14:11 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:14:11 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] No VIF found with MAC fa:16:3e:f9:fd:1a, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:14:13 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:13 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:13 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:13 user nova-compute[82479]: DEBUG nova.compute.manager [req-30257974-2199-46b2-b66f-f8f6769c19f1 req-7f144981-88ab-47ef-893e-5b3427c2f8a4 service nova] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Received event network-changed-62d9fce8-6815-4a29-ab53-d1205a2db648 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:14:13 user nova-compute[82479]: DEBUG nova.compute.manager [req-30257974-2199-46b2-b66f-f8f6769c19f1 req-7f144981-88ab-47ef-893e-5b3427c2f8a4 service nova] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Refreshing instance network info cache due to event network-changed-62d9fce8-6815-4a29-ab53-d1205a2db648. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:14:13 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-30257974-2199-46b2-b66f-f8f6769c19f1 req-7f144981-88ab-47ef-893e-5b3427c2f8a4 service nova] Acquiring lock "refresh_cache-6c35b78e-41e3-40c1-b265-8e1fa5e859c6" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:14:13 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-30257974-2199-46b2-b66f-f8f6769c19f1 req-7f144981-88ab-47ef-893e-5b3427c2f8a4 service nova] Acquired lock "refresh_cache-6c35b78e-41e3-40c1-b265-8e1fa5e859c6" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:14:13 user nova-compute[82479]: DEBUG nova.network.neutron [req-30257974-2199-46b2-b66f-f8f6769c19f1 req-7f144981-88ab-47ef-893e-5b3427c2f8a4 service nova] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Refreshing network info cache for port 62d9fce8-6815-4a29-ab53-d1205a2db648 {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:14:14 user nova-compute[82479]: DEBUG nova.network.neutron [req-30257974-2199-46b2-b66f-f8f6769c19f1 req-7f144981-88ab-47ef-893e-5b3427c2f8a4 service nova] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Updated VIF entry in instance network info cache for port 62d9fce8-6815-4a29-ab53-d1205a2db648. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:14:14 user nova-compute[82479]: DEBUG nova.network.neutron [req-30257974-2199-46b2-b66f-f8f6769c19f1 req-7f144981-88ab-47ef-893e-5b3427c2f8a4 service nova] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Updating instance_info_cache with network_info: [{"id": "62d9fce8-6815-4a29-ab53-d1205a2db648", "address": "fa:16:3e:46:a4:3f", "network": {"id": "66316d10-fed3-4fb9-877e-a01542ca5855", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-93456010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f20caf676a64b9b97027f3fc9bc724c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62d9fce8-68", "ovs_interfaceid": "62d9fce8-6815-4a29-ab53-d1205a2db648", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:14:14 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-30257974-2199-46b2-b66f-f8f6769c19f1 req-7f144981-88ab-47ef-893e-5b3427c2f8a4 service nova] Releasing lock "refresh_cache-6c35b78e-41e3-40c1-b265-8e1fa5e859c6" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:14:14 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:14 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:15 user nova-compute[82479]: DEBUG nova.compute.manager [req-c3fbb7e9-e1ef-474c-8513-3ad29865b04e req-4deac785-f7da-4644-8989-3aff058c9d28 service nova] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Received event network-vif-plugged-617f05b8-c04e-4abf-b4e5-a0234209624a {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:14:15 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-c3fbb7e9-e1ef-474c-8513-3ad29865b04e req-4deac785-f7da-4644-8989-3aff058c9d28 service nova] Acquiring lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:14:15 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-c3fbb7e9-e1ef-474c-8513-3ad29865b04e req-4deac785-f7da-4644-8989-3aff058c9d28 service nova] Lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:14:15 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-c3fbb7e9-e1ef-474c-8513-3ad29865b04e req-4deac785-f7da-4644-8989-3aff058c9d28 service nova] Lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:14:15 user nova-compute[82479]: DEBUG nova.compute.manager [req-c3fbb7e9-e1ef-474c-8513-3ad29865b04e req-4deac785-f7da-4644-8989-3aff058c9d28 service nova] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] No waiting events found dispatching network-vif-plugged-617f05b8-c04e-4abf-b4e5-a0234209624a {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:14:15 user nova-compute[82479]: WARNING nova.compute.manager [req-c3fbb7e9-e1ef-474c-8513-3ad29865b04e req-4deac785-f7da-4644-8989-3aff058c9d28 service nova] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Received unexpected event network-vif-plugged-617f05b8-c04e-4abf-b4e5-a0234209624a for instance with vm_state active and task_state resize_finish.
Apr 14 00:14:15 user nova-compute[82479]: DEBUG nova.compute.manager [req-c3fbb7e9-e1ef-474c-8513-3ad29865b04e req-4deac785-f7da-4644-8989-3aff058c9d28 service nova] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Received event network-vif-plugged-617f05b8-c04e-4abf-b4e5-a0234209624a {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:14:15 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-c3fbb7e9-e1ef-474c-8513-3ad29865b04e req-4deac785-f7da-4644-8989-3aff058c9d28 service nova] Acquiring lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:14:15 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-c3fbb7e9-e1ef-474c-8513-3ad29865b04e req-4deac785-f7da-4644-8989-3aff058c9d28 service nova] Lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:14:15 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-c3fbb7e9-e1ef-474c-8513-3ad29865b04e req-4deac785-f7da-4644-8989-3aff058c9d28 service nova] Lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:14:15 user nova-compute[82479]: DEBUG nova.compute.manager [req-c3fbb7e9-e1ef-474c-8513-3ad29865b04e req-4deac785-f7da-4644-8989-3aff058c9d28 service nova] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] No waiting events found dispatching network-vif-plugged-617f05b8-c04e-4abf-b4e5-a0234209624a {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:14:15 user nova-compute[82479]: WARNING nova.compute.manager [req-c3fbb7e9-e1ef-474c-8513-3ad29865b04e req-4deac785-f7da-4644-8989-3aff058c9d28 service nova] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Received unexpected event network-vif-plugged-617f05b8-c04e-4abf-b4e5-a0234209624a for instance with vm_state active and task_state resize_finish.
Apr 14 00:14:15 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Removed pending event for b3475e7e-ceb4-452a-a045-dbf43c5944dd due to event {{(pid=82479) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 00:14:15 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681431255.58081, b3475e7e-ceb4-452a-a045-dbf43c5944dd => Resumed> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:14:15 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] VM Resumed (Lifecycle Event)
Apr 14 00:14:15 user nova-compute[82479]: DEBUG nova.compute.manager [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Instance event wait completed in 0 seconds for  {{(pid=82479) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 00:14:15 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Instance running successfully.
Apr 14 00:14:15 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Failed to set time: agent not configured {{(pid=82479) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Apr 14 00:14:15 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-e9d5c34c-db8a-4e02-8046-1646a346bf25 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] finish_migration finished successfully. {{(pid=82479) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11742}}
Apr 14 00:14:15 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:14:15 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:14:15 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 14 00:14:15 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681431255.5825715, b3475e7e-ceb4-452a-a045-dbf43c5944dd => Started> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:14:15 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] VM Started (Lifecycle Event)
Apr 14 00:14:15 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:14:15 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:14:15 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 14 00:14:16 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-b5224f3d-de3c-4d9b-843c-55e525728ceb tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6c35b78e-41e3-40c1-b265-8e1fa5e859c6" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:14:16 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-b5224f3d-de3c-4d9b-843c-55e525728ceb tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6c35b78e-41e3-40c1-b265-8e1fa5e859c6" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:14:16 user nova-compute[82479]: INFO nova.compute.manager [None req-b5224f3d-de3c-4d9b-843c-55e525728ceb tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Shelving
Apr 14 00:14:16 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:16 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:16 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:16 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:16 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:16 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:16 user nova-compute[82479]: DEBUG nova.compute.manager [req-fde2131b-e9f0-4823-957c-f508cffa51d7 req-ec7db4c3-30ae-4d49-a320-b20d56577b37 service nova] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Received event network-vif-unplugged-62d9fce8-6815-4a29-ab53-d1205a2db648 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:14:16 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-fde2131b-e9f0-4823-957c-f508cffa51d7 req-ec7db4c3-30ae-4d49-a320-b20d56577b37 service nova] Acquiring lock "6c35b78e-41e3-40c1-b265-8e1fa5e859c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:14:16 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-fde2131b-e9f0-4823-957c-f508cffa51d7 req-ec7db4c3-30ae-4d49-a320-b20d56577b37 service nova] Lock "6c35b78e-41e3-40c1-b265-8e1fa5e859c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:14:16 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-fde2131b-e9f0-4823-957c-f508cffa51d7 req-ec7db4c3-30ae-4d49-a320-b20d56577b37 service nova] Lock "6c35b78e-41e3-40c1-b265-8e1fa5e859c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:14:16 user nova-compute[82479]: DEBUG nova.compute.manager [req-fde2131b-e9f0-4823-957c-f508cffa51d7 req-ec7db4c3-30ae-4d49-a320-b20d56577b37 service nova] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] No waiting events found dispatching network-vif-unplugged-62d9fce8-6815-4a29-ab53-d1205a2db648 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:14:16 user nova-compute[82479]: WARNING nova.compute.manager [req-fde2131b-e9f0-4823-957c-f508cffa51d7 req-ec7db4c3-30ae-4d49-a320-b20d56577b37 service nova] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Received unexpected event network-vif-unplugged-62d9fce8-6815-4a29-ab53-d1205a2db648 for instance with vm_state active and task_state shelving.
Apr 14 00:14:16 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:16 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Instance destroyed successfully.
Apr 14 00:14:16 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-b5224f3d-de3c-4d9b-843c-55e525728ceb tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Beginning cold snapshot process
Apr 14 00:14:17 user nova-compute[82479]: DEBUG nova.privsep.utils [None req-b5224f3d-de3c-4d9b-843c-55e525728ceb tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82479) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 00:14:17 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-b5224f3d-de3c-4d9b-843c-55e525728ceb tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/6c35b78e-41e3-40c1-b265-8e1fa5e859c6/disk /opt/stack/data/nova/instances/snapshots/tmp00ysqnzx/ab435b2e93a04fc6925320559a92064f {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:14:17 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "2793d412-f405-4452-8e46-c192e3c92ccb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:14:17 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "2793d412-f405-4452-8e46-c192e3c92ccb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:14:17 user nova-compute[82479]: DEBUG nova.compute.manager [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Starting instance... {{(pid=82479) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 00:14:17 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:14:17 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:14:17 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82479) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 00:14:17 user nova-compute[82479]: INFO nova.compute.claims [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Claim successful on node user
Apr 14 00:14:17 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-b5224f3d-de3c-4d9b-843c-55e525728ceb tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/6c35b78e-41e3-40c1-b265-8e1fa5e859c6/disk /opt/stack/data/nova/instances/snapshots/tmp00ysqnzx/ab435b2e93a04fc6925320559a92064f" returned: 0 in 0.508s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:14:17 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-b5224f3d-de3c-4d9b-843c-55e525728ceb tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Snapshot extracted, beginning image upload
Apr 14 00:14:18 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:14:18 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:14:18 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.777s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:14:18 user nova-compute[82479]: DEBUG nova.compute.manager [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Start building networks asynchronously for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 00:14:18 user nova-compute[82479]: DEBUG nova.compute.manager [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Allocating IP information in the background. {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 00:14:18 user nova-compute[82479]: DEBUG nova.network.neutron [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] allocate_for_instance() {{(pid=82479) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 00:14:18 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 00:14:18 user nova-compute[82479]: DEBUG nova.compute.manager [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Start building block device mappings for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 00:14:18 user nova-compute[82479]: DEBUG nova.policy [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '90bad96535c3453792982c5acab9dbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f111e24414976beddba7ef90c4793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82479) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 00:14:18 user nova-compute[82479]: DEBUG nova.compute.manager [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Start spawning the instance on the hypervisor. {{(pid=82479) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 00:14:18 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Creating instance directory {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 00:14:18 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Creating image(s)
Apr 14 00:14:18 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "/opt/stack/data/nova/instances/2793d412-f405-4452-8e46-c192e3c92ccb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:14:18 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "/opt/stack/data/nova/instances/2793d412-f405-4452-8e46-c192e3c92ccb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:14:18 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "/opt/stack/data/nova/instances/2793d412-f405-4452-8e46-c192e3c92ccb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:14:18 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:18 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:14:18 user nova-compute[82479]: DEBUG nova.compute.manager [req-b64ee59e-366b-4518-96b4-1fb2a8885cee req-b5068d93-392d-455b-9765-ca637eb30acb service nova] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Received event network-vif-plugged-62d9fce8-6815-4a29-ab53-d1205a2db648 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:14:18 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-b64ee59e-366b-4518-96b4-1fb2a8885cee req-b5068d93-392d-455b-9765-ca637eb30acb service nova] Acquiring lock "6c35b78e-41e3-40c1-b265-8e1fa5e859c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:14:18 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-b64ee59e-366b-4518-96b4-1fb2a8885cee req-b5068d93-392d-455b-9765-ca637eb30acb service nova] Lock "6c35b78e-41e3-40c1-b265-8e1fa5e859c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:14:18 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-b64ee59e-366b-4518-96b4-1fb2a8885cee req-b5068d93-392d-455b-9765-ca637eb30acb service nova] Lock "6c35b78e-41e3-40c1-b265-8e1fa5e859c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:14:18 user nova-compute[82479]: DEBUG nova.compute.manager [req-b64ee59e-366b-4518-96b4-1fb2a8885cee req-b5068d93-392d-455b-9765-ca637eb30acb service nova] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] No waiting events found dispatching network-vif-plugged-62d9fce8-6815-4a29-ab53-d1205a2db648 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:14:18 user nova-compute[82479]: WARNING nova.compute.manager [req-b64ee59e-366b-4518-96b4-1fb2a8885cee req-b5068d93-392d-455b-9765-ca637eb30acb service nova] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Received unexpected event network-vif-plugged-62d9fce8-6815-4a29-ab53-d1205a2db648 for instance with vm_state active and task_state shelving_image_uploading.
Apr 14 00:14:18 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.180s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:14:18 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "3e200e101633f2016e569ae4c0a352380507d1e4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:14:18 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "3e200e101633f2016e569ae4c0a352380507d1e4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:14:18 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:14:19 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.136s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:14:19 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/2793d412-f405-4452-8e46-c192e3c92ccb/disk 1073741824 {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:14:19 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/2793d412-f405-4452-8e46-c192e3c92ccb/disk 1073741824" returned: 0 in 0.055s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:14:19 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "3e200e101633f2016e569ae4c0a352380507d1e4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.198s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:14:19 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:14:19 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.136s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:14:19 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2793d412-f405-4452-8e46-c192e3c92ccb/disk. size=1073741824 {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 00:14:19 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2793d412-f405-4452-8e46-c192e3c92ccb/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:14:19 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2793d412-f405-4452-8e46-c192e3c92ccb/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:14:19 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Cannot resize image /opt/stack/data/nova/instances/2793d412-f405-4452-8e46-c192e3c92ccb/disk to a smaller size. {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 00:14:19 user nova-compute[82479]: DEBUG nova.objects.instance [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lazy-loading 'migration_context' on Instance uuid 2793d412-f405-4452-8e46-c192e3c92ccb {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:14:19 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Created local disks {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 00:14:19 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Ensure instance console log exists: /opt/stack/data/nova/instances/2793d412-f405-4452-8e46-c192e3c92ccb/console.log {{(pid=82479) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 00:14:19 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:14:19 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:14:19 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:14:19 user nova-compute[82479]: DEBUG nova.network.neutron [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Successfully created port: 47e07f85-3946-4934-a2ec-c9c77ccc3761 {{(pid=82479) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 00:14:20 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-b5224f3d-de3c-4d9b-843c-55e525728ceb tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Snapshot image upload complete
Apr 14 00:14:20 user nova-compute[82479]: DEBUG nova.compute.manager [None req-b5224f3d-de3c-4d9b-843c-55e525728ceb tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:14:20 user nova-compute[82479]: INFO nova.compute.manager [None req-b5224f3d-de3c-4d9b-843c-55e525728ceb tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Shelve offloading
Apr 14 00:14:20 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Instance destroyed successfully.
Apr 14 00:14:20 user nova-compute[82479]: DEBUG nova.compute.manager [None req-b5224f3d-de3c-4d9b-843c-55e525728ceb tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:14:20 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-b5224f3d-de3c-4d9b-843c-55e525728ceb tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "refresh_cache-6c35b78e-41e3-40c1-b265-8e1fa5e859c6" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:14:20 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-b5224f3d-de3c-4d9b-843c-55e525728ceb tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquired lock "refresh_cache-6c35b78e-41e3-40c1-b265-8e1fa5e859c6" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:14:20 user nova-compute[82479]: DEBUG nova.network.neutron [None req-b5224f3d-de3c-4d9b-843c-55e525728ceb tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 00:14:21 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:21 user nova-compute[82479]: DEBUG nova.network.neutron [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Successfully updated port: 47e07f85-3946-4934-a2ec-c9c77ccc3761 {{(pid=82479) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 00:14:21 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "refresh_cache-2793d412-f405-4452-8e46-c192e3c92ccb" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:14:21 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquired lock "refresh_cache-2793d412-f405-4452-8e46-c192e3c92ccb" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:14:21 user nova-compute[82479]: DEBUG nova.network.neutron [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 00:14:21 user nova-compute[82479]: DEBUG nova.compute.manager [req-508105f5-b8ea-4619-a727-7e2ffe79f6a8 req-997c63e9-cc17-4bda-9219-2c1190c2493e service nova] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Received event network-changed-47e07f85-3946-4934-a2ec-c9c77ccc3761 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:14:21 user nova-compute[82479]: DEBUG nova.compute.manager [req-508105f5-b8ea-4619-a727-7e2ffe79f6a8 req-997c63e9-cc17-4bda-9219-2c1190c2493e service nova] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Refreshing instance network info cache due to event network-changed-47e07f85-3946-4934-a2ec-c9c77ccc3761. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:14:21 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-508105f5-b8ea-4619-a727-7e2ffe79f6a8 req-997c63e9-cc17-4bda-9219-2c1190c2493e service nova] Acquiring lock "refresh_cache-2793d412-f405-4452-8e46-c192e3c92ccb" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:14:21 user nova-compute[82479]: DEBUG nova.network.neutron [None req-b5224f3d-de3c-4d9b-843c-55e525728ceb tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Updating instance_info_cache with network_info: [{"id": "62d9fce8-6815-4a29-ab53-d1205a2db648", "address": "fa:16:3e:46:a4:3f", "network": {"id": "66316d10-fed3-4fb9-877e-a01542ca5855", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-93456010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f20caf676a64b9b97027f3fc9bc724c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62d9fce8-68", "ovs_interfaceid": "62d9fce8-6815-4a29-ab53-d1205a2db648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:14:21 user nova-compute[82479]: DEBUG nova.network.neutron [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Instance cache missing network info. {{(pid=82479) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 00:14:21 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-b5224f3d-de3c-4d9b-843c-55e525728ceb tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Releasing lock "refresh_cache-6c35b78e-41e3-40c1-b265-8e1fa5e859c6" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:14:21 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:22 user nova-compute[82479]: DEBUG nova.network.neutron [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Updating instance_info_cache with network_info: [{"id": "47e07f85-3946-4934-a2ec-c9c77ccc3761", "address": "fa:16:3e:7b:b8:78", "network": {"id": "491696ea-38ef-4c19-9d94-a61223c1fa00", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1323121698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3f111e24414976beddba7ef90c4793", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e07f85-39", "ovs_interfaceid": "47e07f85-3946-4934-a2ec-c9c77ccc3761", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:14:22 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Releasing lock "refresh_cache-2793d412-f405-4452-8e46-c192e3c92ccb" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:14:22 user nova-compute[82479]: DEBUG nova.compute.manager [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Instance network_info: |[{"id": "47e07f85-3946-4934-a2ec-c9c77ccc3761", "address": "fa:16:3e:7b:b8:78", "network": {"id": "491696ea-38ef-4c19-9d94-a61223c1fa00", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1323121698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3f111e24414976beddba7ef90c4793", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e07f85-39", "ovs_interfaceid": "47e07f85-3946-4934-a2ec-c9c77ccc3761", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 00:14:22 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-508105f5-b8ea-4619-a727-7e2ffe79f6a8 req-997c63e9-cc17-4bda-9219-2c1190c2493e service nova] Acquired lock "refresh_cache-2793d412-f405-4452-8e46-c192e3c92ccb" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:14:22 user nova-compute[82479]: DEBUG nova.network.neutron [req-508105f5-b8ea-4619-a727-7e2ffe79f6a8 req-997c63e9-cc17-4bda-9219-2c1190c2493e service nova] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Refreshing network info cache for port 47e07f85-3946-4934-a2ec-c9c77ccc3761 {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:14:22 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Start _get_guest_xml network_info=[{"id": "47e07f85-3946-4934-a2ec-c9c77ccc3761", "address": "fa:16:3e:7b:b8:78", "network": {"id": "491696ea-38ef-4c19-9d94-a61223c1fa00", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1323121698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3f111e24414976beddba7ef90c4793", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e07f85-39", "ovs_interfaceid": "47e07f85-3946-4934-a2ec-c9c77ccc3761", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 00:14:22 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:14:22 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:14:22 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82479) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 00:14:22 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T00:02:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 00:14:22 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Flavor limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 00:14:22 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Image limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 00:14:22 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Flavor pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 00:14:22 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Image pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 00:14:22 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 00:14:22 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 00:14:22 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 00:14:22 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Got 1 possible topologies {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 00:14:22 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 00:14:22 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 00:14:22 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:14:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1903424874',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1903424874',id=25,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba3f111e24414976beddba7ef90c4793',ramdisk_id='',reservation_id='r-imvsl09i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1545234843',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:14:19Z,user_data=None,user_id='90bad96535c3453792982c5acab9dbc6',uuid=2793d412-f405-4452-8e46-c192e3c92ccb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47e07f85-3946-4934-a2ec-c9c77ccc3761", "address": "fa:16:3e:7b:b8:78", "network": {"id": "491696ea-38ef-4c19-9d94-a61223c1fa00", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1323121698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3f111e24414976beddba7ef90c4793", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e07f85-39", "ovs_interfaceid": "47e07f85-3946-4934-a2ec-c9c77ccc3761", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82479) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 00:14:22 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Converting VIF {"id": "47e07f85-3946-4934-a2ec-c9c77ccc3761", "address": "fa:16:3e:7b:b8:78", "network": {"id": "491696ea-38ef-4c19-9d94-a61223c1fa00", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1323121698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3f111e24414976beddba7ef90c4793", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e07f85-39", "ovs_interfaceid": "47e07f85-3946-4934-a2ec-c9c77ccc3761", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:14:22 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:b8:78,bridge_name='br-int',has_traffic_filtering=True,id=47e07f85-3946-4934-a2ec-c9c77ccc3761,network=Network(491696ea-38ef-4c19-9d94-a61223c1fa00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47e07f85-39') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:14:22 user nova-compute[82479]: DEBUG nova.objects.instance [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lazy-loading 'pci_devices' on Instance uuid 2793d412-f405-4452-8e46-c192e3c92ccb {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:14:22 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] End _get_guest_xml xml=<domain type="kvm">
Apr 14 00:14:22 user nova-compute[82479]:   <uuid>2793d412-f405-4452-8e46-c192e3c92ccb</uuid>
Apr 14 00:14:22 user nova-compute[82479]:   <name>instance-00000019</name>
Apr 14 00:14:22 user nova-compute[82479]:   <memory>131072</memory>
Apr 14 00:14:22 user nova-compute[82479]:   <vcpu>1</vcpu>
Apr 14 00:14:22 user nova-compute[82479]:   <metadata>
Apr 14 00:14:22 user nova-compute[82479]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 00:14:22 user nova-compute[82479]:       <nova:package version="0.0.0"/>
Apr 14 00:14:22 user nova-compute[82479]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1903424874</nova:name>
Apr 14 00:14:22 user nova-compute[82479]:       <nova:creationTime>2023-04-14 00:14:22</nova:creationTime>
Apr 14 00:14:22 user nova-compute[82479]:       <nova:flavor name="m1.nano">
Apr 14 00:14:22 user nova-compute[82479]:         <nova:memory>128</nova:memory>
Apr 14 00:14:22 user nova-compute[82479]:         <nova:disk>1</nova:disk>
Apr 14 00:14:22 user nova-compute[82479]:         <nova:swap>0</nova:swap>
Apr 14 00:14:22 user nova-compute[82479]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 00:14:22 user nova-compute[82479]:         <nova:vcpus>1</nova:vcpus>
Apr 14 00:14:22 user nova-compute[82479]:       </nova:flavor>
Apr 14 00:14:22 user nova-compute[82479]:       <nova:owner>
Apr 14 00:14:22 user nova-compute[82479]:         <nova:user uuid="90bad96535c3453792982c5acab9dbc6">tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member</nova:user>
Apr 14 00:14:22 user nova-compute[82479]:         <nova:project uuid="ba3f111e24414976beddba7ef90c4793">tempest-ServerBootFromVolumeStableRescueTest-1545234843</nova:project>
Apr 14 00:14:22 user nova-compute[82479]:       </nova:owner>
Apr 14 00:14:22 user nova-compute[82479]:       <nova:root type="image" uuid="6db62068-7278-4cd8-b41f-d0140d89e199"/>
Apr 14 00:14:22 user nova-compute[82479]:       <nova:ports>
Apr 14 00:14:22 user nova-compute[82479]:         <nova:port uuid="47e07f85-3946-4934-a2ec-c9c77ccc3761">
Apr 14 00:14:22 user nova-compute[82479]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 14 00:14:22 user nova-compute[82479]:         </nova:port>
Apr 14 00:14:22 user nova-compute[82479]:       </nova:ports>
Apr 14 00:14:22 user nova-compute[82479]:     </nova:instance>
Apr 14 00:14:22 user nova-compute[82479]:   </metadata>
Apr 14 00:14:22 user nova-compute[82479]:   <sysinfo type="smbios">
Apr 14 00:14:22 user nova-compute[82479]:     <system>
Apr 14 00:14:22 user nova-compute[82479]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 00:14:22 user nova-compute[82479]:       <entry name="product">OpenStack Nova</entry>
Apr 14 00:14:22 user nova-compute[82479]:       <entry name="version">0.0.0</entry>
Apr 14 00:14:22 user nova-compute[82479]:       <entry name="serial">2793d412-f405-4452-8e46-c192e3c92ccb</entry>
Apr 14 00:14:22 user nova-compute[82479]:       <entry name="uuid">2793d412-f405-4452-8e46-c192e3c92ccb</entry>
Apr 14 00:14:22 user nova-compute[82479]:       <entry name="family">Virtual Machine</entry>
Apr 14 00:14:22 user nova-compute[82479]:     </system>
Apr 14 00:14:22 user nova-compute[82479]:   </sysinfo>
Apr 14 00:14:22 user nova-compute[82479]:   <os>
Apr 14 00:14:22 user nova-compute[82479]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 00:14:22 user nova-compute[82479]:     <boot dev="hd"/>
Apr 14 00:14:22 user nova-compute[82479]:     <smbios mode="sysinfo"/>
Apr 14 00:14:22 user nova-compute[82479]:   </os>
Apr 14 00:14:22 user nova-compute[82479]:   <features>
Apr 14 00:14:22 user nova-compute[82479]:     <acpi/>
Apr 14 00:14:22 user nova-compute[82479]:     <apic/>
Apr 14 00:14:22 user nova-compute[82479]:     <vmcoreinfo/>
Apr 14 00:14:22 user nova-compute[82479]:   </features>
Apr 14 00:14:22 user nova-compute[82479]:   <clock offset="utc">
Apr 14 00:14:22 user nova-compute[82479]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 00:14:22 user nova-compute[82479]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 00:14:22 user nova-compute[82479]:     <timer name="hpet" present="no"/>
Apr 14 00:14:22 user nova-compute[82479]:   </clock>
Apr 14 00:14:22 user nova-compute[82479]:   <cpu mode="custom" match="exact">
Apr 14 00:14:22 user nova-compute[82479]:     <model>Nehalem</model>
Apr 14 00:14:22 user nova-compute[82479]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 00:14:22 user nova-compute[82479]:   </cpu>
Apr 14 00:14:22 user nova-compute[82479]:   <devices>
Apr 14 00:14:22 user nova-compute[82479]:     <disk type="file" device="disk">
Apr 14 00:14:22 user nova-compute[82479]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 00:14:22 user nova-compute[82479]:       <source file="/opt/stack/data/nova/instances/2793d412-f405-4452-8e46-c192e3c92ccb/disk"/>
Apr 14 00:14:22 user nova-compute[82479]:       <target dev="vda" bus="virtio"/>
Apr 14 00:14:22 user nova-compute[82479]:     </disk>
Apr 14 00:14:22 user nova-compute[82479]:     <interface type="ethernet">
Apr 14 00:14:22 user nova-compute[82479]:       <mac address="fa:16:3e:7b:b8:78"/>
Apr 14 00:14:22 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:14:22 user nova-compute[82479]:       <mtu size="1442"/>
Apr 14 00:14:22 user nova-compute[82479]:       <target dev="tap47e07f85-39"/>
Apr 14 00:14:22 user nova-compute[82479]:     </interface>
Apr 14 00:14:22 user nova-compute[82479]:     <serial type="pty">
Apr 14 00:14:22 user nova-compute[82479]:       <log file="/opt/stack/data/nova/instances/2793d412-f405-4452-8e46-c192e3c92ccb/console.log" append="off"/>
Apr 14 00:14:22 user nova-compute[82479]:     </serial>
Apr 14 00:14:22 user nova-compute[82479]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 00:14:22 user nova-compute[82479]:     <video>
Apr 14 00:14:22 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:14:22 user nova-compute[82479]:     </video>
Apr 14 00:14:22 user nova-compute[82479]:     <rng model="virtio">
Apr 14 00:14:22 user nova-compute[82479]:       <backend model="random">/dev/urandom</backend>
Apr 14 00:14:22 user nova-compute[82479]:     </rng>
Apr 14 00:14:22 user nova-compute[82479]:     <controller type="usb" index="0" model="none"/>
Apr 14 00:14:22 user nova-compute[82479]:     <memballoon model="virtio">
Apr 14 00:14:22 user nova-compute[82479]:       <stats period="10"/>
Apr 14 00:14:22 user nova-compute[82479]:     </memballoon>
Apr 14 00:14:22 user nova-compute[82479]:   </devices>
Apr 14 00:14:22 user nova-compute[82479]: </domain>
Apr 14 00:14:22 user nova-compute[82479]:  {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 00:14:22 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:14:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1903424874',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1903424874',id=25,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba3f111e24414976beddba7ef90c4793',ramdisk_id='',reservation_id='r-imvsl09i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1545234843',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:14:19Z,user_data=None,user_id='90bad96535c3453792982c5acab9dbc6',uuid=2793d412-f405-4452-8e46-c192e3c92ccb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47e07f85-3946-4934-a2ec-c9c77ccc3761", "address": "fa:16:3e:7b:b8:78", "network": {"id": "491696ea-38ef-4c19-9d94-a61223c1fa00", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1323121698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3f111e24414976beddba7ef90c4793", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e07f85-39", "ovs_interfaceid": "47e07f85-3946-4934-a2ec-c9c77ccc3761", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 00:14:22 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Converting VIF {"id": "47e07f85-3946-4934-a2ec-c9c77ccc3761", "address": "fa:16:3e:7b:b8:78", "network": {"id": "491696ea-38ef-4c19-9d94-a61223c1fa00", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1323121698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3f111e24414976beddba7ef90c4793", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e07f85-39", "ovs_interfaceid": "47e07f85-3946-4934-a2ec-c9c77ccc3761", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:14:22 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:b8:78,bridge_name='br-int',has_traffic_filtering=True,id=47e07f85-3946-4934-a2ec-c9c77ccc3761,network=Network(491696ea-38ef-4c19-9d94-a61223c1fa00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47e07f85-39') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:14:22 user nova-compute[82479]: DEBUG os_vif [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:b8:78,bridge_name='br-int',has_traffic_filtering=True,id=47e07f85-3946-4934-a2ec-c9c77ccc3761,network=Network(491696ea-38ef-4c19-9d94-a61223c1fa00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47e07f85-39') {{(pid=82479) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 00:14:22 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:22 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:14:22 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 00:14:22 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:22 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap47e07f85-39, may_exist=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:14:22 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap47e07f85-39, col_values=(('external_ids', {'iface-id': '47e07f85-3946-4934-a2ec-c9c77ccc3761', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:b8:78', 'vm-uuid': '2793d412-f405-4452-8e46-c192e3c92ccb'}),)) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:14:22 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:22 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:14:22 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:22 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:22 user nova-compute[82479]: INFO os_vif [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:b8:78,bridge_name='br-int',has_traffic_filtering=True,id=47e07f85-3946-4934-a2ec-c9c77ccc3761,network=Network(491696ea-38ef-4c19-9d94-a61223c1fa00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47e07f85-39')
Apr 14 00:14:22 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:14:22 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] No VIF found with MAC fa:16:3e:7b:b8:78, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:14:23 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Instance destroyed successfully.
Apr 14 00:14:23 user nova-compute[82479]: DEBUG nova.objects.instance [None req-b5224f3d-de3c-4d9b-843c-55e525728ceb tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lazy-loading 'resources' on Instance uuid 6c35b78e-41e3-40c1-b265-8e1fa5e859c6 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:14:23 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-b5224f3d-de3c-4d9b-843c-55e525728ceb tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:12:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1217758263',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1217758263',id=21,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL4UEOyJwYDEnyxQAY/gseNadkyiHeTpfezaewpCqENgdXuLtykmPySbfnvUAXob1mjZ2nh6y7mHb/UX7vHeRXLyyBaoGtHKG1dH84NmufncEafrHDE/Zf0amaymIZieug==',key_name='tempest-keypair-749403403',keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:12:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='4f20caf676a64b9b97027f3fc9bc724c',ramdisk_id='',reservation_id='r-5zzsx975',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1395403129',owner_user_name='tempest-AttachVolumeShelveTestJSON-1395403129-project-member',shelved_at='2023-04-14T00:14:20.285141',shelved_host='user',shelved_image_id='7400d66e-cf11-48fd-8940-9d8feaf95cd3'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T00:14:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f8b18d40ecd4b4e976cf2018af8220c',uuid=6c35b78e-41e3-40c1-b265-8e1fa5e859c6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "62d9fce8-6815-4a29-ab53-d1205a2db648", "address": "fa:16:3e:46:a4:3f", "network": {"id": "66316d10-fed3-4fb9-877e-a01542ca5855", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-93456010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f20caf676a64b9b97027f3fc9bc724c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62d9fce8-68", "ovs_interfaceid": "62d9fce8-6815-4a29-ab53-d1205a2db648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 00:14:23 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-b5224f3d-de3c-4d9b-843c-55e525728ceb tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Converting VIF {"id": "62d9fce8-6815-4a29-ab53-d1205a2db648", "address": "fa:16:3e:46:a4:3f", "network": {"id": "66316d10-fed3-4fb9-877e-a01542ca5855", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-93456010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f20caf676a64b9b97027f3fc9bc724c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62d9fce8-68", "ovs_interfaceid": "62d9fce8-6815-4a29-ab53-d1205a2db648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:14:23 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-b5224f3d-de3c-4d9b-843c-55e525728ceb tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:a4:3f,bridge_name='br-int',has_traffic_filtering=True,id=62d9fce8-6815-4a29-ab53-d1205a2db648,network=Network(66316d10-fed3-4fb9-877e-a01542ca5855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62d9fce8-68') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:14:23 user nova-compute[82479]: DEBUG os_vif [None req-b5224f3d-de3c-4d9b-843c-55e525728ceb tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:a4:3f,bridge_name='br-int',has_traffic_filtering=True,id=62d9fce8-6815-4a29-ab53-d1205a2db648,network=Network(66316d10-fed3-4fb9-877e-a01542ca5855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62d9fce8-68') {{(pid=82479) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 00:14:23 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:23 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap62d9fce8-68, bridge=br-int, if_exists=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:14:23 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:23 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:14:23 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:23 user nova-compute[82479]: INFO os_vif [None req-b5224f3d-de3c-4d9b-843c-55e525728ceb tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:a4:3f,bridge_name='br-int',has_traffic_filtering=True,id=62d9fce8-6815-4a29-ab53-d1205a2db648,network=Network(66316d10-fed3-4fb9-877e-a01542ca5855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62d9fce8-68')
Apr 14 00:14:23 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-b5224f3d-de3c-4d9b-843c-55e525728ceb tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Deleting instance files /opt/stack/data/nova/instances/6c35b78e-41e3-40c1-b265-8e1fa5e859c6_del
Apr 14 00:14:23 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-b5224f3d-de3c-4d9b-843c-55e525728ceb tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Deletion of /opt/stack/data/nova/instances/6c35b78e-41e3-40c1-b265-8e1fa5e859c6_del complete
Apr 14 00:14:23 user nova-compute[82479]: INFO nova.scheduler.client.report [None req-b5224f3d-de3c-4d9b-843c-55e525728ceb tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Deleted allocations for instance 6c35b78e-41e3-40c1-b265-8e1fa5e859c6
Apr 14 00:14:23 user nova-compute[82479]: DEBUG nova.network.neutron [req-508105f5-b8ea-4619-a727-7e2ffe79f6a8 req-997c63e9-cc17-4bda-9219-2c1190c2493e service nova] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Updated VIF entry in instance network info cache for port 47e07f85-3946-4934-a2ec-c9c77ccc3761. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:14:23 user nova-compute[82479]: DEBUG nova.network.neutron [req-508105f5-b8ea-4619-a727-7e2ffe79f6a8 req-997c63e9-cc17-4bda-9219-2c1190c2493e service nova] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Updating instance_info_cache with network_info: [{"id": "47e07f85-3946-4934-a2ec-c9c77ccc3761", "address": "fa:16:3e:7b:b8:78", "network": {"id": "491696ea-38ef-4c19-9d94-a61223c1fa00", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1323121698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3f111e24414976beddba7ef90c4793", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e07f85-39", "ovs_interfaceid": "47e07f85-3946-4934-a2ec-c9c77ccc3761", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:14:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-508105f5-b8ea-4619-a727-7e2ffe79f6a8 req-997c63e9-cc17-4bda-9219-2c1190c2493e service nova] Releasing lock "refresh_cache-2793d412-f405-4452-8e46-c192e3c92ccb" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:14:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-b5224f3d-de3c-4d9b-843c-55e525728ceb tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:14:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-b5224f3d-de3c-4d9b-843c-55e525728ceb tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:14:23 user nova-compute[82479]: DEBUG nova.objects.instance [None req-b5224f3d-de3c-4d9b-843c-55e525728ceb tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lazy-loading 'numa_topology' on Instance uuid 6c35b78e-41e3-40c1-b265-8e1fa5e859c6 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:14:23 user nova-compute[82479]: DEBUG nova.compute.manager [req-0bbdf639-33f1-4bee-a0a5-fd109a98c91b req-3ea5aa9c-252d-42a1-862b-4b9a63681019 service nova] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Received event network-changed-62d9fce8-6815-4a29-ab53-d1205a2db648 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:14:23 user nova-compute[82479]: DEBUG nova.compute.manager [req-0bbdf639-33f1-4bee-a0a5-fd109a98c91b req-3ea5aa9c-252d-42a1-862b-4b9a63681019 service nova] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Refreshing instance network info cache due to event network-changed-62d9fce8-6815-4a29-ab53-d1205a2db648. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:14:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0bbdf639-33f1-4bee-a0a5-fd109a98c91b req-3ea5aa9c-252d-42a1-862b-4b9a63681019 service nova] Acquiring lock "refresh_cache-6c35b78e-41e3-40c1-b265-8e1fa5e859c6" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:14:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0bbdf639-33f1-4bee-a0a5-fd109a98c91b req-3ea5aa9c-252d-42a1-862b-4b9a63681019 service nova] Acquired lock "refresh_cache-6c35b78e-41e3-40c1-b265-8e1fa5e859c6" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:14:23 user nova-compute[82479]: DEBUG nova.network.neutron [req-0bbdf639-33f1-4bee-a0a5-fd109a98c91b req-3ea5aa9c-252d-42a1-862b-4b9a63681019 service nova] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Refreshing network info cache for port 62d9fce8-6815-4a29-ab53-d1205a2db648 {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:14:23 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:23 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:23 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:23 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-b5224f3d-de3c-4d9b-843c-55e525728ceb tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:14:23 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-b5224f3d-de3c-4d9b-843c-55e525728ceb tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:14:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-b5224f3d-de3c-4d9b-843c-55e525728ceb tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.562s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:14:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-b5224f3d-de3c-4d9b-843c-55e525728ceb tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6c35b78e-41e3-40c1-b265-8e1fa5e859c6" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.851s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:14:23 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:23 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:24 user nova-compute[82479]: DEBUG nova.compute.manager [req-faf23b41-0b7f-4cbd-ad2a-eb9119d437ba req-326a2bcd-5e62-4ffd-9be7-a0d5172afbeb service nova] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Received event network-vif-plugged-47e07f85-3946-4934-a2ec-c9c77ccc3761 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:14:24 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-faf23b41-0b7f-4cbd-ad2a-eb9119d437ba req-326a2bcd-5e62-4ffd-9be7-a0d5172afbeb service nova] Acquiring lock "2793d412-f405-4452-8e46-c192e3c92ccb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:14:24 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-faf23b41-0b7f-4cbd-ad2a-eb9119d437ba req-326a2bcd-5e62-4ffd-9be7-a0d5172afbeb service nova] Lock "2793d412-f405-4452-8e46-c192e3c92ccb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:14:24 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-faf23b41-0b7f-4cbd-ad2a-eb9119d437ba req-326a2bcd-5e62-4ffd-9be7-a0d5172afbeb service nova] Lock "2793d412-f405-4452-8e46-c192e3c92ccb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:14:24 user nova-compute[82479]: DEBUG nova.compute.manager [req-faf23b41-0b7f-4cbd-ad2a-eb9119d437ba req-326a2bcd-5e62-4ffd-9be7-a0d5172afbeb service nova] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] No waiting events found dispatching network-vif-plugged-47e07f85-3946-4934-a2ec-c9c77ccc3761 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:14:24 user nova-compute[82479]: WARNING nova.compute.manager [req-faf23b41-0b7f-4cbd-ad2a-eb9119d437ba req-326a2bcd-5e62-4ffd-9be7-a0d5172afbeb service nova] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Received unexpected event network-vif-plugged-47e07f85-3946-4934-a2ec-c9c77ccc3761 for instance with vm_state building and task_state spawning.
Apr 14 00:14:24 user nova-compute[82479]: DEBUG nova.network.neutron [req-0bbdf639-33f1-4bee-a0a5-fd109a98c91b req-3ea5aa9c-252d-42a1-862b-4b9a63681019 service nova] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Updated VIF entry in instance network info cache for port 62d9fce8-6815-4a29-ab53-d1205a2db648. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:14:24 user nova-compute[82479]: DEBUG nova.network.neutron [req-0bbdf639-33f1-4bee-a0a5-fd109a98c91b req-3ea5aa9c-252d-42a1-862b-4b9a63681019 service nova] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Updating instance_info_cache with network_info: [{"id": "62d9fce8-6815-4a29-ab53-d1205a2db648", "address": "fa:16:3e:46:a4:3f", "network": {"id": "66316d10-fed3-4fb9-877e-a01542ca5855", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-93456010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f20caf676a64b9b97027f3fc9bc724c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap62d9fce8-68", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:14:24 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0bbdf639-33f1-4bee-a0a5-fd109a98c91b req-3ea5aa9c-252d-42a1-862b-4b9a63681019 service nova] Releasing lock "refresh_cache-6c35b78e-41e3-40c1-b265-8e1fa5e859c6" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:14:26 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681431266.033988, 2793d412-f405-4452-8e46-c192e3c92ccb => Resumed> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:14:26 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] VM Resumed (Lifecycle Event)
Apr 14 00:14:26 user nova-compute[82479]: DEBUG nova.compute.manager [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Instance event wait completed in 0 seconds for  {{(pid=82479) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 00:14:26 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Guest created on hypervisor {{(pid=82479) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 00:14:26 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Instance spawned successfully.
Apr 14 00:14:26 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 00:14:26 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:14:26 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:14:26 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Found default for hw_cdrom_bus of ide {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:14:26 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Found default for hw_disk_bus of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:14:26 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Found default for hw_input_bus of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:14:26 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Found default for hw_pointer_model of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:14:26 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Found default for hw_video_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:14:26 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Found default for hw_vif_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:14:26 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:26 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:14:26 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681431266.0374076, 2793d412-f405-4452-8e46-c192e3c92ccb => Started> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:14:26 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] VM Started (Lifecycle Event)
Apr 14 00:14:26 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:14:26 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:14:26 user nova-compute[82479]: DEBUG nova.compute.manager [req-75994828-4efd-48de-8e02-6dd2f427dcdd req-35c4415f-0f59-4beb-a88c-b26439028a9a service nova] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Received event network-vif-plugged-47e07f85-3946-4934-a2ec-c9c77ccc3761 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:14:26 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-75994828-4efd-48de-8e02-6dd2f427dcdd req-35c4415f-0f59-4beb-a88c-b26439028a9a service nova] Acquiring lock "2793d412-f405-4452-8e46-c192e3c92ccb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:14:26 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-75994828-4efd-48de-8e02-6dd2f427dcdd req-35c4415f-0f59-4beb-a88c-b26439028a9a service nova] Lock "2793d412-f405-4452-8e46-c192e3c92ccb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:14:26 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-75994828-4efd-48de-8e02-6dd2f427dcdd req-35c4415f-0f59-4beb-a88c-b26439028a9a service nova] Lock "2793d412-f405-4452-8e46-c192e3c92ccb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:14:26 user nova-compute[82479]: DEBUG nova.compute.manager [req-75994828-4efd-48de-8e02-6dd2f427dcdd req-35c4415f-0f59-4beb-a88c-b26439028a9a service nova] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] No waiting events found dispatching network-vif-plugged-47e07f85-3946-4934-a2ec-c9c77ccc3761 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:14:26 user nova-compute[82479]: WARNING nova.compute.manager [req-75994828-4efd-48de-8e02-6dd2f427dcdd req-35c4415f-0f59-4beb-a88c-b26439028a9a service nova] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Received unexpected event network-vif-plugged-47e07f85-3946-4934-a2ec-c9c77ccc3761 for instance with vm_state building and task_state spawning.
Apr 14 00:14:26 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:14:26 user nova-compute[82479]: INFO nova.compute.manager [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Took 7.44 seconds to spawn the instance on the hypervisor.
Apr 14 00:14:26 user nova-compute[82479]: DEBUG nova.compute.manager [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:14:26 user nova-compute[82479]: INFO nova.compute.manager [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Took 8.63 seconds to build instance.
Apr 14 00:14:26 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ad9a0025-f8a8-4b86-8a45-b4207dac6875 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "2793d412-f405-4452-8e46-c192e3c92ccb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.777s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:14:28 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:29 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ae5c68de-1a03-4712-ba01-3c07ed3f81ff tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "01a65362-36ea-4817-8e83-f75d6daf808b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:14:29 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ae5c68de-1a03-4712-ba01-3c07ed3f81ff tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "01a65362-36ea-4817-8e83-f75d6daf808b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:14:29 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ae5c68de-1a03-4712-ba01-3c07ed3f81ff tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "01a65362-36ea-4817-8e83-f75d6daf808b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:14:29 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ae5c68de-1a03-4712-ba01-3c07ed3f81ff tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "01a65362-36ea-4817-8e83-f75d6daf808b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:14:29 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ae5c68de-1a03-4712-ba01-3c07ed3f81ff tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "01a65362-36ea-4817-8e83-f75d6daf808b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:14:29 user nova-compute[82479]: INFO nova.compute.manager [None req-ae5c68de-1a03-4712-ba01-3c07ed3f81ff tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Terminating instance
Apr 14 00:14:29 user nova-compute[82479]: DEBUG nova.compute.manager [None req-ae5c68de-1a03-4712-ba01-3c07ed3f81ff tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Start destroying the instance on the hypervisor. {{(pid=82479) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 00:14:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:29 user nova-compute[82479]: DEBUG nova.compute.manager [req-fb05a02a-6a88-45fa-9ae6-ca919c51607e req-0b064cb8-5a46-4e15-b9fa-375d9c7f9a68 service nova] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Received event network-vif-unplugged-b5dfa187-0a42-4319-990f-1d3b22691c27 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:14:29 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-fb05a02a-6a88-45fa-9ae6-ca919c51607e req-0b064cb8-5a46-4e15-b9fa-375d9c7f9a68 service nova] Acquiring lock "01a65362-36ea-4817-8e83-f75d6daf808b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:14:29 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-fb05a02a-6a88-45fa-9ae6-ca919c51607e req-0b064cb8-5a46-4e15-b9fa-375d9c7f9a68 service nova] Lock "01a65362-36ea-4817-8e83-f75d6daf808b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:14:29 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-fb05a02a-6a88-45fa-9ae6-ca919c51607e req-0b064cb8-5a46-4e15-b9fa-375d9c7f9a68 service nova] Lock "01a65362-36ea-4817-8e83-f75d6daf808b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:14:29 user nova-compute[82479]: DEBUG nova.compute.manager [req-fb05a02a-6a88-45fa-9ae6-ca919c51607e req-0b064cb8-5a46-4e15-b9fa-375d9c7f9a68 service nova] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] No waiting events found dispatching network-vif-unplugged-b5dfa187-0a42-4319-990f-1d3b22691c27 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:14:29 user nova-compute[82479]: DEBUG nova.compute.manager [req-fb05a02a-6a88-45fa-9ae6-ca919c51607e req-0b064cb8-5a46-4e15-b9fa-375d9c7f9a68 service nova] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Received event network-vif-unplugged-b5dfa187-0a42-4319-990f-1d3b22691c27 for instance with task_state deleting. {{(pid=82479) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 00:14:30 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Instance destroyed successfully.
Apr 14 00:14:30 user nova-compute[82479]: DEBUG nova.objects.instance [None req-ae5c68de-1a03-4712-ba01-3c07ed3f81ff tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lazy-loading 'resources' on Instance uuid 01a65362-36ea-4817-8e83-f75d6daf808b {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:14:30 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-ae5c68de-1a03-4712-ba01-3c07ed3f81ff tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:04:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-874047723',display_name='tempest-AttachVolumeTestJSON-server-874047723',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-874047723',id=5,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFj5BOE0cuvlxZawRQVfnfugrJsq+vAMk/RiiLDSf3KCRmtu0WTqB0nwANMnYIuDZO4AsUPttsoe/j3WMHFiNDVdBMIPFOCGE/kkjYyw9NwqNVOKFmKjVIZ3x8l2xusRtg==',key_name='tempest-keypair-608426082',keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:05:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ec1aab0338ff4bd195a37a4199a378eb',ramdisk_id='',reservation_id='r-n5aqf0fe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1885059489',owner_user_name='tempest-AttachVolumeTestJSON-1885059489-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T00:12:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44530987616b417d87ce5909d8de1871',uuid=01a65362-36ea-4817-8e83-f75d6daf808b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b5dfa187-0a42-4319-990f-1d3b22691c27", "address": "fa:16:3e:7b:38:3d", "network": {"id": "368d9445-850e-4f74-b5cc-86d1eaa95d63", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374332689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec1aab0338ff4bd195a37a4199a378eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5dfa187-0a", "ovs_interfaceid": "b5dfa187-0a42-4319-990f-1d3b22691c27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 00:14:30 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-ae5c68de-1a03-4712-ba01-3c07ed3f81ff tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Converting VIF {"id": "b5dfa187-0a42-4319-990f-1d3b22691c27", "address": "fa:16:3e:7b:38:3d", "network": {"id": "368d9445-850e-4f74-b5cc-86d1eaa95d63", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374332689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec1aab0338ff4bd195a37a4199a378eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5dfa187-0a", "ovs_interfaceid": "b5dfa187-0a42-4319-990f-1d3b22691c27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:14:30 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-ae5c68de-1a03-4712-ba01-3c07ed3f81ff tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:38:3d,bridge_name='br-int',has_traffic_filtering=True,id=b5dfa187-0a42-4319-990f-1d3b22691c27,network=Network(368d9445-850e-4f74-b5cc-86d1eaa95d63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5dfa187-0a') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:14:30 user nova-compute[82479]: DEBUG os_vif [None req-ae5c68de-1a03-4712-ba01-3c07ed3f81ff tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:38:3d,bridge_name='br-int',has_traffic_filtering=True,id=b5dfa187-0a42-4319-990f-1d3b22691c27,network=Network(368d9445-850e-4f74-b5cc-86d1eaa95d63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5dfa187-0a') {{(pid=82479) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 00:14:30 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:30 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb5dfa187-0a, bridge=br-int, if_exists=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:14:30 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:30 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:14:30 user nova-compute[82479]: INFO os_vif [None req-ae5c68de-1a03-4712-ba01-3c07ed3f81ff tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:38:3d,bridge_name='br-int',has_traffic_filtering=True,id=b5dfa187-0a42-4319-990f-1d3b22691c27,network=Network(368d9445-850e-4f74-b5cc-86d1eaa95d63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5dfa187-0a')
Apr 14 00:14:30 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-ae5c68de-1a03-4712-ba01-3c07ed3f81ff tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Deleting instance files /opt/stack/data/nova/instances/01a65362-36ea-4817-8e83-f75d6daf808b_del
Apr 14 00:14:30 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-ae5c68de-1a03-4712-ba01-3c07ed3f81ff tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Deletion of /opt/stack/data/nova/instances/01a65362-36ea-4817-8e83-f75d6daf808b_del complete
Apr 14 00:14:30 user nova-compute[82479]: INFO nova.compute.manager [None req-ae5c68de-1a03-4712-ba01-3c07ed3f81ff tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Took 0.82 seconds to destroy the instance on the hypervisor.
Apr 14 00:14:30 user nova-compute[82479]: DEBUG oslo.service.loopingcall [None req-ae5c68de-1a03-4712-ba01-3c07ed3f81ff tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82479) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 00:14:30 user nova-compute[82479]: DEBUG nova.compute.manager [-] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Deallocating network for instance {{(pid=82479) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 00:14:30 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] deallocate_for_instance() {{(pid=82479) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 00:14:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:31 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Updating instance_info_cache with network_info: [] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:14:31 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Took 0.87 seconds to deallocate network for instance.
Apr 14 00:14:31 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ae5c68de-1a03-4712-ba01-3c07ed3f81ff tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:14:31 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ae5c68de-1a03-4712-ba01-3c07ed3f81ff tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:14:31 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-ae5c68de-1a03-4712-ba01-3c07ed3f81ff tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:14:31 user nova-compute[82479]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681431256.8665364, 6c35b78e-41e3-40c1-b265-8e1fa5e859c6 => Stopped> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:14:31 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] VM Stopped (Lifecycle Event)
Apr 14 00:14:31 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-ae5c68de-1a03-4712-ba01-3c07ed3f81ff tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:14:31 user nova-compute[82479]: DEBUG nova.compute.manager [None req-57eb6409-0c6b-4cae-a4b5-e963a9f8788f None None] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:14:31 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ae5c68de-1a03-4712-ba01-3c07ed3f81ff tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.530s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:14:31 user nova-compute[82479]: INFO nova.scheduler.client.report [None req-ae5c68de-1a03-4712-ba01-3c07ed3f81ff tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Deleted allocations for instance 01a65362-36ea-4817-8e83-f75d6daf808b
Apr 14 00:14:32 user nova-compute[82479]: DEBUG nova.compute.manager [req-fd5968d4-8893-4363-abae-ebcb1f75c459 req-9261d4b0-dda1-4674-965f-30cefa67462e service nova] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Received event network-vif-plugged-b5dfa187-0a42-4319-990f-1d3b22691c27 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:14:32 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-fd5968d4-8893-4363-abae-ebcb1f75c459 req-9261d4b0-dda1-4674-965f-30cefa67462e service nova] Acquiring lock "01a65362-36ea-4817-8e83-f75d6daf808b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:14:32 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-fd5968d4-8893-4363-abae-ebcb1f75c459 req-9261d4b0-dda1-4674-965f-30cefa67462e service nova] Lock "01a65362-36ea-4817-8e83-f75d6daf808b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:14:32 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-fd5968d4-8893-4363-abae-ebcb1f75c459 req-9261d4b0-dda1-4674-965f-30cefa67462e service nova] Lock "01a65362-36ea-4817-8e83-f75d6daf808b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:14:32 user nova-compute[82479]: DEBUG nova.compute.manager [req-fd5968d4-8893-4363-abae-ebcb1f75c459 req-9261d4b0-dda1-4674-965f-30cefa67462e service nova] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] No waiting events found dispatching network-vif-plugged-b5dfa187-0a42-4319-990f-1d3b22691c27 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:14:32 user nova-compute[82479]: WARNING nova.compute.manager [req-fd5968d4-8893-4363-abae-ebcb1f75c459 req-9261d4b0-dda1-4674-965f-30cefa67462e service nova] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Received unexpected event network-vif-plugged-b5dfa187-0a42-4319-990f-1d3b22691c27 for instance with vm_state deleted and task_state None.
Apr 14 00:14:32 user nova-compute[82479]: DEBUG nova.compute.manager [req-fd5968d4-8893-4363-abae-ebcb1f75c459 req-9261d4b0-dda1-4674-965f-30cefa67462e service nova] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Received event network-vif-deleted-b5dfa187-0a42-4319-990f-1d3b22691c27 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:14:32 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ae5c68de-1a03-4712-ba01-3c07ed3f81ff tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "01a65362-36ea-4817-8e83-f75d6daf808b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.524s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:14:35 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-9aaa445e-ec41-4a51-b441-cee8dcb7df1a tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Acquiring lock "8feba40a-03c7-4c60-b862-ee14fb8c9b05" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:14:35 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-9aaa445e-ec41-4a51-b441-cee8dcb7df1a tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "8feba40a-03c7-4c60-b862-ee14fb8c9b05" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:14:35 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-9aaa445e-ec41-4a51-b441-cee8dcb7df1a tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Acquiring lock "8feba40a-03c7-4c60-b862-ee14fb8c9b05-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:14:35 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-9aaa445e-ec41-4a51-b441-cee8dcb7df1a tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "8feba40a-03c7-4c60-b862-ee14fb8c9b05-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:14:35 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-9aaa445e-ec41-4a51-b441-cee8dcb7df1a tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "8feba40a-03c7-4c60-b862-ee14fb8c9b05-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:14:35 user nova-compute[82479]: INFO nova.compute.manager [None req-9aaa445e-ec41-4a51-b441-cee8dcb7df1a tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Terminating instance
Apr 14 00:14:35 user nova-compute[82479]: DEBUG nova.compute.manager [None req-9aaa445e-ec41-4a51-b441-cee8dcb7df1a tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Start destroying the instance on the hypervisor. {{(pid=82479) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 00:14:35 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:35 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:35 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:35 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:35 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:35 user nova-compute[82479]: DEBUG nova.compute.manager [req-ad6492b6-2001-4b65-b200-ce9af16ebd45 req-9d041b6d-13ee-4a28-9166-242fbaf7b939 service nova] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Received event network-vif-unplugged-53562eeb-b1fd-47f1-896e-cacd277abf24 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:14:35 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-ad6492b6-2001-4b65-b200-ce9af16ebd45 req-9d041b6d-13ee-4a28-9166-242fbaf7b939 service nova] Acquiring lock "8feba40a-03c7-4c60-b862-ee14fb8c9b05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:14:35 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-ad6492b6-2001-4b65-b200-ce9af16ebd45 req-9d041b6d-13ee-4a28-9166-242fbaf7b939 service nova] Lock "8feba40a-03c7-4c60-b862-ee14fb8c9b05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:14:35 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-ad6492b6-2001-4b65-b200-ce9af16ebd45 req-9d041b6d-13ee-4a28-9166-242fbaf7b939 service nova] Lock "8feba40a-03c7-4c60-b862-ee14fb8c9b05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:14:35 user nova-compute[82479]: DEBUG nova.compute.manager [req-ad6492b6-2001-4b65-b200-ce9af16ebd45 req-9d041b6d-13ee-4a28-9166-242fbaf7b939 service nova] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] No waiting events found dispatching network-vif-unplugged-53562eeb-b1fd-47f1-896e-cacd277abf24 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:14:35 user nova-compute[82479]: DEBUG nova.compute.manager [req-ad6492b6-2001-4b65-b200-ce9af16ebd45 req-9d041b6d-13ee-4a28-9166-242fbaf7b939 service nova] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Received event network-vif-unplugged-53562eeb-b1fd-47f1-896e-cacd277abf24 for instance with task_state deleting. {{(pid=82479) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 00:14:35 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:36 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:36 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Instance destroyed successfully.
Apr 14 00:14:36 user nova-compute[82479]: DEBUG nova.objects.instance [None req-9aaa445e-ec41-4a51-b441-cee8dcb7df1a tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lazy-loading 'resources' on Instance uuid 8feba40a-03c7-4c60-b862-ee14fb8c9b05 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:14:36 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-9aaa445e-ec41-4a51-b441-cee8dcb7df1a tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:08:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1922236850',display_name='tempest-VolumesAdminNegativeTest-server-1922236850',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1922236850',id=14,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAzgAnzYZDrHRSOtHVv/zz9Jq59yqHCgj+XUAspYSe7CuNpSWviw5YD7t1g/w4+Yy6KXGWPMGPWkh09BzPQ7qv26QIE2Xeb9uqZ1VE97Ta+wjygIDmM6CU+6ySBTktY5UA==',key_name='tempest-keypair-1912277882',keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:09:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dffbe999e60a4add9f23c83f9b0a4252',ramdisk_id='',reservation_id='r-ae2uaapr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1377720460',owner_user_name='tempest-VolumesAdminNegativeTest-1377720460-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T00:09:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='74d7e3d598e74c288e6a44996303b85e',uuid=8feba40a-03c7-4c60-b862-ee14fb8c9b05,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "53562eeb-b1fd-47f1-896e-cacd277abf24", "address": "fa:16:3e:e2:4e:ff", "network": {"id": "49f71fbc-7d65-4cc6-9efe-3918d5dbd51a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2079147315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dffbe999e60a4add9f23c83f9b0a4252", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53562eeb-b1", "ovs_interfaceid": "53562eeb-b1fd-47f1-896e-cacd277abf24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 00:14:36 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-9aaa445e-ec41-4a51-b441-cee8dcb7df1a tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Converting VIF {"id": "53562eeb-b1fd-47f1-896e-cacd277abf24", "address": "fa:16:3e:e2:4e:ff", "network": {"id": "49f71fbc-7d65-4cc6-9efe-3918d5dbd51a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-2079147315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dffbe999e60a4add9f23c83f9b0a4252", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53562eeb-b1", "ovs_interfaceid": "53562eeb-b1fd-47f1-896e-cacd277abf24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:14:36 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-9aaa445e-ec41-4a51-b441-cee8dcb7df1a tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e2:4e:ff,bridge_name='br-int',has_traffic_filtering=True,id=53562eeb-b1fd-47f1-896e-cacd277abf24,network=Network(49f71fbc-7d65-4cc6-9efe-3918d5dbd51a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53562eeb-b1') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:14:36 user nova-compute[82479]: DEBUG os_vif [None req-9aaa445e-ec41-4a51-b441-cee8dcb7df1a tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:4e:ff,bridge_name='br-int',has_traffic_filtering=True,id=53562eeb-b1fd-47f1-896e-cacd277abf24,network=Network(49f71fbc-7d65-4cc6-9efe-3918d5dbd51a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53562eeb-b1') {{(pid=82479) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 00:14:36 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:36 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap53562eeb-b1, bridge=br-int, if_exists=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:14:36 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:14:36 user nova-compute[82479]: INFO os_vif [None req-9aaa445e-ec41-4a51-b441-cee8dcb7df1a tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:4e:ff,bridge_name='br-int',has_traffic_filtering=True,id=53562eeb-b1fd-47f1-896e-cacd277abf24,network=Network(49f71fbc-7d65-4cc6-9efe-3918d5dbd51a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53562eeb-b1')
Apr 14 00:14:36 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-9aaa445e-ec41-4a51-b441-cee8dcb7df1a tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Deleting instance files /opt/stack/data/nova/instances/8feba40a-03c7-4c60-b862-ee14fb8c9b05_del
Apr 14 00:14:36 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-9aaa445e-ec41-4a51-b441-cee8dcb7df1a tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Deletion of /opt/stack/data/nova/instances/8feba40a-03c7-4c60-b862-ee14fb8c9b05_del complete
Apr 14 00:14:36 user nova-compute[82479]: INFO nova.compute.manager [None req-9aaa445e-ec41-4a51-b441-cee8dcb7df1a tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Took 0.87 seconds to destroy the instance on the hypervisor.
Apr 14 00:14:36 user nova-compute[82479]: DEBUG oslo.service.loopingcall [None req-9aaa445e-ec41-4a51-b441-cee8dcb7df1a tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82479) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 00:14:36 user nova-compute[82479]: DEBUG nova.compute.manager [-] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Deallocating network for instance {{(pid=82479) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 00:14:36 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] deallocate_for_instance() {{(pid=82479) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 00:14:36 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Updating instance_info_cache with network_info: [] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:14:37 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Took 0.79 seconds to deallocate network for instance.
Apr 14 00:14:37 user nova-compute[82479]: DEBUG nova.compute.manager [req-584c5665-5253-4774-986d-394d174b0373 req-2939e348-5c85-420b-8973-4dfee7db4b50 service nova] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Received event network-vif-deleted-53562eeb-b1fd-47f1-896e-cacd277abf24 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:14:37 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-9aaa445e-ec41-4a51-b441-cee8dcb7df1a tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:14:37 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-9aaa445e-ec41-4a51-b441-cee8dcb7df1a tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:14:37 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-9aaa445e-ec41-4a51-b441-cee8dcb7df1a tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:14:37 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-9aaa445e-ec41-4a51-b441-cee8dcb7df1a tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:14:37 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-9aaa445e-ec41-4a51-b441-cee8dcb7df1a tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.358s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:14:37 user nova-compute[82479]: INFO nova.scheduler.client.report [None req-9aaa445e-ec41-4a51-b441-cee8dcb7df1a tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Deleted allocations for instance 8feba40a-03c7-4c60-b862-ee14fb8c9b05
Apr 14 00:14:37 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-9aaa445e-ec41-4a51-b441-cee8dcb7df1a tempest-VolumesAdminNegativeTest-1377720460 tempest-VolumesAdminNegativeTest-1377720460-project-member] Lock "8feba40a-03c7-4c60-b862-ee14fb8c9b05" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.223s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:14:37 user nova-compute[82479]: DEBUG nova.compute.manager [req-4dcee45c-f0cb-43bc-b5de-9b9bb816c6c7 req-8e5b6c2b-c97d-4dee-8834-8b7b7bb6b3dc service nova] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Received event network-vif-plugged-53562eeb-b1fd-47f1-896e-cacd277abf24 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:14:37 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-4dcee45c-f0cb-43bc-b5de-9b9bb816c6c7 req-8e5b6c2b-c97d-4dee-8834-8b7b7bb6b3dc service nova] Acquiring lock "8feba40a-03c7-4c60-b862-ee14fb8c9b05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:14:37 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-4dcee45c-f0cb-43bc-b5de-9b9bb816c6c7 req-8e5b6c2b-c97d-4dee-8834-8b7b7bb6b3dc service nova] Lock "8feba40a-03c7-4c60-b862-ee14fb8c9b05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:14:37 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-4dcee45c-f0cb-43bc-b5de-9b9bb816c6c7 req-8e5b6c2b-c97d-4dee-8834-8b7b7bb6b3dc service nova] Lock "8feba40a-03c7-4c60-b862-ee14fb8c9b05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:14:37 user nova-compute[82479]: DEBUG nova.compute.manager [req-4dcee45c-f0cb-43bc-b5de-9b9bb816c6c7 req-8e5b6c2b-c97d-4dee-8834-8b7b7bb6b3dc service nova] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] No waiting events found dispatching network-vif-plugged-53562eeb-b1fd-47f1-896e-cacd277abf24 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:14:37 user nova-compute[82479]: WARNING nova.compute.manager [req-4dcee45c-f0cb-43bc-b5de-9b9bb816c6c7 req-8e5b6c2b-c97d-4dee-8834-8b7b7bb6b3dc service nova] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Received unexpected event network-vif-plugged-53562eeb-b1fd-47f1-896e-cacd277abf24 for instance with vm_state deleted and task_state None.
Apr 14 00:14:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:41 user nova-compute[82479]: INFO nova.compute.manager [None req-58a7ca9f-9ef5-4ae2-9db2-e1beaf5e3903 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Rescuing
Apr 14 00:14:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-58a7ca9f-9ef5-4ae2-9db2-e1beaf5e3903 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "refresh_cache-6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:14:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-58a7ca9f-9ef5-4ae2-9db2-e1beaf5e3903 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquired lock "refresh_cache-6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:14:41 user nova-compute[82479]: DEBUG nova.network.neutron [None req-58a7ca9f-9ef5-4ae2-9db2-e1beaf5e3903 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 00:14:42 user nova-compute[82479]: DEBUG nova.network.neutron [None req-58a7ca9f-9ef5-4ae2-9db2-e1beaf5e3903 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Updating instance_info_cache with network_info: [{"id": "10a32c68-570b-4ba1-ba36-6ecaf135c9bb", "address": "fa:16:3e:a4:44:5a", "network": {"id": "08106daa-a35e-4376-8c46-2b4baa51c6ea", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321730350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524265958bd24a6cb94aa3115eb2b6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10a32c68-57", "ovs_interfaceid": "10a32c68-570b-4ba1-ba36-6ecaf135c9bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:14:42 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-58a7ca9f-9ef5-4ae2-9db2-e1beaf5e3903 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Releasing lock "refresh_cache-6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:14:42 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:14:42 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:42 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:42 user nova-compute[82479]: DEBUG nova.compute.manager [req-218c98c6-a294-48e5-8ea1-2998cc435ed5 req-46d34e48-313c-4a96-bbbb-781d0b7898d2 service nova] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Received event network-vif-unplugged-10a32c68-570b-4ba1-ba36-6ecaf135c9bb {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:14:42 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-218c98c6-a294-48e5-8ea1-2998cc435ed5 req-46d34e48-313c-4a96-bbbb-781d0b7898d2 service nova] Acquiring lock "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:14:42 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-218c98c6-a294-48e5-8ea1-2998cc435ed5 req-46d34e48-313c-4a96-bbbb-781d0b7898d2 service nova] Lock "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:14:42 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-218c98c6-a294-48e5-8ea1-2998cc435ed5 req-46d34e48-313c-4a96-bbbb-781d0b7898d2 service nova] Lock "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:14:42 user nova-compute[82479]: DEBUG nova.compute.manager [req-218c98c6-a294-48e5-8ea1-2998cc435ed5 req-46d34e48-313c-4a96-bbbb-781d0b7898d2 service nova] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] No waiting events found dispatching network-vif-unplugged-10a32c68-570b-4ba1-ba36-6ecaf135c9bb {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:14:42 user nova-compute[82479]: WARNING nova.compute.manager [req-218c98c6-a294-48e5-8ea1-2998cc435ed5 req-46d34e48-313c-4a96-bbbb-781d0b7898d2 service nova] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Received unexpected event network-vif-unplugged-10a32c68-570b-4ba1-ba36-6ecaf135c9bb for instance with vm_state active and task_state rescuing.
Apr 14 00:14:42 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:42 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:43 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:43 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:43 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Instance destroyed successfully.
Apr 14 00:14:43 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-58a7ca9f-9ef5-4ae2-9db2-e1beaf5e3903 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Attempting rescue
Apr 14 00:14:43 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-58a7ca9f-9ef5-4ae2-9db2-e1beaf5e3903 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=82479) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 14 00:14:43 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:43 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-58a7ca9f-9ef5-4ae2-9db2-e1beaf5e3903 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Instance directory exists: not creating {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 00:14:43 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-58a7ca9f-9ef5-4ae2-9db2-e1beaf5e3903 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Creating image(s)
Apr 14 00:14:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-58a7ca9f-9ef5-4ae2-9db2-e1beaf5e3903 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "/opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:14:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-58a7ca9f-9ef5-4ae2-9db2-e1beaf5e3903 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "/opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:14:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-58a7ca9f-9ef5-4ae2-9db2-e1beaf5e3903 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "/opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:14:43 user nova-compute[82479]: DEBUG nova.objects.instance [None req-58a7ca9f-9ef5-4ae2-9db2-e1beaf5e3903 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:14:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-58a7ca9f-9ef5-4ae2-9db2-e1beaf5e3903 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "3e200e101633f2016e569ae4c0a352380507d1e4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:14:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-58a7ca9f-9ef5-4ae2-9db2-e1beaf5e3903 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "3e200e101633f2016e569ae4c0a352380507d1e4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:14:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-58a7ca9f-9ef5-4ae2-9db2-e1beaf5e3903 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:14:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-58a7ca9f-9ef5-4ae2-9db2-e1beaf5e3903 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.160s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:14:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-58a7ca9f-9ef5-4ae2-9db2-e1beaf5e3903 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk.rescue {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:14:43 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-58a7ca9f-9ef5-4ae2-9db2-e1beaf5e3903 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk.rescue" returned: 0 in 0.052s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:14:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-58a7ca9f-9ef5-4ae2-9db2-e1beaf5e3903 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "3e200e101633f2016e569ae4c0a352380507d1e4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.217s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:14:43 user nova-compute[82479]: DEBUG nova.objects.instance [None req-58a7ca9f-9ef5-4ae2-9db2-e1beaf5e3903 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lazy-loading 'migration_context' on Instance uuid 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:14:43 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-58a7ca9f-9ef5-4ae2-9db2-e1beaf5e3903 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Created local disks {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 00:14:43 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-58a7ca9f-9ef5-4ae2-9db2-e1beaf5e3903 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Start _get_guest_xml network_info=[{"id": "10a32c68-570b-4ba1-ba36-6ecaf135c9bb", "address": "fa:16:3e:a4:44:5a", "network": {"id": "08106daa-a35e-4376-8c46-2b4baa51c6ea", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321730350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1321730350-network", "vif_mac": "fa:16:3e:a4:44:5a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524265958bd24a6cb94aa3115eb2b6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10a32c68-57", "ovs_interfaceid": "10a32c68-570b-4ba1-ba36-6ecaf135c9bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 00:14:43 user nova-compute[82479]: DEBUG nova.objects.instance [None req-58a7ca9f-9ef5-4ae2-9db2-e1beaf5e3903 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lazy-loading 'resources' on Instance uuid 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:14:43 user nova-compute[82479]: DEBUG nova.objects.instance [None req-58a7ca9f-9ef5-4ae2-9db2-e1beaf5e3903 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lazy-loading 'numa_topology' on Instance uuid 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:14:43 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-58a7ca9f-9ef5-4ae2-9db2-e1beaf5e3903 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:14:43 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-58a7ca9f-9ef5-4ae2-9db2-e1beaf5e3903 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:14:43 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-58a7ca9f-9ef5-4ae2-9db2-e1beaf5e3903 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82479) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 00:14:43 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-58a7ca9f-9ef5-4ae2-9db2-e1beaf5e3903 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T00:02:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 00:14:43 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-58a7ca9f-9ef5-4ae2-9db2-e1beaf5e3903 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Flavor limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 00:14:43 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-58a7ca9f-9ef5-4ae2-9db2-e1beaf5e3903 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Image limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 00:14:43 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-58a7ca9f-9ef5-4ae2-9db2-e1beaf5e3903 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Flavor pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 00:14:43 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-58a7ca9f-9ef5-4ae2-9db2-e1beaf5e3903 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Image pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 00:14:43 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-58a7ca9f-9ef5-4ae2-9db2-e1beaf5e3903 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 00:14:43 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-58a7ca9f-9ef5-4ae2-9db2-e1beaf5e3903 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 00:14:43 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-58a7ca9f-9ef5-4ae2-9db2-e1beaf5e3903 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 00:14:43 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-58a7ca9f-9ef5-4ae2-9db2-e1beaf5e3903 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Got 1 possible topologies {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 00:14:43 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-58a7ca9f-9ef5-4ae2-9db2-e1beaf5e3903 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 00:14:43 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-58a7ca9f-9ef5-4ae2-9db2-e1beaf5e3903 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 00:14:43 user nova-compute[82479]: DEBUG nova.objects.instance [None req-58a7ca9f-9ef5-4ae2-9db2-e1beaf5e3903 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:14:43 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-58a7ca9f-9ef5-4ae2-9db2-e1beaf5e3903 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:09:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1929968798',display_name='tempest-ServerRescueNegativeTestJSON-server-1929968798',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1929968798',id=17,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:10:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='524265958bd24a6cb94aa3115eb2b6c7',ramdisk_id='',reservation_id='r-r5gflibu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1055458768',owner_user_name='tempest-ServerRescueNegativeTestJSON-1055458768-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:10:07Z,user_data=None,user_id='f43f3171ccad4167ac783bbdfe2df478',uuid=6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "10a32c68-570b-4ba1-ba36-6ecaf135c9bb", "address": "fa:16:3e:a4:44:5a", "network": {"id": "08106daa-a35e-4376-8c46-2b4baa51c6ea", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321730350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1321730350-network", "vif_mac": "fa:16:3e:a4:44:5a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524265958bd24a6cb94aa3115eb2b6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10a32c68-57", "ovs_interfaceid": "10a32c68-570b-4ba1-ba36-6ecaf135c9bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82479) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 00:14:43 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-58a7ca9f-9ef5-4ae2-9db2-e1beaf5e3903 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Converting VIF {"id": "10a32c68-570b-4ba1-ba36-6ecaf135c9bb", "address": "fa:16:3e:a4:44:5a", "network": {"id": "08106daa-a35e-4376-8c46-2b4baa51c6ea", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321730350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1321730350-network", "vif_mac": "fa:16:3e:a4:44:5a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524265958bd24a6cb94aa3115eb2b6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10a32c68-57", "ovs_interfaceid": "10a32c68-570b-4ba1-ba36-6ecaf135c9bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:14:43 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-58a7ca9f-9ef5-4ae2-9db2-e1beaf5e3903 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a4:44:5a,bridge_name='br-int',has_traffic_filtering=True,id=10a32c68-570b-4ba1-ba36-6ecaf135c9bb,network=Network(08106daa-a35e-4376-8c46-2b4baa51c6ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10a32c68-57') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:14:43 user nova-compute[82479]: DEBUG nova.objects.instance [None req-58a7ca9f-9ef5-4ae2-9db2-e1beaf5e3903 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lazy-loading 'pci_devices' on Instance uuid 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:14:43 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-58a7ca9f-9ef5-4ae2-9db2-e1beaf5e3903 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] End _get_guest_xml xml=<domain type="kvm">
Apr 14 00:14:43 user nova-compute[82479]:   <uuid>6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9</uuid>
Apr 14 00:14:43 user nova-compute[82479]:   <name>instance-00000011</name>
Apr 14 00:14:43 user nova-compute[82479]:   <memory>131072</memory>
Apr 14 00:14:43 user nova-compute[82479]:   <vcpu>1</vcpu>
Apr 14 00:14:43 user nova-compute[82479]:   <metadata>
Apr 14 00:14:43 user nova-compute[82479]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 00:14:43 user nova-compute[82479]:       <nova:package version="0.0.0"/>
Apr 14 00:14:43 user nova-compute[82479]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1929968798</nova:name>
Apr 14 00:14:43 user nova-compute[82479]:       <nova:creationTime>2023-04-14 00:14:43</nova:creationTime>
Apr 14 00:14:43 user nova-compute[82479]:       <nova:flavor name="m1.nano">
Apr 14 00:14:43 user nova-compute[82479]:         <nova:memory>128</nova:memory>
Apr 14 00:14:43 user nova-compute[82479]:         <nova:disk>1</nova:disk>
Apr 14 00:14:43 user nova-compute[82479]:         <nova:swap>0</nova:swap>
Apr 14 00:14:43 user nova-compute[82479]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 00:14:43 user nova-compute[82479]:         <nova:vcpus>1</nova:vcpus>
Apr 14 00:14:43 user nova-compute[82479]:       </nova:flavor>
Apr 14 00:14:43 user nova-compute[82479]:       <nova:owner>
Apr 14 00:14:43 user nova-compute[82479]:         <nova:user uuid="f43f3171ccad4167ac783bbdfe2df478">tempest-ServerRescueNegativeTestJSON-1055458768-project-member</nova:user>
Apr 14 00:14:43 user nova-compute[82479]:         <nova:project uuid="524265958bd24a6cb94aa3115eb2b6c7">tempest-ServerRescueNegativeTestJSON-1055458768</nova:project>
Apr 14 00:14:43 user nova-compute[82479]:       </nova:owner>
Apr 14 00:14:43 user nova-compute[82479]:       <nova:root type="image" uuid="6db62068-7278-4cd8-b41f-d0140d89e199"/>
Apr 14 00:14:43 user nova-compute[82479]:       <nova:ports>
Apr 14 00:14:43 user nova-compute[82479]:         <nova:port uuid="10a32c68-570b-4ba1-ba36-6ecaf135c9bb">
Apr 14 00:14:43 user nova-compute[82479]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 14 00:14:43 user nova-compute[82479]:         </nova:port>
Apr 14 00:14:43 user nova-compute[82479]:       </nova:ports>
Apr 14 00:14:43 user nova-compute[82479]:     </nova:instance>
Apr 14 00:14:43 user nova-compute[82479]:   </metadata>
Apr 14 00:14:43 user nova-compute[82479]:   <sysinfo type="smbios">
Apr 14 00:14:43 user nova-compute[82479]:     <system>
Apr 14 00:14:43 user nova-compute[82479]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 00:14:43 user nova-compute[82479]:       <entry name="product">OpenStack Nova</entry>
Apr 14 00:14:43 user nova-compute[82479]:       <entry name="version">0.0.0</entry>
Apr 14 00:14:43 user nova-compute[82479]:       <entry name="serial">6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9</entry>
Apr 14 00:14:43 user nova-compute[82479]:       <entry name="uuid">6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9</entry>
Apr 14 00:14:43 user nova-compute[82479]:       <entry name="family">Virtual Machine</entry>
Apr 14 00:14:43 user nova-compute[82479]:     </system>
Apr 14 00:14:43 user nova-compute[82479]:   </sysinfo>
Apr 14 00:14:43 user nova-compute[82479]:   <os>
Apr 14 00:14:43 user nova-compute[82479]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 00:14:43 user nova-compute[82479]:     <smbios mode="sysinfo"/>
Apr 14 00:14:43 user nova-compute[82479]:   </os>
Apr 14 00:14:43 user nova-compute[82479]:   <features>
Apr 14 00:14:43 user nova-compute[82479]:     <acpi/>
Apr 14 00:14:43 user nova-compute[82479]:     <apic/>
Apr 14 00:14:43 user nova-compute[82479]:     <vmcoreinfo/>
Apr 14 00:14:43 user nova-compute[82479]:   </features>
Apr 14 00:14:43 user nova-compute[82479]:   <clock offset="utc">
Apr 14 00:14:43 user nova-compute[82479]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 00:14:43 user nova-compute[82479]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 00:14:43 user nova-compute[82479]:     <timer name="hpet" present="no"/>
Apr 14 00:14:43 user nova-compute[82479]:   </clock>
Apr 14 00:14:43 user nova-compute[82479]:   <cpu mode="custom" match="exact">
Apr 14 00:14:43 user nova-compute[82479]:     <model>Nehalem</model>
Apr 14 00:14:43 user nova-compute[82479]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 00:14:43 user nova-compute[82479]:   </cpu>
Apr 14 00:14:43 user nova-compute[82479]:   <devices>
Apr 14 00:14:43 user nova-compute[82479]:     <disk type="file" device="disk">
Apr 14 00:14:43 user nova-compute[82479]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 00:14:43 user nova-compute[82479]:       <source file="/opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk.rescue"/>
Apr 14 00:14:43 user nova-compute[82479]:       <target dev="vda" bus="virtio"/>
Apr 14 00:14:43 user nova-compute[82479]:     </disk>
Apr 14 00:14:43 user nova-compute[82479]:     <disk type="file" device="disk">
Apr 14 00:14:43 user nova-compute[82479]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 00:14:43 user nova-compute[82479]:       <source file="/opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk"/>
Apr 14 00:14:43 user nova-compute[82479]:       <target dev="vdb" bus="virtio"/>
Apr 14 00:14:43 user nova-compute[82479]:     </disk>
Apr 14 00:14:43 user nova-compute[82479]:     <interface type="ethernet">
Apr 14 00:14:43 user nova-compute[82479]:       <mac address="fa:16:3e:a4:44:5a"/>
Apr 14 00:14:43 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:14:43 user nova-compute[82479]:       <mtu size="1442"/>
Apr 14 00:14:43 user nova-compute[82479]:       <target dev="tap10a32c68-57"/>
Apr 14 00:14:43 user nova-compute[82479]:     </interface>
Apr 14 00:14:43 user nova-compute[82479]:     <serial type="pty">
Apr 14 00:14:43 user nova-compute[82479]:       <log file="/opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/console.log" append="off"/>
Apr 14 00:14:43 user nova-compute[82479]:     </serial>
Apr 14 00:14:43 user nova-compute[82479]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 00:14:43 user nova-compute[82479]:     <video>
Apr 14 00:14:43 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:14:43 user nova-compute[82479]:     </video>
Apr 14 00:14:43 user nova-compute[82479]:     <rng model="virtio">
Apr 14 00:14:43 user nova-compute[82479]:       <backend model="random">/dev/urandom</backend>
Apr 14 00:14:43 user nova-compute[82479]:     </rng>
Apr 14 00:14:43 user nova-compute[82479]:     <controller type="usb" index="0" model="none"/>
Apr 14 00:14:43 user nova-compute[82479]:     <memballoon model="virtio">
Apr 14 00:14:43 user nova-compute[82479]:       <stats period="10"/>
Apr 14 00:14:43 user nova-compute[82479]:     </memballoon>
Apr 14 00:14:43 user nova-compute[82479]:   </devices>
Apr 14 00:14:43 user nova-compute[82479]: </domain>
Apr 14 00:14:43 user nova-compute[82479]:  {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 00:14:43 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Instance destroyed successfully.
Apr 14 00:14:43 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:43 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-58a7ca9f-9ef5-4ae2-9db2-e1beaf5e3903 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:14:43 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-58a7ca9f-9ef5-4ae2-9db2-e1beaf5e3903 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:14:43 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-58a7ca9f-9ef5-4ae2-9db2-e1beaf5e3903 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] No VIF found with MAC fa:16:3e:a4:44:5a, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:14:43 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:44 user nova-compute[82479]: DEBUG nova.compute.manager [req-bbb782dd-7bb6-497a-bdd9-73c234a126f5 req-995125ce-a164-4386-b561-f897e469d040 service nova] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Received event network-vif-plugged-10a32c68-570b-4ba1-ba36-6ecaf135c9bb {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:14:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-bbb782dd-7bb6-497a-bdd9-73c234a126f5 req-995125ce-a164-4386-b561-f897e469d040 service nova] Acquiring lock "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:14:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-bbb782dd-7bb6-497a-bdd9-73c234a126f5 req-995125ce-a164-4386-b561-f897e469d040 service nova] Lock "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:14:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-bbb782dd-7bb6-497a-bdd9-73c234a126f5 req-995125ce-a164-4386-b561-f897e469d040 service nova] Lock "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:14:44 user nova-compute[82479]: DEBUG nova.compute.manager [req-bbb782dd-7bb6-497a-bdd9-73c234a126f5 req-995125ce-a164-4386-b561-f897e469d040 service nova] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] No waiting events found dispatching network-vif-plugged-10a32c68-570b-4ba1-ba36-6ecaf135c9bb {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:14:44 user nova-compute[82479]: WARNING nova.compute.manager [req-bbb782dd-7bb6-497a-bdd9-73c234a126f5 req-995125ce-a164-4386-b561-f897e469d040 service nova] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Received unexpected event network-vif-plugged-10a32c68-570b-4ba1-ba36-6ecaf135c9bb for instance with vm_state active and task_state rescuing.
Apr 14 00:14:44 user nova-compute[82479]: DEBUG nova.compute.manager [req-bbb782dd-7bb6-497a-bdd9-73c234a126f5 req-995125ce-a164-4386-b561-f897e469d040 service nova] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Received event network-vif-plugged-10a32c68-570b-4ba1-ba36-6ecaf135c9bb {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:14:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-bbb782dd-7bb6-497a-bdd9-73c234a126f5 req-995125ce-a164-4386-b561-f897e469d040 service nova] Acquiring lock "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:14:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-bbb782dd-7bb6-497a-bdd9-73c234a126f5 req-995125ce-a164-4386-b561-f897e469d040 service nova] Lock "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:14:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-bbb782dd-7bb6-497a-bdd9-73c234a126f5 req-995125ce-a164-4386-b561-f897e469d040 service nova] Lock "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:14:44 user nova-compute[82479]: DEBUG nova.compute.manager [req-bbb782dd-7bb6-497a-bdd9-73c234a126f5 req-995125ce-a164-4386-b561-f897e469d040 service nova] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] No waiting events found dispatching network-vif-plugged-10a32c68-570b-4ba1-ba36-6ecaf135c9bb {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:14:44 user nova-compute[82479]: WARNING nova.compute.manager [req-bbb782dd-7bb6-497a-bdd9-73c234a126f5 req-995125ce-a164-4386-b561-f897e469d040 service nova] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Received unexpected event network-vif-plugged-10a32c68-570b-4ba1-ba36-6ecaf135c9bb for instance with vm_state active and task_state rescuing.
Apr 14 00:14:44 user nova-compute[82479]: DEBUG nova.compute.manager [req-bbb782dd-7bb6-497a-bdd9-73c234a126f5 req-995125ce-a164-4386-b561-f897e469d040 service nova] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Received event network-vif-plugged-10a32c68-570b-4ba1-ba36-6ecaf135c9bb {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:14:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-bbb782dd-7bb6-497a-bdd9-73c234a126f5 req-995125ce-a164-4386-b561-f897e469d040 service nova] Acquiring lock "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:14:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-bbb782dd-7bb6-497a-bdd9-73c234a126f5 req-995125ce-a164-4386-b561-f897e469d040 service nova] Lock "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:14:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-bbb782dd-7bb6-497a-bdd9-73c234a126f5 req-995125ce-a164-4386-b561-f897e469d040 service nova] Lock "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:14:44 user nova-compute[82479]: DEBUG nova.compute.manager [req-bbb782dd-7bb6-497a-bdd9-73c234a126f5 req-995125ce-a164-4386-b561-f897e469d040 service nova] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] No waiting events found dispatching network-vif-plugged-10a32c68-570b-4ba1-ba36-6ecaf135c9bb {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:14:44 user nova-compute[82479]: WARNING nova.compute.manager [req-bbb782dd-7bb6-497a-bdd9-73c234a126f5 req-995125ce-a164-4386-b561-f897e469d040 service nova] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Received unexpected event network-vif-plugged-10a32c68-570b-4ba1-ba36-6ecaf135c9bb for instance with vm_state active and task_state rescuing.
Apr 14 00:14:44 user nova-compute[82479]: DEBUG nova.compute.manager [req-bbb782dd-7bb6-497a-bdd9-73c234a126f5 req-995125ce-a164-4386-b561-f897e469d040 service nova] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Received event network-vif-unplugged-10a32c68-570b-4ba1-ba36-6ecaf135c9bb {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:14:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-bbb782dd-7bb6-497a-bdd9-73c234a126f5 req-995125ce-a164-4386-b561-f897e469d040 service nova] Acquiring lock "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:14:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-bbb782dd-7bb6-497a-bdd9-73c234a126f5 req-995125ce-a164-4386-b561-f897e469d040 service nova] Lock "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:14:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-bbb782dd-7bb6-497a-bdd9-73c234a126f5 req-995125ce-a164-4386-b561-f897e469d040 service nova] Lock "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:14:44 user nova-compute[82479]: DEBUG nova.compute.manager [req-bbb782dd-7bb6-497a-bdd9-73c234a126f5 req-995125ce-a164-4386-b561-f897e469d040 service nova] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] No waiting events found dispatching network-vif-unplugged-10a32c68-570b-4ba1-ba36-6ecaf135c9bb {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:14:44 user nova-compute[82479]: WARNING nova.compute.manager [req-bbb782dd-7bb6-497a-bdd9-73c234a126f5 req-995125ce-a164-4386-b561-f897e469d040 service nova] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Received unexpected event network-vif-unplugged-10a32c68-570b-4ba1-ba36-6ecaf135c9bb for instance with vm_state active and task_state rescuing.
Apr 14 00:14:44 user nova-compute[82479]: DEBUG nova.compute.manager [req-bbb782dd-7bb6-497a-bdd9-73c234a126f5 req-995125ce-a164-4386-b561-f897e469d040 service nova] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Received event network-vif-plugged-10a32c68-570b-4ba1-ba36-6ecaf135c9bb {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:14:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-bbb782dd-7bb6-497a-bdd9-73c234a126f5 req-995125ce-a164-4386-b561-f897e469d040 service nova] Acquiring lock "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:14:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-bbb782dd-7bb6-497a-bdd9-73c234a126f5 req-995125ce-a164-4386-b561-f897e469d040 service nova] Lock "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:14:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-bbb782dd-7bb6-497a-bdd9-73c234a126f5 req-995125ce-a164-4386-b561-f897e469d040 service nova] Lock "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:14:44 user nova-compute[82479]: DEBUG nova.compute.manager [req-bbb782dd-7bb6-497a-bdd9-73c234a126f5 req-995125ce-a164-4386-b561-f897e469d040 service nova] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] No waiting events found dispatching network-vif-plugged-10a32c68-570b-4ba1-ba36-6ecaf135c9bb {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:14:44 user nova-compute[82479]: WARNING nova.compute.manager [req-bbb782dd-7bb6-497a-bdd9-73c234a126f5 req-995125ce-a164-4386-b561-f897e469d040 service nova] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Received unexpected event network-vif-plugged-10a32c68-570b-4ba1-ba36-6ecaf135c9bb for instance with vm_state active and task_state rescuing.
Apr 14 00:14:45 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:45 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:45 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:45 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:45 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:45 user nova-compute[82479]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681431270.3204577, 01a65362-36ea-4817-8e83-f75d6daf808b => Stopped> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:14:45 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] VM Stopped (Lifecycle Event)
Apr 14 00:14:45 user nova-compute[82479]: DEBUG nova.compute.manager [None req-2e246e63-ab5c-4b3f-a6da-453899cade50 None None] [instance: 01a65362-36ea-4817-8e83-f75d6daf808b] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:14:46 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:46 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:46 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:14:46 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Starting heal instance info cache {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 00:14:46 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "refresh_cache-17c6c147-fb62-4204-a416-792b94d3f7dd" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:14:46 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquired lock "refresh_cache-17c6c147-fb62-4204-a416-792b94d3f7dd" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:14:46 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Forcefully refreshing network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 00:14:46 user nova-compute[82479]: DEBUG nova.compute.manager [req-74102e35-09f5-4500-b34e-1f11996a0d58 req-df86501f-9c52-44b2-a575-98ca247569b3 service nova] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Received event network-vif-plugged-10a32c68-570b-4ba1-ba36-6ecaf135c9bb {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:14:46 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-74102e35-09f5-4500-b34e-1f11996a0d58 req-df86501f-9c52-44b2-a575-98ca247569b3 service nova] Acquiring lock "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:14:46 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-74102e35-09f5-4500-b34e-1f11996a0d58 req-df86501f-9c52-44b2-a575-98ca247569b3 service nova] Lock "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:14:46 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-74102e35-09f5-4500-b34e-1f11996a0d58 req-df86501f-9c52-44b2-a575-98ca247569b3 service nova] Lock "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:14:46 user nova-compute[82479]: DEBUG nova.compute.manager [req-74102e35-09f5-4500-b34e-1f11996a0d58 req-df86501f-9c52-44b2-a575-98ca247569b3 service nova] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] No waiting events found dispatching network-vif-plugged-10a32c68-570b-4ba1-ba36-6ecaf135c9bb {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:14:46 user nova-compute[82479]: WARNING nova.compute.manager [req-74102e35-09f5-4500-b34e-1f11996a0d58 req-df86501f-9c52-44b2-a575-98ca247569b3 service nova] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Received unexpected event network-vif-plugged-10a32c68-570b-4ba1-ba36-6ecaf135c9bb for instance with vm_state active and task_state rescuing.
Apr 14 00:14:46 user nova-compute[82479]: DEBUG nova.compute.manager [req-74102e35-09f5-4500-b34e-1f11996a0d58 req-df86501f-9c52-44b2-a575-98ca247569b3 service nova] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Received event network-vif-plugged-10a32c68-570b-4ba1-ba36-6ecaf135c9bb {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:14:46 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-74102e35-09f5-4500-b34e-1f11996a0d58 req-df86501f-9c52-44b2-a575-98ca247569b3 service nova] Acquiring lock "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:14:46 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-74102e35-09f5-4500-b34e-1f11996a0d58 req-df86501f-9c52-44b2-a575-98ca247569b3 service nova] Lock "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:14:46 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-74102e35-09f5-4500-b34e-1f11996a0d58 req-df86501f-9c52-44b2-a575-98ca247569b3 service nova] Lock "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:14:46 user nova-compute[82479]: DEBUG nova.compute.manager [req-74102e35-09f5-4500-b34e-1f11996a0d58 req-df86501f-9c52-44b2-a575-98ca247569b3 service nova] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] No waiting events found dispatching network-vif-plugged-10a32c68-570b-4ba1-ba36-6ecaf135c9bb {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:14:46 user nova-compute[82479]: WARNING nova.compute.manager [req-74102e35-09f5-4500-b34e-1f11996a0d58 req-df86501f-9c52-44b2-a575-98ca247569b3 service nova] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Received unexpected event network-vif-plugged-10a32c68-570b-4ba1-ba36-6ecaf135c9bb for instance with vm_state active and task_state rescuing.
Apr 14 00:14:47 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Updating instance_info_cache with network_info: [{"id": "102987de-d5e4-4ccd-b4fd-7ca7c131e379", "address": "fa:16:3e:23:dd:a5", "network": {"id": "491696ea-38ef-4c19-9d94-a61223c1fa00", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1323121698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3f111e24414976beddba7ef90c4793", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap102987de-d5", "ovs_interfaceid": "102987de-d5e4-4ccd-b4fd-7ca7c131e379", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:14:47 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Removed pending event for 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 due to event {{(pid=82479) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 00:14:47 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681431287.2946854, 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 => Resumed> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:14:47 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] VM Resumed (Lifecycle Event)
Apr 14 00:14:47 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Releasing lock "refresh_cache-17c6c147-fb62-4204-a416-792b94d3f7dd" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:14:47 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Updated the network info_cache for instance {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 00:14:47 user nova-compute[82479]: DEBUG nova.compute.manager [None req-58a7ca9f-9ef5-4ae2-9db2-e1beaf5e3903 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:14:47 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:14:47 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:14:47 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:14:47 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 14 00:14:47 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681431287.2966535, 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 => Started> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:14:47 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] VM Started (Lifecycle Event)
Apr 14 00:14:47 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:14:47 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:14:48 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:14:49 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:14:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:51 user nova-compute[82479]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681431276.1136394, 8feba40a-03c7-4c60-b862-ee14fb8c9b05 => Stopped> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:14:51 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] VM Stopped (Lifecycle Event)
Apr 14 00:14:51 user nova-compute[82479]: DEBUG nova.compute.manager [None req-94769e16-cf2d-493e-b004-c9742b22a92c None None] [instance: 8feba40a-03c7-4c60-b862-ee14fb8c9b05] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:14:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:51 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:14:51 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:14:51 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82479) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 00:14:52 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:14:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:14:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:14:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:14:52 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Auditing locally available compute resources for user (node: user) {{(pid=82479) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 00:14:52 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13860c45-6a4b-48ea-9d0f-d50656585637/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:14:52 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13860c45-6a4b-48ea-9d0f-d50656585637/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:14:52 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13860c45-6a4b-48ea-9d0f-d50656585637/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:14:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13860c45-6a4b-48ea-9d0f-d50656585637/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:14:53 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:14:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk.rescue --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:14:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:14:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk.rescue --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:14:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:14:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:14:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:14:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:14:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:14:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:14:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:14:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:14:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:14:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk.rescue --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:14:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:14:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk.rescue --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:14:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:14:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:14:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:14:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:14:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:14:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7553ffb8-704b-4b9c-8a15-13357f4ac9e7/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:14:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7553ffb8-704b-4b9c-8a15-13357f4ac9e7/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:14:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7553ffb8-704b-4b9c-8a15-13357f4ac9e7/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:14:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7553ffb8-704b-4b9c-8a15-13357f4ac9e7/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:14:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:14:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:14:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:14:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:14:55 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:14:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:14:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:14:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:14:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:14:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2793d412-f405-4452-8e46-c192e3c92ccb/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:14:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2793d412-f405-4452-8e46-c192e3c92ccb/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:14:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2793d412-f405-4452-8e46-c192e3c92ccb/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:14:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2793d412-f405-4452-8e46-c192e3c92ccb/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:14:56 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:56 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:14:56 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:14:56 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Hypervisor/Node resource view: name=user free_ram=7737MB free_disk=26.162647247314453GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82479) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 00:14:56 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:14:56 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:14:56 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:14:56 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Applying migration context for instance b3475e7e-ceb4-452a-a045-dbf43c5944dd as it has an incoming, in-progress migration 0879efd2-53d7-4b3f-bbf4-18105f4ac7bb. Migration status is finished {{(pid=82479) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 14 00:14:56 user nova-compute[82479]: INFO nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Updating resource usage from migration 0879efd2-53d7-4b3f-bbf4-18105f4ac7bb
Apr 14 00:14:56 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 23718fd0-58b8-47f9-b1ef-a26a90741ecc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:14:56 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 17c6c147-fb62-4204-a416-792b94d3f7dd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:14:56 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:14:56 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:14:56 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 13860c45-6a4b-48ea-9d0f-d50656585637 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:14:56 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 7553ffb8-704b-4b9c-8a15-13357f4ac9e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:14:56 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:14:56 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Migration 0879efd2-53d7-4b3f-bbf4-18105f4ac7bb is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 14 00:14:56 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance b3475e7e-ceb4-452a-a045-dbf43c5944dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:14:56 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 2793d412-f405-4452-8e46-c192e3c92ccb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:14:56 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 00:14:56 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Final resource view: name=user phys_ram=16023MB used_ram=1856MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 00:14:56 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:14:56 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:14:56 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Compute_service record updated for user:user {{(pid=82479) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 00:14:56 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.455s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:14:57 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:14:57 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:15:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:15:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:15:06 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:15:06 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:15:10 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-b56307f4-b3fa-4b21-9663-9d147b3a8b88 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Acquiring lock "13860c45-6a4b-48ea-9d0f-d50656585637" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:15:10 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-b56307f4-b3fa-4b21-9663-9d147b3a8b88 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lock "13860c45-6a4b-48ea-9d0f-d50656585637" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:15:10 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-b56307f4-b3fa-4b21-9663-9d147b3a8b88 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Acquiring lock "13860c45-6a4b-48ea-9d0f-d50656585637-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:15:10 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-b56307f4-b3fa-4b21-9663-9d147b3a8b88 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lock "13860c45-6a4b-48ea-9d0f-d50656585637-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:15:10 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-b56307f4-b3fa-4b21-9663-9d147b3a8b88 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lock "13860c45-6a4b-48ea-9d0f-d50656585637-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:15:10 user nova-compute[82479]: INFO nova.compute.manager [None req-b56307f4-b3fa-4b21-9663-9d147b3a8b88 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] Terminating instance
Apr 14 00:15:10 user nova-compute[82479]: DEBUG nova.compute.manager [None req-b56307f4-b3fa-4b21-9663-9d147b3a8b88 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] Start destroying the instance on the hypervisor. {{(pid=82479) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 00:15:10 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:15:10 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:15:10 user nova-compute[82479]: DEBUG nova.compute.manager [req-38d7ea1a-029a-41b9-a332-17e2662114df req-aaec8462-a850-466e-8690-867fe2f665a6 service nova] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] Received event network-vif-unplugged-d102c4a9-79bd-4968-9a16-9eedcbce0056 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:15:10 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-38d7ea1a-029a-41b9-a332-17e2662114df req-aaec8462-a850-466e-8690-867fe2f665a6 service nova] Acquiring lock "13860c45-6a4b-48ea-9d0f-d50656585637-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:15:10 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-38d7ea1a-029a-41b9-a332-17e2662114df req-aaec8462-a850-466e-8690-867fe2f665a6 service nova] Lock "13860c45-6a4b-48ea-9d0f-d50656585637-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:15:10 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-38d7ea1a-029a-41b9-a332-17e2662114df req-aaec8462-a850-466e-8690-867fe2f665a6 service nova] Lock "13860c45-6a4b-48ea-9d0f-d50656585637-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:15:10 user nova-compute[82479]: DEBUG nova.compute.manager [req-38d7ea1a-029a-41b9-a332-17e2662114df req-aaec8462-a850-466e-8690-867fe2f665a6 service nova] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] No waiting events found dispatching network-vif-unplugged-d102c4a9-79bd-4968-9a16-9eedcbce0056 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:15:10 user nova-compute[82479]: DEBUG nova.compute.manager [req-38d7ea1a-029a-41b9-a332-17e2662114df req-aaec8462-a850-466e-8690-867fe2f665a6 service nova] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] Received event network-vif-unplugged-d102c4a9-79bd-4968-9a16-9eedcbce0056 for instance with task_state deleting. {{(pid=82479) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 00:15:10 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] Instance destroyed successfully.
Apr 14 00:15:10 user nova-compute[82479]: DEBUG nova.objects.instance [None req-b56307f4-b3fa-4b21-9663-9d147b3a8b88 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lazy-loading 'resources' on Instance uuid 13860c45-6a4b-48ea-9d0f-d50656585637 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:15:11 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-b56307f4-b3fa-4b21-9663-9d147b3a8b88 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:13:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-580695201',display_name='tempest-VolumesActionsTest-instance-580695201',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-580695201',id=22,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:13:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='67e9bf71f0644907979ec775c62a0b39',ramdisk_id='',reservation_id='r-yscy0g1l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-422643142',owner_user_name='tempest-VolumesActionsTest-422643142-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T00:13:28Z,user_data=None,user_id='719f2342cc1d452daae3a4ded790f69a',uuid=13860c45-6a4b-48ea-9d0f-d50656585637,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d102c4a9-79bd-4968-9a16-9eedcbce0056", "address": "fa:16:3e:c1:dc:21", "network": {"id": "e3acf139-a0c8-4b33-aae5-26131d3dccb5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1150180978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "67e9bf71f0644907979ec775c62a0b39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd102c4a9-79", "ovs_interfaceid": "d102c4a9-79bd-4968-9a16-9eedcbce0056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 00:15:11 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-b56307f4-b3fa-4b21-9663-9d147b3a8b88 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Converting VIF {"id": "d102c4a9-79bd-4968-9a16-9eedcbce0056", "address": "fa:16:3e:c1:dc:21", "network": {"id": "e3acf139-a0c8-4b33-aae5-26131d3dccb5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1150180978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "67e9bf71f0644907979ec775c62a0b39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd102c4a9-79", "ovs_interfaceid": "d102c4a9-79bd-4968-9a16-9eedcbce0056", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:15:11 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-b56307f4-b3fa-4b21-9663-9d147b3a8b88 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:dc:21,bridge_name='br-int',has_traffic_filtering=True,id=d102c4a9-79bd-4968-9a16-9eedcbce0056,network=Network(e3acf139-a0c8-4b33-aae5-26131d3dccb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd102c4a9-79') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:15:11 user nova-compute[82479]: DEBUG os_vif [None req-b56307f4-b3fa-4b21-9663-9d147b3a8b88 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:dc:21,bridge_name='br-int',has_traffic_filtering=True,id=d102c4a9-79bd-4968-9a16-9eedcbce0056,network=Network(e3acf139-a0c8-4b33-aae5-26131d3dccb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd102c4a9-79') {{(pid=82479) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 00:15:11 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:15:11 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd102c4a9-79, bridge=br-int, if_exists=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:15:11 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:15:11 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:15:11 user nova-compute[82479]: INFO os_vif [None req-b56307f4-b3fa-4b21-9663-9d147b3a8b88 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:dc:21,bridge_name='br-int',has_traffic_filtering=True,id=d102c4a9-79bd-4968-9a16-9eedcbce0056,network=Network(e3acf139-a0c8-4b33-aae5-26131d3dccb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd102c4a9-79')
Apr 14 00:15:11 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-b56307f4-b3fa-4b21-9663-9d147b3a8b88 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] Deleting instance files /opt/stack/data/nova/instances/13860c45-6a4b-48ea-9d0f-d50656585637_del
Apr 14 00:15:11 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-b56307f4-b3fa-4b21-9663-9d147b3a8b88 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] Deletion of /opt/stack/data/nova/instances/13860c45-6a4b-48ea-9d0f-d50656585637_del complete
Apr 14 00:15:11 user nova-compute[82479]: INFO nova.compute.manager [None req-b56307f4-b3fa-4b21-9663-9d147b3a8b88 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] Took 0.86 seconds to destroy the instance on the hypervisor.
Apr 14 00:15:11 user nova-compute[82479]: DEBUG oslo.service.loopingcall [None req-b56307f4-b3fa-4b21-9663-9d147b3a8b88 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82479) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 00:15:11 user nova-compute[82479]: DEBUG nova.compute.manager [-] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] Deallocating network for instance {{(pid=82479) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 00:15:11 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] deallocate_for_instance() {{(pid=82479) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 00:15:11 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:15:11 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] Updating instance_info_cache with network_info: [] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:15:11 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] Took 0.56 seconds to deallocate network for instance.
Apr 14 00:15:11 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-b56307f4-b3fa-4b21-9663-9d147b3a8b88 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:15:11 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-b56307f4-b3fa-4b21-9663-9d147b3a8b88 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:15:11 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-b56307f4-b3fa-4b21-9663-9d147b3a8b88 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:15:11 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-b56307f4-b3fa-4b21-9663-9d147b3a8b88 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:15:12 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-b56307f4-b3fa-4b21-9663-9d147b3a8b88 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.309s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:15:12 user nova-compute[82479]: INFO nova.scheduler.client.report [None req-b56307f4-b3fa-4b21-9663-9d147b3a8b88 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Deleted allocations for instance 13860c45-6a4b-48ea-9d0f-d50656585637
Apr 14 00:15:12 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-b56307f4-b3fa-4b21-9663-9d147b3a8b88 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lock "13860c45-6a4b-48ea-9d0f-d50656585637" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.902s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:15:12 user nova-compute[82479]: DEBUG nova.compute.manager [req-75b56508-22f5-4565-bef1-9b75f8387b4b req-d457243c-2192-4b88-874a-f2f7b979a282 service nova] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] Received event network-vif-plugged-d102c4a9-79bd-4968-9a16-9eedcbce0056 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:15:12 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-75b56508-22f5-4565-bef1-9b75f8387b4b req-d457243c-2192-4b88-874a-f2f7b979a282 service nova] Acquiring lock "13860c45-6a4b-48ea-9d0f-d50656585637-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:15:12 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-75b56508-22f5-4565-bef1-9b75f8387b4b req-d457243c-2192-4b88-874a-f2f7b979a282 service nova] Lock "13860c45-6a4b-48ea-9d0f-d50656585637-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:15:12 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-75b56508-22f5-4565-bef1-9b75f8387b4b req-d457243c-2192-4b88-874a-f2f7b979a282 service nova] Lock "13860c45-6a4b-48ea-9d0f-d50656585637-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:15:12 user nova-compute[82479]: DEBUG nova.compute.manager [req-75b56508-22f5-4565-bef1-9b75f8387b4b req-d457243c-2192-4b88-874a-f2f7b979a282 service nova] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] No waiting events found dispatching network-vif-plugged-d102c4a9-79bd-4968-9a16-9eedcbce0056 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:15:12 user nova-compute[82479]: WARNING nova.compute.manager [req-75b56508-22f5-4565-bef1-9b75f8387b4b req-d457243c-2192-4b88-874a-f2f7b979a282 service nova] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] Received unexpected event network-vif-plugged-d102c4a9-79bd-4968-9a16-9eedcbce0056 for instance with vm_state deleted and task_state None.
Apr 14 00:15:12 user nova-compute[82479]: DEBUG nova.compute.manager [req-75b56508-22f5-4565-bef1-9b75f8387b4b req-d457243c-2192-4b88-874a-f2f7b979a282 service nova] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] Received event network-vif-deleted-d102c4a9-79bd-4968-9a16-9eedcbce0056 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:15:16 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:15:16 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:15:21 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:15:21 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:15:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "1cfe388b-396b-4ce9-97aa-9049cbcb32f4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:15:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "1cfe388b-396b-4ce9-97aa-9049cbcb32f4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:15:23 user nova-compute[82479]: DEBUG nova.compute.manager [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Starting instance... {{(pid=82479) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 00:15:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:15:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:15:23 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82479) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 00:15:23 user nova-compute[82479]: INFO nova.compute.claims [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Claim successful on node user
Apr 14 00:15:24 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:15:24 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:15:24 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.380s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:15:24 user nova-compute[82479]: DEBUG nova.compute.manager [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Start building networks asynchronously for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 00:15:24 user nova-compute[82479]: DEBUG nova.compute.manager [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Allocating IP information in the background. {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 00:15:24 user nova-compute[82479]: DEBUG nova.network.neutron [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] allocate_for_instance() {{(pid=82479) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 00:15:24 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 00:15:24 user nova-compute[82479]: DEBUG nova.compute.manager [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Start building block device mappings for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 00:15:24 user nova-compute[82479]: DEBUG nova.policy [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '44530987616b417d87ce5909d8de1871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec1aab0338ff4bd195a37a4199a378eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82479) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 00:15:24 user nova-compute[82479]: DEBUG nova.compute.manager [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Start spawning the instance on the hypervisor. {{(pid=82479) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 00:15:24 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Creating instance directory {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 00:15:24 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Creating image(s)
Apr 14 00:15:24 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "/opt/stack/data/nova/instances/1cfe388b-396b-4ce9-97aa-9049cbcb32f4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:15:24 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "/opt/stack/data/nova/instances/1cfe388b-396b-4ce9-97aa-9049cbcb32f4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:15:24 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "/opt/stack/data/nova/instances/1cfe388b-396b-4ce9-97aa-9049cbcb32f4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:15:24 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:15:24 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.138s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:15:24 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "3e200e101633f2016e569ae4c0a352380507d1e4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:15:24 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "3e200e101633f2016e569ae4c0a352380507d1e4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:15:24 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:15:24 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.136s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:15:24 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/1cfe388b-396b-4ce9-97aa-9049cbcb32f4/disk 1073741824 {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:15:24 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/1cfe388b-396b-4ce9-97aa-9049cbcb32f4/disk 1073741824" returned: 0 in 0.048s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:15:24 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "3e200e101633f2016e569ae4c0a352380507d1e4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.190s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:15:24 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:15:24 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.145s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:15:24 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1cfe388b-396b-4ce9-97aa-9049cbcb32f4/disk. size=1073741824 {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 00:15:24 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cfe388b-396b-4ce9-97aa-9049cbcb32f4/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:15:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cfe388b-396b-4ce9-97aa-9049cbcb32f4/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:15:25 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Cannot resize image /opt/stack/data/nova/instances/1cfe388b-396b-4ce9-97aa-9049cbcb32f4/disk to a smaller size. {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 00:15:25 user nova-compute[82479]: DEBUG nova.objects.instance [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lazy-loading 'migration_context' on Instance uuid 1cfe388b-396b-4ce9-97aa-9049cbcb32f4 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:15:25 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Created local disks {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 00:15:25 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Ensure instance console log exists: /opt/stack/data/nova/instances/1cfe388b-396b-4ce9-97aa-9049cbcb32f4/console.log {{(pid=82479) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 00:15:25 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:15:25 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:15:25 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:15:25 user nova-compute[82479]: DEBUG nova.network.neutron [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Successfully created port: 7c1bd582-678f-4d5e-9f6e-e60edd6f037b {{(pid=82479) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 00:15:25 user nova-compute[82479]: DEBUG nova.network.neutron [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Successfully updated port: 7c1bd582-678f-4d5e-9f6e-e60edd6f037b {{(pid=82479) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 00:15:25 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "refresh_cache-1cfe388b-396b-4ce9-97aa-9049cbcb32f4" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:15:25 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquired lock "refresh_cache-1cfe388b-396b-4ce9-97aa-9049cbcb32f4" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:15:25 user nova-compute[82479]: DEBUG nova.network.neutron [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 00:15:25 user nova-compute[82479]: DEBUG nova.compute.manager [req-774f9097-94f8-4fdb-8090-dacd69f7130c req-86781a7d-7ba7-48aa-82d0-533cff908f55 service nova] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Received event network-changed-7c1bd582-678f-4d5e-9f6e-e60edd6f037b {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:15:25 user nova-compute[82479]: DEBUG nova.compute.manager [req-774f9097-94f8-4fdb-8090-dacd69f7130c req-86781a7d-7ba7-48aa-82d0-533cff908f55 service nova] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Refreshing instance network info cache due to event network-changed-7c1bd582-678f-4d5e-9f6e-e60edd6f037b. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:15:25 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-774f9097-94f8-4fdb-8090-dacd69f7130c req-86781a7d-7ba7-48aa-82d0-533cff908f55 service nova] Acquiring lock "refresh_cache-1cfe388b-396b-4ce9-97aa-9049cbcb32f4" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:15:25 user nova-compute[82479]: DEBUG nova.network.neutron [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Instance cache missing network info. {{(pid=82479) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 00:15:25 user nova-compute[82479]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681431310.9887288, 13860c45-6a4b-48ea-9d0f-d50656585637 => Stopped> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:15:25 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] VM Stopped (Lifecycle Event)
Apr 14 00:15:26 user nova-compute[82479]: DEBUG nova.compute.manager [None req-82e08d87-d132-47f8-aa7a-c3c4ca99f0dd None None] [instance: 13860c45-6a4b-48ea-9d0f-d50656585637] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:15:26 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:15:26 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:15:26 user nova-compute[82479]: DEBUG nova.network.neutron [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Updating instance_info_cache with network_info: [{"id": "7c1bd582-678f-4d5e-9f6e-e60edd6f037b", "address": "fa:16:3e:58:24:c8", "network": {"id": "368d9445-850e-4f74-b5cc-86d1eaa95d63", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374332689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec1aab0338ff4bd195a37a4199a378eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c1bd582-67", "ovs_interfaceid": "7c1bd582-678f-4d5e-9f6e-e60edd6f037b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:15:26 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Releasing lock "refresh_cache-1cfe388b-396b-4ce9-97aa-9049cbcb32f4" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:15:26 user nova-compute[82479]: DEBUG nova.compute.manager [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Instance network_info: |[{"id": "7c1bd582-678f-4d5e-9f6e-e60edd6f037b", "address": "fa:16:3e:58:24:c8", "network": {"id": "368d9445-850e-4f74-b5cc-86d1eaa95d63", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374332689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec1aab0338ff4bd195a37a4199a378eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c1bd582-67", "ovs_interfaceid": "7c1bd582-678f-4d5e-9f6e-e60edd6f037b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 00:15:26 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-774f9097-94f8-4fdb-8090-dacd69f7130c req-86781a7d-7ba7-48aa-82d0-533cff908f55 service nova] Acquired lock "refresh_cache-1cfe388b-396b-4ce9-97aa-9049cbcb32f4" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:15:26 user nova-compute[82479]: DEBUG nova.network.neutron [req-774f9097-94f8-4fdb-8090-dacd69f7130c req-86781a7d-7ba7-48aa-82d0-533cff908f55 service nova] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Refreshing network info cache for port 7c1bd582-678f-4d5e-9f6e-e60edd6f037b {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:15:26 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Start _get_guest_xml network_info=[{"id": "7c1bd582-678f-4d5e-9f6e-e60edd6f037b", "address": "fa:16:3e:58:24:c8", "network": {"id": "368d9445-850e-4f74-b5cc-86d1eaa95d63", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374332689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec1aab0338ff4bd195a37a4199a378eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c1bd582-67", "ovs_interfaceid": "7c1bd582-678f-4d5e-9f6e-e60edd6f037b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 00:15:26 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:15:26 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:15:26 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82479) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 00:15:26 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T00:02:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 00:15:26 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Flavor limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 00:15:26 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Image limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 00:15:26 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Flavor pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 00:15:26 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Image pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 00:15:26 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 00:15:26 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 00:15:26 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 00:15:26 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Got 1 possible topologies {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 00:15:26 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 00:15:26 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 00:15:26 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:15:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1072577782',display_name='tempest-AttachVolumeTestJSON-server-1072577782',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1072577782',id=26,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNeu3sLSv8MjRHlPE0XtJ4rNeSiWhefKhtVNlkDogqACZkiI1sdRyNSDtHyBnSkkNhIwyCmjqAmbXkqQdo4qEaGe/zgoUlWHrCvPiCy5gC+LrtY/wQVkC2HqO/3lmIrXQw==',key_name='tempest-keypair-1596000720',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ec1aab0338ff4bd195a37a4199a378eb',ramdisk_id='',reservation_id='r-xp4uiih8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1885059489',owner_user_name='tempest-AttachVolumeTestJSON-1885059489-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:15:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44530987616b417d87ce5909d8de1871',uuid=1cfe388b-396b-4ce9-97aa-9049cbcb32f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c1bd582-678f-4d5e-9f6e-e60edd6f037b", "address": "fa:16:3e:58:24:c8", "network": {"id": "368d9445-850e-4f74-b5cc-86d1eaa95d63", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374332689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec1aab0338ff4bd195a37a4199a378eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c1bd582-67", "ovs_interfaceid": "7c1bd582-678f-4d5e-9f6e-e60edd6f037b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82479) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 00:15:26 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Converting VIF {"id": "7c1bd582-678f-4d5e-9f6e-e60edd6f037b", "address": "fa:16:3e:58:24:c8", "network": {"id": "368d9445-850e-4f74-b5cc-86d1eaa95d63", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374332689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec1aab0338ff4bd195a37a4199a378eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c1bd582-67", "ovs_interfaceid": "7c1bd582-678f-4d5e-9f6e-e60edd6f037b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:15:26 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:24:c8,bridge_name='br-int',has_traffic_filtering=True,id=7c1bd582-678f-4d5e-9f6e-e60edd6f037b,network=Network(368d9445-850e-4f74-b5cc-86d1eaa95d63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c1bd582-67') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:15:26 user nova-compute[82479]: DEBUG nova.objects.instance [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lazy-loading 'pci_devices' on Instance uuid 1cfe388b-396b-4ce9-97aa-9049cbcb32f4 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:15:26 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] End _get_guest_xml xml=<domain type="kvm">
Apr 14 00:15:26 user nova-compute[82479]:   <uuid>1cfe388b-396b-4ce9-97aa-9049cbcb32f4</uuid>
Apr 14 00:15:26 user nova-compute[82479]:   <name>instance-0000001a</name>
Apr 14 00:15:26 user nova-compute[82479]:   <memory>131072</memory>
Apr 14 00:15:26 user nova-compute[82479]:   <vcpu>1</vcpu>
Apr 14 00:15:26 user nova-compute[82479]:   <metadata>
Apr 14 00:15:26 user nova-compute[82479]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 00:15:26 user nova-compute[82479]:       <nova:package version="0.0.0"/>
Apr 14 00:15:26 user nova-compute[82479]:       <nova:name>tempest-AttachVolumeTestJSON-server-1072577782</nova:name>
Apr 14 00:15:26 user nova-compute[82479]:       <nova:creationTime>2023-04-14 00:15:26</nova:creationTime>
Apr 14 00:15:26 user nova-compute[82479]:       <nova:flavor name="m1.nano">
Apr 14 00:15:26 user nova-compute[82479]:         <nova:memory>128</nova:memory>
Apr 14 00:15:26 user nova-compute[82479]:         <nova:disk>1</nova:disk>
Apr 14 00:15:26 user nova-compute[82479]:         <nova:swap>0</nova:swap>
Apr 14 00:15:26 user nova-compute[82479]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 00:15:26 user nova-compute[82479]:         <nova:vcpus>1</nova:vcpus>
Apr 14 00:15:26 user nova-compute[82479]:       </nova:flavor>
Apr 14 00:15:26 user nova-compute[82479]:       <nova:owner>
Apr 14 00:15:26 user nova-compute[82479]:         <nova:user uuid="44530987616b417d87ce5909d8de1871">tempest-AttachVolumeTestJSON-1885059489-project-member</nova:user>
Apr 14 00:15:26 user nova-compute[82479]:         <nova:project uuid="ec1aab0338ff4bd195a37a4199a378eb">tempest-AttachVolumeTestJSON-1885059489</nova:project>
Apr 14 00:15:26 user nova-compute[82479]:       </nova:owner>
Apr 14 00:15:26 user nova-compute[82479]:       <nova:root type="image" uuid="6db62068-7278-4cd8-b41f-d0140d89e199"/>
Apr 14 00:15:26 user nova-compute[82479]:       <nova:ports>
Apr 14 00:15:26 user nova-compute[82479]:         <nova:port uuid="7c1bd582-678f-4d5e-9f6e-e60edd6f037b">
Apr 14 00:15:26 user nova-compute[82479]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 14 00:15:26 user nova-compute[82479]:         </nova:port>
Apr 14 00:15:26 user nova-compute[82479]:       </nova:ports>
Apr 14 00:15:26 user nova-compute[82479]:     </nova:instance>
Apr 14 00:15:26 user nova-compute[82479]:   </metadata>
Apr 14 00:15:26 user nova-compute[82479]:   <sysinfo type="smbios">
Apr 14 00:15:26 user nova-compute[82479]:     <system>
Apr 14 00:15:26 user nova-compute[82479]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 00:15:26 user nova-compute[82479]:       <entry name="product">OpenStack Nova</entry>
Apr 14 00:15:26 user nova-compute[82479]:       <entry name="version">0.0.0</entry>
Apr 14 00:15:26 user nova-compute[82479]:       <entry name="serial">1cfe388b-396b-4ce9-97aa-9049cbcb32f4</entry>
Apr 14 00:15:26 user nova-compute[82479]:       <entry name="uuid">1cfe388b-396b-4ce9-97aa-9049cbcb32f4</entry>
Apr 14 00:15:26 user nova-compute[82479]:       <entry name="family">Virtual Machine</entry>
Apr 14 00:15:26 user nova-compute[82479]:     </system>
Apr 14 00:15:26 user nova-compute[82479]:   </sysinfo>
Apr 14 00:15:26 user nova-compute[82479]:   <os>
Apr 14 00:15:26 user nova-compute[82479]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 00:15:26 user nova-compute[82479]:     <boot dev="hd"/>
Apr 14 00:15:26 user nova-compute[82479]:     <smbios mode="sysinfo"/>
Apr 14 00:15:26 user nova-compute[82479]:   </os>
Apr 14 00:15:26 user nova-compute[82479]:   <features>
Apr 14 00:15:26 user nova-compute[82479]:     <acpi/>
Apr 14 00:15:26 user nova-compute[82479]:     <apic/>
Apr 14 00:15:26 user nova-compute[82479]:     <vmcoreinfo/>
Apr 14 00:15:26 user nova-compute[82479]:   </features>
Apr 14 00:15:26 user nova-compute[82479]:   <clock offset="utc">
Apr 14 00:15:26 user nova-compute[82479]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 00:15:26 user nova-compute[82479]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 00:15:26 user nova-compute[82479]:     <timer name="hpet" present="no"/>
Apr 14 00:15:26 user nova-compute[82479]:   </clock>
Apr 14 00:15:26 user nova-compute[82479]:   <cpu mode="custom" match="exact">
Apr 14 00:15:26 user nova-compute[82479]:     <model>Nehalem</model>
Apr 14 00:15:26 user nova-compute[82479]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 00:15:26 user nova-compute[82479]:   </cpu>
Apr 14 00:15:26 user nova-compute[82479]:   <devices>
Apr 14 00:15:26 user nova-compute[82479]:     <disk type="file" device="disk">
Apr 14 00:15:26 user nova-compute[82479]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 00:15:26 user nova-compute[82479]:       <source file="/opt/stack/data/nova/instances/1cfe388b-396b-4ce9-97aa-9049cbcb32f4/disk"/>
Apr 14 00:15:26 user nova-compute[82479]:       <target dev="vda" bus="virtio"/>
Apr 14 00:15:26 user nova-compute[82479]:     </disk>
Apr 14 00:15:26 user nova-compute[82479]:     <interface type="ethernet">
Apr 14 00:15:26 user nova-compute[82479]:       <mac address="fa:16:3e:58:24:c8"/>
Apr 14 00:15:26 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:15:26 user nova-compute[82479]:       <mtu size="1442"/>
Apr 14 00:15:26 user nova-compute[82479]:       <target dev="tap7c1bd582-67"/>
Apr 14 00:15:26 user nova-compute[82479]:     </interface>
Apr 14 00:15:26 user nova-compute[82479]:     <serial type="pty">
Apr 14 00:15:26 user nova-compute[82479]:       <log file="/opt/stack/data/nova/instances/1cfe388b-396b-4ce9-97aa-9049cbcb32f4/console.log" append="off"/>
Apr 14 00:15:26 user nova-compute[82479]:     </serial>
Apr 14 00:15:26 user nova-compute[82479]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 00:15:26 user nova-compute[82479]:     <video>
Apr 14 00:15:26 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:15:26 user nova-compute[82479]:     </video>
Apr 14 00:15:26 user nova-compute[82479]:     <rng model="virtio">
Apr 14 00:15:26 user nova-compute[82479]:       <backend model="random">/dev/urandom</backend>
Apr 14 00:15:26 user nova-compute[82479]:     </rng>
Apr 14 00:15:26 user nova-compute[82479]:     <controller type="usb" index="0" model="none"/>
Apr 14 00:15:26 user nova-compute[82479]:     <memballoon model="virtio">
Apr 14 00:15:26 user nova-compute[82479]:       <stats period="10"/>
Apr 14 00:15:26 user nova-compute[82479]:     </memballoon>
Apr 14 00:15:26 user nova-compute[82479]:   </devices>
Apr 14 00:15:26 user nova-compute[82479]: </domain>
Apr 14 00:15:26 user nova-compute[82479]:  {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 00:15:26 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:15:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1072577782',display_name='tempest-AttachVolumeTestJSON-server-1072577782',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1072577782',id=26,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNeu3sLSv8MjRHlPE0XtJ4rNeSiWhefKhtVNlkDogqACZkiI1sdRyNSDtHyBnSkkNhIwyCmjqAmbXkqQdo4qEaGe/zgoUlWHrCvPiCy5gC+LrtY/wQVkC2HqO/3lmIrXQw==',key_name='tempest-keypair-1596000720',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ec1aab0338ff4bd195a37a4199a378eb',ramdisk_id='',reservation_id='r-xp4uiih8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1885059489',owner_user_name='tempest-AttachVolumeTestJSON-1885059489-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:15:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44530987616b417d87ce5909d8de1871',uuid=1cfe388b-396b-4ce9-97aa-9049cbcb32f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c1bd582-678f-4d5e-9f6e-e60edd6f037b", "address": "fa:16:3e:58:24:c8", "network": {"id": "368d9445-850e-4f74-b5cc-86d1eaa95d63", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374332689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec1aab0338ff4bd195a37a4199a378eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c1bd582-67", "ovs_interfaceid": "7c1bd582-678f-4d5e-9f6e-e60edd6f037b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 00:15:26 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Converting VIF {"id": "7c1bd582-678f-4d5e-9f6e-e60edd6f037b", "address": "fa:16:3e:58:24:c8", "network": {"id": "368d9445-850e-4f74-b5cc-86d1eaa95d63", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374332689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec1aab0338ff4bd195a37a4199a378eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c1bd582-67", "ovs_interfaceid": "7c1bd582-678f-4d5e-9f6e-e60edd6f037b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:15:26 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:24:c8,bridge_name='br-int',has_traffic_filtering=True,id=7c1bd582-678f-4d5e-9f6e-e60edd6f037b,network=Network(368d9445-850e-4f74-b5cc-86d1eaa95d63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c1bd582-67') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:15:26 user nova-compute[82479]: DEBUG os_vif [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:24:c8,bridge_name='br-int',has_traffic_filtering=True,id=7c1bd582-678f-4d5e-9f6e-e60edd6f037b,network=Network(368d9445-850e-4f74-b5cc-86d1eaa95d63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c1bd582-67') {{(pid=82479) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 00:15:26 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:15:26 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:15:26 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 00:15:26 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:15:26 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7c1bd582-67, may_exist=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:15:26 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7c1bd582-67, col_values=(('external_ids', {'iface-id': '7c1bd582-678f-4d5e-9f6e-e60edd6f037b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:24:c8', 'vm-uuid': '1cfe388b-396b-4ce9-97aa-9049cbcb32f4'}),)) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:15:26 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:15:26 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:15:26 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:15:26 user nova-compute[82479]: INFO os_vif [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:24:c8,bridge_name='br-int',has_traffic_filtering=True,id=7c1bd582-678f-4d5e-9f6e-e60edd6f037b,network=Network(368d9445-850e-4f74-b5cc-86d1eaa95d63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c1bd582-67')
Apr 14 00:15:26 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:15:26 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] No VIF found with MAC fa:16:3e:58:24:c8, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:15:26 user nova-compute[82479]: DEBUG nova.network.neutron [req-774f9097-94f8-4fdb-8090-dacd69f7130c req-86781a7d-7ba7-48aa-82d0-533cff908f55 service nova] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Updated VIF entry in instance network info cache for port 7c1bd582-678f-4d5e-9f6e-e60edd6f037b. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:15:26 user nova-compute[82479]: DEBUG nova.network.neutron [req-774f9097-94f8-4fdb-8090-dacd69f7130c req-86781a7d-7ba7-48aa-82d0-533cff908f55 service nova] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Updating instance_info_cache with network_info: [{"id": "7c1bd582-678f-4d5e-9f6e-e60edd6f037b", "address": "fa:16:3e:58:24:c8", "network": {"id": "368d9445-850e-4f74-b5cc-86d1eaa95d63", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374332689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec1aab0338ff4bd195a37a4199a378eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c1bd582-67", "ovs_interfaceid": "7c1bd582-678f-4d5e-9f6e-e60edd6f037b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:15:26 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-774f9097-94f8-4fdb-8090-dacd69f7130c req-86781a7d-7ba7-48aa-82d0-533cff908f55 service nova] Releasing lock "refresh_cache-1cfe388b-396b-4ce9-97aa-9049cbcb32f4" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:15:27 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:15:27 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:15:27 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:15:28 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-407d7ec5-ac8c-47ec-b111-4b576593b1e5 tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Acquiring lock "7553ffb8-704b-4b9c-8a15-13357f4ac9e7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:15:28 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-407d7ec5-ac8c-47ec-b111-4b576593b1e5 tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Lock "7553ffb8-704b-4b9c-8a15-13357f4ac9e7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:15:28 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-407d7ec5-ac8c-47ec-b111-4b576593b1e5 tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Acquiring lock "7553ffb8-704b-4b9c-8a15-13357f4ac9e7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:15:28 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-407d7ec5-ac8c-47ec-b111-4b576593b1e5 tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Lock "7553ffb8-704b-4b9c-8a15-13357f4ac9e7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:15:28 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-407d7ec5-ac8c-47ec-b111-4b576593b1e5 tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Lock "7553ffb8-704b-4b9c-8a15-13357f4ac9e7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:15:28 user nova-compute[82479]: INFO nova.compute.manager [None req-407d7ec5-ac8c-47ec-b111-4b576593b1e5 tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] Terminating instance
Apr 14 00:15:28 user nova-compute[82479]: DEBUG nova.compute.manager [None req-407d7ec5-ac8c-47ec-b111-4b576593b1e5 tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] Start destroying the instance on the hypervisor. {{(pid=82479) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 00:15:28 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:15:28 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:15:28 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:15:28 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:15:28 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:15:28 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:15:28 user nova-compute[82479]: DEBUG nova.compute.manager [req-0e5f0b75-44bf-4d81-948d-637465d10b54 req-2e54a1c4-9a41-4bc6-904a-1b4b1c1cbbb7 service nova] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Received event network-vif-plugged-7c1bd582-678f-4d5e-9f6e-e60edd6f037b {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:15:28 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0e5f0b75-44bf-4d81-948d-637465d10b54 req-2e54a1c4-9a41-4bc6-904a-1b4b1c1cbbb7 service nova] Acquiring lock "1cfe388b-396b-4ce9-97aa-9049cbcb32f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:15:28 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0e5f0b75-44bf-4d81-948d-637465d10b54 req-2e54a1c4-9a41-4bc6-904a-1b4b1c1cbbb7 service nova] Lock "1cfe388b-396b-4ce9-97aa-9049cbcb32f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:15:28 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0e5f0b75-44bf-4d81-948d-637465d10b54 req-2e54a1c4-9a41-4bc6-904a-1b4b1c1cbbb7 service nova] Lock "1cfe388b-396b-4ce9-97aa-9049cbcb32f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:15:28 user nova-compute[82479]: DEBUG nova.compute.manager [req-0e5f0b75-44bf-4d81-948d-637465d10b54 req-2e54a1c4-9a41-4bc6-904a-1b4b1c1cbbb7 service nova] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] No waiting events found dispatching network-vif-plugged-7c1bd582-678f-4d5e-9f6e-e60edd6f037b {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:15:28 user nova-compute[82479]: WARNING nova.compute.manager [req-0e5f0b75-44bf-4d81-948d-637465d10b54 req-2e54a1c4-9a41-4bc6-904a-1b4b1c1cbbb7 service nova] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Received unexpected event network-vif-plugged-7c1bd582-678f-4d5e-9f6e-e60edd6f037b for instance with vm_state building and task_state spawning.
Apr 14 00:15:28 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:15:28 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:15:28 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:15:28 user nova-compute[82479]: DEBUG nova.compute.manager [req-edd2b5d6-3131-4d13-b4c2-df7317896028 req-f06b4d45-9e8f-4429-8a4e-10c71a5d1cca service nova] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] Received event network-vif-unplugged-b4182f27-1858-4ce4-abfb-83ccbc0ac556 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:15:28 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-edd2b5d6-3131-4d13-b4c2-df7317896028 req-f06b4d45-9e8f-4429-8a4e-10c71a5d1cca service nova] Acquiring lock "7553ffb8-704b-4b9c-8a15-13357f4ac9e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:15:28 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-edd2b5d6-3131-4d13-b4c2-df7317896028 req-f06b4d45-9e8f-4429-8a4e-10c71a5d1cca service nova] Lock "7553ffb8-704b-4b9c-8a15-13357f4ac9e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:15:28 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-edd2b5d6-3131-4d13-b4c2-df7317896028 req-f06b4d45-9e8f-4429-8a4e-10c71a5d1cca service nova] Lock "7553ffb8-704b-4b9c-8a15-13357f4ac9e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:15:28 user nova-compute[82479]: DEBUG nova.compute.manager [req-edd2b5d6-3131-4d13-b4c2-df7317896028 req-f06b4d45-9e8f-4429-8a4e-10c71a5d1cca service nova] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] No waiting events found dispatching network-vif-unplugged-b4182f27-1858-4ce4-abfb-83ccbc0ac556 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:15:28 user nova-compute[82479]: DEBUG nova.compute.manager [req-edd2b5d6-3131-4d13-b4c2-df7317896028 req-f06b4d45-9e8f-4429-8a4e-10c71a5d1cca service nova] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] Received event network-vif-unplugged-b4182f27-1858-4ce4-abfb-83ccbc0ac556 for instance with task_state deleting. {{(pid=82479) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 00:15:28 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] Instance destroyed successfully.
Apr 14 00:15:28 user nova-compute[82479]: DEBUG nova.objects.instance [None req-407d7ec5-ac8c-47ec-b111-4b576593b1e5 tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Lazy-loading 'resources' on Instance uuid 7553ffb8-704b-4b9c-8a15-13357f4ac9e7 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:15:28 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-407d7ec5-ac8c-47ec-b111-4b576593b1e5 tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:13:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-749728094',display_name='tempest-VolumesNegativeTest-instance-749728094',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-749728094',id=23,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:13:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3d9d27c26e8e4b529040d8909aec1a04',ramdisk_id='',reservation_id='r-3iyh0jnd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1085100121',owner_user_name='tempest-VolumesNegativeTest-1085100121-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T00:13:45Z,user_data=None,user_id='bb07ce4305014dfaacd6283e4fcab068',uuid=7553ffb8-704b-4b9c-8a15-13357f4ac9e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b4182f27-1858-4ce4-abfb-83ccbc0ac556", "address": "fa:16:3e:f2:0b:5e", "network": {"id": "a7c293b2-01c9-43bb-99b1-fd78cdf3b101", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ccfc655ef7b947398980b9772e4864df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4182f27-18", "ovs_interfaceid": "b4182f27-1858-4ce4-abfb-83ccbc0ac556", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 00:15:28 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-407d7ec5-ac8c-47ec-b111-4b576593b1e5 tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Converting VIF {"id": "b4182f27-1858-4ce4-abfb-83ccbc0ac556", "address": "fa:16:3e:f2:0b:5e", "network": {"id": "a7c293b2-01c9-43bb-99b1-fd78cdf3b101", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "ccfc655ef7b947398980b9772e4864df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4182f27-18", "ovs_interfaceid": "b4182f27-1858-4ce4-abfb-83ccbc0ac556", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:15:28 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-407d7ec5-ac8c-47ec-b111-4b576593b1e5 tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:0b:5e,bridge_name='br-int',has_traffic_filtering=True,id=b4182f27-1858-4ce4-abfb-83ccbc0ac556,network=Network(a7c293b2-01c9-43bb-99b1-fd78cdf3b101),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4182f27-18') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:15:28 user nova-compute[82479]: DEBUG os_vif [None req-407d7ec5-ac8c-47ec-b111-4b576593b1e5 tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:0b:5e,bridge_name='br-int',has_traffic_filtering=True,id=b4182f27-1858-4ce4-abfb-83ccbc0ac556,network=Network(a7c293b2-01c9-43bb-99b1-fd78cdf3b101),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4182f27-18') {{(pid=82479) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 00:15:28 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:15:28 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb4182f27-18, bridge=br-int, if_exists=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:15:28 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:15:28 user nova-compute[82479]: INFO os_vif [None req-407d7ec5-ac8c-47ec-b111-4b576593b1e5 tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:0b:5e,bridge_name='br-int',has_traffic_filtering=True,id=b4182f27-1858-4ce4-abfb-83ccbc0ac556,network=Network(a7c293b2-01c9-43bb-99b1-fd78cdf3b101),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4182f27-18')
Apr 14 00:15:28 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-407d7ec5-ac8c-47ec-b111-4b576593b1e5 tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] Deleting instance files /opt/stack/data/nova/instances/7553ffb8-704b-4b9c-8a15-13357f4ac9e7_del
Apr 14 00:15:28 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-407d7ec5-ac8c-47ec-b111-4b576593b1e5 tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] Deletion of /opt/stack/data/nova/instances/7553ffb8-704b-4b9c-8a15-13357f4ac9e7_del complete
Apr 14 00:15:28 user nova-compute[82479]: INFO nova.compute.manager [None req-407d7ec5-ac8c-47ec-b111-4b576593b1e5 tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] Took 0.71 seconds to destroy the instance on the hypervisor.
Apr 14 00:15:28 user nova-compute[82479]: DEBUG oslo.service.loopingcall [None req-407d7ec5-ac8c-47ec-b111-4b576593b1e5 tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82479) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 00:15:28 user nova-compute[82479]: DEBUG nova.compute.manager [-] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] Deallocating network for instance {{(pid=82479) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 00:15:28 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] deallocate_for_instance() {{(pid=82479) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 00:15:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:15:29 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] Updating instance_info_cache with network_info: [] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:15:29 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] Took 0.51 seconds to deallocate network for instance.
Apr 14 00:15:29 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-407d7ec5-ac8c-47ec-b111-4b576593b1e5 tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:15:29 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-407d7ec5-ac8c-47ec-b111-4b576593b1e5 tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:15:29 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-407d7ec5-ac8c-47ec-b111-4b576593b1e5 tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:15:29 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-407d7ec5-ac8c-47ec-b111-4b576593b1e5 tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:15:29 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-407d7ec5-ac8c-47ec-b111-4b576593b1e5 tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.309s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:15:29 user nova-compute[82479]: INFO nova.scheduler.client.report [None req-407d7ec5-ac8c-47ec-b111-4b576593b1e5 tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Deleted allocations for instance 7553ffb8-704b-4b9c-8a15-13357f4ac9e7
Apr 14 00:15:29 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-407d7ec5-ac8c-47ec-b111-4b576593b1e5 tempest-VolumesNegativeTest-1085100121 tempest-VolumesNegativeTest-1085100121-project-member] Lock "7553ffb8-704b-4b9c-8a15-13357f4ac9e7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.696s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:15:29 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681431329.8819244, 1cfe388b-396b-4ce9-97aa-9049cbcb32f4 => Resumed> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:15:29 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] VM Resumed (Lifecycle Event)
Apr 14 00:15:29 user nova-compute[82479]: DEBUG nova.compute.manager [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Instance event wait completed in 0 seconds for  {{(pid=82479) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 00:15:29 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Guest created on hypervisor {{(pid=82479) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 00:15:29 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Instance spawned successfully.
Apr 14 00:15:29 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 00:15:29 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:15:29 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:15:29 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Found default for hw_cdrom_bus of ide {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:15:29 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Found default for hw_disk_bus of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:15:29 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Found default for hw_input_bus of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:15:29 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Found default for hw_pointer_model of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:15:29 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Found default for hw_video_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:15:29 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Found default for hw_vif_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:15:29 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:15:29 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681431329.8829582, 1cfe388b-396b-4ce9-97aa-9049cbcb32f4 => Started> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:15:29 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] VM Started (Lifecycle Event)
Apr 14 00:15:29 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:15:29 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:15:29 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:15:29 user nova-compute[82479]: INFO nova.compute.manager [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Took 5.61 seconds to spawn the instance on the hypervisor.
Apr 14 00:15:29 user nova-compute[82479]: DEBUG nova.compute.manager [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:15:30 user nova-compute[82479]: INFO nova.compute.manager [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Took 6.30 seconds to build instance.
Apr 14 00:15:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-658ac92b-1ab0-40d5-8186-39e2e758a6a9 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "1cfe388b-396b-4ce9-97aa-9049cbcb32f4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.382s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:15:30 user nova-compute[82479]: DEBUG nova.compute.manager [req-33d9a200-100a-45ff-b6ef-aea7ef2f8eb9 req-eb91b876-fd76-4ca1-ab4d-2780bbb96dc5 service nova] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Received event network-vif-plugged-7c1bd582-678f-4d5e-9f6e-e60edd6f037b {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:15:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-33d9a200-100a-45ff-b6ef-aea7ef2f8eb9 req-eb91b876-fd76-4ca1-ab4d-2780bbb96dc5 service nova] Acquiring lock "1cfe388b-396b-4ce9-97aa-9049cbcb32f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:15:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-33d9a200-100a-45ff-b6ef-aea7ef2f8eb9 req-eb91b876-fd76-4ca1-ab4d-2780bbb96dc5 service nova] Lock "1cfe388b-396b-4ce9-97aa-9049cbcb32f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:15:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-33d9a200-100a-45ff-b6ef-aea7ef2f8eb9 req-eb91b876-fd76-4ca1-ab4d-2780bbb96dc5 service nova] Lock "1cfe388b-396b-4ce9-97aa-9049cbcb32f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:15:30 user nova-compute[82479]: DEBUG nova.compute.manager [req-33d9a200-100a-45ff-b6ef-aea7ef2f8eb9 req-eb91b876-fd76-4ca1-ab4d-2780bbb96dc5 service nova] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] No waiting events found dispatching network-vif-plugged-7c1bd582-678f-4d5e-9f6e-e60edd6f037b {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:15:30 user nova-compute[82479]: WARNING nova.compute.manager [req-33d9a200-100a-45ff-b6ef-aea7ef2f8eb9 req-eb91b876-fd76-4ca1-ab4d-2780bbb96dc5 service nova] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Received unexpected event network-vif-plugged-7c1bd582-678f-4d5e-9f6e-e60edd6f037b for instance with vm_state active and task_state None.
Apr 14 00:15:30 user nova-compute[82479]: DEBUG nova.compute.manager [req-b283ff39-0203-4d1b-8e0a-332e60ab1351 req-1482a2f6-5bf9-4eb5-a08c-94c3e079c83b service nova] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] Received event network-vif-plugged-b4182f27-1858-4ce4-abfb-83ccbc0ac556 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:15:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-b283ff39-0203-4d1b-8e0a-332e60ab1351 req-1482a2f6-5bf9-4eb5-a08c-94c3e079c83b service nova] Acquiring lock "7553ffb8-704b-4b9c-8a15-13357f4ac9e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:15:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-b283ff39-0203-4d1b-8e0a-332e60ab1351 req-1482a2f6-5bf9-4eb5-a08c-94c3e079c83b service nova] Lock "7553ffb8-704b-4b9c-8a15-13357f4ac9e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:15:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-b283ff39-0203-4d1b-8e0a-332e60ab1351 req-1482a2f6-5bf9-4eb5-a08c-94c3e079c83b service nova] Lock "7553ffb8-704b-4b9c-8a15-13357f4ac9e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:15:30 user nova-compute[82479]: DEBUG nova.compute.manager [req-b283ff39-0203-4d1b-8e0a-332e60ab1351 req-1482a2f6-5bf9-4eb5-a08c-94c3e079c83b service nova] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] No waiting events found dispatching network-vif-plugged-b4182f27-1858-4ce4-abfb-83ccbc0ac556 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:15:30 user nova-compute[82479]: WARNING nova.compute.manager [req-b283ff39-0203-4d1b-8e0a-332e60ab1351 req-1482a2f6-5bf9-4eb5-a08c-94c3e079c83b service nova] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] Received unexpected event network-vif-plugged-b4182f27-1858-4ce4-abfb-83ccbc0ac556 for instance with vm_state deleted and task_state None.
Apr 14 00:15:30 user nova-compute[82479]: DEBUG nova.compute.manager [req-b283ff39-0203-4d1b-8e0a-332e60ab1351 req-1482a2f6-5bf9-4eb5-a08c-94c3e079c83b service nova] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] Received event network-vif-deleted-b4182f27-1858-4ce4-abfb-83ccbc0ac556 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:15:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:15:33 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:15:33 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:15:36 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:15:38 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:15:42 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:15:43 user nova-compute[82479]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681431328.6748338, 7553ffb8-704b-4b9c-8a15-13357f4ac9e7 => Stopped> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:15:43 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] VM Stopped (Lifecycle Event)
Apr 14 00:15:43 user nova-compute[82479]: DEBUG nova.compute.manager [None req-84e15029-20a0-4085-ac67-9a0ff3c98265 None None] [instance: 7553ffb8-704b-4b9c-8a15-13357f4ac9e7] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:15:43 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:15:46 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:15:46 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:15:47 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:15:47 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Starting heal instance info cache {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 00:15:47 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "refresh_cache-6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:15:47 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquired lock "refresh_cache-6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:15:47 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Forcefully refreshing network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 00:15:48 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:15:48 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Updating instance_info_cache with network_info: [{"id": "10a32c68-570b-4ba1-ba36-6ecaf135c9bb", "address": "fa:16:3e:a4:44:5a", "network": {"id": "08106daa-a35e-4376-8c46-2b4baa51c6ea", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321730350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524265958bd24a6cb94aa3115eb2b6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10a32c68-57", "ovs_interfaceid": "10a32c68-570b-4ba1-ba36-6ecaf135c9bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:15:48 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Releasing lock "refresh_cache-6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:15:48 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Updated the network info_cache for instance {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 00:15:48 user nova-compute[82479]: DEBUG nova.compute.manager [req-fb60387f-db17-47bf-9a56-f6d7b1833ab4 req-6e801654-7450-4e8c-ab8b-fa292edab596 service nova] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Received event network-changed-adb392b2-602f-421d-b26b-1e8f243cacff {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:15:48 user nova-compute[82479]: DEBUG nova.compute.manager [req-fb60387f-db17-47bf-9a56-f6d7b1833ab4 req-6e801654-7450-4e8c-ab8b-fa292edab596 service nova] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Refreshing instance network info cache due to event network-changed-adb392b2-602f-421d-b26b-1e8f243cacff. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:15:48 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-fb60387f-db17-47bf-9a56-f6d7b1833ab4 req-6e801654-7450-4e8c-ab8b-fa292edab596 service nova] Acquiring lock "refresh_cache-e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:15:48 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-fb60387f-db17-47bf-9a56-f6d7b1833ab4 req-6e801654-7450-4e8c-ab8b-fa292edab596 service nova] Acquired lock "refresh_cache-e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:15:48 user nova-compute[82479]: DEBUG nova.network.neutron [req-fb60387f-db17-47bf-9a56-f6d7b1833ab4 req-6e801654-7450-4e8c-ab8b-fa292edab596 service nova] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Refreshing network info cache for port adb392b2-602f-421d-b26b-1e8f243cacff {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:15:49 user nova-compute[82479]: DEBUG nova.network.neutron [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Port 617f05b8-c04e-4abf-b4e5-a0234209624a binding to destination host user is already ACTIVE {{(pid=82479) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 14 00:15:49 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "refresh_cache-b3475e7e-ceb4-452a-a045-dbf43c5944dd" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:15:49 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquired lock "refresh_cache-b3475e7e-ceb4-452a-a045-dbf43c5944dd" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:15:49 user nova-compute[82479]: DEBUG nova.network.neutron [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 00:15:49 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:15:49 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:15:49 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Cleaning up deleted instances {{(pid=82479) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 00:15:49 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] There are 0 instances to clean {{(pid=82479) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 00:15:49 user nova-compute[82479]: DEBUG nova.network.neutron [req-fb60387f-db17-47bf-9a56-f6d7b1833ab4 req-6e801654-7450-4e8c-ab8b-fa292edab596 service nova] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Updated VIF entry in instance network info cache for port adb392b2-602f-421d-b26b-1e8f243cacff. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:15:49 user nova-compute[82479]: DEBUG nova.network.neutron [req-fb60387f-db17-47bf-9a56-f6d7b1833ab4 req-6e801654-7450-4e8c-ab8b-fa292edab596 service nova] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Updating instance_info_cache with network_info: [{"id": "adb392b2-602f-421d-b26b-1e8f243cacff", "address": "fa:16:3e:3f:64:bc", "network": {"id": "6d80f923-8aef-45df-921b-f77ed4ff0e75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-696070096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44c9d67ad2fa4cb9ab309b98f8fe051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadb392b2-60", "ovs_interfaceid": "adb392b2-602f-421d-b26b-1e8f243cacff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:15:49 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-fb60387f-db17-47bf-9a56-f6d7b1833ab4 req-6e801654-7450-4e8c-ab8b-fa292edab596 service nova] Releasing lock "refresh_cache-e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:15:50 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-5323c647-7aeb-49f2-8848-03656abe585a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:15:50 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-5323c647-7aeb-49f2-8848-03656abe585a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:15:50 user nova-compute[82479]: DEBUG nova.objects.instance [None req-5323c647-7aeb-49f2-8848-03656abe585a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lazy-loading 'flavor' on Instance uuid e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:15:50 user nova-compute[82479]: DEBUG nova.network.neutron [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Updating instance_info_cache with network_info: [{"id": "617f05b8-c04e-4abf-b4e5-a0234209624a", "address": "fa:16:3e:f9:fd:1a", "network": {"id": "cb8c9bb1-a885-486d-aa6a-de600bc01c2e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1676259779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8663ccad9047f4b11b9ae0646c287a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617f05b8-c0", "ovs_interfaceid": "617f05b8-c04e-4abf-b4e5-a0234209624a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:15:50 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-5323c647-7aeb-49f2-8848-03656abe585a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:15:50 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Releasing lock "refresh_cache-b3475e7e-ceb4-452a-a045-dbf43c5944dd" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:15:50 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Creating tmpfile /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/tmpf805fdfp to verify with other compute node that the instance is on the same shared storage. {{(pid=82479) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9595}}
Apr 14 00:15:50 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:15:50 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:15:50 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:15:50 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:15:50 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-5323c647-7aeb-49f2-8848-03656abe585a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:15:50 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-5323c647-7aeb-49f2-8848-03656abe585a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:15:50 user nova-compute[82479]: INFO nova.compute.manager [None req-5323c647-7aeb-49f2-8848-03656abe585a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Attaching volume ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 to /dev/vdb
Apr 14 00:15:50 user nova-compute[82479]: DEBUG os_brick.utils [None req-5323c647-7aeb-49f2-8848-03656abe585a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:15:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:15:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:15:50 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20baf8d-a70d-4c0a-8e62-4f65dd59dc19]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fec92fcfdd3\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:15:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:15:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:15:50 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a5cd98-6fc4-4817-b63d-fc56a62fb766]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:15:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:15:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:15:50 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7a096d-c36a-4255-9969-eff34452f618]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:15:50 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6be597c-ec4a-47d8-b8d4-2c610f6a6721]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:15:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-5323c647-7aeb-49f2-8848-03656abe585a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Running cmd (subprocess): nvme version {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:15:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-5323c647-7aeb-49f2-8848-03656abe585a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] 'nvme version' failed. Not Retrying. {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:15:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5323c647-7aeb-49f2-8848-03656abe585a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] nvme not present on system {{(pid=82479) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 00:15:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:15:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:15:50 user nova-compute[82479]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 00:15:50 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e219b6a-9497-4ec6-9df2-ff433ebaa1d0]: (4, '') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:15:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-5323c647-7aeb-49f2-8848-03656abe585a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82479) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 00:15:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-5323c647-7aeb-49f2-8848-03656abe585a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 00:15:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-5323c647-7aeb-49f2-8848-03656abe585a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] LIGHTOS: no hostnqn found. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 00:15:50 user nova-compute[82479]: DEBUG os_brick.utils [None req-5323c647-7aeb-49f2-8848-03656abe585a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fec92fcfdd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:15:50 user nova-compute[82479]: DEBUG nova.virt.block_device [None req-5323c647-7aeb-49f2-8848-03656abe585a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Updating existing volume attachment record: 7ff32392-3588-4516-b84a-d3043efb571f {{(pid=82479) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 00:15:50 user nova-compute[82479]: DEBUG nova.compute.manager [req-9d1433ad-9c52-45c9-b776-359d1c65a85f req-54716bdc-6d52-46f3-b3d3-230f065edc87 service nova] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Received event network-vif-unplugged-617f05b8-c04e-4abf-b4e5-a0234209624a {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:15:50 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-9d1433ad-9c52-45c9-b776-359d1c65a85f req-54716bdc-6d52-46f3-b3d3-230f065edc87 service nova] Acquiring lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:15:50 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-9d1433ad-9c52-45c9-b776-359d1c65a85f req-54716bdc-6d52-46f3-b3d3-230f065edc87 service nova] Lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:15:50 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-9d1433ad-9c52-45c9-b776-359d1c65a85f req-54716bdc-6d52-46f3-b3d3-230f065edc87 service nova] Lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:15:50 user nova-compute[82479]: DEBUG nova.compute.manager [req-9d1433ad-9c52-45c9-b776-359d1c65a85f req-54716bdc-6d52-46f3-b3d3-230f065edc87 service nova] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] No waiting events found dispatching network-vif-unplugged-617f05b8-c04e-4abf-b4e5-a0234209624a {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:15:50 user nova-compute[82479]: WARNING nova.compute.manager [req-9d1433ad-9c52-45c9-b776-359d1c65a85f req-54716bdc-6d52-46f3-b3d3-230f065edc87 service nova] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Received unexpected event network-vif-unplugged-617f05b8-c04e-4abf-b4e5-a0234209624a for instance with vm_state resized and task_state resize_reverting.
Apr 14 00:15:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:15:51 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Instance destroyed successfully.
Apr 14 00:15:51 user nova-compute[82479]: DEBUG nova.objects.instance [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lazy-loading 'resources' on Instance uuid b3475e7e-ceb4-452a-a045-dbf43c5944dd {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:15:51 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T00:05:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-2144192259',display_name='tempest-ServerActionsTestJSON-server-1662090424',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-2144192259',id=6,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD8E1mkrqLo3jsCiJcIvha4CNzW2T6/HQ38hZ5dGaGtUghmrHejTJlAuKgmy6xusLbaAzGTrJCKVkdgQ5v0CqCqGeNMDA89aLJgLl5KHn3gvI39SkbPja84HarSvbQbbXg==',key_name='tempest-keypair-1040271550',keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:14:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=<?>,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bf8663ccad9047f4b11b9ae0646c287a',ramdisk_id='',reservation_id='r-amqn5295',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-948553482',owner_user_name='tempest-ServerActionsTestJSON-948553482-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T00:14:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d86662f2c7648daad87118b7e9f757c',uuid=b3475e7e-ceb4-452a-a045-dbf43c5944dd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "617f05b8-c04e-4abf-b4e5-a0234209624a", "address": "fa:16:3e:f9:fd:1a", "network": {"id": "cb8c9bb1-a885-486d-aa6a-de600bc01c2e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1676259779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8663ccad9047f4b11b9ae0646c287a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617f05b8-c0", "ovs_interfaceid": "617f05b8-c04e-4abf-b4e5-a0234209624a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 00:15:51 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Converting VIF {"id": "617f05b8-c04e-4abf-b4e5-a0234209624a", "address": "fa:16:3e:f9:fd:1a", "network": {"id": "cb8c9bb1-a885-486d-aa6a-de600bc01c2e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1676259779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8663ccad9047f4b11b9ae0646c287a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617f05b8-c0", "ovs_interfaceid": "617f05b8-c04e-4abf-b4e5-a0234209624a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:15:51 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:fd:1a,bridge_name='br-int',has_traffic_filtering=True,id=617f05b8-c04e-4abf-b4e5-a0234209624a,network=Network(cb8c9bb1-a885-486d-aa6a-de600bc01c2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap617f05b8-c0') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:15:51 user nova-compute[82479]: DEBUG os_vif [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:fd:1a,bridge_name='br-int',has_traffic_filtering=True,id=617f05b8-c04e-4abf-b4e5-a0234209624a,network=Network(cb8c9bb1-a885-486d-aa6a-de600bc01c2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap617f05b8-c0') {{(pid=82479) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 00:15:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:15:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap617f05b8-c0, bridge=br-int, if_exists=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:15:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:15:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:15:51 user nova-compute[82479]: INFO os_vif [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:fd:1a,bridge_name='br-int',has_traffic_filtering=True,id=617f05b8-c04e-4abf-b4e5-a0234209624a,network=Network(cb8c9bb1-a885-486d-aa6a-de600bc01c2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap617f05b8-c0')
Apr 14 00:15:51 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] calling os-brick to detach iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 00:15:51 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, {'target_iqn': 'iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YrRJCHcL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:15:51 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:15:51 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:15:51 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:15:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:15:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:15:51 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac52b5c9-7b1a-44c2-bcb7-e4d48a432624]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:15:51 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 00:15:51 user nova-compute[82479]: No targets found.
Apr 14 00:15:51 user nova-compute[82479]: iSNS:
Apr 14 00:15:51 user nova-compute[82479]: No targets found.
Apr 14 00:15:51 user nova-compute[82479]: STATIC:
Apr 14 00:15:51 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc
Apr 14 00:15:51 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:15:51 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:15:51 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e
Apr 14 00:15:51 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:15:51 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:15:51 user nova-compute[82479]: FIRMWARE:
Apr 14 00:15:51 user nova-compute[82479]: No targets found.
Apr 14 00:15:51 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:15:51 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 00:15:51 user nova-compute[82479]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 00:15:51 user nova-compute[82479]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82479) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 00:15:51 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e', 0)] {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 00:15:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:15:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:15:51 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc9dc58-fd38-4a64-a841-d279aa12e24d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:15:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:15:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:15:51 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[9333ed69-66a3-4155-bef4-1a96d2a3b188]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:15:51 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:15:51 user nova-compute[82479]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e (non-flash)
Apr 14 00:15:51 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:15:51 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:15:51 user nova-compute[82479]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e (non-flash)
Apr 14 00:15:51 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:15:51 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3330103be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e'): ({'sdb'}, set())}) {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 00:15:51 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Removing single pathed devices sdb {{(pid=82479) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 00:15:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:15:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:15:51 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a5a2df-19a3-449a-868f-a4b9e8be9053]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:15:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:15:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:15:51 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a2efebb-872d-4846-a4ad-82926c28c7a8]: (4, ('ok\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:15:51 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Flushing IO for device /dev/sdb {{(pid=82479) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 00:15:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:15:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:15:51 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e2b915-8531-4fde-82b6-ac625cf6a9b6]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:15:51 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82479) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 00:15:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:15:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:15:51 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed9f566-1d02-4977-b51e-427f0cf88c7e]: (4, ('1', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:15:51 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 00:15:51 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] SCSI volumes sdb have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 00:15:51 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e')] {{(pid=82479) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 00:15:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:15:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:15:51 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d68e74-4a26-4899-81c9-6371d5fae85b]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:15:51 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:15:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e -p 172.16.0.220:3260 --logout {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:15:51 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:15:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:15:51 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d48e86-4a24-4138-8740-d5108afb9b4f]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:15:51 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e, portal: 172.16.0.220,3260]
Apr 14 00:15:51 user nova-compute[82479]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e, portal: 172.16.0.220,3260] successful.
Apr 14 00:15:51 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:15:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e -p 172.16.0.220:3260 --op delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:15:51 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:15:51 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ff9296-4d8e-4d45-bf11-8d8fbf5771ea]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:15:51 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:15:51 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:15:51 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] <== disconnect_volume: return (303ms) None {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:15:51 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Disconnected iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 00:15:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:15:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:15:52 user nova-compute[82479]: DEBUG nova.objects.instance [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lazy-loading 'migration_context' on Instance uuid b3475e7e-ceb4-452a-a045-dbf43c5944dd {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:15:52 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:15:52 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:15:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.397s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:15:53 user nova-compute[82479]: DEBUG nova.compute.manager [req-f54a4ced-5765-4c89-be46-7259e6f2ce0e req-eebb823a-247a-47e7-bbb5-7e9654728492 service nova] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Received event network-vif-plugged-617f05b8-c04e-4abf-b4e5-a0234209624a {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:15:53 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-f54a4ced-5765-4c89-be46-7259e6f2ce0e req-eebb823a-247a-47e7-bbb5-7e9654728492 service nova] Acquiring lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:15:53 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-f54a4ced-5765-4c89-be46-7259e6f2ce0e req-eebb823a-247a-47e7-bbb5-7e9654728492 service nova] Lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:15:53 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-f54a4ced-5765-4c89-be46-7259e6f2ce0e req-eebb823a-247a-47e7-bbb5-7e9654728492 service nova] Lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:15:53 user nova-compute[82479]: DEBUG nova.compute.manager [req-f54a4ced-5765-4c89-be46-7259e6f2ce0e req-eebb823a-247a-47e7-bbb5-7e9654728492 service nova] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] No waiting events found dispatching network-vif-plugged-617f05b8-c04e-4abf-b4e5-a0234209624a {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:15:53 user nova-compute[82479]: WARNING nova.compute.manager [req-f54a4ced-5765-4c89-be46-7259e6f2ce0e req-eebb823a-247a-47e7-bbb5-7e9654728492 service nova] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Received unexpected event network-vif-plugged-617f05b8-c04e-4abf-b4e5-a0234209624a for instance with vm_state resized and task_state resize_reverting.
Apr 14 00:15:53 user nova-compute[82479]: INFO nova.compute.manager [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Swapping old allocation on dict_keys(['3847975a-19aa-4b27-9180-14b5cc49044a']) held by migration 0879efd2-53d7-4b3f-bbf4-18105f4ac7bb for instance
Apr 14 00:15:53 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Overwriting current allocation {'allocations': {'3847975a-19aa-4b27-9180-14b5cc49044a': {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}, 'generation': 31}}, 'project_id': 'bf8663ccad9047f4b11b9ae0646c287a', 'user_id': '3d86662f2c7648daad87118b7e9f757c', 'consumer_generation': 1} on consumer b3475e7e-ceb4-452a-a045-dbf43c5944dd {{(pid=82479) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Apr 14 00:15:53 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "refresh_cache-b3475e7e-ceb4-452a-a045-dbf43c5944dd" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:15:53 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquired lock "refresh_cache-b3475e7e-ceb4-452a-a045-dbf43c5944dd" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:15:53 user nova-compute[82479]: DEBUG nova.network.neutron [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 00:15:53 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:15:53 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:15:53 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:15:53 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82479) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 00:15:53 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:15:53 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:15:53 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:15:53 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:15:53 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Auditing locally available compute resources for user (node: user) {{(pid=82479) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 00:15:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:15:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:15:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:15:53 user nova-compute[82479]: DEBUG nova.network.neutron [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Updating instance_info_cache with network_info: [{"id": "617f05b8-c04e-4abf-b4e5-a0234209624a", "address": "fa:16:3e:f9:fd:1a", "network": {"id": "cb8c9bb1-a885-486d-aa6a-de600bc01c2e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1676259779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8663ccad9047f4b11b9ae0646c287a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617f05b8-c0", "ovs_interfaceid": "617f05b8-c04e-4abf-b4e5-a0234209624a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:15:53 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Releasing lock "refresh_cache-b3475e7e-ceb4-452a-a045-dbf43c5944dd" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:15:53 user nova-compute[82479]: DEBUG os_brick.utils [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:15:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:15:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:15:53 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[a351b72b-1ac8-41e3-9b7c-fe1584e93f04]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fec92fcfdd3\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:15:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:15:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:15:54 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c4ad931-b5ce-4074-8414-f13a855b30db]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:15:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:15:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:15:54 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25f8853-99c4-4d59-8ef0-250f16b0f0c1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:15:54 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f8550d-fef6-4fd4-82d5-8573bc088df6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:15:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Running cmd (subprocess): nvme version {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:15:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] 'nvme version' failed. Not Retrying. {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:15:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] nvme not present on system {{(pid=82479) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 00:15:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:15:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:15:54 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:15:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:15:54 user nova-compute[82479]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 00:15:54 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[003aab20-2e80-4dcc-828e-43c11b147199]: (4, '') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:15:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82479) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 00:15:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 00:15:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] LIGHTOS: no hostnqn found. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 00:15:54 user nova-compute[82479]: DEBUG os_brick.utils [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fec92fcfdd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:15:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2793d412-f405-4452-8e46-c192e3c92ccb/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:15:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2793d412-f405-4452-8e46-c192e3c92ccb/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:15:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2793d412-f405-4452-8e46-c192e3c92ccb/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:15:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2793d412-f405-4452-8e46-c192e3c92ccb/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:15:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk.rescue --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:15:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:15:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk.rescue --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:15:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:15:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:15:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:15:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:15:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:15:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk.rescue --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:15:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:15:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk.rescue --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:15:55 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5323c647-7aeb-49f2-8848-03656abe585a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Calling os-brick to attach iSCSI Volume {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 00:15:55 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-5323c647-7aeb-49f2-8848-03656abe585a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sfVBgCIN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:15:55 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-5323c647-7aeb-49f2-8848-03656abe585a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:15:55 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-5323c647-7aeb-49f2-8848-03656abe585a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:15:55 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-5323c647-7aeb-49f2-8848-03656abe585a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:15:55 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-5323c647-7aeb-49f2-8848-03656abe585a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:15:55 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-5323c647-7aeb-49f2-8848-03656abe585a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:15:55 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-5323c647-7aeb-49f2-8848-03656abe585a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:15:55 user nova-compute[82479]: INFO os_brick.initiator.connectors.iscsi [None req-5323c647-7aeb-49f2-8848-03656abe585a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 00:15:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 -p 172.16.0.220:3260 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:15:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:15:55 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[df76c92f-538f-4a7f-a0d8-9ea7e5850f27]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:15:55 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-5323c647-7aeb-49f2-8848-03656abe585a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 00:15:55 user nova-compute[82479]:  {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:15:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 -p 172.16.0.220:3260 --interface default --op new {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:15:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:15:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:15:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:15:55 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4da72d-ebea-4fbf-b131-1d6a89b6a47e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1] added\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:15:55 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-5323c647-7aeb-49f2-8848-03656abe585a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1] added
Apr 14 00:15:55 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:15:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:15:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:15:55 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5610cb-55e3-454d-a504-b01e6e38547c]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:15:55 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-5323c647-7aeb-49f2-8848-03656abe585a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:15:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:15:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:15:55 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd31d196-3952-4842-a81f-52b74b81e223]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:15:55 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-5323c647-7aeb-49f2-8848-03656abe585a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:15:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sfVBgCIN {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:15:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sfVBgCIN" returned: 0 in 0.022s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:15:55 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[331eff05-9ebb-4c73-89a6-2a02b5d40e3d]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:15:55 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-5323c647-7aeb-49f2-8848-03656abe585a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sfVBgCIN'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:15:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:15:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:15:55 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb001c4-b42b-4710-9ab6-0a50de1550f8]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:15:55 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-5323c647-7aeb-49f2-8848-03656abe585a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:15:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:15:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:15:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:15:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:15:55 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6865ba1-114a-4e47-96f5-603a86ec170e]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:15:55 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-5323c647-7aeb-49f2-8848-03656abe585a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:15:55 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:15:55 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-5323c647-7aeb-49f2-8848-03656abe585a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:15:55 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:15:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 -p 172.16.0.220:3260 --login {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:15:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:15:55 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[18fa0971-8d88-4f52-8b5b-1e009b21d9e2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:15:55 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-5323c647-7aeb-49f2-8848-03656abe585a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1, portal: 172.16.0.220,3260]
Apr 14 00:15:55 user nova-compute[82479]: Login to [iface: default, target: iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1, portal: 172.16.0.220,3260] successful.
Apr 14 00:15:55 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:15:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:15:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:15:55 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d84099-3707-40aa-b121-3da84e886da9]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:15:55 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-5323c647-7aeb-49f2-8848-03656abe585a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:15:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:15:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:15:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:15:55 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[5516eb9a-2d5e-414c-b592-9d4befa5dc9d]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:15:55 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-5323c647-7aeb-49f2-8848-03656abe585a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:15:55 user nova-compute[82479]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 (non-flash)
Apr 14 00:15:55 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:15:55 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-5323c647-7aeb-49f2-8848-03656abe585a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:15:55 user nova-compute[82479]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 (non-flash)
Apr 14 00:15:55 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:15:55 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-5323c647-7aeb-49f2-8848-03656abe585a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:15:55 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-5323c647-7aeb-49f2-8848-03656abe585a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Connected to 172.16.0.220:3260 {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 00:15:55 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-5323c647-7aeb-49f2-8848-03656abe585a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] HCTL ('33', '-', '-', 0) found on session 25 with lun 0 {{(pid=82479) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 00:15:55 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-5323c647-7aeb-49f2-8848-03656abe585a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82479) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 00:15:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:15:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cfe388b-396b-4ce9-97aa-9049cbcb32f4/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:15:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:15:55 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f86723-c1c1-47b1-ad49-1580c4c72d87]: (4, ('- - 0', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:15:55 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-5323c647-7aeb-49f2-8848-03656abe585a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Searching for a device in session 25 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82479) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 00:15:55 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-5323c647-7aeb-49f2-8848-03656abe585a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sfVBgCIN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 00:15:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cfe388b-396b-4ce9-97aa-9049cbcb32f4/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:15:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cfe388b-396b-4ce9-97aa-9049cbcb32f4/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:15:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cfe388b-396b-4ce9-97aa-9049cbcb32f4/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:15:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:15:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:15:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:15:56 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:15:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:15:56 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:15:56 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-5323c647-7aeb-49f2-8848-03656abe585a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.432s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:15:56 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-5323c647-7aeb-49f2-8848-03656abe585a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] <== connect_volume: return (1435ms) {'type': 'block', 'scsi_wwn': '23335666464393062', 'path': '/dev/sdb'} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:15:56 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5323c647-7aeb-49f2-8848-03656abe585a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23335666464393062', 'path': '/dev/sdb'} {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 00:15:56 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:15:56 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:15:56 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Hypervisor/Node resource view: name=user free_ram=7982MB free_disk=26.15033721923828GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82479) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 00:15:56 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:15:56 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:15:56 user nova-compute[82479]: DEBUG nova.objects.instance [None req-5323c647-7aeb-49f2-8848-03656abe585a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lazy-loading 'flavor' on Instance uuid e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:15:56 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-5323c647-7aeb-49f2-8848-03656abe585a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 00:15:56 user nova-compute[82479]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:15:56 user nova-compute[82479]:   <source dev="/dev/sdb"/>
Apr 14 00:15:56 user nova-compute[82479]:   <target dev="vdb" bus="virtio"/>
Apr 14 00:15:56 user nova-compute[82479]:   <serial>ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1</serial>
Apr 14 00:15:56 user nova-compute[82479]: </disk>
Apr 14 00:15:56 user nova-compute[82479]:  {{(pid=82479) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 00:15:57 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 23718fd0-58b8-47f9-b1ef-a26a90741ecc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:15:57 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 17c6c147-fb62-4204-a416-792b94d3f7dd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:15:57 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:15:57 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:15:57 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:15:57 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance b3475e7e-ceb4-452a-a045-dbf43c5944dd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:15:57 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 2793d412-f405-4452-8e46-c192e3c92ccb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:15:57 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 1cfe388b-396b-4ce9-97aa-9049cbcb32f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:15:57 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 00:15:57 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 00:15:57 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Refreshing inventories for resource provider 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 00:15:57 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Updating ProviderTree inventory for provider 3847975a-19aa-4b27-9180-14b5cc49044a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 00:15:57 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Updating inventory in ProviderTree for provider 3847975a-19aa-4b27-9180-14b5cc49044a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 00:15:57 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Refreshing aggregate associations for resource provider 3847975a-19aa-4b27-9180-14b5cc49044a, aggregates: None {{(pid=82479) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 00:15:57 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Refreshing trait associations for resource provider 3847975a-19aa-4b27-9180-14b5cc49044a, traits: COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,HW_CPU_X86_SSE42,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO {{(pid=82479) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 00:15:57 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-5323c647-7aeb-49f2-8848-03656abe585a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:15:57 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-5323c647-7aeb-49f2-8848-03656abe585a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:15:57 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-5323c647-7aeb-49f2-8848-03656abe585a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] No VIF found with MAC fa:16:3e:3f:64:bc, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:15:57 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-5323c647-7aeb-49f2-8848-03656abe585a tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.698s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:15:57 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:15:57 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:15:57 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Compute_service record updated for user:user {{(pid=82479) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 00:15:57 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.081s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:15:57 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:15:57 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Cleaning up deleted instances with incomplete migration  {{(pid=82479) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 00:15:58 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-24459fcb-cd10-4d30-b933-6998cd4ebd31 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:15:58 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-24459fcb-cd10-4d30-b933-6998cd4ebd31 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:15:58 user nova-compute[82479]: INFO nova.compute.manager [None req-24459fcb-cd10-4d30-b933-6998cd4ebd31 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Detaching volume ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1
Apr 14 00:15:58 user nova-compute[82479]: INFO nova.virt.block_device [None req-24459fcb-cd10-4d30-b933-6998cd4ebd31 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Attempting to driver detach volume ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 from mountpoint /dev/vdb
Apr 14 00:15:58 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-24459fcb-cd10-4d30-b933-6998cd4ebd31 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Attempting to detach device vdb from instance e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8 from the persistent domain config. {{(pid=82479) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 00:15:58 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-24459fcb-cd10-4d30-b933-6998cd4ebd31 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 00:15:58 user nova-compute[82479]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:15:58 user nova-compute[82479]:   <source dev="/dev/sdb"/>
Apr 14 00:15:58 user nova-compute[82479]:   <target dev="vdb" bus="virtio"/>
Apr 14 00:15:58 user nova-compute[82479]:   <serial>ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1</serial>
Apr 14 00:15:58 user nova-compute[82479]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 00:15:58 user nova-compute[82479]: </disk>
Apr 14 00:15:58 user nova-compute[82479]:  {{(pid=82479) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 00:15:58 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-24459fcb-cd10-4d30-b933-6998cd4ebd31 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Successfully detached device vdb from instance e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8 from the persistent domain config.
Apr 14 00:15:58 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-24459fcb-cd10-4d30-b933-6998cd4ebd31 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8 from the live domain config. {{(pid=82479) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 00:15:58 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-24459fcb-cd10-4d30-b933-6998cd4ebd31 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 00:15:58 user nova-compute[82479]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:15:58 user nova-compute[82479]:   <source dev="/dev/sdb"/>
Apr 14 00:15:58 user nova-compute[82479]:   <target dev="vdb" bus="virtio"/>
Apr 14 00:15:58 user nova-compute[82479]:   <serial>ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1</serial>
Apr 14 00:15:58 user nova-compute[82479]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 00:15:58 user nova-compute[82479]: </disk>
Apr 14 00:15:58 user nova-compute[82479]:  {{(pid=82479) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 00:15:59 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Received event <DeviceRemovedEvent: 1681431359.170585, e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82479) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 00:15:59 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-24459fcb-cd10-4d30-b933-6998cd4ebd31 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8 {{(pid=82479) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 00:15:59 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-24459fcb-cd10-4d30-b933-6998cd4ebd31 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Successfully detached device vdb from instance e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8 from the live domain config.
Apr 14 00:15:59 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24459fcb-cd10-4d30-b933-6998cd4ebd31 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] calling os-brick to detach iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 00:15:59 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-24459fcb-cd10-4d30-b933-6998cd4ebd31 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, {'target_iqn': 'iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sfVBgCIN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:15:59 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-24459fcb-cd10-4d30-b933-6998cd4ebd31 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:15:59 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-24459fcb-cd10-4d30-b933-6998cd4ebd31 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:15:59 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-24459fcb-cd10-4d30-b933-6998cd4ebd31 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:15:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:15:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:15:59 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd81a74e-fc4c-408e-92cc-a57a2b71930b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:15:59 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-24459fcb-cd10-4d30-b933-6998cd4ebd31 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 00:15:59 user nova-compute[82479]: No targets found.
Apr 14 00:15:59 user nova-compute[82479]: iSNS:
Apr 14 00:15:59 user nova-compute[82479]: No targets found.
Apr 14 00:15:59 user nova-compute[82479]: STATIC:
Apr 14 00:15:59 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc
Apr 14 00:15:59 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:15:59 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:15:59 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1
Apr 14 00:15:59 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:15:59 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:15:59 user nova-compute[82479]: FIRMWARE:
Apr 14 00:15:59 user nova-compute[82479]: No targets found.
Apr 14 00:15:59 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:15:59 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-24459fcb-cd10-4d30-b933-6998cd4ebd31 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 00:15:59 user nova-compute[82479]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 00:15:59 user nova-compute[82479]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82479) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 00:15:59 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-24459fcb-cd10-4d30-b933-6998cd4ebd31 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1', 0)] {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 00:15:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:15:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:15:59 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43afb5a-ce6c-45c4-b611-b52c6422745d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:15:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:15:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:15:59 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3206809-2c3e-4357-ae00-da6efe762a79]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:15:59 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-24459fcb-cd10-4d30-b933-6998cd4ebd31 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:15:59 user nova-compute[82479]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 (non-flash)
Apr 14 00:15:59 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:15:59 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-24459fcb-cd10-4d30-b933-6998cd4ebd31 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:15:59 user nova-compute[82479]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 (non-flash)
Apr 14 00:15:59 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:15:59 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-24459fcb-cd10-4d30-b933-6998cd4ebd31 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f33381e6320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1'): ({'sdb'}, set())}) {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 00:15:59 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-24459fcb-cd10-4d30-b933-6998cd4ebd31 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Removing single pathed devices sdb {{(pid=82479) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 00:15:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:15:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:15:59 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad267d9-78ca-45f3-8bac-6fc329be894f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:15:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:15:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:15:59 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d471a29-d29b-4746-98c0-20f02ea8788f]: (4, ('ok\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:15:59 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-24459fcb-cd10-4d30-b933-6998cd4ebd31 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Flushing IO for device /dev/sdb {{(pid=82479) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 00:15:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:15:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:15:59 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[efee7232-9f69-4252-8845-0b45c3057d6c]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:15:59 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-24459fcb-cd10-4d30-b933-6998cd4ebd31 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82479) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 00:15:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:15:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.033s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:15:59 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[78544a35-7e02-4caa-80f0-dc16eb15d88b]: (4, ('1', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:15:59 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-24459fcb-cd10-4d30-b933-6998cd4ebd31 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 00:15:59 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-24459fcb-cd10-4d30-b933-6998cd4ebd31 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] SCSI volumes sdb have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 00:15:59 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-24459fcb-cd10-4d30-b933-6998cd4ebd31 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1')] {{(pid=82479) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 00:15:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:15:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:15:59 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d3c716-4fc1-44df-b1d9-d58921f4a228]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:15:59 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-24459fcb-cd10-4d30-b933-6998cd4ebd31 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:15:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 -p 172.16.0.220:3260 --logout {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:15:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:15:59 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc628f1c-ec85-4a25-8f27-0856d3eb1b88]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:15:59 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-24459fcb-cd10-4d30-b933-6998cd4ebd31 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1, portal: 172.16.0.220,3260]
Apr 14 00:15:59 user nova-compute[82479]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1, portal: 172.16.0.220,3260] successful.
Apr 14 00:15:59 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:15:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 -p 172.16.0.220:3260 --op delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:15:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:15:59 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e778be-7453-41be-a796-d3b27157b9dc]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:15:59 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-24459fcb-cd10-4d30-b933-6998cd4ebd31 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:15:59 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-24459fcb-cd10-4d30-b933-6998cd4ebd31 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:15:59 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-24459fcb-cd10-4d30-b933-6998cd4ebd31 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] <== disconnect_volume: return (282ms) None {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:15:59 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24459fcb-cd10-4d30-b933-6998cd4ebd31 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Disconnected iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 00:15:59 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Starting finish_revert_migration {{(pid=82479) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11792}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Start _get_guest_xml network_info=[{"id": "617f05b8-c04e-4abf-b4e5-a0234209624a", "address": "fa:16:3e:f9:fd:1a", "network": {"id": "cb8c9bb1-a885-486d-aa6a-de600bc01c2e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1676259779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8663ccad9047f4b11b9ae0646c287a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617f05b8-c0", "ovs_interfaceid": "617f05b8-c04e-4abf-b4e5-a0234209624a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': None, 'device_type': 'disk', 'delete_on_termination': False, 'attachment_id': '54e4b1f5-010b-4766-ab8a-d6eea6f1f43b', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YrRJCHcL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'b3475e7e-ceb4-452a-a045-dbf43c5944dd', 'attached_at': '2023-04-14T00:16:01.000000', 'detached_at': '', 'volume_id': '94d1d134-5857-4a7c-bf52-bd818e828f3e', 'serial': '94d1d134-5857-4a7c-bf52-bd818e828f3e'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 00:16:01 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:16:01 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:16:01 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82479) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T00:02:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Flavor limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Image limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Flavor pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Image pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Got 1 possible topologies {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG nova.objects.instance [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lazy-loading 'vcpu_model' on Instance uuid b3475e7e-ceb4-452a-a045-dbf43c5944dd {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Calling os-brick to attach iSCSI Volume {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YrRJCHcL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:16:01 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:16:01 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:16:01 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:16:01 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:16:01 user nova-compute[82479]: INFO os_brick.initiator.connectors.iscsi [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 00:16:01 user nova-compute[82479]: DEBUG nova.objects.instance [None req-24459fcb-cd10-4d30-b933-6998cd4ebd31 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lazy-loading 'flavor' on Instance uuid e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e -p 172.16.0.220:3260 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[4949174e-9910-4753-b9c3-9793af25164c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 00:16:01 user nova-compute[82479]:  {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e -p 172.16.0.220:3260 --interface default --op new {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-24459fcb-cd10-4d30-b933-6998cd4ebd31 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.005s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac6093a0-b833-4343-8e90-4c84bd9ebe19]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e] added\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e] added
Apr 14 00:16:01 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da3d70f-5cce-46d7-98b0-ff63eb4cc1ee]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[0788092f-2790-4656-b99a-cea9b6a8dabc]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YrRJCHcL {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YrRJCHcL" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[3edcd735-d01d-45f7-b3d5-81e086bbd7be]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YrRJCHcL'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f89e2a9-7715-40d1-9ddc-c047898e4200]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb01fdf5-8420-4601-a7de-309340946391]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Acquiring lock "02f97792-efc1-4976-bde1-70d7f9047cb5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lock "02f97792-efc1-4976-bde1-70d7f9047cb5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:16:01 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:16:01 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e -p 172.16.0.220:3260 --login {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG nova.compute.manager [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] Starting instance... {{(pid=82479) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[f11a50f8-dee7-4da3-9f84-70983d7c3551]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e, portal: 172.16.0.220,3260]
Apr 14 00:16:01 user nova-compute[82479]: Login to [iface: default, target: iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e, portal: 172.16.0.220,3260] successful.
Apr 14 00:16:01 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd45a4a-cdbc-426a-82d8-38e4ba4a5145]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82479) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 00:16:01 user nova-compute[82479]: INFO nova.compute.claims [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] Claim successful on node user
Apr 14 00:16:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a499b07-8443-4ce7-863c-9a9a195d71dd]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:16:01 user nova-compute[82479]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e (non-flash)
Apr 14 00:16:01 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:16:01 user nova-compute[82479]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e (non-flash)
Apr 14 00:16:01 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Connected to 172.16.0.220:3260 {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] HCTL ('33', '-', '-', 0) found on session 26 with lun 0 {{(pid=82479) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82479) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[d37a880b-f59e-4ded-90df-f494e1a426a0]: (4, ('- - 0', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Searching for a device in session 26 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82479) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 00:16:01 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YrRJCHcL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 00:16:02 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:16:02 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:16:02 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.450s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:16:02 user nova-compute[82479]: DEBUG nova.compute.manager [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] Start building networks asynchronously for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 00:16:02 user nova-compute[82479]: DEBUG nova.compute.manager [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] Allocating IP information in the background. {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 00:16:02 user nova-compute[82479]: DEBUG nova.network.neutron [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] allocate_for_instance() {{(pid=82479) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 00:16:02 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 00:16:02 user nova-compute[82479]: DEBUG nova.compute.manager [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] Start building block device mappings for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 00:16:02 user nova-compute[82479]: DEBUG nova.policy [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '719f2342cc1d452daae3a4ded790f69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67e9bf71f0644907979ec775c62a0b39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82479) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 00:16:02 user nova-compute[82479]: DEBUG nova.compute.manager [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] Start spawning the instance on the hypervisor. {{(pid=82479) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 00:16:02 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] Creating instance directory {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 00:16:02 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] Creating image(s)
Apr 14 00:16:02 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Acquiring lock "/opt/stack/data/nova/instances/02f97792-efc1-4976-bde1-70d7f9047cb5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:16:02 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lock "/opt/stack/data/nova/instances/02f97792-efc1-4976-bde1-70d7f9047cb5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:16:02 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lock "/opt/stack/data/nova/instances/02f97792-efc1-4976-bde1-70d7f9047cb5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:16:02 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:16:02 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.130s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:16:02 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Acquiring lock "3e200e101633f2016e569ae4c0a352380507d1e4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:16:02 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lock "3e200e101633f2016e569ae4c0a352380507d1e4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:16:02 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:16:02 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.134s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:16:02 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/02f97792-efc1-4976-bde1-70d7f9047cb5/disk 1073741824 {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:16:02 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/02f97792-efc1-4976-bde1-70d7f9047cb5/disk 1073741824" returned: 0 in 0.052s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:16:02 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lock "3e200e101633f2016e569ae4c0a352380507d1e4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:16:02 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:16:02 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:16:02 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '23363343733396464', 'path': '/dev/sdb'} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:16:02 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363343733396464', 'path': '/dev/sdb'} {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 00:16:02 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T00:05:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-2144192259',display_name='tempest-ServerActionsTestJSON-server-1662090424',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-2144192259',id=6,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD8E1mkrqLo3jsCiJcIvha4CNzW2T6/HQ38hZ5dGaGtUghmrHejTJlAuKgmy6xusLbaAzGTrJCKVkdgQ5v0CqCqGeNMDA89aLJgLl5KHn3gvI39SkbPja84HarSvbQbbXg==',key_name='tempest-keypair-1040271550',keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:14:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='bf8663ccad9047f4b11b9ae0646c287a',ramdisk_id='',reservation_id='r-amqn5295',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-948553482',owner_user_name='tempest-ServerActionsTestJSON-948553482-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T00:15:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d86662f2c7648daad87118b7e9f757c',uuid=b3475e7e-ceb4-452a-a045-dbf43c5944dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "617f05b8-c04e-4abf-b4e5-a0234209624a", "address": "fa:16:3e:f9:fd:1a", "network": {"id": "cb8c9bb1-a885-486d-aa6a-de600bc01c2e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1676259779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8663ccad9047f4b11b9ae0646c287a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617f05b8-c0", "ovs_interfaceid": "617f05b8-c04e-4abf-b4e5-a0234209624a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82479) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 00:16:02 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Converting VIF {"id": "617f05b8-c04e-4abf-b4e5-a0234209624a", "address": "fa:16:3e:f9:fd:1a", "network": {"id": "cb8c9bb1-a885-486d-aa6a-de600bc01c2e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1676259779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8663ccad9047f4b11b9ae0646c287a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617f05b8-c0", "ovs_interfaceid": "617f05b8-c04e-4abf-b4e5-a0234209624a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:16:02 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:fd:1a,bridge_name='br-int',has_traffic_filtering=True,id=617f05b8-c04e-4abf-b4e5-a0234209624a,network=Network(cb8c9bb1-a885-486d-aa6a-de600bc01c2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap617f05b8-c0') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:16:03 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] End _get_guest_xml xml=<domain type="kvm">
Apr 14 00:16:03 user nova-compute[82479]:   <uuid>b3475e7e-ceb4-452a-a045-dbf43c5944dd</uuid>
Apr 14 00:16:03 user nova-compute[82479]:   <name>instance-00000006</name>
Apr 14 00:16:03 user nova-compute[82479]:   <memory>131072</memory>
Apr 14 00:16:03 user nova-compute[82479]:   <vcpu>1</vcpu>
Apr 14 00:16:03 user nova-compute[82479]:   <metadata>
Apr 14 00:16:03 user nova-compute[82479]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 00:16:03 user nova-compute[82479]:       <nova:package version="0.0.0"/>
Apr 14 00:16:03 user nova-compute[82479]:       <nova:name>tempest-ServerActionsTestJSON-server-1662090424</nova:name>
Apr 14 00:16:03 user nova-compute[82479]:       <nova:creationTime>2023-04-14 00:16:01</nova:creationTime>
Apr 14 00:16:03 user nova-compute[82479]:       <nova:flavor name="m1.nano">
Apr 14 00:16:03 user nova-compute[82479]:         <nova:memory>128</nova:memory>
Apr 14 00:16:03 user nova-compute[82479]:         <nova:disk>1</nova:disk>
Apr 14 00:16:03 user nova-compute[82479]:         <nova:swap>0</nova:swap>
Apr 14 00:16:03 user nova-compute[82479]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 00:16:03 user nova-compute[82479]:         <nova:vcpus>1</nova:vcpus>
Apr 14 00:16:03 user nova-compute[82479]:       </nova:flavor>
Apr 14 00:16:03 user nova-compute[82479]:       <nova:owner>
Apr 14 00:16:03 user nova-compute[82479]:         <nova:user uuid="3d86662f2c7648daad87118b7e9f757c">tempest-ServerActionsTestJSON-948553482-project-member</nova:user>
Apr 14 00:16:03 user nova-compute[82479]:         <nova:project uuid="bf8663ccad9047f4b11b9ae0646c287a">tempest-ServerActionsTestJSON-948553482</nova:project>
Apr 14 00:16:03 user nova-compute[82479]:       </nova:owner>
Apr 14 00:16:03 user nova-compute[82479]:       <nova:root type="image" uuid="6db62068-7278-4cd8-b41f-d0140d89e199"/>
Apr 14 00:16:03 user nova-compute[82479]:       <nova:ports>
Apr 14 00:16:03 user nova-compute[82479]:         <nova:port uuid="617f05b8-c04e-4abf-b4e5-a0234209624a">
Apr 14 00:16:03 user nova-compute[82479]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 14 00:16:03 user nova-compute[82479]:         </nova:port>
Apr 14 00:16:03 user nova-compute[82479]:       </nova:ports>
Apr 14 00:16:03 user nova-compute[82479]:     </nova:instance>
Apr 14 00:16:03 user nova-compute[82479]:   </metadata>
Apr 14 00:16:03 user nova-compute[82479]:   <sysinfo type="smbios">
Apr 14 00:16:03 user nova-compute[82479]:     <system>
Apr 14 00:16:03 user nova-compute[82479]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 00:16:03 user nova-compute[82479]:       <entry name="product">OpenStack Nova</entry>
Apr 14 00:16:03 user nova-compute[82479]:       <entry name="version">0.0.0</entry>
Apr 14 00:16:03 user nova-compute[82479]:       <entry name="serial">b3475e7e-ceb4-452a-a045-dbf43c5944dd</entry>
Apr 14 00:16:03 user nova-compute[82479]:       <entry name="uuid">b3475e7e-ceb4-452a-a045-dbf43c5944dd</entry>
Apr 14 00:16:03 user nova-compute[82479]:       <entry name="family">Virtual Machine</entry>
Apr 14 00:16:03 user nova-compute[82479]:     </system>
Apr 14 00:16:03 user nova-compute[82479]:   </sysinfo>
Apr 14 00:16:03 user nova-compute[82479]:   <os>
Apr 14 00:16:03 user nova-compute[82479]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 00:16:03 user nova-compute[82479]:     <boot dev="hd"/>
Apr 14 00:16:03 user nova-compute[82479]:     <smbios mode="sysinfo"/>
Apr 14 00:16:03 user nova-compute[82479]:   </os>
Apr 14 00:16:03 user nova-compute[82479]:   <features>
Apr 14 00:16:03 user nova-compute[82479]:     <acpi/>
Apr 14 00:16:03 user nova-compute[82479]:     <apic/>
Apr 14 00:16:03 user nova-compute[82479]:     <vmcoreinfo/>
Apr 14 00:16:03 user nova-compute[82479]:   </features>
Apr 14 00:16:03 user nova-compute[82479]:   <clock offset="utc">
Apr 14 00:16:03 user nova-compute[82479]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 00:16:03 user nova-compute[82479]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 00:16:03 user nova-compute[82479]:     <timer name="hpet" present="no"/>
Apr 14 00:16:03 user nova-compute[82479]:   </clock>
Apr 14 00:16:03 user nova-compute[82479]:   <cpu mode="custom" match="exact">
Apr 14 00:16:03 user nova-compute[82479]:     <model>Nehalem</model>
Apr 14 00:16:03 user nova-compute[82479]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 00:16:03 user nova-compute[82479]:   </cpu>
Apr 14 00:16:03 user nova-compute[82479]:   <devices>
Apr 14 00:16:03 user nova-compute[82479]:     <disk type="file" device="disk">
Apr 14 00:16:03 user nova-compute[82479]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 00:16:03 user nova-compute[82479]:       <source file="/opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk"/>
Apr 14 00:16:03 user nova-compute[82479]:       <target dev="vda" bus="virtio"/>
Apr 14 00:16:03 user nova-compute[82479]:     </disk>
Apr 14 00:16:03 user nova-compute[82479]:     <disk type="block" device="disk">
Apr 14 00:16:03 user nova-compute[82479]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:16:03 user nova-compute[82479]:       <source dev="/dev/sdb"/>
Apr 14 00:16:03 user nova-compute[82479]:       <target dev="vdb" bus="virtio"/>
Apr 14 00:16:03 user nova-compute[82479]:       <serial>94d1d134-5857-4a7c-bf52-bd818e828f3e</serial>
Apr 14 00:16:03 user nova-compute[82479]:     </disk>
Apr 14 00:16:03 user nova-compute[82479]:     <interface type="ethernet">
Apr 14 00:16:03 user nova-compute[82479]:       <mac address="fa:16:3e:f9:fd:1a"/>
Apr 14 00:16:03 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:16:03 user nova-compute[82479]:       <mtu size="1442"/>
Apr 14 00:16:03 user nova-compute[82479]:       <target dev="tap617f05b8-c0"/>
Apr 14 00:16:03 user nova-compute[82479]:     </interface>
Apr 14 00:16:03 user nova-compute[82479]:     <serial type="pty">
Apr 14 00:16:03 user nova-compute[82479]:       <log file="/opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/console.log" append="off"/>
Apr 14 00:16:03 user nova-compute[82479]:     </serial>
Apr 14 00:16:03 user nova-compute[82479]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 00:16:03 user nova-compute[82479]:     <video>
Apr 14 00:16:03 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:16:03 user nova-compute[82479]:     </video>
Apr 14 00:16:03 user nova-compute[82479]:     <rng model="virtio">
Apr 14 00:16:03 user nova-compute[82479]:       <backend model="random">/dev/urandom</backend>
Apr 14 00:16:03 user nova-compute[82479]:     </rng>
Apr 14 00:16:03 user nova-compute[82479]:     <controller type="usb" index="0" model="none"/>
Apr 14 00:16:03 user nova-compute[82479]:     <memballoon model="virtio">
Apr 14 00:16:03 user nova-compute[82479]:       <stats period="10"/>
Apr 14 00:16:03 user nova-compute[82479]:     </memballoon>
Apr 14 00:16:03 user nova-compute[82479]:   </devices>
Apr 14 00:16:03 user nova-compute[82479]: </domain>
Apr 14 00:16:03 user nova-compute[82479]:  {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 00:16:03 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T00:05:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-2144192259',display_name='tempest-ServerActionsTestJSON-server-1662090424',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-2144192259',id=6,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD8E1mkrqLo3jsCiJcIvha4CNzW2T6/HQ38hZ5dGaGtUghmrHejTJlAuKgmy6xusLbaAzGTrJCKVkdgQ5v0CqCqGeNMDA89aLJgLl5KHn3gvI39SkbPja84HarSvbQbbXg==',key_name='tempest-keypair-1040271550',keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:14:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='bf8663ccad9047f4b11b9ae0646c287a',ramdisk_id='',reservation_id='r-amqn5295',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-948553482',owner_user_name='tempest-ServerActionsTestJSON-948553482-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T00:15:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d86662f2c7648daad87118b7e9f757c',uuid=b3475e7e-ceb4-452a-a045-dbf43c5944dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "617f05b8-c04e-4abf-b4e5-a0234209624a", "address": "fa:16:3e:f9:fd:1a", "network": {"id": "cb8c9bb1-a885-486d-aa6a-de600bc01c2e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1676259779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8663ccad9047f4b11b9ae0646c287a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617f05b8-c0", "ovs_interfaceid": "617f05b8-c04e-4abf-b4e5-a0234209624a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 00:16:03 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Converting VIF {"id": "617f05b8-c04e-4abf-b4e5-a0234209624a", "address": "fa:16:3e:f9:fd:1a", "network": {"id": "cb8c9bb1-a885-486d-aa6a-de600bc01c2e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1676259779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8663ccad9047f4b11b9ae0646c287a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617f05b8-c0", "ovs_interfaceid": "617f05b8-c04e-4abf-b4e5-a0234209624a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:16:03 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:fd:1a,bridge_name='br-int',has_traffic_filtering=True,id=617f05b8-c04e-4abf-b4e5-a0234209624a,network=Network(cb8c9bb1-a885-486d-aa6a-de600bc01c2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap617f05b8-c0') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:16:03 user nova-compute[82479]: DEBUG os_vif [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:fd:1a,bridge_name='br-int',has_traffic_filtering=True,id=617f05b8-c04e-4abf-b4e5-a0234209624a,network=Network(cb8c9bb1-a885-486d-aa6a-de600bc01c2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap617f05b8-c0') {{(pid=82479) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 00:16:03 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:16:03 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:16:03 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 00:16:03 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:16:03 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap617f05b8-c0, may_exist=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:16:03 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap617f05b8-c0, col_values=(('external_ids', {'iface-id': '617f05b8-c04e-4abf-b4e5-a0234209624a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:fd:1a', 'vm-uuid': 'b3475e7e-ceb4-452a-a045-dbf43c5944dd'}),)) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:16:03 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:16:03 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:16:03 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:16:03 user nova-compute[82479]: INFO os_vif [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:fd:1a,bridge_name='br-int',has_traffic_filtering=True,id=617f05b8-c04e-4abf-b4e5-a0234209624a,network=Network(cb8c9bb1-a885-486d-aa6a-de600bc01c2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap617f05b8-c0')
Apr 14 00:16:03 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.141s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:16:03 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Checking if we can resize image /opt/stack/data/nova/instances/02f97792-efc1-4976-bde1-70d7f9047cb5/disk. size=1073741824 {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 00:16:03 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02f97792-efc1-4976-bde1-70d7f9047cb5/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:16:03 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02f97792-efc1-4976-bde1-70d7f9047cb5/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:16:03 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Cannot resize image /opt/stack/data/nova/instances/02f97792-efc1-4976-bde1-70d7f9047cb5/disk to a smaller size. {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 00:16:03 user nova-compute[82479]: DEBUG nova.objects.instance [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lazy-loading 'migration_context' on Instance uuid 02f97792-efc1-4976-bde1-70d7f9047cb5 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:16:03 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] Created local disks {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 00:16:03 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] Ensure instance console log exists: /opt/stack/data/nova/instances/02f97792-efc1-4976-bde1-70d7f9047cb5/console.log {{(pid=82479) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 00:16:03 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:16:03 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:16:03 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:16:03 user nova-compute[82479]: DEBUG nova.network.neutron [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] Successfully created port: 91cab0f7-d11a-451f-8708-b1d2917834cc {{(pid=82479) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 00:16:04 user nova-compute[82479]: DEBUG nova.network.neutron [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] Successfully updated port: 91cab0f7-d11a-451f-8708-b1d2917834cc {{(pid=82479) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 00:16:04 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Acquiring lock "refresh_cache-02f97792-efc1-4976-bde1-70d7f9047cb5" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:16:04 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Acquired lock "refresh_cache-02f97792-efc1-4976-bde1-70d7f9047cb5" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:16:04 user nova-compute[82479]: DEBUG nova.network.neutron [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 00:16:04 user nova-compute[82479]: DEBUG nova.compute.manager [req-a70d710b-d834-42e0-aed7-ed85e1db767e req-47b01484-121c-4b52-8485-0ac0fe10942d service nova] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] Received event network-changed-91cab0f7-d11a-451f-8708-b1d2917834cc {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:16:04 user nova-compute[82479]: DEBUG nova.compute.manager [req-a70d710b-d834-42e0-aed7-ed85e1db767e req-47b01484-121c-4b52-8485-0ac0fe10942d service nova] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] Refreshing instance network info cache due to event network-changed-91cab0f7-d11a-451f-8708-b1d2917834cc. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:16:04 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-a70d710b-d834-42e0-aed7-ed85e1db767e req-47b01484-121c-4b52-8485-0ac0fe10942d service nova] Acquiring lock "refresh_cache-02f97792-efc1-4976-bde1-70d7f9047cb5" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:16:04 user nova-compute[82479]: DEBUG nova.network.neutron [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] Instance cache missing network info. {{(pid=82479) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 00:16:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:16:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:16:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:16:04 user nova-compute[82479]: DEBUG nova.network.neutron [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] Updating instance_info_cache with network_info: [{"id": "91cab0f7-d11a-451f-8708-b1d2917834cc", "address": "fa:16:3e:b1:7f:8d", "network": {"id": "e3acf139-a0c8-4b33-aae5-26131d3dccb5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1150180978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "67e9bf71f0644907979ec775c62a0b39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91cab0f7-d1", "ovs_interfaceid": "91cab0f7-d11a-451f-8708-b1d2917834cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:16:04 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Releasing lock "refresh_cache-02f97792-efc1-4976-bde1-70d7f9047cb5" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:16:04 user nova-compute[82479]: DEBUG nova.compute.manager [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] Instance network_info: |[{"id": "91cab0f7-d11a-451f-8708-b1d2917834cc", "address": "fa:16:3e:b1:7f:8d", "network": {"id": "e3acf139-a0c8-4b33-aae5-26131d3dccb5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1150180978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "67e9bf71f0644907979ec775c62a0b39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91cab0f7-d1", "ovs_interfaceid": "91cab0f7-d11a-451f-8708-b1d2917834cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 00:16:04 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-a70d710b-d834-42e0-aed7-ed85e1db767e req-47b01484-121c-4b52-8485-0ac0fe10942d service nova] Acquired lock "refresh_cache-02f97792-efc1-4976-bde1-70d7f9047cb5" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:16:04 user nova-compute[82479]: DEBUG nova.network.neutron [req-a70d710b-d834-42e0-aed7-ed85e1db767e req-47b01484-121c-4b52-8485-0ac0fe10942d service nova] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] Refreshing network info cache for port 91cab0f7-d11a-451f-8708-b1d2917834cc {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:16:04 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] Start _get_guest_xml network_info=[{"id": "91cab0f7-d11a-451f-8708-b1d2917834cc", "address": "fa:16:3e:b1:7f:8d", "network": {"id": "e3acf139-a0c8-4b33-aae5-26131d3dccb5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1150180978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "67e9bf71f0644907979ec775c62a0b39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91cab0f7-d1", "ovs_interfaceid": "91cab0f7-d11a-451f-8708-b1d2917834cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 00:16:04 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:16:04 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:16:04 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82479) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 00:16:04 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T00:02:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 00:16:04 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Flavor limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 00:16:04 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Image limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 00:16:04 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Flavor pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 00:16:04 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Image pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 00:16:04 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 00:16:04 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 00:16:04 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 00:16:04 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Got 1 possible topologies {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 00:16:04 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 00:16:04 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 00:16:04 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:16:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-642127814',display_name='tempest-VolumesActionsTest-instance-642127814',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-642127814',id=27,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67e9bf71f0644907979ec775c62a0b39',ramdisk_id='',reservation_id='r-qe4vz5ir',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-422643142',owner_user_name='tempest-VolumesActionsTest-422643142-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:16:03Z,user_data=None,user_id='719f2342cc1d452daae3a4ded790f69a',uuid=02f97792-efc1-4976-bde1-70d7f9047cb5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91cab0f7-d11a-451f-8708-b1d2917834cc", "address": "fa:16:3e:b1:7f:8d", "network": {"id": "e3acf139-a0c8-4b33-aae5-26131d3dccb5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1150180978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "67e9bf71f0644907979ec775c62a0b39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91cab0f7-d1", "ovs_interfaceid": "91cab0f7-d11a-451f-8708-b1d2917834cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82479) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 00:16:04 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Converting VIF {"id": "91cab0f7-d11a-451f-8708-b1d2917834cc", "address": "fa:16:3e:b1:7f:8d", "network": {"id": "e3acf139-a0c8-4b33-aae5-26131d3dccb5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1150180978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "67e9bf71f0644907979ec775c62a0b39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91cab0f7-d1", "ovs_interfaceid": "91cab0f7-d11a-451f-8708-b1d2917834cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:16:04 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:7f:8d,bridge_name='br-int',has_traffic_filtering=True,id=91cab0f7-d11a-451f-8708-b1d2917834cc,network=Network(e3acf139-a0c8-4b33-aae5-26131d3dccb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91cab0f7-d1') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:16:04 user nova-compute[82479]: DEBUG nova.objects.instance [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lazy-loading 'pci_devices' on Instance uuid 02f97792-efc1-4976-bde1-70d7f9047cb5 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:16:04 user nova-compute[82479]: DEBUG nova.compute.manager [req-abb94564-ea36-4b3d-8964-e521bef0a88b req-aca112ae-c49f-4c2d-8fcc-a458049d73ad service nova] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Received event network-vif-plugged-617f05b8-c04e-4abf-b4e5-a0234209624a {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:16:04 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-abb94564-ea36-4b3d-8964-e521bef0a88b req-aca112ae-c49f-4c2d-8fcc-a458049d73ad service nova] Acquiring lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:16:04 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-abb94564-ea36-4b3d-8964-e521bef0a88b req-aca112ae-c49f-4c2d-8fcc-a458049d73ad service nova] Lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:16:04 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-abb94564-ea36-4b3d-8964-e521bef0a88b req-aca112ae-c49f-4c2d-8fcc-a458049d73ad service nova] Lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:16:04 user nova-compute[82479]: DEBUG nova.compute.manager [req-abb94564-ea36-4b3d-8964-e521bef0a88b req-aca112ae-c49f-4c2d-8fcc-a458049d73ad service nova] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] No waiting events found dispatching network-vif-plugged-617f05b8-c04e-4abf-b4e5-a0234209624a {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:16:04 user nova-compute[82479]: WARNING nova.compute.manager [req-abb94564-ea36-4b3d-8964-e521bef0a88b req-aca112ae-c49f-4c2d-8fcc-a458049d73ad service nova] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Received unexpected event network-vif-plugged-617f05b8-c04e-4abf-b4e5-a0234209624a for instance with vm_state resized and task_state resize_reverting.
Apr 14 00:16:04 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] End _get_guest_xml xml=<domain type="kvm">
Apr 14 00:16:04 user nova-compute[82479]:   <uuid>02f97792-efc1-4976-bde1-70d7f9047cb5</uuid>
Apr 14 00:16:04 user nova-compute[82479]:   <name>instance-0000001b</name>
Apr 14 00:16:04 user nova-compute[82479]:   <memory>131072</memory>
Apr 14 00:16:04 user nova-compute[82479]:   <vcpu>1</vcpu>
Apr 14 00:16:04 user nova-compute[82479]:   <metadata>
Apr 14 00:16:04 user nova-compute[82479]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 00:16:04 user nova-compute[82479]:       <nova:package version="0.0.0"/>
Apr 14 00:16:04 user nova-compute[82479]:       <nova:name>tempest-VolumesActionsTest-instance-642127814</nova:name>
Apr 14 00:16:04 user nova-compute[82479]:       <nova:creationTime>2023-04-14 00:16:04</nova:creationTime>
Apr 14 00:16:04 user nova-compute[82479]:       <nova:flavor name="m1.nano">
Apr 14 00:16:04 user nova-compute[82479]:         <nova:memory>128</nova:memory>
Apr 14 00:16:04 user nova-compute[82479]:         <nova:disk>1</nova:disk>
Apr 14 00:16:04 user nova-compute[82479]:         <nova:swap>0</nova:swap>
Apr 14 00:16:04 user nova-compute[82479]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 00:16:04 user nova-compute[82479]:         <nova:vcpus>1</nova:vcpus>
Apr 14 00:16:04 user nova-compute[82479]:       </nova:flavor>
Apr 14 00:16:04 user nova-compute[82479]:       <nova:owner>
Apr 14 00:16:04 user nova-compute[82479]:         <nova:user uuid="719f2342cc1d452daae3a4ded790f69a">tempest-VolumesActionsTest-422643142-project-member</nova:user>
Apr 14 00:16:04 user nova-compute[82479]:         <nova:project uuid="67e9bf71f0644907979ec775c62a0b39">tempest-VolumesActionsTest-422643142</nova:project>
Apr 14 00:16:04 user nova-compute[82479]:       </nova:owner>
Apr 14 00:16:04 user nova-compute[82479]:       <nova:root type="image" uuid="6db62068-7278-4cd8-b41f-d0140d89e199"/>
Apr 14 00:16:04 user nova-compute[82479]:       <nova:ports>
Apr 14 00:16:04 user nova-compute[82479]:         <nova:port uuid="91cab0f7-d11a-451f-8708-b1d2917834cc">
Apr 14 00:16:04 user nova-compute[82479]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 14 00:16:04 user nova-compute[82479]:         </nova:port>
Apr 14 00:16:04 user nova-compute[82479]:       </nova:ports>
Apr 14 00:16:04 user nova-compute[82479]:     </nova:instance>
Apr 14 00:16:04 user nova-compute[82479]:   </metadata>
Apr 14 00:16:04 user nova-compute[82479]:   <sysinfo type="smbios">
Apr 14 00:16:04 user nova-compute[82479]:     <system>
Apr 14 00:16:04 user nova-compute[82479]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 00:16:04 user nova-compute[82479]:       <entry name="product">OpenStack Nova</entry>
Apr 14 00:16:04 user nova-compute[82479]:       <entry name="version">0.0.0</entry>
Apr 14 00:16:04 user nova-compute[82479]:       <entry name="serial">02f97792-efc1-4976-bde1-70d7f9047cb5</entry>
Apr 14 00:16:04 user nova-compute[82479]:       <entry name="uuid">02f97792-efc1-4976-bde1-70d7f9047cb5</entry>
Apr 14 00:16:04 user nova-compute[82479]:       <entry name="family">Virtual Machine</entry>
Apr 14 00:16:04 user nova-compute[82479]:     </system>
Apr 14 00:16:04 user nova-compute[82479]:   </sysinfo>
Apr 14 00:16:04 user nova-compute[82479]:   <os>
Apr 14 00:16:04 user nova-compute[82479]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 00:16:04 user nova-compute[82479]:     <boot dev="hd"/>
Apr 14 00:16:04 user nova-compute[82479]:     <smbios mode="sysinfo"/>
Apr 14 00:16:04 user nova-compute[82479]:   </os>
Apr 14 00:16:04 user nova-compute[82479]:   <features>
Apr 14 00:16:04 user nova-compute[82479]:     <acpi/>
Apr 14 00:16:04 user nova-compute[82479]:     <apic/>
Apr 14 00:16:04 user nova-compute[82479]:     <vmcoreinfo/>
Apr 14 00:16:04 user nova-compute[82479]:   </features>
Apr 14 00:16:04 user nova-compute[82479]:   <clock offset="utc">
Apr 14 00:16:04 user nova-compute[82479]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 00:16:04 user nova-compute[82479]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 00:16:04 user nova-compute[82479]:     <timer name="hpet" present="no"/>
Apr 14 00:16:04 user nova-compute[82479]:   </clock>
Apr 14 00:16:04 user nova-compute[82479]:   <cpu mode="custom" match="exact">
Apr 14 00:16:04 user nova-compute[82479]:     <model>Nehalem</model>
Apr 14 00:16:04 user nova-compute[82479]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 00:16:04 user nova-compute[82479]:   </cpu>
Apr 14 00:16:04 user nova-compute[82479]:   <devices>
Apr 14 00:16:04 user nova-compute[82479]:     <disk type="file" device="disk">
Apr 14 00:16:04 user nova-compute[82479]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 00:16:04 user nova-compute[82479]:       <source file="/opt/stack/data/nova/instances/02f97792-efc1-4976-bde1-70d7f9047cb5/disk"/>
Apr 14 00:16:04 user nova-compute[82479]:       <target dev="vda" bus="virtio"/>
Apr 14 00:16:04 user nova-compute[82479]:     </disk>
Apr 14 00:16:04 user nova-compute[82479]:     <interface type="ethernet">
Apr 14 00:16:04 user nova-compute[82479]:       <mac address="fa:16:3e:b1:7f:8d"/>
Apr 14 00:16:04 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:16:04 user nova-compute[82479]:       <mtu size="1442"/>
Apr 14 00:16:04 user nova-compute[82479]:       <target dev="tap91cab0f7-d1"/>
Apr 14 00:16:04 user nova-compute[82479]:     </interface>
Apr 14 00:16:04 user nova-compute[82479]:     <serial type="pty">
Apr 14 00:16:04 user nova-compute[82479]:       <log file="/opt/stack/data/nova/instances/02f97792-efc1-4976-bde1-70d7f9047cb5/console.log" append="off"/>
Apr 14 00:16:04 user nova-compute[82479]:     </serial>
Apr 14 00:16:04 user nova-compute[82479]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 00:16:04 user nova-compute[82479]:     <video>
Apr 14 00:16:04 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:16:04 user nova-compute[82479]:     </video>
Apr 14 00:16:04 user nova-compute[82479]:     <rng model="virtio">
Apr 14 00:16:04 user nova-compute[82479]:       <backend model="random">/dev/urandom</backend>
Apr 14 00:16:04 user nova-compute[82479]:     </rng>
Apr 14 00:16:04 user nova-compute[82479]:     <controller type="usb" index="0" model="none"/>
Apr 14 00:16:04 user nova-compute[82479]:     <memballoon model="virtio">
Apr 14 00:16:04 user nova-compute[82479]:       <stats period="10"/>
Apr 14 00:16:04 user nova-compute[82479]:     </memballoon>
Apr 14 00:16:04 user nova-compute[82479]:   </devices>
Apr 14 00:16:04 user nova-compute[82479]: </domain>
Apr 14 00:16:04 user nova-compute[82479]:  {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 00:16:04 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:16:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-642127814',display_name='tempest-VolumesActionsTest-instance-642127814',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-642127814',id=27,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67e9bf71f0644907979ec775c62a0b39',ramdisk_id='',reservation_id='r-qe4vz5ir',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-422643142',owner_user_name='tempest-VolumesActionsTest-422643142-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:16:03Z,user_data=None,user_id='719f2342cc1d452daae3a4ded790f69a',uuid=02f97792-efc1-4976-bde1-70d7f9047cb5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91cab0f7-d11a-451f-8708-b1d2917834cc", "address": "fa:16:3e:b1:7f:8d", "network": {"id": "e3acf139-a0c8-4b33-aae5-26131d3dccb5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1150180978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "67e9bf71f0644907979ec775c62a0b39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91cab0f7-d1", "ovs_interfaceid": "91cab0f7-d11a-451f-8708-b1d2917834cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 00:16:04 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Converting VIF {"id": "91cab0f7-d11a-451f-8708-b1d2917834cc", "address": "fa:16:3e:b1:7f:8d", "network": {"id": "e3acf139-a0c8-4b33-aae5-26131d3dccb5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1150180978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "67e9bf71f0644907979ec775c62a0b39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91cab0f7-d1", "ovs_interfaceid": "91cab0f7-d11a-451f-8708-b1d2917834cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:16:04 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:7f:8d,bridge_name='br-int',has_traffic_filtering=True,id=91cab0f7-d11a-451f-8708-b1d2917834cc,network=Network(e3acf139-a0c8-4b33-aae5-26131d3dccb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91cab0f7-d1') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:16:04 user nova-compute[82479]: DEBUG os_vif [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:7f:8d,bridge_name='br-int',has_traffic_filtering=True,id=91cab0f7-d11a-451f-8708-b1d2917834cc,network=Network(e3acf139-a0c8-4b33-aae5-26131d3dccb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91cab0f7-d1') {{(pid=82479) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 00:16:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:16:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:16:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 00:16:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:16:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap91cab0f7-d1, may_exist=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:16:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap91cab0f7-d1, col_values=(('external_ids', {'iface-id': '91cab0f7-d11a-451f-8708-b1d2917834cc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:7f:8d', 'vm-uuid': '02f97792-efc1-4976-bde1-70d7f9047cb5'}),)) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:16:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:16:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:16:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:16:04 user nova-compute[82479]: INFO os_vif [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:7f:8d,bridge_name='br-int',has_traffic_filtering=True,id=91cab0f7-d11a-451f-8708-b1d2917834cc,network=Network(e3acf139-a0c8-4b33-aae5-26131d3dccb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91cab0f7-d1')
Apr 14 00:16:04 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:16:04 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] No VIF found with MAC fa:16:3e:b1:7f:8d, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:16:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:16:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:16:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:16:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:16:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:16:05 user nova-compute[82479]: DEBUG nova.network.neutron [req-a70d710b-d834-42e0-aed7-ed85e1db767e req-47b01484-121c-4b52-8485-0ac0fe10942d service nova] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] Updated VIF entry in instance network info cache for port 91cab0f7-d11a-451f-8708-b1d2917834cc. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:16:05 user nova-compute[82479]: DEBUG nova.network.neutron [req-a70d710b-d834-42e0-aed7-ed85e1db767e req-47b01484-121c-4b52-8485-0ac0fe10942d service nova] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] Updating instance_info_cache with network_info: [{"id": "91cab0f7-d11a-451f-8708-b1d2917834cc", "address": "fa:16:3e:b1:7f:8d", "network": {"id": "e3acf139-a0c8-4b33-aae5-26131d3dccb5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1150180978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "67e9bf71f0644907979ec775c62a0b39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91cab0f7-d1", "ovs_interfaceid": "91cab0f7-d11a-451f-8708-b1d2917834cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:16:05 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-a70d710b-d834-42e0-aed7-ed85e1db767e req-47b01484-121c-4b52-8485-0ac0fe10942d service nova] Releasing lock "refresh_cache-02f97792-efc1-4976-bde1-70d7f9047cb5" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:16:06 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:16:06 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:16:06 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:16:06 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:16:06 user nova-compute[82479]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681431351.3233407, b3475e7e-ceb4-452a-a045-dbf43c5944dd => Stopped> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:16:06 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] VM Stopped (Lifecycle Event)
Apr 14 00:16:06 user nova-compute[82479]: DEBUG nova.compute.manager [None req-0f25e371-0d7a-485d-86e6-555d05e62a5d None None] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:16:06 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681431366.6275835, b3475e7e-ceb4-452a-a045-dbf43c5944dd => Resumed> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:16:06 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] VM Resumed (Lifecycle Event)
Apr 14 00:16:06 user nova-compute[82479]: DEBUG nova.compute.manager [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Instance event wait completed in 0 seconds for  {{(pid=82479) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 00:16:06 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Instance running successfully.
Apr 14 00:16:06 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] finish_revert_migration finished successfully. {{(pid=82479) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11836}}
Apr 14 00:16:06 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:16:06 user nova-compute[82479]: DEBUG nova.compute.manager [req-f1817d5d-9691-472d-b360-e364d5aab6a6 req-adb37e43-684e-4ae1-8c85-1f66c0803ea9 service nova] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] Received event network-vif-plugged-91cab0f7-d11a-451f-8708-b1d2917834cc {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:16:06 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-f1817d5d-9691-472d-b360-e364d5aab6a6 req-adb37e43-684e-4ae1-8c85-1f66c0803ea9 service nova] Acquiring lock "02f97792-efc1-4976-bde1-70d7f9047cb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:16:06 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-f1817d5d-9691-472d-b360-e364d5aab6a6 req-adb37e43-684e-4ae1-8c85-1f66c0803ea9 service nova] Lock "02f97792-efc1-4976-bde1-70d7f9047cb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:16:06 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-f1817d5d-9691-472d-b360-e364d5aab6a6 req-adb37e43-684e-4ae1-8c85-1f66c0803ea9 service nova] Lock "02f97792-efc1-4976-bde1-70d7f9047cb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:16:06 user nova-compute[82479]: DEBUG nova.compute.manager [req-f1817d5d-9691-472d-b360-e364d5aab6a6 req-adb37e43-684e-4ae1-8c85-1f66c0803ea9 service nova] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] No waiting events found dispatching network-vif-plugged-91cab0f7-d11a-451f-8708-b1d2917834cc {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:16:06 user nova-compute[82479]: WARNING nova.compute.manager [req-f1817d5d-9691-472d-b360-e364d5aab6a6 req-adb37e43-684e-4ae1-8c85-1f66c0803ea9 service nova] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] Received unexpected event network-vif-plugged-91cab0f7-d11a-451f-8708-b1d2917834cc for instance with vm_state building and task_state spawning.
Apr 14 00:16:06 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:16:06 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Apr 14 00:16:06 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681431366.6279874, b3475e7e-ceb4-452a-a045-dbf43c5944dd => Started> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:16:06 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] VM Started (Lifecycle Event)
Apr 14 00:16:06 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:16:06 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:16:06 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Apr 14 00:16:06 user nova-compute[82479]: DEBUG nova.compute.manager [req-6843e20d-3cf0-4cf8-b34d-f40fd8051c43 req-4346eb22-5e79-4450-9a25-aaa829d16277 service nova] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Received event network-vif-plugged-617f05b8-c04e-4abf-b4e5-a0234209624a {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:16:06 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-6843e20d-3cf0-4cf8-b34d-f40fd8051c43 req-4346eb22-5e79-4450-9a25-aaa829d16277 service nova] Acquiring lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:16:06 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-6843e20d-3cf0-4cf8-b34d-f40fd8051c43 req-4346eb22-5e79-4450-9a25-aaa829d16277 service nova] Lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:16:06 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-6843e20d-3cf0-4cf8-b34d-f40fd8051c43 req-4346eb22-5e79-4450-9a25-aaa829d16277 service nova] Lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:16:06 user nova-compute[82479]: DEBUG nova.compute.manager [req-6843e20d-3cf0-4cf8-b34d-f40fd8051c43 req-4346eb22-5e79-4450-9a25-aaa829d16277 service nova] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] No waiting events found dispatching network-vif-plugged-617f05b8-c04e-4abf-b4e5-a0234209624a {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:16:06 user nova-compute[82479]: WARNING nova.compute.manager [req-6843e20d-3cf0-4cf8-b34d-f40fd8051c43 req-4346eb22-5e79-4450-9a25-aaa829d16277 service nova] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Received unexpected event network-vif-plugged-617f05b8-c04e-4abf-b4e5-a0234209624a for instance with vm_state resized and task_state resize_reverting.
Apr 14 00:16:06 user nova-compute[82479]: INFO nova.compute.manager [None req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Updating instance to original state: 'active'
Apr 14 00:16:08 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681431368.4744139, 02f97792-efc1-4976-bde1-70d7f9047cb5 => Resumed> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:16:08 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] VM Resumed (Lifecycle Event)
Apr 14 00:16:08 user nova-compute[82479]: DEBUG nova.compute.manager [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] Instance event wait completed in 0 seconds for  {{(pid=82479) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 00:16:08 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] Guest created on hypervisor {{(pid=82479) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 00:16:08 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] Instance spawned successfully.
Apr 14 00:16:08 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 00:16:08 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:16:08 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:16:08 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] Found default for hw_cdrom_bus of ide {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:16:08 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] Found default for hw_disk_bus of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:16:08 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] Found default for hw_input_bus of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:16:08 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] Found default for hw_pointer_model of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:16:08 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] Found default for hw_video_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:16:08 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] Found default for hw_vif_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:16:08 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:16:08 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681431368.4755325, 02f97792-efc1-4976-bde1-70d7f9047cb5 => Started> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:16:08 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] VM Started (Lifecycle Event)
Apr 14 00:16:08 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:16:08 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:16:08 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:16:08 user nova-compute[82479]: INFO nova.compute.manager [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] Took 6.04 seconds to spawn the instance on the hypervisor.
Apr 14 00:16:08 user nova-compute[82479]: DEBUG nova.compute.manager [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:16:08 user nova-compute[82479]: INFO nova.compute.manager [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] Took 6.85 seconds to build instance.
Apr 14 00:16:08 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-ae7dc0ec-672b-4ee8-a8c1-d208d07691a2 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lock "02f97792-efc1-4976-bde1-70d7f9047cb5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.951s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:16:08 user nova-compute[82479]: DEBUG nova.compute.manager [req-c889a069-02e0-40dd-b12a-29c2d181ee0d req-b4972e9a-8ac5-4be1-a144-397f55257edc service nova] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] Received event network-vif-plugged-91cab0f7-d11a-451f-8708-b1d2917834cc {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:16:08 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-c889a069-02e0-40dd-b12a-29c2d181ee0d req-b4972e9a-8ac5-4be1-a144-397f55257edc service nova] Acquiring lock "02f97792-efc1-4976-bde1-70d7f9047cb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:16:08 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-c889a069-02e0-40dd-b12a-29c2d181ee0d req-b4972e9a-8ac5-4be1-a144-397f55257edc service nova] Lock "02f97792-efc1-4976-bde1-70d7f9047cb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:16:08 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-c889a069-02e0-40dd-b12a-29c2d181ee0d req-b4972e9a-8ac5-4be1-a144-397f55257edc service nova] Lock "02f97792-efc1-4976-bde1-70d7f9047cb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:16:08 user nova-compute[82479]: DEBUG nova.compute.manager [req-c889a069-02e0-40dd-b12a-29c2d181ee0d req-b4972e9a-8ac5-4be1-a144-397f55257edc service nova] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] No waiting events found dispatching network-vif-plugged-91cab0f7-d11a-451f-8708-b1d2917834cc {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:16:08 user nova-compute[82479]: WARNING nova.compute.manager [req-c889a069-02e0-40dd-b12a-29c2d181ee0d req-b4972e9a-8ac5-4be1-a144-397f55257edc service nova] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] Received unexpected event network-vif-plugged-91cab0f7-d11a-451f-8708-b1d2917834cc for instance with vm_state active and task_state None.
Apr 14 00:16:08 user nova-compute[82479]: DEBUG nova.compute.manager [None req-b1058195-f089-41b0-8536-1a14b35550d3 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:16:08 user nova-compute[82479]: INFO nova.compute.manager [None req-b1058195-f089-41b0-8536-1a14b35550d3 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] instance snapshotting
Apr 14 00:16:08 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-b1058195-f089-41b0-8536-1a14b35550d3 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Beginning live snapshot process
Apr 14 00:16:09 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-b1058195-f089-41b0-8536-1a14b35550d3 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2793d412-f405-4452-8e46-c192e3c92ccb/disk --force-share --output=json -f qcow2 {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:16:09 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6c35b78e-41e3-40c1-b265-8e1fa5e859c6" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:16:09 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6c35b78e-41e3-40c1-b265-8e1fa5e859c6" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:16:09 user nova-compute[82479]: INFO nova.compute.manager [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Unshelving
Apr 14 00:16:09 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-b1058195-f089-41b0-8536-1a14b35550d3 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2793d412-f405-4452-8e46-c192e3c92ccb/disk --force-share --output=json -f qcow2" returned: 0 in 0.151s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:16:09 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-b1058195-f089-41b0-8536-1a14b35550d3 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2793d412-f405-4452-8e46-c192e3c92ccb/disk --force-share --output=json -f qcow2 {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:16:09 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-b1058195-f089-41b0-8536-1a14b35550d3 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2793d412-f405-4452-8e46-c192e3c92ccb/disk --force-share --output=json -f qcow2" returned: 0 in 0.164s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:16:09 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-b1058195-f089-41b0-8536-1a14b35550d3 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:16:09 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:16:09 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:16:09 user nova-compute[82479]: DEBUG nova.objects.instance [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lazy-loading 'pci_requests' on Instance uuid 6c35b78e-41e3-40c1-b265-8e1fa5e859c6 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:16:09 user nova-compute[82479]: DEBUG nova.objects.instance [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lazy-loading 'numa_topology' on Instance uuid 6c35b78e-41e3-40c1-b265-8e1fa5e859c6 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:16:09 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82479) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 00:16:09 user nova-compute[82479]: INFO nova.compute.claims [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Claim successful on node user
Apr 14 00:16:09 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-b1058195-f089-41b0-8536-1a14b35550d3 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.152s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:16:09 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-b1058195-f089-41b0-8536-1a14b35550d3 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp6cpoalj4/d9c1956e053a47cd92fff5d481ab4fea.delta 1073741824 {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:16:09 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-b1058195-f089-41b0-8536-1a14b35550d3 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp6cpoalj4/d9c1956e053a47cd92fff5d481ab4fea.delta 1073741824" returned: 0 in 0.056s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:16:09 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-b1058195-f089-41b0-8536-1a14b35550d3 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 14 00:16:09 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:16:10 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:16:10 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:16:10 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.596s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:16:10 user nova-compute[82479]: INFO nova.network.neutron [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Updating port 62d9fce8-6815-4a29-ab53-d1205a2db648 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 14 00:16:10 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-b1058195-f089-41b0-8536-1a14b35550d3 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=82479) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 00:16:11 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:16:11 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "refresh_cache-6c35b78e-41e3-40c1-b265-8e1fa5e859c6" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:16:11 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquired lock "refresh_cache-6c35b78e-41e3-40c1-b265-8e1fa5e859c6" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:16:11 user nova-compute[82479]: DEBUG nova.network.neutron [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 00:16:11 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-b1058195-f089-41b0-8536-1a14b35550d3 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=82479) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 00:16:11 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-b1058195-f089-41b0-8536-1a14b35550d3 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 14 00:16:11 user nova-compute[82479]: DEBUG nova.compute.manager [req-ace42674-f2bb-4bf3-b1a5-16a795184af6 req-65c72662-8445-4905-873b-185680c3b8bb service nova] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Received event network-changed-62d9fce8-6815-4a29-ab53-d1205a2db648 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:16:11 user nova-compute[82479]: DEBUG nova.compute.manager [req-ace42674-f2bb-4bf3-b1a5-16a795184af6 req-65c72662-8445-4905-873b-185680c3b8bb service nova] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Refreshing instance network info cache due to event network-changed-62d9fce8-6815-4a29-ab53-d1205a2db648. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:16:11 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-ace42674-f2bb-4bf3-b1a5-16a795184af6 req-65c72662-8445-4905-873b-185680c3b8bb service nova] Acquiring lock "refresh_cache-6c35b78e-41e3-40c1-b265-8e1fa5e859c6" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:16:11 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:16:11 user nova-compute[82479]: DEBUG nova.privsep.utils [None req-b1058195-f089-41b0-8536-1a14b35550d3 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82479) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 00:16:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-b1058195-f089-41b0-8536-1a14b35550d3 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp6cpoalj4/d9c1956e053a47cd92fff5d481ab4fea.delta /opt/stack/data/nova/instances/snapshots/tmp6cpoalj4/d9c1956e053a47cd92fff5d481ab4fea {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:16:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-b1058195-f089-41b0-8536-1a14b35550d3 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp6cpoalj4/d9c1956e053a47cd92fff5d481ab4fea.delta /opt/stack/data/nova/instances/snapshots/tmp6cpoalj4/d9c1956e053a47cd92fff5d481ab4fea" returned: 0 in 0.412s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:16:11 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-b1058195-f089-41b0-8536-1a14b35550d3 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Snapshot extracted, beginning image upload
Apr 14 00:16:11 user nova-compute[82479]: DEBUG nova.network.neutron [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Updating instance_info_cache with network_info: [{"id": "62d9fce8-6815-4a29-ab53-d1205a2db648", "address": "fa:16:3e:46:a4:3f", "network": {"id": "66316d10-fed3-4fb9-877e-a01542ca5855", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-93456010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f20caf676a64b9b97027f3fc9bc724c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62d9fce8-68", "ovs_interfaceid": "62d9fce8-6815-4a29-ab53-d1205a2db648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:16:11 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Releasing lock "refresh_cache-6c35b78e-41e3-40c1-b265-8e1fa5e859c6" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:16:11 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Creating instance directory {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 00:16:11 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Creating image(s)
Apr 14 00:16:11 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "/opt/stack/data/nova/instances/6c35b78e-41e3-40c1-b265-8e1fa5e859c6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:16:11 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "/opt/stack/data/nova/instances/6c35b78e-41e3-40c1-b265-8e1fa5e859c6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:16:11 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "/opt/stack/data/nova/instances/6c35b78e-41e3-40c1-b265-8e1fa5e859c6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:16:11 user nova-compute[82479]: DEBUG nova.objects.instance [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6c35b78e-41e3-40c1-b265-8e1fa5e859c6 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:16:11 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-ace42674-f2bb-4bf3-b1a5-16a795184af6 req-65c72662-8445-4905-873b-185680c3b8bb service nova] Acquired lock "refresh_cache-6c35b78e-41e3-40c1-b265-8e1fa5e859c6" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:16:11 user nova-compute[82479]: DEBUG nova.network.neutron [req-ace42674-f2bb-4bf3-b1a5-16a795184af6 req-65c72662-8445-4905-873b-185680c3b8bb service nova] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Refreshing network info cache for port 62d9fce8-6815-4a29-ab53-d1205a2db648 {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:16:11 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "e7b497aade2cf3320c9dd648df0aba732d7e7d55" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:16:11 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "e7b497aade2cf3320c9dd648df0aba732d7e7d55" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:16:12 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e7b497aade2cf3320c9dd648df0aba732d7e7d55.part --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:16:12 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e7b497aade2cf3320c9dd648df0aba732d7e7d55.part --force-share --output=json" returned: 0 in 0.181s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:16:12 user nova-compute[82479]: DEBUG nova.virt.images [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] 7400d66e-cf11-48fd-8940-9d8feaf95cd3 was qcow2, converting to raw {{(pid=82479) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 00:16:12 user nova-compute[82479]: DEBUG nova.privsep.utils [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82479) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 00:16:12 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e7b497aade2cf3320c9dd648df0aba732d7e7d55.part /opt/stack/data/nova/instances/_base/e7b497aade2cf3320c9dd648df0aba732d7e7d55.converted {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:16:12 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e7b497aade2cf3320c9dd648df0aba732d7e7d55.part /opt/stack/data/nova/instances/_base/e7b497aade2cf3320c9dd648df0aba732d7e7d55.converted" returned: 0 in 0.309s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:16:13 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e7b497aade2cf3320c9dd648df0aba732d7e7d55.converted --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:16:13 user nova-compute[82479]: DEBUG nova.network.neutron [req-ace42674-f2bb-4bf3-b1a5-16a795184af6 req-65c72662-8445-4905-873b-185680c3b8bb service nova] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Updated VIF entry in instance network info cache for port 62d9fce8-6815-4a29-ab53-d1205a2db648. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:16:13 user nova-compute[82479]: DEBUG nova.network.neutron [req-ace42674-f2bb-4bf3-b1a5-16a795184af6 req-65c72662-8445-4905-873b-185680c3b8bb service nova] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Updating instance_info_cache with network_info: [{"id": "62d9fce8-6815-4a29-ab53-d1205a2db648", "address": "fa:16:3e:46:a4:3f", "network": {"id": "66316d10-fed3-4fb9-877e-a01542ca5855", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-93456010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f20caf676a64b9b97027f3fc9bc724c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62d9fce8-68", "ovs_interfaceid": "62d9fce8-6815-4a29-ab53-d1205a2db648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:16:13 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-ace42674-f2bb-4bf3-b1a5-16a795184af6 req-65c72662-8445-4905-873b-185680c3b8bb service nova] Releasing lock "refresh_cache-6c35b78e-41e3-40c1-b265-8e1fa5e859c6" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:16:13 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e7b497aade2cf3320c9dd648df0aba732d7e7d55.converted --force-share --output=json" returned: 0 in 0.143s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:16:13 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "e7b497aade2cf3320c9dd648df0aba732d7e7d55" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.475s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:16:13 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e7b497aade2cf3320c9dd648df0aba732d7e7d55 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:16:13 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e7b497aade2cf3320c9dd648df0aba732d7e7d55 --force-share --output=json" returned: 0 in 0.136s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:16:13 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "e7b497aade2cf3320c9dd648df0aba732d7e7d55" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:16:13 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "e7b497aade2cf3320c9dd648df0aba732d7e7d55" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:16:13 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e7b497aade2cf3320c9dd648df0aba732d7e7d55 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:16:13 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e7b497aade2cf3320c9dd648df0aba732d7e7d55 --force-share --output=json" returned: 0 in 0.162s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:16:13 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e7b497aade2cf3320c9dd648df0aba732d7e7d55,backing_fmt=raw /opt/stack/data/nova/instances/6c35b78e-41e3-40c1-b265-8e1fa5e859c6/disk 1073741824 {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:16:13 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e7b497aade2cf3320c9dd648df0aba732d7e7d55,backing_fmt=raw /opt/stack/data/nova/instances/6c35b78e-41e3-40c1-b265-8e1fa5e859c6/disk 1073741824" returned: 0 in 0.060s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:16:13 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "e7b497aade2cf3320c9dd648df0aba732d7e7d55" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:16:13 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e7b497aade2cf3320c9dd648df0aba732d7e7d55 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:16:13 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e7b497aade2cf3320c9dd648df0aba732d7e7d55 --force-share --output=json" returned: 0 in 0.139s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:16:13 user nova-compute[82479]: DEBUG nova.objects.instance [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lazy-loading 'migration_context' on Instance uuid 6c35b78e-41e3-40c1-b265-8e1fa5e859c6 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:16:13 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Rebasing disk image.
Apr 14 00:16:13 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:16:13 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.151s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:16:13 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 -F raw /opt/stack/data/nova/instances/6c35b78e-41e3-40c1-b265-8e1fa5e859c6/disk {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:16:14 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:16:14 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-b1058195-f089-41b0-8536-1a14b35550d3 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Snapshot image upload complete
Apr 14 00:16:14 user nova-compute[82479]: INFO nova.compute.manager [None req-b1058195-f089-41b0-8536-1a14b35550d3 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Took 6.02 seconds to snapshot the instance on the hypervisor.
Apr 14 00:16:16 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:16:16 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 -F raw /opt/stack/data/nova/instances/6c35b78e-41e3-40c1-b265-8e1fa5e859c6/disk" returned: 0 in 2.560s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:16:16 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Created local disks {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 00:16:16 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Ensure instance console log exists: /opt/stack/data/nova/instances/6c35b78e-41e3-40c1-b265-8e1fa5e859c6/console.log {{(pid=82479) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 00:16:16 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:16:16 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:16:16 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:16:16 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Start _get_guest_xml network_info=[{"id": "62d9fce8-6815-4a29-ab53-d1205a2db648", "address": "fa:16:3e:46:a4:3f", "network": {"id": "66316d10-fed3-4fb9-877e-a01542ca5855", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-93456010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f20caf676a64b9b97027f3fc9bc724c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62d9fce8-68", "ovs_interfaceid": "62d9fce8-6815-4a29-ab53-d1205a2db648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='ef10a3d966ab2ad9816410683f7ebe76',container_format='bare',created_at=2023-04-14T00:14:16Z,direct_url=<?>,disk_format='qcow2',id=7400d66e-cf11-48fd-8940-9d8feaf95cd3,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1217758263-shelved',owner='4f20caf676a64b9b97027f3fc9bc724c',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-14T00:14:20Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 00:16:16 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:16:16 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:16:16 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82479) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 00:16:16 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T00:02:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='ef10a3d966ab2ad9816410683f7ebe76',container_format='bare',created_at=2023-04-14T00:14:16Z,direct_url=<?>,disk_format='qcow2',id=7400d66e-cf11-48fd-8940-9d8feaf95cd3,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1217758263-shelved',owner='4f20caf676a64b9b97027f3fc9bc724c',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-14T00:14:20Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 00:16:16 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Flavor limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 00:16:16 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Image limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 00:16:16 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Flavor pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 00:16:16 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Image pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 00:16:16 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 00:16:16 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 00:16:16 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 00:16:16 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Got 1 possible topologies {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 00:16:16 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 00:16:16 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 00:16:16 user nova-compute[82479]: DEBUG nova.objects.instance [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6c35b78e-41e3-40c1-b265-8e1fa5e859c6 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:16:16 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T00:12:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1217758263',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1217758263',id=21,image_ref='7400d66e-cf11-48fd-8940-9d8feaf95cd3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-749403403',keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:12:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='4f20caf676a64b9b97027f3fc9bc724c',ramdisk_id='',reservation_id='r-5zzsx975',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1395403129',owner_user_name='tempest-AttachVolumeShelveTestJSON-1395403129-project-member',shelved_at='2023-04-14T00:14:20.285141',shelved_host='user',shelved_image_id='7400d66e-cf11-48fd-8940-9d8feaf95cd3'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:16:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f8b18d40ecd4b4e976cf2018af8220c',uuid=6c35b78e-41e3-40c1-b265-8e1fa5e859c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "62d9fce8-6815-4a29-ab53-d1205a2db648", "address": "fa:16:3e:46:a4:3f", "network": {"id": "66316d10-fed3-4fb9-877e-a01542ca5855", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-93456010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f20caf676a64b9b97027f3fc9bc724c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62d9fce8-68", "ovs_interfaceid": "62d9fce8-6815-4a29-ab53-d1205a2db648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82479) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 00:16:16 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Converting VIF {"id": "62d9fce8-6815-4a29-ab53-d1205a2db648", "address": "fa:16:3e:46:a4:3f", "network": {"id": "66316d10-fed3-4fb9-877e-a01542ca5855", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-93456010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f20caf676a64b9b97027f3fc9bc724c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62d9fce8-68", "ovs_interfaceid": "62d9fce8-6815-4a29-ab53-d1205a2db648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:16:16 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:a4:3f,bridge_name='br-int',has_traffic_filtering=True,id=62d9fce8-6815-4a29-ab53-d1205a2db648,network=Network(66316d10-fed3-4fb9-877e-a01542ca5855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62d9fce8-68') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:16:16 user nova-compute[82479]: DEBUG nova.objects.instance [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lazy-loading 'pci_devices' on Instance uuid 6c35b78e-41e3-40c1-b265-8e1fa5e859c6 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:16:16 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] End _get_guest_xml xml=<domain type="kvm">
Apr 14 00:16:16 user nova-compute[82479]:   <uuid>6c35b78e-41e3-40c1-b265-8e1fa5e859c6</uuid>
Apr 14 00:16:16 user nova-compute[82479]:   <name>instance-00000015</name>
Apr 14 00:16:16 user nova-compute[82479]:   <memory>131072</memory>
Apr 14 00:16:16 user nova-compute[82479]:   <vcpu>1</vcpu>
Apr 14 00:16:16 user nova-compute[82479]:   <metadata>
Apr 14 00:16:16 user nova-compute[82479]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 00:16:16 user nova-compute[82479]:       <nova:package version="0.0.0"/>
Apr 14 00:16:16 user nova-compute[82479]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1217758263</nova:name>
Apr 14 00:16:16 user nova-compute[82479]:       <nova:creationTime>2023-04-14 00:16:16</nova:creationTime>
Apr 14 00:16:16 user nova-compute[82479]:       <nova:flavor name="m1.nano">
Apr 14 00:16:16 user nova-compute[82479]:         <nova:memory>128</nova:memory>
Apr 14 00:16:16 user nova-compute[82479]:         <nova:disk>1</nova:disk>
Apr 14 00:16:16 user nova-compute[82479]:         <nova:swap>0</nova:swap>
Apr 14 00:16:16 user nova-compute[82479]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 00:16:16 user nova-compute[82479]:         <nova:vcpus>1</nova:vcpus>
Apr 14 00:16:16 user nova-compute[82479]:       </nova:flavor>
Apr 14 00:16:16 user nova-compute[82479]:       <nova:owner>
Apr 14 00:16:16 user nova-compute[82479]:         <nova:user uuid="2f8b18d40ecd4b4e976cf2018af8220c">tempest-AttachVolumeShelveTestJSON-1395403129-project-member</nova:user>
Apr 14 00:16:16 user nova-compute[82479]:         <nova:project uuid="4f20caf676a64b9b97027f3fc9bc724c">tempest-AttachVolumeShelveTestJSON-1395403129</nova:project>
Apr 14 00:16:16 user nova-compute[82479]:       </nova:owner>
Apr 14 00:16:16 user nova-compute[82479]:       <nova:root type="image" uuid="7400d66e-cf11-48fd-8940-9d8feaf95cd3"/>
Apr 14 00:16:16 user nova-compute[82479]:       <nova:ports>
Apr 14 00:16:16 user nova-compute[82479]:         <nova:port uuid="62d9fce8-6815-4a29-ab53-d1205a2db648">
Apr 14 00:16:16 user nova-compute[82479]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 14 00:16:16 user nova-compute[82479]:         </nova:port>
Apr 14 00:16:16 user nova-compute[82479]:       </nova:ports>
Apr 14 00:16:16 user nova-compute[82479]:     </nova:instance>
Apr 14 00:16:16 user nova-compute[82479]:   </metadata>
Apr 14 00:16:16 user nova-compute[82479]:   <sysinfo type="smbios">
Apr 14 00:16:16 user nova-compute[82479]:     <system>
Apr 14 00:16:16 user nova-compute[82479]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 00:16:16 user nova-compute[82479]:       <entry name="product">OpenStack Nova</entry>
Apr 14 00:16:16 user nova-compute[82479]:       <entry name="version">0.0.0</entry>
Apr 14 00:16:16 user nova-compute[82479]:       <entry name="serial">6c35b78e-41e3-40c1-b265-8e1fa5e859c6</entry>
Apr 14 00:16:16 user nova-compute[82479]:       <entry name="uuid">6c35b78e-41e3-40c1-b265-8e1fa5e859c6</entry>
Apr 14 00:16:16 user nova-compute[82479]:       <entry name="family">Virtual Machine</entry>
Apr 14 00:16:16 user nova-compute[82479]:     </system>
Apr 14 00:16:16 user nova-compute[82479]:   </sysinfo>
Apr 14 00:16:16 user nova-compute[82479]:   <os>
Apr 14 00:16:16 user nova-compute[82479]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 00:16:16 user nova-compute[82479]:     <boot dev="hd"/>
Apr 14 00:16:16 user nova-compute[82479]:     <smbios mode="sysinfo"/>
Apr 14 00:16:16 user nova-compute[82479]:   </os>
Apr 14 00:16:16 user nova-compute[82479]:   <features>
Apr 14 00:16:16 user nova-compute[82479]:     <acpi/>
Apr 14 00:16:16 user nova-compute[82479]:     <apic/>
Apr 14 00:16:16 user nova-compute[82479]:     <vmcoreinfo/>
Apr 14 00:16:16 user nova-compute[82479]:   </features>
Apr 14 00:16:16 user nova-compute[82479]:   <clock offset="utc">
Apr 14 00:16:16 user nova-compute[82479]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 00:16:16 user nova-compute[82479]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 00:16:16 user nova-compute[82479]:     <timer name="hpet" present="no"/>
Apr 14 00:16:16 user nova-compute[82479]:   </clock>
Apr 14 00:16:16 user nova-compute[82479]:   <cpu mode="custom" match="exact">
Apr 14 00:16:16 user nova-compute[82479]:     <model>Nehalem</model>
Apr 14 00:16:16 user nova-compute[82479]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 00:16:16 user nova-compute[82479]:   </cpu>
Apr 14 00:16:16 user nova-compute[82479]:   <devices>
Apr 14 00:16:16 user nova-compute[82479]:     <disk type="file" device="disk">
Apr 14 00:16:16 user nova-compute[82479]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 00:16:16 user nova-compute[82479]:       <source file="/opt/stack/data/nova/instances/6c35b78e-41e3-40c1-b265-8e1fa5e859c6/disk"/>
Apr 14 00:16:16 user nova-compute[82479]:       <target dev="vda" bus="virtio"/>
Apr 14 00:16:16 user nova-compute[82479]:     </disk>
Apr 14 00:16:16 user nova-compute[82479]:     <interface type="ethernet">
Apr 14 00:16:16 user nova-compute[82479]:       <mac address="fa:16:3e:46:a4:3f"/>
Apr 14 00:16:16 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:16:16 user nova-compute[82479]:       <mtu size="1442"/>
Apr 14 00:16:16 user nova-compute[82479]:       <target dev="tap62d9fce8-68"/>
Apr 14 00:16:16 user nova-compute[82479]:     </interface>
Apr 14 00:16:16 user nova-compute[82479]:     <serial type="pty">
Apr 14 00:16:16 user nova-compute[82479]:       <log file="/opt/stack/data/nova/instances/6c35b78e-41e3-40c1-b265-8e1fa5e859c6/console.log" append="off"/>
Apr 14 00:16:16 user nova-compute[82479]:     </serial>
Apr 14 00:16:16 user nova-compute[82479]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 00:16:16 user nova-compute[82479]:     <video>
Apr 14 00:16:16 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:16:16 user nova-compute[82479]:     </video>
Apr 14 00:16:16 user nova-compute[82479]:     <rng model="virtio">
Apr 14 00:16:16 user nova-compute[82479]:       <backend model="random">/dev/urandom</backend>
Apr 14 00:16:16 user nova-compute[82479]:     </rng>
Apr 14 00:16:16 user nova-compute[82479]:     <controller type="usb" index="0" model="none"/>
Apr 14 00:16:16 user nova-compute[82479]:     <memballoon model="virtio">
Apr 14 00:16:16 user nova-compute[82479]:       <stats period="10"/>
Apr 14 00:16:16 user nova-compute[82479]:     </memballoon>
Apr 14 00:16:16 user nova-compute[82479]:   </devices>
Apr 14 00:16:16 user nova-compute[82479]: </domain>
Apr 14 00:16:16 user nova-compute[82479]:  {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 00:16:16 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T00:12:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1217758263',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1217758263',id=21,image_ref='7400d66e-cf11-48fd-8940-9d8feaf95cd3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-749403403',keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:12:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='4f20caf676a64b9b97027f3fc9bc724c',ramdisk_id='',reservation_id='r-5zzsx975',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1395403129',owner_user_name='tempest-AttachVolumeShelveTestJSON-1395403129-project-member',shelved_at='2023-04-14T00:14:20.285141',shelved_host='user',shelved_image_id='7400d66e-cf11-48fd-8940-9d8feaf95cd3'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:16:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f8b18d40ecd4b4e976cf2018af8220c',uuid=6c35b78e-41e3-40c1-b265-8e1fa5e859c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "62d9fce8-6815-4a29-ab53-d1205a2db648", "address": "fa:16:3e:46:a4:3f", "network": {"id": "66316d10-fed3-4fb9-877e-a01542ca5855", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-93456010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f20caf676a64b9b97027f3fc9bc724c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62d9fce8-68", "ovs_interfaceid": "62d9fce8-6815-4a29-ab53-d1205a2db648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 00:16:16 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Converting VIF {"id": "62d9fce8-6815-4a29-ab53-d1205a2db648", "address": "fa:16:3e:46:a4:3f", "network": {"id": "66316d10-fed3-4fb9-877e-a01542ca5855", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-93456010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f20caf676a64b9b97027f3fc9bc724c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62d9fce8-68", "ovs_interfaceid": "62d9fce8-6815-4a29-ab53-d1205a2db648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:16:16 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:a4:3f,bridge_name='br-int',has_traffic_filtering=True,id=62d9fce8-6815-4a29-ab53-d1205a2db648,network=Network(66316d10-fed3-4fb9-877e-a01542ca5855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62d9fce8-68') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:16:16 user nova-compute[82479]: DEBUG os_vif [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:a4:3f,bridge_name='br-int',has_traffic_filtering=True,id=62d9fce8-6815-4a29-ab53-d1205a2db648,network=Network(66316d10-fed3-4fb9-877e-a01542ca5855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62d9fce8-68') {{(pid=82479) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 00:16:16 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:16:16 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:16:16 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 00:16:16 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:16:16 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap62d9fce8-68, may_exist=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:16:16 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap62d9fce8-68, col_values=(('external_ids', {'iface-id': '62d9fce8-6815-4a29-ab53-d1205a2db648', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:a4:3f', 'vm-uuid': '6c35b78e-41e3-40c1-b265-8e1fa5e859c6'}),)) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:16:16 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:16:16 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:16:16 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:16:16 user nova-compute[82479]: INFO os_vif [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:a4:3f,bridge_name='br-int',has_traffic_filtering=True,id=62d9fce8-6815-4a29-ab53-d1205a2db648,network=Network(66316d10-fed3-4fb9-877e-a01542ca5855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62d9fce8-68')
Apr 14 00:16:16 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:16:16 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] No VIF found with MAC fa:16:3e:46:a4:3f, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:16:17 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:16:17 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:16:17 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:16:18 user nova-compute[82479]: DEBUG nova.compute.manager [req-f6490c4e-5569-4599-8a55-324d96a9257d req-71142195-58a6-4162-8b84-da88d2fb0790 service nova] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Received event network-vif-plugged-62d9fce8-6815-4a29-ab53-d1205a2db648 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:16:18 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-f6490c4e-5569-4599-8a55-324d96a9257d req-71142195-58a6-4162-8b84-da88d2fb0790 service nova] Acquiring lock "6c35b78e-41e3-40c1-b265-8e1fa5e859c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:16:18 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-f6490c4e-5569-4599-8a55-324d96a9257d req-71142195-58a6-4162-8b84-da88d2fb0790 service nova] Lock "6c35b78e-41e3-40c1-b265-8e1fa5e859c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:16:18 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-f6490c4e-5569-4599-8a55-324d96a9257d req-71142195-58a6-4162-8b84-da88d2fb0790 service nova] Lock "6c35b78e-41e3-40c1-b265-8e1fa5e859c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:16:18 user nova-compute[82479]: DEBUG nova.compute.manager [req-f6490c4e-5569-4599-8a55-324d96a9257d req-71142195-58a6-4162-8b84-da88d2fb0790 service nova] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] No waiting events found dispatching network-vif-plugged-62d9fce8-6815-4a29-ab53-d1205a2db648 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:16:18 user nova-compute[82479]: WARNING nova.compute.manager [req-f6490c4e-5569-4599-8a55-324d96a9257d req-71142195-58a6-4162-8b84-da88d2fb0790 service nova] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Received unexpected event network-vif-plugged-62d9fce8-6815-4a29-ab53-d1205a2db648 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 14 00:16:18 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:16:18 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:16:18 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:16:18 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:16:20 user nova-compute[82479]: DEBUG nova.compute.manager [req-ddab8fd6-c3c5-49d6-95fc-351fdca6cce4 req-51cc3f93-85b4-4447-ac40-4d8b50daec30 service nova] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Received event network-vif-plugged-62d9fce8-6815-4a29-ab53-d1205a2db648 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:16:20 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-ddab8fd6-c3c5-49d6-95fc-351fdca6cce4 req-51cc3f93-85b4-4447-ac40-4d8b50daec30 service nova] Acquiring lock "6c35b78e-41e3-40c1-b265-8e1fa5e859c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:16:20 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-ddab8fd6-c3c5-49d6-95fc-351fdca6cce4 req-51cc3f93-85b4-4447-ac40-4d8b50daec30 service nova] Lock "6c35b78e-41e3-40c1-b265-8e1fa5e859c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:16:20 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-ddab8fd6-c3c5-49d6-95fc-351fdca6cce4 req-51cc3f93-85b4-4447-ac40-4d8b50daec30 service nova] Lock "6c35b78e-41e3-40c1-b265-8e1fa5e859c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:16:20 user nova-compute[82479]: DEBUG nova.compute.manager [req-ddab8fd6-c3c5-49d6-95fc-351fdca6cce4 req-51cc3f93-85b4-4447-ac40-4d8b50daec30 service nova] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] No waiting events found dispatching network-vif-plugged-62d9fce8-6815-4a29-ab53-d1205a2db648 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:16:20 user nova-compute[82479]: WARNING nova.compute.manager [req-ddab8fd6-c3c5-49d6-95fc-351fdca6cce4 req-51cc3f93-85b4-4447-ac40-4d8b50daec30 service nova] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Received unexpected event network-vif-plugged-62d9fce8-6815-4a29-ab53-d1205a2db648 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 14 00:16:20 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681431380.2676585, 6c35b78e-41e3-40c1-b265-8e1fa5e859c6 => Resumed> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:16:20 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] VM Resumed (Lifecycle Event)
Apr 14 00:16:20 user nova-compute[82479]: DEBUG nova.compute.manager [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Instance event wait completed in 0 seconds for  {{(pid=82479) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 00:16:20 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Guest created on hypervisor {{(pid=82479) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 00:16:20 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:16:20 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Instance spawned successfully.
Apr 14 00:16:20 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:16:20 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:16:20 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681431380.267853, 6c35b78e-41e3-40c1-b265-8e1fa5e859c6 => Started> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:16:20 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] VM Started (Lifecycle Event)
Apr 14 00:16:20 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:16:20 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:16:20 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:16:20 user nova-compute[82479]: DEBUG nova.compute.manager [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:16:20 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8c6ec1de-dfb3-46a5-94bc-c46ba0a40b6e tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6c35b78e-41e3-40c1-b265-8e1fa5e859c6" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.295s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:16:21 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:16:21 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:16:26 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:16:26 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:16:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:16:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:16:33 user nova-compute[82479]: INFO nova.compute.manager [None req-87777626-17f7-4edd-a93e-1c66f9930078 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Unrescuing
Apr 14 00:16:33 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-87777626-17f7-4edd-a93e-1c66f9930078 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "refresh_cache-6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:16:33 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-87777626-17f7-4edd-a93e-1c66f9930078 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquired lock "refresh_cache-6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:16:33 user nova-compute[82479]: DEBUG nova.network.neutron [None req-87777626-17f7-4edd-a93e-1c66f9930078 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 00:16:34 user nova-compute[82479]: DEBUG nova.network.neutron [None req-87777626-17f7-4edd-a93e-1c66f9930078 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Updating instance_info_cache with network_info: [{"id": "10a32c68-570b-4ba1-ba36-6ecaf135c9bb", "address": "fa:16:3e:a4:44:5a", "network": {"id": "08106daa-a35e-4376-8c46-2b4baa51c6ea", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321730350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524265958bd24a6cb94aa3115eb2b6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10a32c68-57", "ovs_interfaceid": "10a32c68-570b-4ba1-ba36-6ecaf135c9bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:16:34 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-87777626-17f7-4edd-a93e-1c66f9930078 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Releasing lock "refresh_cache-6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:16:34 user nova-compute[82479]: DEBUG nova.objects.instance [None req-87777626-17f7-4edd-a93e-1c66f9930078 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lazy-loading 'flavor' on Instance uuid 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:16:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:16:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:16:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:16:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:16:34 user nova-compute[82479]: DEBUG nova.compute.manager [req-56865cd6-8939-40e3-a08a-c9463391d90b req-7dc84619-3b13-4b1c-a008-f00fd5cf9243 service nova] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Received event network-vif-unplugged-10a32c68-570b-4ba1-ba36-6ecaf135c9bb {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:16:34 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-56865cd6-8939-40e3-a08a-c9463391d90b req-7dc84619-3b13-4b1c-a008-f00fd5cf9243 service nova] Acquiring lock "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:16:34 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-56865cd6-8939-40e3-a08a-c9463391d90b req-7dc84619-3b13-4b1c-a008-f00fd5cf9243 service nova] Lock "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:16:34 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-56865cd6-8939-40e3-a08a-c9463391d90b req-7dc84619-3b13-4b1c-a008-f00fd5cf9243 service nova] Lock "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:16:34 user nova-compute[82479]: DEBUG nova.compute.manager [req-56865cd6-8939-40e3-a08a-c9463391d90b req-7dc84619-3b13-4b1c-a008-f00fd5cf9243 service nova] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] No waiting events found dispatching network-vif-unplugged-10a32c68-570b-4ba1-ba36-6ecaf135c9bb {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:16:34 user nova-compute[82479]: WARNING nova.compute.manager [req-56865cd6-8939-40e3-a08a-c9463391d90b req-7dc84619-3b13-4b1c-a008-f00fd5cf9243 service nova] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Received unexpected event network-vif-unplugged-10a32c68-570b-4ba1-ba36-6ecaf135c9bb for instance with vm_state rescued and task_state unrescuing.
Apr 14 00:16:34 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Instance destroyed successfully.
Apr 14 00:16:36 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:16:36 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:16:36 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:16:36 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:16:36 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:16:36 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:16:36 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:16:36 user nova-compute[82479]: DEBUG nova.compute.manager [req-13356e05-aa2b-4638-a2e3-5318fda0267b req-424a3c8c-8e49-4b17-aef4-1ec7a943915e service nova] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Received event network-vif-plugged-10a32c68-570b-4ba1-ba36-6ecaf135c9bb {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:16:36 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-13356e05-aa2b-4638-a2e3-5318fda0267b req-424a3c8c-8e49-4b17-aef4-1ec7a943915e service nova] Acquiring lock "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:16:36 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-13356e05-aa2b-4638-a2e3-5318fda0267b req-424a3c8c-8e49-4b17-aef4-1ec7a943915e service nova] Lock "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:16:36 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-13356e05-aa2b-4638-a2e3-5318fda0267b req-424a3c8c-8e49-4b17-aef4-1ec7a943915e service nova] Lock "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:16:36 user nova-compute[82479]: DEBUG nova.compute.manager [req-13356e05-aa2b-4638-a2e3-5318fda0267b req-424a3c8c-8e49-4b17-aef4-1ec7a943915e service nova] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] No waiting events found dispatching network-vif-plugged-10a32c68-570b-4ba1-ba36-6ecaf135c9bb {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:16:36 user nova-compute[82479]: WARNING nova.compute.manager [req-13356e05-aa2b-4638-a2e3-5318fda0267b req-424a3c8c-8e49-4b17-aef4-1ec7a943915e service nova] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Received unexpected event network-vif-plugged-10a32c68-570b-4ba1-ba36-6ecaf135c9bb for instance with vm_state rescued and task_state unrescuing.
Apr 14 00:16:36 user nova-compute[82479]: DEBUG nova.compute.manager [req-13356e05-aa2b-4638-a2e3-5318fda0267b req-424a3c8c-8e49-4b17-aef4-1ec7a943915e service nova] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Received event network-vif-plugged-10a32c68-570b-4ba1-ba36-6ecaf135c9bb {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:16:36 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-13356e05-aa2b-4638-a2e3-5318fda0267b req-424a3c8c-8e49-4b17-aef4-1ec7a943915e service nova] Acquiring lock "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:16:36 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-13356e05-aa2b-4638-a2e3-5318fda0267b req-424a3c8c-8e49-4b17-aef4-1ec7a943915e service nova] Lock "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:16:36 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-13356e05-aa2b-4638-a2e3-5318fda0267b req-424a3c8c-8e49-4b17-aef4-1ec7a943915e service nova] Lock "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:16:36 user nova-compute[82479]: DEBUG nova.compute.manager [req-13356e05-aa2b-4638-a2e3-5318fda0267b req-424a3c8c-8e49-4b17-aef4-1ec7a943915e service nova] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] No waiting events found dispatching network-vif-plugged-10a32c68-570b-4ba1-ba36-6ecaf135c9bb {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:16:36 user nova-compute[82479]: WARNING nova.compute.manager [req-13356e05-aa2b-4638-a2e3-5318fda0267b req-424a3c8c-8e49-4b17-aef4-1ec7a943915e service nova] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Received unexpected event network-vif-plugged-10a32c68-570b-4ba1-ba36-6ecaf135c9bb for instance with vm_state rescued and task_state unrescuing.
Apr 14 00:16:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:16:38 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Removed pending event for 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 due to event {{(pid=82479) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 00:16:38 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681431398.7700143, 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 => Resumed> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:16:38 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] VM Resumed (Lifecycle Event)
Apr 14 00:16:38 user nova-compute[82479]: DEBUG nova.compute.manager [None req-87777626-17f7-4edd-a93e-1c66f9930078 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:16:38 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:16:38 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:16:38 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 14 00:16:38 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681431398.7712607, 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 => Started> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:16:38 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] VM Started (Lifecycle Event)
Apr 14 00:16:38 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:16:38 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:16:39 user nova-compute[82479]: DEBUG nova.compute.manager [req-85e509bb-9176-423b-a556-0c19ff572b50 req-baf0d4c9-93a4-4fec-ae4a-772f675c4a45 service nova] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Received event network-vif-plugged-10a32c68-570b-4ba1-ba36-6ecaf135c9bb {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:16:39 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-85e509bb-9176-423b-a556-0c19ff572b50 req-baf0d4c9-93a4-4fec-ae4a-772f675c4a45 service nova] Acquiring lock "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:16:39 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-85e509bb-9176-423b-a556-0c19ff572b50 req-baf0d4c9-93a4-4fec-ae4a-772f675c4a45 service nova] Lock "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:16:39 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-85e509bb-9176-423b-a556-0c19ff572b50 req-baf0d4c9-93a4-4fec-ae4a-772f675c4a45 service nova] Lock "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:16:39 user nova-compute[82479]: DEBUG nova.compute.manager [req-85e509bb-9176-423b-a556-0c19ff572b50 req-baf0d4c9-93a4-4fec-ae4a-772f675c4a45 service nova] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] No waiting events found dispatching network-vif-plugged-10a32c68-570b-4ba1-ba36-6ecaf135c9bb {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:16:39 user nova-compute[82479]: WARNING nova.compute.manager [req-85e509bb-9176-423b-a556-0c19ff572b50 req-baf0d4c9-93a4-4fec-ae4a-772f675c4a45 service nova] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Received unexpected event network-vif-plugged-10a32c68-570b-4ba1-ba36-6ecaf135c9bb for instance with vm_state active and task_state None.
Apr 14 00:16:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:16:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:16:42 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:16:44 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:16:45 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:16:46 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:16:46 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:16:48 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:16:48 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Starting heal instance info cache {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 00:16:48 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "refresh_cache-d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:16:48 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquired lock "refresh_cache-d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:16:48 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Forcefully refreshing network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 00:16:49 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-5d787c25-e5ac-4504-8776-65983d0446ac tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:16:49 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-5d787c25-e5ac-4504-8776-65983d0446ac tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:16:49 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-5d787c25-e5ac-4504-8776-65983d0446ac tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:16:49 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-5d787c25-e5ac-4504-8776-65983d0446ac tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:16:49 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-5d787c25-e5ac-4504-8776-65983d0446ac tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:16:49 user nova-compute[82479]: INFO nova.compute.manager [None req-5d787c25-e5ac-4504-8776-65983d0446ac tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Terminating instance
Apr 14 00:16:49 user nova-compute[82479]: DEBUG nova.compute.manager [None req-5d787c25-e5ac-4504-8776-65983d0446ac tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Start destroying the instance on the hypervisor. {{(pid=82479) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 00:16:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:16:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:16:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:16:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:16:49 user nova-compute[82479]: DEBUG nova.compute.manager [req-8772481f-ce3e-41f0-bcfa-940a3c4351e6 req-b4e28aca-6927-4d73-8034-18fa680667ba service nova] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Received event network-vif-unplugged-adb392b2-602f-421d-b26b-1e8f243cacff {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:16:49 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-8772481f-ce3e-41f0-bcfa-940a3c4351e6 req-b4e28aca-6927-4d73-8034-18fa680667ba service nova] Acquiring lock "e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:16:49 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-8772481f-ce3e-41f0-bcfa-940a3c4351e6 req-b4e28aca-6927-4d73-8034-18fa680667ba service nova] Lock "e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:16:49 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-8772481f-ce3e-41f0-bcfa-940a3c4351e6 req-b4e28aca-6927-4d73-8034-18fa680667ba service nova] Lock "e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:16:49 user nova-compute[82479]: DEBUG nova.compute.manager [req-8772481f-ce3e-41f0-bcfa-940a3c4351e6 req-b4e28aca-6927-4d73-8034-18fa680667ba service nova] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] No waiting events found dispatching network-vif-unplugged-adb392b2-602f-421d-b26b-1e8f243cacff {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:16:49 user nova-compute[82479]: DEBUG nova.compute.manager [req-8772481f-ce3e-41f0-bcfa-940a3c4351e6 req-b4e28aca-6927-4d73-8034-18fa680667ba service nova] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Received event network-vif-unplugged-adb392b2-602f-421d-b26b-1e8f243cacff for instance with task_state deleting. {{(pid=82479) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 00:16:49 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Updating instance_info_cache with network_info: [{"id": "caaa85dc-5a5f-4480-b6be-b2bc234cd455", "address": "fa:16:3e:73:2a:e3", "network": {"id": "08106daa-a35e-4376-8c46-2b4baa51c6ea", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321730350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524265958bd24a6cb94aa3115eb2b6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaaa85dc-5a", "ovs_interfaceid": "caaa85dc-5a5f-4480-b6be-b2bc234cd455", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:16:49 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Releasing lock "refresh_cache-d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:16:49 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Updated the network info_cache for instance {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 00:16:49 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:16:49 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Instance destroyed successfully.
Apr 14 00:16:49 user nova-compute[82479]: DEBUG nova.objects.instance [None req-5d787c25-e5ac-4504-8776-65983d0446ac tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lazy-loading 'resources' on Instance uuid e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:16:49 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-5d787c25-e5ac-4504-8776-65983d0446ac tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:13:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1247623601',display_name='tempest-AttachVolumeNegativeTest-server-1247623601',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1247623601',id=24,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLGkLOYcKKntXB8xBUrq5TfkCx1/xNQj4Ksi6k+fzjiqYC04ZpG2CZF3KkB+DY5NBDh2NzjAuCSlSRLBIT2B1CwX+AbHx15ScaMmXWoEIRyWreJeS2PAr2D8ysrfPRBoiQ==',key_name='tempest-keypair-1854176898',keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:14:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='44c9d67ad2fa4cb9ab309b98f8fe051a',ramdisk_id='',reservation_id='r-ounfao1n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-719597397',owner_user_name='tempest-AttachVolumeNegativeTest-719597397-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T00:14:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb293fdfc658466aaa7134269fa46a7c',uuid=e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "adb392b2-602f-421d-b26b-1e8f243cacff", "address": "fa:16:3e:3f:64:bc", "network": {"id": "6d80f923-8aef-45df-921b-f77ed4ff0e75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-696070096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44c9d67ad2fa4cb9ab309b98f8fe051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadb392b2-60", "ovs_interfaceid": "adb392b2-602f-421d-b26b-1e8f243cacff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 00:16:49 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-5d787c25-e5ac-4504-8776-65983d0446ac tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Converting VIF {"id": "adb392b2-602f-421d-b26b-1e8f243cacff", "address": "fa:16:3e:3f:64:bc", "network": {"id": "6d80f923-8aef-45df-921b-f77ed4ff0e75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-696070096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44c9d67ad2fa4cb9ab309b98f8fe051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadb392b2-60", "ovs_interfaceid": "adb392b2-602f-421d-b26b-1e8f243cacff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:16:49 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-5d787c25-e5ac-4504-8776-65983d0446ac tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3f:64:bc,bridge_name='br-int',has_traffic_filtering=True,id=adb392b2-602f-421d-b26b-1e8f243cacff,network=Network(6d80f923-8aef-45df-921b-f77ed4ff0e75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadb392b2-60') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:16:49 user nova-compute[82479]: DEBUG os_vif [None req-5d787c25-e5ac-4504-8776-65983d0446ac tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:64:bc,bridge_name='br-int',has_traffic_filtering=True,id=adb392b2-602f-421d-b26b-1e8f243cacff,network=Network(6d80f923-8aef-45df-921b-f77ed4ff0e75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadb392b2-60') {{(pid=82479) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 00:16:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:16:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapadb392b2-60, bridge=br-int, if_exists=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:16:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:16:49 user nova-compute[82479]: INFO os_vif [None req-5d787c25-e5ac-4504-8776-65983d0446ac tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:64:bc,bridge_name='br-int',has_traffic_filtering=True,id=adb392b2-602f-421d-b26b-1e8f243cacff,network=Network(6d80f923-8aef-45df-921b-f77ed4ff0e75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadb392b2-60')
Apr 14 00:16:49 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-5d787c25-e5ac-4504-8776-65983d0446ac tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Deleting instance files /opt/stack/data/nova/instances/e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8_del
Apr 14 00:16:49 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-5d787c25-e5ac-4504-8776-65983d0446ac tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Deletion of /opt/stack/data/nova/instances/e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8_del complete
Apr 14 00:16:49 user nova-compute[82479]: INFO nova.compute.manager [None req-5d787c25-e5ac-4504-8776-65983d0446ac tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Took 0.94 seconds to destroy the instance on the hypervisor.
Apr 14 00:16:49 user nova-compute[82479]: DEBUG oslo.service.loopingcall [None req-5d787c25-e5ac-4504-8776-65983d0446ac tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82479) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 00:16:49 user nova-compute[82479]: DEBUG nova.compute.manager [-] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Deallocating network for instance {{(pid=82479) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 00:16:49 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] deallocate_for_instance() {{(pid=82479) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 00:16:50 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Updating instance_info_cache with network_info: [] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:16:50 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Took 0.87 seconds to deallocate network for instance.
Apr 14 00:16:50 user nova-compute[82479]: DEBUG nova.compute.manager [req-90139baa-2ee3-4bf5-949a-4d2a167935c9 req-7b1ec813-6d56-4d1e-8ded-78dfa19b7fc2 service nova] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Received event network-vif-deleted-adb392b2-602f-421d-b26b-1e8f243cacff {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:16:50 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-5d787c25-e5ac-4504-8776-65983d0446ac tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:16:50 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-5d787c25-e5ac-4504-8776-65983d0446ac tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:16:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:16:51 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-5d787c25-e5ac-4504-8776-65983d0446ac tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:16:51 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-5d787c25-e5ac-4504-8776-65983d0446ac tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:16:51 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-5d787c25-e5ac-4504-8776-65983d0446ac tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.353s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:16:51 user nova-compute[82479]: INFO nova.scheduler.client.report [None req-5d787c25-e5ac-4504-8776-65983d0446ac tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Deleted allocations for instance e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8
Apr 14 00:16:51 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-5d787c25-e5ac-4504-8776-65983d0446ac tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.739s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:16:51 user nova-compute[82479]: DEBUG nova.compute.manager [req-63f9fbc4-c719-41ab-9ad5-958fb99049ab req-09ac4a20-b73b-4dfd-8962-4db6ed797dd4 service nova] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Received event network-vif-plugged-adb392b2-602f-421d-b26b-1e8f243cacff {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:16:51 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-63f9fbc4-c719-41ab-9ad5-958fb99049ab req-09ac4a20-b73b-4dfd-8962-4db6ed797dd4 service nova] Acquiring lock "e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:16:51 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-63f9fbc4-c719-41ab-9ad5-958fb99049ab req-09ac4a20-b73b-4dfd-8962-4db6ed797dd4 service nova] Lock "e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:16:51 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-63f9fbc4-c719-41ab-9ad5-958fb99049ab req-09ac4a20-b73b-4dfd-8962-4db6ed797dd4 service nova] Lock "e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:16:51 user nova-compute[82479]: DEBUG nova.compute.manager [req-63f9fbc4-c719-41ab-9ad5-958fb99049ab req-09ac4a20-b73b-4dfd-8962-4db6ed797dd4 service nova] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] No waiting events found dispatching network-vif-plugged-adb392b2-602f-421d-b26b-1e8f243cacff {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:16:51 user nova-compute[82479]: WARNING nova.compute.manager [req-63f9fbc4-c719-41ab-9ad5-958fb99049ab req-09ac4a20-b73b-4dfd-8962-4db6ed797dd4 service nova] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Received unexpected event network-vif-plugged-adb392b2-602f-421d-b26b-1e8f243cacff for instance with vm_state deleted and task_state None.
Apr 14 00:16:52 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:16:52 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:16:53 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Acquiring lock "c7e1f470-fe8a-455e-aa0b-0d2475957fc0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:16:53 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "c7e1f470-fe8a-455e-aa0b-0d2475957fc0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:16:53 user nova-compute[82479]: DEBUG nova.compute.manager [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Starting instance... {{(pid=82479) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 00:16:53 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:16:53 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:16:53 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82479) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 00:16:53 user nova-compute[82479]: INFO nova.compute.claims [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Claim successful on node user
Apr 14 00:16:53 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:16:53 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:16:53 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:16:53 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:16:53 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.378s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:16:53 user nova-compute[82479]: DEBUG nova.compute.manager [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Start building networks asynchronously for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 00:16:53 user nova-compute[82479]: DEBUG nova.compute.manager [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Allocating IP information in the background. {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 00:16:53 user nova-compute[82479]: DEBUG nova.network.neutron [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] allocate_for_instance() {{(pid=82479) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 00:16:53 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 00:16:53 user nova-compute[82479]: DEBUG nova.compute.manager [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Start building block device mappings for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 00:16:53 user nova-compute[82479]: INFO nova.virt.block_device [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Booting with volume 69599ada-93d4-425a-ae12-e52cafcc29f7 at /dev/vda
Apr 14 00:16:53 user nova-compute[82479]: DEBUG nova.policy [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b81e5ce5d2414980a506d0f3b37d0d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6be95e5c8d94269802ecf487ff73104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82479) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 00:16:53 user nova-compute[82479]: DEBUG os_brick.utils [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:16:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:16:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:16:53 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[14099885-9e11-4da9-a5cb-b95140cf54ea]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fec92fcfdd3\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:16:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:16:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:16:53 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8fd9cd8-2c71-4b60-a715-58af30f0150c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:16:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:16:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.029s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:16:53 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7555d0-ae76-422b-a2e3-b450938e4eef]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:16:53 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d12d06e-5043-4d76-bb2f-b35bc5a00f5b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:16:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Running cmd (subprocess): nvme version {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:16:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] 'nvme version' failed. Not Retrying. {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:16:53 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] nvme not present on system {{(pid=82479) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 00:16:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:16:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:16:53 user nova-compute[82479]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 00:16:53 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a48a6a-4ab6-403f-8ec6-b692fac69d56]: (4, '') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:16:53 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82479) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 00:16:53 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 00:16:53 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] LIGHTOS: no hostnqn found. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 00:16:53 user nova-compute[82479]: DEBUG os_brick.utils [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fec92fcfdd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:16:53 user nova-compute[82479]: DEBUG nova.virt.block_device [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Updating existing volume attachment record: 1cf6ab58-ea49-4409-8a5b-bbc6e23cbce0 {{(pid=82479) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 00:16:54 user nova-compute[82479]: DEBUG nova.network.neutron [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Successfully created port: 0f90a627-4dab-4a2a-a2c2-eaae2910b379 {{(pid=82479) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 00:16:54 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:16:54 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82479) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 00:16:54 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:16:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:16:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:16:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:16:54 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Auditing locally available compute resources for user (node: user) {{(pid=82479) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 00:16:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:16:54 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:16:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:16:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:16:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:16:55 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:16:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:16:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:16:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:16:55 user nova-compute[82479]: DEBUG nova.network.neutron [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Successfully updated port: 0f90a627-4dab-4a2a-a2c2-eaae2910b379 {{(pid=82479) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 00:16:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Acquiring lock "refresh_cache-c7e1f470-fe8a-455e-aa0b-0d2475957fc0" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:16:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Acquired lock "refresh_cache-c7e1f470-fe8a-455e-aa0b-0d2475957fc0" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:16:55 user nova-compute[82479]: DEBUG nova.network.neutron [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 00:16:55 user nova-compute[82479]: DEBUG nova.compute.manager [req-8f18319f-7efe-4125-b4d9-734644d0e8a6 req-a41478f2-e040-45b2-ba98-6264235b919b service nova] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Received event network-changed-0f90a627-4dab-4a2a-a2c2-eaae2910b379 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:16:55 user nova-compute[82479]: DEBUG nova.compute.manager [req-8f18319f-7efe-4125-b4d9-734644d0e8a6 req-a41478f2-e040-45b2-ba98-6264235b919b service nova] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Refreshing instance network info cache due to event network-changed-0f90a627-4dab-4a2a-a2c2-eaae2910b379. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:16:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-8f18319f-7efe-4125-b4d9-734644d0e8a6 req-a41478f2-e040-45b2-ba98-6264235b919b service nova] Acquiring lock "refresh_cache-c7e1f470-fe8a-455e-aa0b-0d2475957fc0" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:16:55 user nova-compute[82479]: DEBUG nova.network.neutron [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Instance cache missing network info. {{(pid=82479) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 00:16:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:16:55 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:16:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2793d412-f405-4452-8e46-c192e3c92ccb/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:16:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2793d412-f405-4452-8e46-c192e3c92ccb/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:16:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2793d412-f405-4452-8e46-c192e3c92ccb/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:16:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2793d412-f405-4452-8e46-c192e3c92ccb/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:16:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02f97792-efc1-4976-bde1-70d7f9047cb5/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:16:55 user nova-compute[82479]: DEBUG nova.network.neutron [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Updating instance_info_cache with network_info: [{"id": "0f90a627-4dab-4a2a-a2c2-eaae2910b379", "address": "fa:16:3e:e2:65:cb", "network": {"id": "9f0b7c66-0d95-4c5f-8c77-6f12228c20fc", "bridge": "br-int", "label": "tempest-TestShelveInstance-940455626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6be95e5c8d94269802ecf487ff73104", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f90a627-4d", "ovs_interfaceid": "0f90a627-4dab-4a2a-a2c2-eaae2910b379", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:16:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Releasing lock "refresh_cache-c7e1f470-fe8a-455e-aa0b-0d2475957fc0" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:16:55 user nova-compute[82479]: DEBUG nova.compute.manager [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Instance network_info: |[{"id": "0f90a627-4dab-4a2a-a2c2-eaae2910b379", "address": "fa:16:3e:e2:65:cb", "network": {"id": "9f0b7c66-0d95-4c5f-8c77-6f12228c20fc", "bridge": "br-int", "label": "tempest-TestShelveInstance-940455626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6be95e5c8d94269802ecf487ff73104", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f90a627-4d", "ovs_interfaceid": "0f90a627-4dab-4a2a-a2c2-eaae2910b379", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 00:16:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-8f18319f-7efe-4125-b4d9-734644d0e8a6 req-a41478f2-e040-45b2-ba98-6264235b919b service nova] Acquired lock "refresh_cache-c7e1f470-fe8a-455e-aa0b-0d2475957fc0" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:16:55 user nova-compute[82479]: DEBUG nova.network.neutron [req-8f18319f-7efe-4125-b4d9-734644d0e8a6 req-a41478f2-e040-45b2-ba98-6264235b919b service nova] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Refreshing network info cache for port 0f90a627-4dab-4a2a-a2c2-eaae2910b379 {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:16:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02f97792-efc1-4976-bde1-70d7f9047cb5/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:16:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02f97792-efc1-4976-bde1-70d7f9047cb5/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:16:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02f97792-efc1-4976-bde1-70d7f9047cb5/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:16:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c35b78e-41e3-40c1-b265-8e1fa5e859c6/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:16:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c35b78e-41e3-40c1-b265-8e1fa5e859c6/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:16:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c35b78e-41e3-40c1-b265-8e1fa5e859c6/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:16:56 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:16:56 user nova-compute[82479]: DEBUG nova.network.neutron [req-8f18319f-7efe-4125-b4d9-734644d0e8a6 req-a41478f2-e040-45b2-ba98-6264235b919b service nova] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Updated VIF entry in instance network info cache for port 0f90a627-4dab-4a2a-a2c2-eaae2910b379. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:16:56 user nova-compute[82479]: DEBUG nova.network.neutron [req-8f18319f-7efe-4125-b4d9-734644d0e8a6 req-a41478f2-e040-45b2-ba98-6264235b919b service nova] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Updating instance_info_cache with network_info: [{"id": "0f90a627-4dab-4a2a-a2c2-eaae2910b379", "address": "fa:16:3e:e2:65:cb", "network": {"id": "9f0b7c66-0d95-4c5f-8c77-6f12228c20fc", "bridge": "br-int", "label": "tempest-TestShelveInstance-940455626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6be95e5c8d94269802ecf487ff73104", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f90a627-4d", "ovs_interfaceid": "0f90a627-4dab-4a2a-a2c2-eaae2910b379", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:16:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c35b78e-41e3-40c1-b265-8e1fa5e859c6/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:16:56 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-8f18319f-7efe-4125-b4d9-734644d0e8a6 req-a41478f2-e040-45b2-ba98-6264235b919b service nova] Releasing lock "refresh_cache-c7e1f470-fe8a-455e-aa0b-0d2475957fc0" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:16:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk.rescue --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:16:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk.rescue --force-share --output=json" returned: 0 in 0.153s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:16:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk.rescue --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:16:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk.rescue --force-share --output=json" returned: 0 in 0.162s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:16:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:16:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:16:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:16:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:16:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:16:57 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:16:57 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:16:57 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:16:57 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cfe388b-396b-4ce9-97aa-9049cbcb32f4/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:16:57 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cfe388b-396b-4ce9-97aa-9049cbcb32f4/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:16:57 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cfe388b-396b-4ce9-97aa-9049cbcb32f4/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:16:57 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cfe388b-396b-4ce9-97aa-9049cbcb32f4/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:16:58 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:16:58 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:16:58 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Hypervisor/Node resource view: name=user free_ram=7729MB free_disk=26.12079620361328GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82479) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 23718fd0-58b8-47f9-b1ef-a26a90741ecc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 17c6c147-fb62-4204-a416-792b94d3f7dd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance b3475e7e-ceb4-452a-a045-dbf43c5944dd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 2793d412-f405-4452-8e46-c192e3c92ccb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 1cfe388b-396b-4ce9-97aa-9049cbcb32f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 02f97792-efc1-4976-bde1-70d7f9047cb5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 6c35b78e-41e3-40c1-b265-8e1fa5e859c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance c7e1f470-fe8a-455e-aa0b-0d2475957fc0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Compute_service record updated for user:user {{(pid=82479) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.458s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG nova.compute.manager [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Start spawning the instance on the hypervisor. {{(pid=82479) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Creating instance directory {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 00:16:58 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Creating image(s)
Apr 14 00:16:58 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Did not create local disks {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Ensure instance console log exists: /opt/stack/data/nova/instances/c7e1f470-fe8a-455e-aa0b-0d2475957fc0/console.log {{(pid=82479) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Start _get_guest_xml network_info=[{"id": "0f90a627-4dab-4a2a-a2c2-eaae2910b379", "address": "fa:16:3e:e2:65:cb", "network": {"id": "9f0b7c66-0d95-4c5f-8c77-6f12228c20fc", "bridge": "br-int", "label": "tempest-TestShelveInstance-940455626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6be95e5c8d94269802ecf487ff73104", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f90a627-4d", "ovs_interfaceid": "0f90a627-4dab-4a2a-a2c2-eaae2910b379", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': True, 'attachment_id': '1cf6ab58-ea49-4409-8a5b-bbc6e23cbce0', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FZCpIqMc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c7e1f470-fe8a-455e-aa0b-0d2475957fc0', 'attached_at': '', 'detached_at': '', 'volume_id': '69599ada-93d4-425a-ae12-e52cafcc29f7', 'serial': '69599ada-93d4-425a-ae12-e52cafcc29f7'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 00:16:58 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:16:58 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:16:58 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82479) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T00:02:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Flavor limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Image limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Flavor pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Image pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Got 1 possible topologies {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Calling os-brick to attach iSCSI Volume {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FZCpIqMc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:16:58 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:16:58 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:16:58 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:16:58 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:16:58 user nova-compute[82479]: INFO os_brick.initiator.connectors.iscsi [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 00:16:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 -p 172.16.0.220:3260 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f6a4f8-4f63-4970-87ac-9eae61310087]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 00:16:58 user nova-compute[82479]:  {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 -p 172.16.0.220:3260 --interface default --op new {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[211131df-ae4f-4114-9887-fa908ac3fbdb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7] added\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7] added
Apr 14 00:16:58 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c3fff04-9edb-4ab1-95dd-05ed9d46a38d]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[e67f6f4e-0e38-48dc-b1de-0692820b1e5d]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FZCpIqMc {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FZCpIqMc" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[5150309b-f695-4201-acbe-80af7e83f778]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FZCpIqMc'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[83503fbe-9baa-4ce3-a3ef-b50e237e3125]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b8b9b62-27c0-48fe-8992-00208bbea9a2]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:16:58 user nova-compute[82479]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e (non-flash)
Apr 14 00:16:58 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:16:58 user nova-compute[82479]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e (non-flash)
Apr 14 00:16:58 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 -p 172.16.0.220:3260 --login {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 -p 172.16.0.220:3260 --login" returned: 0 in 0.099s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3e83fd-03df-4c11-be0c-34e3844755dd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7, portal: 172.16.0.220,3260]
Apr 14 00:16:58 user nova-compute[82479]: Login to [iface: default, target: iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7, portal: 172.16.0.220,3260] successful.
Apr 14 00:16:58 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[929f6f41-f2e3-4b4a-959e-1436831bd1f4]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:16:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:16:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:16:59 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[611a6177-8ce8-435f-ab0a-e53e90bc4905]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:16:59 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:16:59 user nova-compute[82479]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e (non-flash)
Apr 14 00:16:59 user nova-compute[82479]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 (non-flash)
Apr 14 00:16:59 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:16:59 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:16:59 user nova-compute[82479]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e (non-flash)
Apr 14 00:16:59 user nova-compute[82479]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 (non-flash)
Apr 14 00:16:59 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:16:59 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:16:59 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Connected to 172.16.0.220:3260 {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 00:16:59 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] HCTL ('35', '-', '-', 0) found on session 27 with lun 0 {{(pid=82479) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 00:16:59 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=82479) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 00:16:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:16:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:16:59 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe7393a-c23a-4409-8490-c577bcb995ba]: (4, ('- - 0', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:16:59 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Searching for a device in session 27 and hctl ['35', '*', '*', 0] yield: None {{(pid=82479) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 00:16:59 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:16:59 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:17:00 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Searching for a device in session 27 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=82479) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 00:17:00 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FZCpIqMc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 00:17:00 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:17:00 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '26630376635613839', 'path': '/dev/sdd'} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:17:00 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630376635613839', 'path': '/dev/sdd'} {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 00:17:00 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:16:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-454867915',display_name='tempest-TestShelveInstance-server-454867915',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-454867915',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC+PTdQ169W4Ik0XJKAX1vms0H6bKP2Yz2If5eK4IKeWDFl4zKDtIms+QmK6CN9t818K0haZCxWGM5VZYA/HUy2ewr54rCodMDtSTJaDzyD+lhV417bVgrES1KaG3eBq0w==',key_name='tempest-TestShelveInstance-266505447',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6be95e5c8d94269802ecf487ff73104',ramdisk_id='',reservation_id='r-el3udybd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-5222591',owner_user_name='tempest-TestShelveInstance-5222591-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:16:54Z,user_data=None,user_id='b81e5ce5d2414980a506d0f3b37d0d5c',uuid=c7e1f470-fe8a-455e-aa0b-0d2475957fc0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f90a627-4dab-4a2a-a2c2-eaae2910b379", "address": "fa:16:3e:e2:65:cb", "network": {"id": "9f0b7c66-0d95-4c5f-8c77-6f12228c20fc", "bridge": "br-int", "label": "tempest-TestShelveInstance-940455626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6be95e5c8d94269802ecf487ff73104", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f90a627-4d", "ovs_interfaceid": "0f90a627-4dab-4a2a-a2c2-eaae2910b379", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82479) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 00:17:00 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Converting VIF {"id": "0f90a627-4dab-4a2a-a2c2-eaae2910b379", "address": "fa:16:3e:e2:65:cb", "network": {"id": "9f0b7c66-0d95-4c5f-8c77-6f12228c20fc", "bridge": "br-int", "label": "tempest-TestShelveInstance-940455626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6be95e5c8d94269802ecf487ff73104", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f90a627-4d", "ovs_interfaceid": "0f90a627-4dab-4a2a-a2c2-eaae2910b379", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:17:00 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:65:cb,bridge_name='br-int',has_traffic_filtering=True,id=0f90a627-4dab-4a2a-a2c2-eaae2910b379,network=Network(9f0b7c66-0d95-4c5f-8c77-6f12228c20fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f90a627-4d') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:17:00 user nova-compute[82479]: DEBUG nova.objects.instance [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lazy-loading 'pci_devices' on Instance uuid c7e1f470-fe8a-455e-aa0b-0d2475957fc0 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:17:00 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] End _get_guest_xml xml=<domain type="kvm">
Apr 14 00:17:00 user nova-compute[82479]:   <uuid>c7e1f470-fe8a-455e-aa0b-0d2475957fc0</uuid>
Apr 14 00:17:00 user nova-compute[82479]:   <name>instance-0000001c</name>
Apr 14 00:17:00 user nova-compute[82479]:   <memory>131072</memory>
Apr 14 00:17:00 user nova-compute[82479]:   <vcpu>1</vcpu>
Apr 14 00:17:00 user nova-compute[82479]:   <metadata>
Apr 14 00:17:00 user nova-compute[82479]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 00:17:00 user nova-compute[82479]:       <nova:package version="0.0.0"/>
Apr 14 00:17:00 user nova-compute[82479]:       <nova:name>tempest-TestShelveInstance-server-454867915</nova:name>
Apr 14 00:17:00 user nova-compute[82479]:       <nova:creationTime>2023-04-14 00:16:58</nova:creationTime>
Apr 14 00:17:00 user nova-compute[82479]:       <nova:flavor name="m1.nano">
Apr 14 00:17:00 user nova-compute[82479]:         <nova:memory>128</nova:memory>
Apr 14 00:17:00 user nova-compute[82479]:         <nova:disk>1</nova:disk>
Apr 14 00:17:00 user nova-compute[82479]:         <nova:swap>0</nova:swap>
Apr 14 00:17:00 user nova-compute[82479]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 00:17:00 user nova-compute[82479]:         <nova:vcpus>1</nova:vcpus>
Apr 14 00:17:00 user nova-compute[82479]:       </nova:flavor>
Apr 14 00:17:00 user nova-compute[82479]:       <nova:owner>
Apr 14 00:17:00 user nova-compute[82479]:         <nova:user uuid="b81e5ce5d2414980a506d0f3b37d0d5c">tempest-TestShelveInstance-5222591-project-member</nova:user>
Apr 14 00:17:00 user nova-compute[82479]:         <nova:project uuid="e6be95e5c8d94269802ecf487ff73104">tempest-TestShelveInstance-5222591</nova:project>
Apr 14 00:17:00 user nova-compute[82479]:       </nova:owner>
Apr 14 00:17:00 user nova-compute[82479]:       <nova:ports>
Apr 14 00:17:00 user nova-compute[82479]:         <nova:port uuid="0f90a627-4dab-4a2a-a2c2-eaae2910b379">
Apr 14 00:17:00 user nova-compute[82479]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 14 00:17:00 user nova-compute[82479]:         </nova:port>
Apr 14 00:17:00 user nova-compute[82479]:       </nova:ports>
Apr 14 00:17:00 user nova-compute[82479]:     </nova:instance>
Apr 14 00:17:00 user nova-compute[82479]:   </metadata>
Apr 14 00:17:00 user nova-compute[82479]:   <sysinfo type="smbios">
Apr 14 00:17:00 user nova-compute[82479]:     <system>
Apr 14 00:17:00 user nova-compute[82479]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 00:17:00 user nova-compute[82479]:       <entry name="product">OpenStack Nova</entry>
Apr 14 00:17:00 user nova-compute[82479]:       <entry name="version">0.0.0</entry>
Apr 14 00:17:00 user nova-compute[82479]:       <entry name="serial">c7e1f470-fe8a-455e-aa0b-0d2475957fc0</entry>
Apr 14 00:17:00 user nova-compute[82479]:       <entry name="uuid">c7e1f470-fe8a-455e-aa0b-0d2475957fc0</entry>
Apr 14 00:17:00 user nova-compute[82479]:       <entry name="family">Virtual Machine</entry>
Apr 14 00:17:00 user nova-compute[82479]:     </system>
Apr 14 00:17:00 user nova-compute[82479]:   </sysinfo>
Apr 14 00:17:00 user nova-compute[82479]:   <os>
Apr 14 00:17:00 user nova-compute[82479]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 00:17:00 user nova-compute[82479]:     <boot dev="hd"/>
Apr 14 00:17:00 user nova-compute[82479]:     <smbios mode="sysinfo"/>
Apr 14 00:17:00 user nova-compute[82479]:   </os>
Apr 14 00:17:00 user nova-compute[82479]:   <features>
Apr 14 00:17:00 user nova-compute[82479]:     <acpi/>
Apr 14 00:17:00 user nova-compute[82479]:     <apic/>
Apr 14 00:17:00 user nova-compute[82479]:     <vmcoreinfo/>
Apr 14 00:17:00 user nova-compute[82479]:   </features>
Apr 14 00:17:00 user nova-compute[82479]:   <clock offset="utc">
Apr 14 00:17:00 user nova-compute[82479]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 00:17:00 user nova-compute[82479]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 00:17:00 user nova-compute[82479]:     <timer name="hpet" present="no"/>
Apr 14 00:17:00 user nova-compute[82479]:   </clock>
Apr 14 00:17:00 user nova-compute[82479]:   <cpu mode="custom" match="exact">
Apr 14 00:17:00 user nova-compute[82479]:     <model>Nehalem</model>
Apr 14 00:17:00 user nova-compute[82479]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 00:17:00 user nova-compute[82479]:   </cpu>
Apr 14 00:17:00 user nova-compute[82479]:   <devices>
Apr 14 00:17:00 user nova-compute[82479]:     <disk type="block" device="disk">
Apr 14 00:17:00 user nova-compute[82479]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:17:00 user nova-compute[82479]:       <source dev="/dev/sdd"/>
Apr 14 00:17:00 user nova-compute[82479]:       <target dev="vda" bus="virtio"/>
Apr 14 00:17:00 user nova-compute[82479]:       <serial>69599ada-93d4-425a-ae12-e52cafcc29f7</serial>
Apr 14 00:17:00 user nova-compute[82479]:     </disk>
Apr 14 00:17:00 user nova-compute[82479]:     <interface type="ethernet">
Apr 14 00:17:00 user nova-compute[82479]:       <mac address="fa:16:3e:e2:65:cb"/>
Apr 14 00:17:00 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:17:00 user nova-compute[82479]:       <mtu size="1442"/>
Apr 14 00:17:00 user nova-compute[82479]:       <target dev="tap0f90a627-4d"/>
Apr 14 00:17:00 user nova-compute[82479]:     </interface>
Apr 14 00:17:00 user nova-compute[82479]:     <serial type="pty">
Apr 14 00:17:00 user nova-compute[82479]:       <log file="/opt/stack/data/nova/instances/c7e1f470-fe8a-455e-aa0b-0d2475957fc0/console.log" append="off"/>
Apr 14 00:17:00 user nova-compute[82479]:     </serial>
Apr 14 00:17:00 user nova-compute[82479]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 00:17:00 user nova-compute[82479]:     <video>
Apr 14 00:17:00 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:17:00 user nova-compute[82479]:     </video>
Apr 14 00:17:00 user nova-compute[82479]:     <rng model="virtio">
Apr 14 00:17:00 user nova-compute[82479]:       <backend model="random">/dev/urandom</backend>
Apr 14 00:17:00 user nova-compute[82479]:     </rng>
Apr 14 00:17:00 user nova-compute[82479]:     <controller type="usb" index="0" model="none"/>
Apr 14 00:17:00 user nova-compute[82479]:     <memballoon model="virtio">
Apr 14 00:17:00 user nova-compute[82479]:       <stats period="10"/>
Apr 14 00:17:00 user nova-compute[82479]:     </memballoon>
Apr 14 00:17:00 user nova-compute[82479]:   </devices>
Apr 14 00:17:00 user nova-compute[82479]: </domain>
Apr 14 00:17:00 user nova-compute[82479]:  {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 00:17:00 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:16:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-454867915',display_name='tempest-TestShelveInstance-server-454867915',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-454867915',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC+PTdQ169W4Ik0XJKAX1vms0H6bKP2Yz2If5eK4IKeWDFl4zKDtIms+QmK6CN9t818K0haZCxWGM5VZYA/HUy2ewr54rCodMDtSTJaDzyD+lhV417bVgrES1KaG3eBq0w==',key_name='tempest-TestShelveInstance-266505447',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6be95e5c8d94269802ecf487ff73104',ramdisk_id='',reservation_id='r-el3udybd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-5222591',owner_user_name='tempest-TestShelveInstance-5222591-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:16:54Z,user_data=None,user_id='b81e5ce5d2414980a506d0f3b37d0d5c',uuid=c7e1f470-fe8a-455e-aa0b-0d2475957fc0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f90a627-4dab-4a2a-a2c2-eaae2910b379", "address": "fa:16:3e:e2:65:cb", "network": {"id": "9f0b7c66-0d95-4c5f-8c77-6f12228c20fc", "bridge": "br-int", "label": "tempest-TestShelveInstance-940455626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6be95e5c8d94269802ecf487ff73104", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f90a627-4d", "ovs_interfaceid": "0f90a627-4dab-4a2a-a2c2-eaae2910b379", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 00:17:00 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Converting VIF {"id": "0f90a627-4dab-4a2a-a2c2-eaae2910b379", "address": "fa:16:3e:e2:65:cb", "network": {"id": "9f0b7c66-0d95-4c5f-8c77-6f12228c20fc", "bridge": "br-int", "label": "tempest-TestShelveInstance-940455626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6be95e5c8d94269802ecf487ff73104", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f90a627-4d", "ovs_interfaceid": "0f90a627-4dab-4a2a-a2c2-eaae2910b379", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:17:00 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:65:cb,bridge_name='br-int',has_traffic_filtering=True,id=0f90a627-4dab-4a2a-a2c2-eaae2910b379,network=Network(9f0b7c66-0d95-4c5f-8c77-6f12228c20fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f90a627-4d') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:17:00 user nova-compute[82479]: DEBUG os_vif [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:65:cb,bridge_name='br-int',has_traffic_filtering=True,id=0f90a627-4dab-4a2a-a2c2-eaae2910b379,network=Network(9f0b7c66-0d95-4c5f-8c77-6f12228c20fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f90a627-4d') {{(pid=82479) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 00:17:00 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:17:00 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:17:00 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 00:17:00 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:17:00 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0f90a627-4d, may_exist=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:17:00 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0f90a627-4d, col_values=(('external_ids', {'iface-id': '0f90a627-4dab-4a2a-a2c2-eaae2910b379', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:65:cb', 'vm-uuid': 'c7e1f470-fe8a-455e-aa0b-0d2475957fc0'}),)) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:17:00 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:17:00 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:17:00 user nova-compute[82479]: INFO os_vif [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:65:cb,bridge_name='br-int',has_traffic_filtering=True,id=0f90a627-4dab-4a2a-a2c2-eaae2910b379,network=Network(9f0b7c66-0d95-4c5f-8c77-6f12228c20fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f90a627-4d')
Apr 14 00:17:00 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:17:00 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] No VIF found with MAC fa:16:3e:e2:65:cb, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:17:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:17:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:17:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:17:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:17:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:17:01 user nova-compute[82479]: DEBUG nova.compute.manager [req-aef13de5-68a6-4a99-b88a-0d74ee6c2c72 req-d8e853dc-a447-41e8-b27b-c15d8e40eafa service nova] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Received event network-vif-plugged-0f90a627-4dab-4a2a-a2c2-eaae2910b379 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:17:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-aef13de5-68a6-4a99-b88a-0d74ee6c2c72 req-d8e853dc-a447-41e8-b27b-c15d8e40eafa service nova] Acquiring lock "c7e1f470-fe8a-455e-aa0b-0d2475957fc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:17:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-aef13de5-68a6-4a99-b88a-0d74ee6c2c72 req-d8e853dc-a447-41e8-b27b-c15d8e40eafa service nova] Lock "c7e1f470-fe8a-455e-aa0b-0d2475957fc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:17:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-aef13de5-68a6-4a99-b88a-0d74ee6c2c72 req-d8e853dc-a447-41e8-b27b-c15d8e40eafa service nova] Lock "c7e1f470-fe8a-455e-aa0b-0d2475957fc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:17:01 user nova-compute[82479]: DEBUG nova.compute.manager [req-aef13de5-68a6-4a99-b88a-0d74ee6c2c72 req-d8e853dc-a447-41e8-b27b-c15d8e40eafa service nova] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] No waiting events found dispatching network-vif-plugged-0f90a627-4dab-4a2a-a2c2-eaae2910b379 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:17:01 user nova-compute[82479]: WARNING nova.compute.manager [req-aef13de5-68a6-4a99-b88a-0d74ee6c2c72 req-d8e853dc-a447-41e8-b27b-c15d8e40eafa service nova] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Received unexpected event network-vif-plugged-0f90a627-4dab-4a2a-a2c2-eaae2910b379 for instance with vm_state building and task_state spawning.
Apr 14 00:17:02 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:17:02 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:17:02 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:17:02 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:17:03 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681431423.658949, c7e1f470-fe8a-455e-aa0b-0d2475957fc0 => Resumed> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:17:03 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] VM Resumed (Lifecycle Event)
Apr 14 00:17:03 user nova-compute[82479]: DEBUG nova.compute.manager [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Instance event wait completed in 0 seconds for  {{(pid=82479) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 00:17:03 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Guest created on hypervisor {{(pid=82479) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 00:17:03 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Instance spawned successfully.
Apr 14 00:17:03 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 00:17:03 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:17:03 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:17:03 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Found default for hw_cdrom_bus of ide {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:17:03 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Found default for hw_disk_bus of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:17:03 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Found default for hw_input_bus of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:17:03 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Found default for hw_pointer_model of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:17:03 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Found default for hw_video_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:17:03 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Found default for hw_vif_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:17:03 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:17:03 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681431423.664414, c7e1f470-fe8a-455e-aa0b-0d2475957fc0 => Started> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:17:03 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] VM Started (Lifecycle Event)
Apr 14 00:17:03 user nova-compute[82479]: DEBUG nova.compute.manager [req-f7dc6306-ed4e-4daf-9737-a20ee7e0f71c req-dfd4952a-60ab-4b04-a4b9-9972bf70ba80 service nova] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Received event network-vif-plugged-0f90a627-4dab-4a2a-a2c2-eaae2910b379 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:17:03 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-f7dc6306-ed4e-4daf-9737-a20ee7e0f71c req-dfd4952a-60ab-4b04-a4b9-9972bf70ba80 service nova] Acquiring lock "c7e1f470-fe8a-455e-aa0b-0d2475957fc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:17:03 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-f7dc6306-ed4e-4daf-9737-a20ee7e0f71c req-dfd4952a-60ab-4b04-a4b9-9972bf70ba80 service nova] Lock "c7e1f470-fe8a-455e-aa0b-0d2475957fc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:17:03 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-f7dc6306-ed4e-4daf-9737-a20ee7e0f71c req-dfd4952a-60ab-4b04-a4b9-9972bf70ba80 service nova] Lock "c7e1f470-fe8a-455e-aa0b-0d2475957fc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:17:03 user nova-compute[82479]: DEBUG nova.compute.manager [req-f7dc6306-ed4e-4daf-9737-a20ee7e0f71c req-dfd4952a-60ab-4b04-a4b9-9972bf70ba80 service nova] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] No waiting events found dispatching network-vif-plugged-0f90a627-4dab-4a2a-a2c2-eaae2910b379 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:17:03 user nova-compute[82479]: WARNING nova.compute.manager [req-f7dc6306-ed4e-4daf-9737-a20ee7e0f71c req-dfd4952a-60ab-4b04-a4b9-9972bf70ba80 service nova] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Received unexpected event network-vif-plugged-0f90a627-4dab-4a2a-a2c2-eaae2910b379 for instance with vm_state building and task_state spawning.
Apr 14 00:17:03 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:17:03 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:17:03 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:17:03 user nova-compute[82479]: INFO nova.compute.manager [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Took 5.14 seconds to spawn the instance on the hypervisor.
Apr 14 00:17:03 user nova-compute[82479]: DEBUG nova.compute.manager [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:17:03 user nova-compute[82479]: INFO nova.compute.manager [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Took 10.63 seconds to build instance.
Apr 14 00:17:03 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "c7e1f470-fe8a-455e-aa0b-0d2475957fc0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.724s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:17:04 user nova-compute[82479]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681431409.8833132, e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8 => Stopped> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:17:04 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] VM Stopped (Lifecycle Event)
Apr 14 00:17:04 user nova-compute[82479]: DEBUG nova.compute.manager [None req-e4de380a-1edb-462a-9bee-d8371cdf5a32 None None] [instance: e4f7f06c-1c1b-408b-bfb1-9015a3ef2de8] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:17:05 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:17:06 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:17:10 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:17:11 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:17:14 user nova-compute[82479]: DEBUG nova.compute.manager [req-5ed65a6f-7672-4c7a-9bbe-e8ee907362c5 req-75863d39-2a63-43b2-ae1d-bcecc587e194 service nova] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Received event network-changed-7c1bd582-678f-4d5e-9f6e-e60edd6f037b {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:17:14 user nova-compute[82479]: DEBUG nova.compute.manager [req-5ed65a6f-7672-4c7a-9bbe-e8ee907362c5 req-75863d39-2a63-43b2-ae1d-bcecc587e194 service nova] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Refreshing instance network info cache due to event network-changed-7c1bd582-678f-4d5e-9f6e-e60edd6f037b. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:17:14 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-5ed65a6f-7672-4c7a-9bbe-e8ee907362c5 req-75863d39-2a63-43b2-ae1d-bcecc587e194 service nova] Acquiring lock "refresh_cache-1cfe388b-396b-4ce9-97aa-9049cbcb32f4" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:17:14 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-5ed65a6f-7672-4c7a-9bbe-e8ee907362c5 req-75863d39-2a63-43b2-ae1d-bcecc587e194 service nova] Acquired lock "refresh_cache-1cfe388b-396b-4ce9-97aa-9049cbcb32f4" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:17:14 user nova-compute[82479]: DEBUG nova.network.neutron [req-5ed65a6f-7672-4c7a-9bbe-e8ee907362c5 req-75863d39-2a63-43b2-ae1d-bcecc587e194 service nova] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Refreshing network info cache for port 7c1bd582-678f-4d5e-9f6e-e60edd6f037b {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:17:15 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:17:15 user nova-compute[82479]: DEBUG nova.network.neutron [req-5ed65a6f-7672-4c7a-9bbe-e8ee907362c5 req-75863d39-2a63-43b2-ae1d-bcecc587e194 service nova] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Updated VIF entry in instance network info cache for port 7c1bd582-678f-4d5e-9f6e-e60edd6f037b. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:17:15 user nova-compute[82479]: DEBUG nova.network.neutron [req-5ed65a6f-7672-4c7a-9bbe-e8ee907362c5 req-75863d39-2a63-43b2-ae1d-bcecc587e194 service nova] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Updating instance_info_cache with network_info: [{"id": "7c1bd582-678f-4d5e-9f6e-e60edd6f037b", "address": "fa:16:3e:58:24:c8", "network": {"id": "368d9445-850e-4f74-b5cc-86d1eaa95d63", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374332689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec1aab0338ff4bd195a37a4199a378eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c1bd582-67", "ovs_interfaceid": "7c1bd582-678f-4d5e-9f6e-e60edd6f037b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:17:15 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-5ed65a6f-7672-4c7a-9bbe-e8ee907362c5 req-75863d39-2a63-43b2-ae1d-bcecc587e194 service nova] Releasing lock "refresh_cache-1cfe388b-396b-4ce9-97aa-9049cbcb32f4" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:17:16 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:17:16 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "13a94e92-54cf-49b7-ae71-32b3c48df332" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:17:16 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "13a94e92-54cf-49b7-ae71-32b3c48df332" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:17:16 user nova-compute[82479]: DEBUG nova.compute.manager [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Starting instance... {{(pid=82479) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 00:17:16 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:17:16 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:17:16 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82479) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 00:17:16 user nova-compute[82479]: INFO nova.compute.claims [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Claim successful on node user
Apr 14 00:17:16 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:17:16 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:17:16 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.409s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:17:16 user nova-compute[82479]: DEBUG nova.compute.manager [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Start building networks asynchronously for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 00:17:17 user nova-compute[82479]: DEBUG nova.compute.manager [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Allocating IP information in the background. {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 00:17:17 user nova-compute[82479]: DEBUG nova.network.neutron [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] allocate_for_instance() {{(pid=82479) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 00:17:17 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 00:17:17 user nova-compute[82479]: DEBUG nova.compute.manager [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Start building block device mappings for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 00:17:17 user nova-compute[82479]: INFO nova.virt.block_device [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Booting with volume-backed-image 6db62068-7278-4cd8-b41f-d0140d89e199 at /dev/vda
Apr 14 00:17:17 user nova-compute[82479]: DEBUG nova.policy [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '90bad96535c3453792982c5acab9dbc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3f111e24414976beddba7ef90c4793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82479) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 00:17:17 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-11abbb7d-b787-4238-8274-e10babab4fd8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "1cfe388b-396b-4ce9-97aa-9049cbcb32f4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:17:17 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-11abbb7d-b787-4238-8274-e10babab4fd8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "1cfe388b-396b-4ce9-97aa-9049cbcb32f4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:17:17 user nova-compute[82479]: DEBUG nova.objects.instance [None req-11abbb7d-b787-4238-8274-e10babab4fd8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lazy-loading 'flavor' on Instance uuid 1cfe388b-396b-4ce9-97aa-9049cbcb32f4 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:17:17 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-11abbb7d-b787-4238-8274-e10babab4fd8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "1cfe388b-396b-4ce9-97aa-9049cbcb32f4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:17:17 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-11abbb7d-b787-4238-8274-e10babab4fd8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "1cfe388b-396b-4ce9-97aa-9049cbcb32f4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:17:17 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-11abbb7d-b787-4238-8274-e10babab4fd8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "1cfe388b-396b-4ce9-97aa-9049cbcb32f4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:17:17 user nova-compute[82479]: INFO nova.compute.manager [None req-11abbb7d-b787-4238-8274-e10babab4fd8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Attaching volume 89a24f9a-783f-4d14-8413-4fb61263665e to /dev/vdb
Apr 14 00:17:17 user nova-compute[82479]: DEBUG os_brick.utils [None req-11abbb7d-b787-4238-8274-e10babab4fd8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:17:17 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:17 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:17 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[495466cc-a364-42d5-a33b-b823ef506a85]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fec92fcfdd3\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:17:17 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:17 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:17 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec7bda6-8481-4d1c-8cba-9ef2a24c62f5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:17:17 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:17 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:17 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a4199f-daa2-4a8a-bc02-12ba3866bf0e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:17:17 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[305bc192-65cc-4f59-9770-4f4b89c122c0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:17:17 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-11abbb7d-b787-4238-8274-e10babab4fd8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Running cmd (subprocess): nvme version {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:17 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-11abbb7d-b787-4238-8274-e10babab4fd8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] 'nvme version' failed. Not Retrying. {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:17:17 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.nvmeof [None req-11abbb7d-b787-4238-8274-e10babab4fd8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] nvme not present on system {{(pid=82479) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 00:17:17 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:17 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:17:17 user nova-compute[82479]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 00:17:17 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb3b8db-8160-4c64-8bef-94f023021d01]: (4, '') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:17:17 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-11abbb7d-b787-4238-8274-e10babab4fd8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82479) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 00:17:17 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-11abbb7d-b787-4238-8274-e10babab4fd8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 00:17:17 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-11abbb7d-b787-4238-8274-e10babab4fd8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] LIGHTOS: no hostnqn found. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 00:17:17 user nova-compute[82479]: DEBUG os_brick.utils [None req-11abbb7d-b787-4238-8274-e10babab4fd8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fec92fcfdd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:17:17 user nova-compute[82479]: DEBUG nova.virt.block_device [None req-11abbb7d-b787-4238-8274-e10babab4fd8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Updating existing volume attachment record: bc4f1100-cf47-442c-a1d6-2c5f41524bc6 {{(pid=82479) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 00:17:18 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:17:18 user nova-compute[82479]: DEBUG nova.network.neutron [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Successfully created port: 4788878b-ac88-49ff-a42d-df57ef410442 {{(pid=82479) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 00:17:19 user nova-compute[82479]: DEBUG nova.network.neutron [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Successfully updated port: 4788878b-ac88-49ff-a42d-df57ef410442 {{(pid=82479) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 00:17:19 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "refresh_cache-13a94e92-54cf-49b7-ae71-32b3c48df332" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:17:19 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquired lock "refresh_cache-13a94e92-54cf-49b7-ae71-32b3c48df332" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:17:19 user nova-compute[82479]: DEBUG nova.network.neutron [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 00:17:19 user nova-compute[82479]: DEBUG nova.compute.manager [req-08cb897a-8c5d-4678-b2cf-3036ae72f2d1 req-4396d430-01ce-41c6-9aba-c9d929b80211 service nova] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Received event network-changed-4788878b-ac88-49ff-a42d-df57ef410442 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:17:19 user nova-compute[82479]: DEBUG nova.compute.manager [req-08cb897a-8c5d-4678-b2cf-3036ae72f2d1 req-4396d430-01ce-41c6-9aba-c9d929b80211 service nova] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Refreshing instance network info cache due to event network-changed-4788878b-ac88-49ff-a42d-df57ef410442. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:17:19 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-08cb897a-8c5d-4678-b2cf-3036ae72f2d1 req-4396d430-01ce-41c6-9aba-c9d929b80211 service nova] Acquiring lock "refresh_cache-13a94e92-54cf-49b7-ae71-32b3c48df332" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:17:19 user nova-compute[82479]: DEBUG nova.network.neutron [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Instance cache missing network info. {{(pid=82479) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 00:17:19 user nova-compute[82479]: DEBUG nova.network.neutron [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Updating instance_info_cache with network_info: [{"id": "4788878b-ac88-49ff-a42d-df57ef410442", "address": "fa:16:3e:97:9a:e9", "network": {"id": "491696ea-38ef-4c19-9d94-a61223c1fa00", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1323121698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3f111e24414976beddba7ef90c4793", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4788878b-ac", "ovs_interfaceid": "4788878b-ac88-49ff-a42d-df57ef410442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:17:19 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Releasing lock "refresh_cache-13a94e92-54cf-49b7-ae71-32b3c48df332" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:17:19 user nova-compute[82479]: DEBUG nova.compute.manager [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Instance network_info: |[{"id": "4788878b-ac88-49ff-a42d-df57ef410442", "address": "fa:16:3e:97:9a:e9", "network": {"id": "491696ea-38ef-4c19-9d94-a61223c1fa00", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1323121698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3f111e24414976beddba7ef90c4793", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4788878b-ac", "ovs_interfaceid": "4788878b-ac88-49ff-a42d-df57ef410442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 00:17:19 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-08cb897a-8c5d-4678-b2cf-3036ae72f2d1 req-4396d430-01ce-41c6-9aba-c9d929b80211 service nova] Acquired lock "refresh_cache-13a94e92-54cf-49b7-ae71-32b3c48df332" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:17:19 user nova-compute[82479]: DEBUG nova.network.neutron [req-08cb897a-8c5d-4678-b2cf-3036ae72f2d1 req-4396d430-01ce-41c6-9aba-c9d929b80211 service nova] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Refreshing network info cache for port 4788878b-ac88-49ff-a42d-df57ef410442 {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:17:20 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:17:20 user nova-compute[82479]: DEBUG nova.network.neutron [req-08cb897a-8c5d-4678-b2cf-3036ae72f2d1 req-4396d430-01ce-41c6-9aba-c9d929b80211 service nova] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Updated VIF entry in instance network info cache for port 4788878b-ac88-49ff-a42d-df57ef410442. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:17:20 user nova-compute[82479]: DEBUG nova.network.neutron [req-08cb897a-8c5d-4678-b2cf-3036ae72f2d1 req-4396d430-01ce-41c6-9aba-c9d929b80211 service nova] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Updating instance_info_cache with network_info: [{"id": "4788878b-ac88-49ff-a42d-df57ef410442", "address": "fa:16:3e:97:9a:e9", "network": {"id": "491696ea-38ef-4c19-9d94-a61223c1fa00", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1323121698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3f111e24414976beddba7ef90c4793", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4788878b-ac", "ovs_interfaceid": "4788878b-ac88-49ff-a42d-df57ef410442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:17:20 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-08cb897a-8c5d-4678-b2cf-3036ae72f2d1 req-4396d430-01ce-41c6-9aba-c9d929b80211 service nova] Releasing lock "refresh_cache-13a94e92-54cf-49b7-ae71-32b3c48df332" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:17:21 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:17:22 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11abbb7d-b787-4238-8274-e10babab4fd8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Calling os-brick to attach iSCSI Volume {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 00:17:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-11abbb7d-b787-4238-8274-e10babab4fd8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qzxBPYXt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:17:22 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-11abbb7d-b787-4238-8274-e10babab4fd8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:17:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-11abbb7d-b787-4238-8274-e10babab4fd8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:17:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-11abbb7d-b787-4238-8274-e10babab4fd8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:17:22 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-11abbb7d-b787-4238-8274-e10babab4fd8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:17:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-11abbb7d-b787-4238-8274-e10babab4fd8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:17:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-11abbb7d-b787-4238-8274-e10babab4fd8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:17:22 user nova-compute[82479]: INFO os_brick.initiator.connectors.iscsi [None req-11abbb7d-b787-4238-8274-e10babab4fd8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 00:17:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e -p 172.16.0.220:3260 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:22 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb20f90-d716-4934-b03e-151c46e270f4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:17:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-11abbb7d-b787-4238-8274-e10babab4fd8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 00:17:22 user nova-compute[82479]:  {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:17:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e -p 172.16.0.220:3260 --interface default --op new {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:22 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[c837884a-069e-4e1c-9c9a-064e2e2b7d27]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e] added\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:17:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-11abbb7d-b787-4238-8274-e10babab4fd8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e] added
Apr 14 00:17:22 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:17:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:22 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[e506fe11-f24a-4fe5-abe1-e0a76854a8a3]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:17:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-11abbb7d-b787-4238-8274-e10babab4fd8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:17:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:22 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ad72d4-52d3-4def-ae80-e80584135598]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:17:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-11abbb7d-b787-4238-8274-e10babab4fd8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:17:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qzxBPYXt {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qzxBPYXt" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:22 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec7c19e-5f36-487f-b305-edd6f74a880a]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:17:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-11abbb7d-b787-4238-8274-e10babab4fd8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qzxBPYXt'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:17:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:22 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff639f64-88b1-4009-ab6f-a047d4f52e7d]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:17:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-11abbb7d-b787-4238-8274-e10babab4fd8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:17:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:22 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e6bf8f9-7154-47ac-a789-c5765cefcd99]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:17:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-11abbb7d-b787-4238-8274-e10babab4fd8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:17:22 user nova-compute[82479]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e (non-flash)
Apr 14 00:17:22 user nova-compute[82479]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 (non-flash)
Apr 14 00:17:22 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:17:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-11abbb7d-b787-4238-8274-e10babab4fd8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:17:22 user nova-compute[82479]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e (non-flash)
Apr 14 00:17:22 user nova-compute[82479]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 (non-flash)
Apr 14 00:17:22 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:17:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e -p 172.16.0.220:3260 --login {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:22 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a8fca4d-f32f-431a-8e99-4e45aff0f6e8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:17:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-11abbb7d-b787-4238-8274-e10babab4fd8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e, portal: 172.16.0.220,3260]
Apr 14 00:17:22 user nova-compute[82479]: Login to [iface: default, target: iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e, portal: 172.16.0.220,3260] successful.
Apr 14 00:17:22 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:17:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:22 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ae68f5-2fe6-4835-a2bd-7f01751eef7f]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:17:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-11abbb7d-b787-4238-8274-e10babab4fd8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:17:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:22 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c8e876-896d-45ee-87a6-c7dbb68872a3]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:17:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-11abbb7d-b787-4238-8274-e10babab4fd8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:17:22 user nova-compute[82479]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e (non-flash)
Apr 14 00:17:22 user nova-compute[82479]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 (non-flash)
Apr 14 00:17:22 user nova-compute[82479]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e (non-flash)
Apr 14 00:17:22 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:17:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-11abbb7d-b787-4238-8274-e10babab4fd8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:17:22 user nova-compute[82479]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e (non-flash)
Apr 14 00:17:22 user nova-compute[82479]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 (non-flash)
Apr 14 00:17:22 user nova-compute[82479]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e (non-flash)
Apr 14 00:17:22 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:17:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-11abbb7d-b787-4238-8274-e10babab4fd8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:17:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-11abbb7d-b787-4238-8274-e10babab4fd8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Connected to 172.16.0.220:3260 {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 00:17:22 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-11abbb7d-b787-4238-8274-e10babab4fd8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] HCTL ('36', '-', '-', 0) found on session 28 with lun 0 {{(pid=82479) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 00:17:22 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-11abbb7d-b787-4238-8274-e10babab4fd8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=82479) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 00:17:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:22 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[42cf6c38-c3e0-4724-be3d-b96f3b3fb220]: (4, ('- - 0', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:17:22 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-11abbb7d-b787-4238-8274-e10babab4fd8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Searching for a device in session 28 and hctl ['36', '*', '*', 0] yield: None {{(pid=82479) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 00:17:22 user nova-compute[82479]: DEBUG os_brick.utils [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:17:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:22 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e02d83-1d6a-4726-860d-c1af9e5d377f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fec92fcfdd3\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:17:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:22 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a4a83f-37be-4f73-9dd3-8ff4a7b35ef2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:17:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:22 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[091e866b-5b84-4991-9ae6-cc093ad4f72d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:17:23 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[a67f1235-cfda-4288-953e-1935c6761df6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:17:23 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Running cmd (subprocess): nvme version {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:23 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] 'nvme version' failed. Not Retrying. {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:17:23 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] nvme not present on system {{(pid=82479) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 00:17:23 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:23 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:17:23 user nova-compute[82479]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 00:17:23 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[3afa67b0-0bb4-4d86-affb-33b498a907a9]: (4, '') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:17:23 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82479) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 00:17:23 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 00:17:23 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] LIGHTOS: no hostnqn found. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 00:17:23 user nova-compute[82479]: DEBUG os_brick.utils [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fec92fcfdd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:17:23 user nova-compute[82479]: DEBUG nova.virt.block_device [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Updating existing volume attachment record: 9e5814ce-b181-44ee-877c-53333941f6ac {{(pid=82479) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 00:17:23 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-11abbb7d-b787-4238-8274-e10babab4fd8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Searching for a device in session 28 and hctl ['36', '*', '*', 0] yield: sde {{(pid=82479) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 00:17:23 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-11abbb7d-b787-4238-8274-e10babab4fd8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qzxBPYXt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 00:17:23 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-11abbb7d-b787-4238-8274-e10babab4fd8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:17:23 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-11abbb7d-b787-4238-8274-e10babab4fd8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '26664353764633864', 'path': '/dev/sde'} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:17:23 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11abbb7d-b787-4238-8274-e10babab4fd8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26664353764633864', 'path': '/dev/sde'} {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 00:17:23 user nova-compute[82479]: DEBUG nova.objects.instance [None req-11abbb7d-b787-4238-8274-e10babab4fd8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lazy-loading 'flavor' on Instance uuid 1cfe388b-396b-4ce9-97aa-9049cbcb32f4 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:17:23 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-11abbb7d-b787-4238-8274-e10babab4fd8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 00:17:23 user nova-compute[82479]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:17:23 user nova-compute[82479]:   <source dev="/dev/sde"/>
Apr 14 00:17:23 user nova-compute[82479]:   <target dev="vdb" bus="virtio"/>
Apr 14 00:17:23 user nova-compute[82479]:   <serial>89a24f9a-783f-4d14-8413-4fb61263665e</serial>
Apr 14 00:17:23 user nova-compute[82479]: </disk>
Apr 14 00:17:23 user nova-compute[82479]:  {{(pid=82479) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 00:17:24 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-11abbb7d-b787-4238-8274-e10babab4fd8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:17:24 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-11abbb7d-b787-4238-8274-e10babab4fd8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:17:24 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-11abbb7d-b787-4238-8274-e10babab4fd8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] No VIF found with MAC fa:16:3e:58:24:c8, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:17:24 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-11abbb7d-b787-4238-8274-e10babab4fd8 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "1cfe388b-396b-4ce9-97aa-9049cbcb32f4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.638s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:17:25 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:17:26 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:17:27 user nova-compute[82479]: DEBUG nova.compute.manager [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Start spawning the instance on the hypervisor. {{(pid=82479) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 00:17:27 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Creating instance directory {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 00:17:27 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Creating image(s)
Apr 14 00:17:27 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Did not create local disks {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 00:17:27 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Ensure instance console log exists: /opt/stack/data/nova/instances/13a94e92-54cf-49b7-ae71-32b3c48df332/console.log {{(pid=82479) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 00:17:27 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:17:27 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:17:27 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:17:27 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Start _get_guest_xml network_info=[{"id": "4788878b-ac88-49ff-a42d-df57ef410442", "address": "fa:16:3e:97:9a:e9", "network": {"id": "491696ea-38ef-4c19-9d94-a61223c1fa00", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1323121698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3f111e24414976beddba7ef90c4793", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4788878b-ac", "ovs_interfaceid": "4788878b-ac88-49ff-a42d-df57ef410442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': False, 'attachment_id': '9e5814ce-b181-44ee-877c-53333941f6ac', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NhaiJkPC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '13a94e92-54cf-49b7-ae71-32b3c48df332', 'attached_at': '', 'detached_at': '', 'volume_id': '2681b171-ba2b-44b0-8a6a-e89a52fafc99', 'serial': '2681b171-ba2b-44b0-8a6a-e89a52fafc99'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 00:17:27 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:17:27 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:17:27 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82479) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 00:17:27 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T00:02:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 00:17:27 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Flavor limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 00:17:27 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Image limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 00:17:27 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Flavor pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 00:17:27 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Image pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 00:17:27 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 00:17:27 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 00:17:27 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 00:17:27 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Got 1 possible topologies {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 00:17:27 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 00:17:27 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 00:17:27 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Calling os-brick to attach iSCSI Volume {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 00:17:27 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NhaiJkPC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:17:27 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:17:27 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:17:27 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:17:27 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:17:27 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:17:27 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:17:27 user nova-compute[82479]: INFO os_brick.initiator.connectors.iscsi [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 00:17:27 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 -p 172.16.0.220:3260 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:27 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:27 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[c935a69d-54ab-416c-b403-650a0a9fa949]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:17:27 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 00:17:27 user nova-compute[82479]:  {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:17:27 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 -p 172.16.0.220:3260 --interface default --op new {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:27 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:27 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98d20cd-3695-4ec4-a3a0-e65a5465f779]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99] added\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:17:27 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99] added
Apr 14 00:17:27 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:17:27 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:27 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:27 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe108c68-1985-4e2a-a2e1-825730434129]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:17:27 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:17:27 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:27 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:27 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[c643e62c-4d5e-4da0-898c-ed4ab6e03e00]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:17:27 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:17:27 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NhaiJkPC {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:27 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NhaiJkPC" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:27 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c89de2-eb7a-4468-8e42-0edd2b45ed66]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:17:27 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NhaiJkPC'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:17:27 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:27 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:27 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[57909ab0-7867-4362-a481-4c3ceb8f700f]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:17:27 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:17:27 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:27 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:27 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e113041-968e-41dc-8a98-c0c2af23ac6c]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:17:27 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:17:27 user nova-compute[82479]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e (non-flash)
Apr 14 00:17:27 user nova-compute[82479]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 (non-flash)
Apr 14 00:17:27 user nova-compute[82479]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e (non-flash)
Apr 14 00:17:27 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:17:27 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:17:27 user nova-compute[82479]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e (non-flash)
Apr 14 00:17:27 user nova-compute[82479]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 (non-flash)
Apr 14 00:17:27 user nova-compute[82479]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e (non-flash)
Apr 14 00:17:27 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:17:27 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 -p 172.16.0.220:3260 --login {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:27 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:27 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e225519-4128-4b56-962e-c3f299b4147e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:17:27 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99, portal: 172.16.0.220,3260]
Apr 14 00:17:27 user nova-compute[82479]: Login to [iface: default, target: iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99, portal: 172.16.0.220,3260] successful.
Apr 14 00:17:27 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:17:27 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:27 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:27 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b6ad56-27bc-4e7f-86a6-3672b57d77a0]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:17:27 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:17:27 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:27 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:27 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[7277ac61-d731-42c3-b98d-634f99b38c27]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:17:27 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:17:27 user nova-compute[82479]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e (non-flash)
Apr 14 00:17:27 user nova-compute[82479]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 (non-flash)
Apr 14 00:17:27 user nova-compute[82479]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e (non-flash)
Apr 14 00:17:27 user nova-compute[82479]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 (non-flash)
Apr 14 00:17:27 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:17:27 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:17:27 user nova-compute[82479]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e (non-flash)
Apr 14 00:17:27 user nova-compute[82479]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 (non-flash)
Apr 14 00:17:27 user nova-compute[82479]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e (non-flash)
Apr 14 00:17:27 user nova-compute[82479]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 (non-flash)
Apr 14 00:17:27 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:17:27 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:17:27 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Connected to 172.16.0.220:3260 {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 00:17:27 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] HCTL ('37', '-', '-', 0) found on session 29 with lun 0 {{(pid=82479) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 00:17:27 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=82479) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 00:17:27 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:27 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:27 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf56948-ce5c-47cf-b227-5a57606890f6]: (4, ('- - 0', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:17:27 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Searching for a device in session 29 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=82479) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 00:17:27 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NhaiJkPC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 00:17:28 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "1cfe388b-396b-4ce9-97aa-9049cbcb32f4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:17:28 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "1cfe388b-396b-4ce9-97aa-9049cbcb32f4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:17:28 user nova-compute[82479]: DEBUG nova.objects.instance [None req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lazy-loading 'flavor' on Instance uuid 1cfe388b-396b-4ce9-97aa-9049cbcb32f4 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:17:28 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "1cfe388b-396b-4ce9-97aa-9049cbcb32f4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:17:28 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "1cfe388b-396b-4ce9-97aa-9049cbcb32f4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:17:28 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "1cfe388b-396b-4ce9-97aa-9049cbcb32f4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:17:28 user nova-compute[82479]: INFO nova.compute.manager [None req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Attaching volume a7501233-eeb6-4ef4-8e07-4f0b28e2f902 to /dev/vdc
Apr 14 00:17:28 user nova-compute[82479]: DEBUG os_brick.utils [None req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:17:28 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:28 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:28 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a013de-eb4a-4c43-8a9c-01a1767a4f0d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fec92fcfdd3\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:17:28 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:28 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:28 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc28d36b-8b01-446d-aef4-6b957b3869ca]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:17:28 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:28 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:28 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f0c625-fc09-4bdc-b0e2-6e93a3a584d6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:17:28 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[e282f350-546d-43d0-a52a-24f1df301de5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:17:28 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Running cmd (subprocess): nvme version {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:28 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] 'nvme version' failed. Not Retrying. {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:17:28 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] nvme not present on system {{(pid=82479) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 00:17:28 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:28 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:17:28 user nova-compute[82479]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 00:17:28 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b305828-8cb8-445f-945a-ac07be8bc8de]: (4, '') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:17:28 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82479) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 00:17:28 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 00:17:28 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] LIGHTOS: no hostnqn found. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 00:17:28 user nova-compute[82479]: DEBUG os_brick.utils [None req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fec92fcfdd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:17:28 user nova-compute[82479]: DEBUG nova.virt.block_device [None req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Updating existing volume attachment record: 359c9192-9e2e-4708-b343-be97a3461fd8 {{(pid=82479) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 00:17:28 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:17:28 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '26236666663313066', 'path': '/dev/sdf'} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:17:28 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236666663313066', 'path': '/dev/sdf'} {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 00:17:28 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:17:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1831378742',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1831378742',id=29,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba3f111e24414976beddba7ef90c4793',ramdisk_id='',reservation_id='r-ba0cm12p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1545234843',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:17:17Z,user_data=None,user_id='90bad96535c3453792982c5acab9dbc6',uuid=13a94e92-54cf-49b7-ae71-32b3c48df332,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4788878b-ac88-49ff-a42d-df57ef410442", "address": "fa:16:3e:97:9a:e9", "network": {"id": "491696ea-38ef-4c19-9d94-a61223c1fa00", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1323121698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3f111e24414976beddba7ef90c4793", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4788878b-ac", "ovs_interfaceid": "4788878b-ac88-49ff-a42d-df57ef410442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82479) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 00:17:28 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Converting VIF {"id": "4788878b-ac88-49ff-a42d-df57ef410442", "address": "fa:16:3e:97:9a:e9", "network": {"id": "491696ea-38ef-4c19-9d94-a61223c1fa00", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1323121698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3f111e24414976beddba7ef90c4793", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4788878b-ac", "ovs_interfaceid": "4788878b-ac88-49ff-a42d-df57ef410442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:17:28 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:9a:e9,bridge_name='br-int',has_traffic_filtering=True,id=4788878b-ac88-49ff-a42d-df57ef410442,network=Network(491696ea-38ef-4c19-9d94-a61223c1fa00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4788878b-ac') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:17:28 user nova-compute[82479]: DEBUG nova.objects.instance [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lazy-loading 'pci_devices' on Instance uuid 13a94e92-54cf-49b7-ae71-32b3c48df332 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:17:28 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] End _get_guest_xml xml=<domain type="kvm">
Apr 14 00:17:28 user nova-compute[82479]:   <uuid>13a94e92-54cf-49b7-ae71-32b3c48df332</uuid>
Apr 14 00:17:28 user nova-compute[82479]:   <name>instance-0000001d</name>
Apr 14 00:17:28 user nova-compute[82479]:   <memory>131072</memory>
Apr 14 00:17:28 user nova-compute[82479]:   <vcpu>1</vcpu>
Apr 14 00:17:28 user nova-compute[82479]:   <metadata>
Apr 14 00:17:28 user nova-compute[82479]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 00:17:28 user nova-compute[82479]:       <nova:package version="0.0.0"/>
Apr 14 00:17:28 user nova-compute[82479]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1831378742</nova:name>
Apr 14 00:17:28 user nova-compute[82479]:       <nova:creationTime>2023-04-14 00:17:27</nova:creationTime>
Apr 14 00:17:28 user nova-compute[82479]:       <nova:flavor name="m1.nano">
Apr 14 00:17:28 user nova-compute[82479]:         <nova:memory>128</nova:memory>
Apr 14 00:17:28 user nova-compute[82479]:         <nova:disk>1</nova:disk>
Apr 14 00:17:28 user nova-compute[82479]:         <nova:swap>0</nova:swap>
Apr 14 00:17:28 user nova-compute[82479]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 00:17:28 user nova-compute[82479]:         <nova:vcpus>1</nova:vcpus>
Apr 14 00:17:28 user nova-compute[82479]:       </nova:flavor>
Apr 14 00:17:28 user nova-compute[82479]:       <nova:owner>
Apr 14 00:17:28 user nova-compute[82479]:         <nova:user uuid="90bad96535c3453792982c5acab9dbc6">tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member</nova:user>
Apr 14 00:17:28 user nova-compute[82479]:         <nova:project uuid="ba3f111e24414976beddba7ef90c4793">tempest-ServerBootFromVolumeStableRescueTest-1545234843</nova:project>
Apr 14 00:17:28 user nova-compute[82479]:       </nova:owner>
Apr 14 00:17:28 user nova-compute[82479]:       <nova:root type="image" uuid="6db62068-7278-4cd8-b41f-d0140d89e199"/>
Apr 14 00:17:28 user nova-compute[82479]:       <nova:ports>
Apr 14 00:17:28 user nova-compute[82479]:         <nova:port uuid="4788878b-ac88-49ff-a42d-df57ef410442">
Apr 14 00:17:28 user nova-compute[82479]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 00:17:28 user nova-compute[82479]:         </nova:port>
Apr 14 00:17:28 user nova-compute[82479]:       </nova:ports>
Apr 14 00:17:28 user nova-compute[82479]:     </nova:instance>
Apr 14 00:17:28 user nova-compute[82479]:   </metadata>
Apr 14 00:17:28 user nova-compute[82479]:   <sysinfo type="smbios">
Apr 14 00:17:28 user nova-compute[82479]:     <system>
Apr 14 00:17:28 user nova-compute[82479]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 00:17:28 user nova-compute[82479]:       <entry name="product">OpenStack Nova</entry>
Apr 14 00:17:28 user nova-compute[82479]:       <entry name="version">0.0.0</entry>
Apr 14 00:17:28 user nova-compute[82479]:       <entry name="serial">13a94e92-54cf-49b7-ae71-32b3c48df332</entry>
Apr 14 00:17:28 user nova-compute[82479]:       <entry name="uuid">13a94e92-54cf-49b7-ae71-32b3c48df332</entry>
Apr 14 00:17:28 user nova-compute[82479]:       <entry name="family">Virtual Machine</entry>
Apr 14 00:17:28 user nova-compute[82479]:     </system>
Apr 14 00:17:28 user nova-compute[82479]:   </sysinfo>
Apr 14 00:17:28 user nova-compute[82479]:   <os>
Apr 14 00:17:28 user nova-compute[82479]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 00:17:28 user nova-compute[82479]:     <boot dev="hd"/>
Apr 14 00:17:28 user nova-compute[82479]:     <smbios mode="sysinfo"/>
Apr 14 00:17:28 user nova-compute[82479]:   </os>
Apr 14 00:17:28 user nova-compute[82479]:   <features>
Apr 14 00:17:28 user nova-compute[82479]:     <acpi/>
Apr 14 00:17:28 user nova-compute[82479]:     <apic/>
Apr 14 00:17:28 user nova-compute[82479]:     <vmcoreinfo/>
Apr 14 00:17:28 user nova-compute[82479]:   </features>
Apr 14 00:17:28 user nova-compute[82479]:   <clock offset="utc">
Apr 14 00:17:28 user nova-compute[82479]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 00:17:28 user nova-compute[82479]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 00:17:28 user nova-compute[82479]:     <timer name="hpet" present="no"/>
Apr 14 00:17:28 user nova-compute[82479]:   </clock>
Apr 14 00:17:28 user nova-compute[82479]:   <cpu mode="custom" match="exact">
Apr 14 00:17:28 user nova-compute[82479]:     <model>Nehalem</model>
Apr 14 00:17:28 user nova-compute[82479]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 00:17:28 user nova-compute[82479]:   </cpu>
Apr 14 00:17:28 user nova-compute[82479]:   <devices>
Apr 14 00:17:28 user nova-compute[82479]:     <disk type="block" device="disk">
Apr 14 00:17:28 user nova-compute[82479]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:17:28 user nova-compute[82479]:       <source dev="/dev/sdf"/>
Apr 14 00:17:28 user nova-compute[82479]:       <target dev="vda" bus="virtio"/>
Apr 14 00:17:28 user nova-compute[82479]:       <serial>2681b171-ba2b-44b0-8a6a-e89a52fafc99</serial>
Apr 14 00:17:28 user nova-compute[82479]:     </disk>
Apr 14 00:17:28 user nova-compute[82479]:     <interface type="ethernet">
Apr 14 00:17:28 user nova-compute[82479]:       <mac address="fa:16:3e:97:9a:e9"/>
Apr 14 00:17:28 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:17:28 user nova-compute[82479]:       <mtu size="1442"/>
Apr 14 00:17:28 user nova-compute[82479]:       <target dev="tap4788878b-ac"/>
Apr 14 00:17:28 user nova-compute[82479]:     </interface>
Apr 14 00:17:28 user nova-compute[82479]:     <serial type="pty">
Apr 14 00:17:28 user nova-compute[82479]:       <log file="/opt/stack/data/nova/instances/13a94e92-54cf-49b7-ae71-32b3c48df332/console.log" append="off"/>
Apr 14 00:17:28 user nova-compute[82479]:     </serial>
Apr 14 00:17:28 user nova-compute[82479]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 00:17:28 user nova-compute[82479]:     <video>
Apr 14 00:17:28 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:17:28 user nova-compute[82479]:     </video>
Apr 14 00:17:28 user nova-compute[82479]:     <rng model="virtio">
Apr 14 00:17:28 user nova-compute[82479]:       <backend model="random">/dev/urandom</backend>
Apr 14 00:17:28 user nova-compute[82479]:     </rng>
Apr 14 00:17:28 user nova-compute[82479]:     <controller type="usb" index="0" model="none"/>
Apr 14 00:17:28 user nova-compute[82479]:     <memballoon model="virtio">
Apr 14 00:17:28 user nova-compute[82479]:       <stats period="10"/>
Apr 14 00:17:28 user nova-compute[82479]:     </memballoon>
Apr 14 00:17:28 user nova-compute[82479]:   </devices>
Apr 14 00:17:28 user nova-compute[82479]: </domain>
Apr 14 00:17:28 user nova-compute[82479]:  {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 00:17:28 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:17:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1831378742',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1831378742',id=29,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba3f111e24414976beddba7ef90c4793',ramdisk_id='',reservation_id='r-ba0cm12p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1545234843',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:17:17Z,user_data=None,user_id='90bad96535c3453792982c5acab9dbc6',uuid=13a94e92-54cf-49b7-ae71-32b3c48df332,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4788878b-ac88-49ff-a42d-df57ef410442", "address": "fa:16:3e:97:9a:e9", "network": {"id": "491696ea-38ef-4c19-9d94-a61223c1fa00", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1323121698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3f111e24414976beddba7ef90c4793", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4788878b-ac", "ovs_interfaceid": "4788878b-ac88-49ff-a42d-df57ef410442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 00:17:28 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Converting VIF {"id": "4788878b-ac88-49ff-a42d-df57ef410442", "address": "fa:16:3e:97:9a:e9", "network": {"id": "491696ea-38ef-4c19-9d94-a61223c1fa00", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1323121698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3f111e24414976beddba7ef90c4793", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4788878b-ac", "ovs_interfaceid": "4788878b-ac88-49ff-a42d-df57ef410442", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:17:28 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:9a:e9,bridge_name='br-int',has_traffic_filtering=True,id=4788878b-ac88-49ff-a42d-df57ef410442,network=Network(491696ea-38ef-4c19-9d94-a61223c1fa00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4788878b-ac') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:17:28 user nova-compute[82479]: DEBUG os_vif [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:9a:e9,bridge_name='br-int',has_traffic_filtering=True,id=4788878b-ac88-49ff-a42d-df57ef410442,network=Network(491696ea-38ef-4c19-9d94-a61223c1fa00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4788878b-ac') {{(pid=82479) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 00:17:28 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:17:28 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:17:28 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 00:17:28 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:17:28 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4788878b-ac, may_exist=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:17:28 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4788878b-ac, col_values=(('external_ids', {'iface-id': '4788878b-ac88-49ff-a42d-df57ef410442', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:9a:e9', 'vm-uuid': '13a94e92-54cf-49b7-ae71-32b3c48df332'}),)) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:17:28 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:17:28 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:17:28 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:17:28 user nova-compute[82479]: INFO os_vif [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:9a:e9,bridge_name='br-int',has_traffic_filtering=True,id=4788878b-ac88-49ff-a42d-df57ef410442,network=Network(491696ea-38ef-4c19-9d94-a61223c1fa00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4788878b-ac')
Apr 14 00:17:29 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:17:29 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] No VIF found with MAC fa:16:3e:97:9a:e9, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:17:30 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:17:30 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:17:30 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:17:30 user nova-compute[82479]: DEBUG nova.compute.manager [req-024330a7-f762-4f52-b6e6-67298383ff13 req-f97369c0-a245-4820-a0ef-9f554d8fadb3 service nova] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Received event network-vif-plugged-4788878b-ac88-49ff-a42d-df57ef410442 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:17:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-024330a7-f762-4f52-b6e6-67298383ff13 req-f97369c0-a245-4820-a0ef-9f554d8fadb3 service nova] Acquiring lock "13a94e92-54cf-49b7-ae71-32b3c48df332-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:17:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-024330a7-f762-4f52-b6e6-67298383ff13 req-f97369c0-a245-4820-a0ef-9f554d8fadb3 service nova] Lock "13a94e92-54cf-49b7-ae71-32b3c48df332-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:17:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-024330a7-f762-4f52-b6e6-67298383ff13 req-f97369c0-a245-4820-a0ef-9f554d8fadb3 service nova] Lock "13a94e92-54cf-49b7-ae71-32b3c48df332-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:17:30 user nova-compute[82479]: DEBUG nova.compute.manager [req-024330a7-f762-4f52-b6e6-67298383ff13 req-f97369c0-a245-4820-a0ef-9f554d8fadb3 service nova] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] No waiting events found dispatching network-vif-plugged-4788878b-ac88-49ff-a42d-df57ef410442 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:17:30 user nova-compute[82479]: WARNING nova.compute.manager [req-024330a7-f762-4f52-b6e6-67298383ff13 req-f97369c0-a245-4820-a0ef-9f554d8fadb3 service nova] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Received unexpected event network-vif-plugged-4788878b-ac88-49ff-a42d-df57ef410442 for instance with vm_state building and task_state spawning.
Apr 14 00:17:30 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:17:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:17:32 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681431452.5920432, 13a94e92-54cf-49b7-ae71-32b3c48df332 => Resumed> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:17:32 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] VM Resumed (Lifecycle Event)
Apr 14 00:17:32 user nova-compute[82479]: DEBUG nova.compute.manager [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Instance event wait completed in 0 seconds for  {{(pid=82479) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 00:17:32 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Guest created on hypervisor {{(pid=82479) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 00:17:32 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Instance spawned successfully.
Apr 14 00:17:32 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 00:17:32 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:17:32 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Found default for hw_cdrom_bus of ide {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:17:32 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Found default for hw_disk_bus of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:17:32 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Found default for hw_input_bus of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:17:32 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Found default for hw_pointer_model of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:17:32 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Found default for hw_video_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:17:32 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Found default for hw_vif_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:17:32 user nova-compute[82479]: DEBUG nova.compute.manager [req-73ecfaf8-af66-4fd9-a7b2-3b1d1eb676b5 req-515a3926-18cc-4601-946f-26dff475d0a0 service nova] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Received event network-vif-plugged-4788878b-ac88-49ff-a42d-df57ef410442 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:17:32 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-73ecfaf8-af66-4fd9-a7b2-3b1d1eb676b5 req-515a3926-18cc-4601-946f-26dff475d0a0 service nova] Acquiring lock "13a94e92-54cf-49b7-ae71-32b3c48df332-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:17:32 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-73ecfaf8-af66-4fd9-a7b2-3b1d1eb676b5 req-515a3926-18cc-4601-946f-26dff475d0a0 service nova] Lock "13a94e92-54cf-49b7-ae71-32b3c48df332-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:17:32 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-73ecfaf8-af66-4fd9-a7b2-3b1d1eb676b5 req-515a3926-18cc-4601-946f-26dff475d0a0 service nova] Lock "13a94e92-54cf-49b7-ae71-32b3c48df332-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:17:32 user nova-compute[82479]: DEBUG nova.compute.manager [req-73ecfaf8-af66-4fd9-a7b2-3b1d1eb676b5 req-515a3926-18cc-4601-946f-26dff475d0a0 service nova] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] No waiting events found dispatching network-vif-plugged-4788878b-ac88-49ff-a42d-df57ef410442 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:17:32 user nova-compute[82479]: WARNING nova.compute.manager [req-73ecfaf8-af66-4fd9-a7b2-3b1d1eb676b5 req-515a3926-18cc-4601-946f-26dff475d0a0 service nova] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Received unexpected event network-vif-plugged-4788878b-ac88-49ff-a42d-df57ef410442 for instance with vm_state building and task_state spawning.
Apr 14 00:17:32 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:17:32 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:17:32 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681431452.5941498, 13a94e92-54cf-49b7-ae71-32b3c48df332 => Started> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:17:32 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] VM Started (Lifecycle Event)
Apr 14 00:17:32 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:17:32 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:17:32 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:17:32 user nova-compute[82479]: INFO nova.compute.manager [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Took 5.33 seconds to spawn the instance on the hypervisor.
Apr 14 00:17:32 user nova-compute[82479]: DEBUG nova.compute.manager [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:17:32 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Calling os-brick to attach iSCSI Volume {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 00:17:32 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PtALrNGE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:17:32 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:17:32 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:17:32 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:17:32 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:17:32 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:17:32 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:17:32 user nova-compute[82479]: INFO os_brick.initiator.connectors.iscsi [None req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 00:17:32 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902 -p 172.16.0.220:3260 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:32 user nova-compute[82479]: INFO nova.compute.manager [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Took 16.40 seconds to build instance.
Apr 14 00:17:32 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902 -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:32 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3760b52-3d21-4bb4-bb84-bc9c98359a56]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:17:32 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 00:17:32 user nova-compute[82479]:  {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:17:32 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902 -p 172.16.0.220:3260 --interface default --op new {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:32 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d8df7363-6483-46a8-94a1-36b8251714a6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "13a94e92-54cf-49b7-ae71-32b3c48df332" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.507s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:17:32 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:32 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[05081821-85d6-434b-9d58-89df061a9be2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902] added\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:17:32 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902] added
Apr 14 00:17:32 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:17:32 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:33 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:33 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[57dd2a90-77e5-4559-9a85-faeabe0111e8]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:17:33 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:17:33 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:33 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:33 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[061c7137-0250-4bb6-842f-2a47e62de5a4]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:17:33 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:17:33 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PtALrNGE {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:33 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PtALrNGE" returned: 0 in 0.025s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:33 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef883ffd-72ac-41e1-8a73-206fe1599a15]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:17:33 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PtALrNGE'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:17:33 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:33 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:33 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[922655d9-c1d0-4d02-a2b2-90cd507f087d]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:17:33 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:17:33 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:33 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:33 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c727598-ce2a-4df7-8a1f-dc3e9f17eb62]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:17:33 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:17:33 user nova-compute[82479]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e (non-flash)
Apr 14 00:17:33 user nova-compute[82479]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 (non-flash)
Apr 14 00:17:33 user nova-compute[82479]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e (non-flash)
Apr 14 00:17:33 user nova-compute[82479]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 (non-flash)
Apr 14 00:17:33 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:17:33 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:17:33 user nova-compute[82479]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e (non-flash)
Apr 14 00:17:33 user nova-compute[82479]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 (non-flash)
Apr 14 00:17:33 user nova-compute[82479]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e (non-flash)
Apr 14 00:17:33 user nova-compute[82479]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 (non-flash)
Apr 14 00:17:33 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:17:33 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902 -p 172.16.0.220:3260 --login {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:33 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:33 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1c4399-ec6e-4559-9664-dd113a5a46bb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:17:33 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902, portal: 172.16.0.220,3260]
Apr 14 00:17:33 user nova-compute[82479]: Login to [iface: default, target: iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902, portal: 172.16.0.220,3260] successful.
Apr 14 00:17:33 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:17:33 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:33 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.033s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:33 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa4aa4c7-ecf4-4d20-8986-493e109e3a08]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:17:33 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:17:33 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:33 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:33 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c6e1bc-1545-4032-a676-3388f42c2182]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:17:33 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:17:33 user nova-compute[82479]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e (non-flash)
Apr 14 00:17:33 user nova-compute[82479]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 (non-flash)
Apr 14 00:17:33 user nova-compute[82479]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e (non-flash)
Apr 14 00:17:33 user nova-compute[82479]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 (non-flash)
Apr 14 00:17:33 user nova-compute[82479]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902 (non-flash)
Apr 14 00:17:33 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:17:33 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:17:33 user nova-compute[82479]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e (non-flash)
Apr 14 00:17:33 user nova-compute[82479]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 (non-flash)
Apr 14 00:17:33 user nova-compute[82479]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e (non-flash)
Apr 14 00:17:33 user nova-compute[82479]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 (non-flash)
Apr 14 00:17:33 user nova-compute[82479]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902 (non-flash)
Apr 14 00:17:33 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:17:33 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.376s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:17:33 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Connected to 172.16.0.220:3260 {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 00:17:33 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] HCTL ('38', '-', '-', 0) found on session 30 with lun 0 {{(pid=82479) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 00:17:33 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=82479) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 00:17:33 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:33 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:33 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec385bea-cca7-4ce4-824e-97109fd56dcc]: (4, ('- - 0', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:17:33 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Searching for a device in session 30 and hctl ['38', '*', '*', 0] yield: None {{(pid=82479) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 00:17:33 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:17:34 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Searching for a device in session 30 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=82479) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 00:17:34 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PtALrNGE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 00:17:34 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.412s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:17:34 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] <== connect_volume: return (1413ms) {'type': 'block', 'scsi_wwn': '26163373766343464', 'path': '/dev/sdg'} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:17:34 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26163373766343464', 'path': '/dev/sdg'} {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 00:17:34 user nova-compute[82479]: DEBUG nova.objects.instance [None req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lazy-loading 'flavor' on Instance uuid 1cfe388b-396b-4ce9-97aa-9049cbcb32f4 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:17:34 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 00:17:34 user nova-compute[82479]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:17:34 user nova-compute[82479]:   <source dev="/dev/sdg"/>
Apr 14 00:17:34 user nova-compute[82479]:   <target dev="vdc" bus="virtio"/>
Apr 14 00:17:34 user nova-compute[82479]:   <serial>a7501233-eeb6-4ef4-8e07-4f0b28e2f902</serial>
Apr 14 00:17:34 user nova-compute[82479]: </disk>
Apr 14 00:17:34 user nova-compute[82479]:  {{(pid=82479) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 00:17:34 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:17:34 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:17:34 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] No BDM found with device name vdc, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:17:34 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] No VIF found with MAC fa:16:3e:58:24:c8, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:17:34 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "1cfe388b-396b-4ce9-97aa-9049cbcb32f4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.768s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:17:36 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:17:36 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e9728202-9ea9-4697-94ff-103e11e339e5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "1cfe388b-396b-4ce9-97aa-9049cbcb32f4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:17:36 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e9728202-9ea9-4697-94ff-103e11e339e5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "1cfe388b-396b-4ce9-97aa-9049cbcb32f4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:17:36 user nova-compute[82479]: INFO nova.compute.manager [None req-e9728202-9ea9-4697-94ff-103e11e339e5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Detaching volume 89a24f9a-783f-4d14-8413-4fb61263665e
Apr 14 00:17:36 user nova-compute[82479]: INFO nova.virt.block_device [None req-e9728202-9ea9-4697-94ff-103e11e339e5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Attempting to driver detach volume 89a24f9a-783f-4d14-8413-4fb61263665e from mountpoint /dev/vdb
Apr 14 00:17:36 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-e9728202-9ea9-4697-94ff-103e11e339e5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Attempting to detach device vdb from instance 1cfe388b-396b-4ce9-97aa-9049cbcb32f4 from the persistent domain config. {{(pid=82479) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 00:17:36 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-e9728202-9ea9-4697-94ff-103e11e339e5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 00:17:36 user nova-compute[82479]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:17:36 user nova-compute[82479]:   <source dev="/dev/sde"/>
Apr 14 00:17:36 user nova-compute[82479]:   <target dev="vdb" bus="virtio"/>
Apr 14 00:17:36 user nova-compute[82479]:   <serial>89a24f9a-783f-4d14-8413-4fb61263665e</serial>
Apr 14 00:17:36 user nova-compute[82479]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 00:17:36 user nova-compute[82479]: </disk>
Apr 14 00:17:36 user nova-compute[82479]:  {{(pid=82479) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 00:17:36 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-e9728202-9ea9-4697-94ff-103e11e339e5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Successfully detached device vdb from instance 1cfe388b-396b-4ce9-97aa-9049cbcb32f4 from the persistent domain config.
Apr 14 00:17:36 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-e9728202-9ea9-4697-94ff-103e11e339e5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1cfe388b-396b-4ce9-97aa-9049cbcb32f4 from the live domain config. {{(pid=82479) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 00:17:36 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-e9728202-9ea9-4697-94ff-103e11e339e5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 00:17:36 user nova-compute[82479]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:17:36 user nova-compute[82479]:   <source dev="/dev/sde"/>
Apr 14 00:17:36 user nova-compute[82479]:   <target dev="vdb" bus="virtio"/>
Apr 14 00:17:36 user nova-compute[82479]:   <serial>89a24f9a-783f-4d14-8413-4fb61263665e</serial>
Apr 14 00:17:36 user nova-compute[82479]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 00:17:36 user nova-compute[82479]: </disk>
Apr 14 00:17:36 user nova-compute[82479]:  {{(pid=82479) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 00:17:37 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Received event <DeviceRemovedEvent: 1681431457.0614998, 1cfe388b-396b-4ce9-97aa-9049cbcb32f4 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82479) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 00:17:37 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-e9728202-9ea9-4697-94ff-103e11e339e5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1cfe388b-396b-4ce9-97aa-9049cbcb32f4 {{(pid=82479) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 00:17:37 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-e9728202-9ea9-4697-94ff-103e11e339e5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Successfully detached device vdb from instance 1cfe388b-396b-4ce9-97aa-9049cbcb32f4 from the live domain config.
Apr 14 00:17:37 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9728202-9ea9-4697-94ff-103e11e339e5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] calling os-brick to detach iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 00:17:37 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9728202-9ea9-4697-94ff-103e11e339e5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, {'target_iqn': 'iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qzxBPYXt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:17:37 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-e9728202-9ea9-4697-94ff-103e11e339e5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:17:37 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-e9728202-9ea9-4697-94ff-103e11e339e5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:17:37 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-e9728202-9ea9-4697-94ff-103e11e339e5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:17:37 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:37 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:37 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ed908f-0217-4f36-bf18-18473948e913]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:17:37 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9728202-9ea9-4697-94ff-103e11e339e5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 00:17:37 user nova-compute[82479]: No targets found.
Apr 14 00:17:37 user nova-compute[82479]: iSNS:
Apr 14 00:17:37 user nova-compute[82479]: No targets found.
Apr 14 00:17:37 user nova-compute[82479]: STATIC:
Apr 14 00:17:37 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc
Apr 14 00:17:37 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:17:37 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:17:37 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7
Apr 14 00:17:37 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:17:37 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:17:37 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e
Apr 14 00:17:37 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:17:37 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:17:37 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e
Apr 14 00:17:37 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:17:37 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:17:37 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99
Apr 14 00:17:37 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:17:37 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:17:37 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902
Apr 14 00:17:37 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:17:37 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:17:37 user nova-compute[82479]: FIRMWARE:
Apr 14 00:17:37 user nova-compute[82479]: No targets found.
Apr 14 00:17:37 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:17:37 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9728202-9ea9-4697-94ff-103e11e339e5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 00:17:37 user nova-compute[82479]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 00:17:37 user nova-compute[82479]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82479) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 00:17:37 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9728202-9ea9-4697-94ff-103e11e339e5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e', 0)] {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 00:17:37 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:37 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:37 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea466414-d6f3-47aa-850e-71168e58295c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:17:37 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:37 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:37 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c477a18-aad5-414e-a4cb-a9346b129bc4]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:17:37 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9728202-9ea9-4697-94ff-103e11e339e5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:17:37 user nova-compute[82479]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e (non-flash)
Apr 14 00:17:37 user nova-compute[82479]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 (non-flash)
Apr 14 00:17:37 user nova-compute[82479]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e (non-flash)
Apr 14 00:17:37 user nova-compute[82479]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 (non-flash)
Apr 14 00:17:37 user nova-compute[82479]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902 (non-flash)
Apr 14 00:17:37 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:17:37 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9728202-9ea9-4697-94ff-103e11e339e5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:17:37 user nova-compute[82479]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e (non-flash)
Apr 14 00:17:37 user nova-compute[82479]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 (non-flash)
Apr 14 00:17:37 user nova-compute[82479]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e (non-flash)
Apr 14 00:17:37 user nova-compute[82479]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 (non-flash)
Apr 14 00:17:37 user nova-compute[82479]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902 (non-flash)
Apr 14 00:17:37 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:17:37 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9728202-9ea9-4697-94ff-103e11e339e5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3338557520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e'): ({'sde'}, set())}) {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 00:17:37 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-e9728202-9ea9-4697-94ff-103e11e339e5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Removing single pathed devices sde {{(pid=82479) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 00:17:37 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:37 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:37 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc7533ed-761a-4a89-bc0a-b6e170f4a789]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:17:37 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:37 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:37 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffedddf4-b664-4fa4-83fe-7b192494bb3d]: (4, ('ok\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:17:37 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-e9728202-9ea9-4697-94ff-103e11e339e5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Flushing IO for device /dev/sde {{(pid=82479) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 00:17:37 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:37 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:37 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[9490fff0-b771-4eac-85b4-4b7b26d98285]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:17:37 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-e9728202-9ea9-4697-94ff-103e11e339e5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=82479) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 00:17:37 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:37 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:37 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e89df38-436f-4a6e-9dd6-23d7d0bd71f6]: (4, ('1', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:17:37 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-e9728202-9ea9-4697-94ff-103e11e339e5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 00:17:37 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-e9728202-9ea9-4697-94ff-103e11e339e5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] SCSI volumes sde have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 00:17:37 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9728202-9ea9-4697-94ff-103e11e339e5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e')] {{(pid=82479) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 00:17:37 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:37 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:37 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8134dfc-409d-49ab-932a-e39052886aa5]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:17:37 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9728202-9ea9-4697-94ff-103e11e339e5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:17:37 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e -p 172.16.0.220:3260 --logout {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:37 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:37 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb7ecc9-d51e-4a80-b8bd-b55a5bb027d8]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:17:37 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9728202-9ea9-4697-94ff-103e11e339e5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e, portal: 172.16.0.220,3260]
Apr 14 00:17:37 user nova-compute[82479]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e, portal: 172.16.0.220,3260] successful.
Apr 14 00:17:37 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:17:37 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e -p 172.16.0.220:3260 --op delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:37 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:37 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e49ce0f-d1d1-4bb1-8a69-a554125c8bba]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:17:37 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9728202-9ea9-4697-94ff-103e11e339e5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:17:37 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-e9728202-9ea9-4697-94ff-103e11e339e5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:17:37 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9728202-9ea9-4697-94ff-103e11e339e5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] <== disconnect_volume: return (358ms) None {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:17:37 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9728202-9ea9-4697-94ff-103e11e339e5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Disconnected iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 00:17:38 user nova-compute[82479]: DEBUG nova.objects.instance [None req-e9728202-9ea9-4697-94ff-103e11e339e5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lazy-loading 'flavor' on Instance uuid 1cfe388b-396b-4ce9-97aa-9049cbcb32f4 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:17:38 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e9728202-9ea9-4697-94ff-103e11e339e5 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "1cfe388b-396b-4ce9-97aa-9049cbcb32f4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.709s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:17:38 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-b4104ceb-7e1f-45c9-b527-4542b81adec4 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "1cfe388b-396b-4ce9-97aa-9049cbcb32f4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:17:38 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-b4104ceb-7e1f-45c9-b527-4542b81adec4 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "1cfe388b-396b-4ce9-97aa-9049cbcb32f4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:17:38 user nova-compute[82479]: INFO nova.compute.manager [None req-b4104ceb-7e1f-45c9-b527-4542b81adec4 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Detaching volume a7501233-eeb6-4ef4-8e07-4f0b28e2f902
Apr 14 00:17:38 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:17:39 user nova-compute[82479]: INFO nova.virt.block_device [None req-b4104ceb-7e1f-45c9-b527-4542b81adec4 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Attempting to driver detach volume a7501233-eeb6-4ef4-8e07-4f0b28e2f902 from mountpoint /dev/vdc
Apr 14 00:17:39 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-b4104ceb-7e1f-45c9-b527-4542b81adec4 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Attempting to detach device vdc from instance 1cfe388b-396b-4ce9-97aa-9049cbcb32f4 from the persistent domain config. {{(pid=82479) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 00:17:39 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-b4104ceb-7e1f-45c9-b527-4542b81adec4 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 00:17:39 user nova-compute[82479]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:17:39 user nova-compute[82479]:   <source dev="/dev/sdg"/>
Apr 14 00:17:39 user nova-compute[82479]:   <target dev="vdc" bus="virtio"/>
Apr 14 00:17:39 user nova-compute[82479]:   <serial>a7501233-eeb6-4ef4-8e07-4f0b28e2f902</serial>
Apr 14 00:17:39 user nova-compute[82479]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 14 00:17:39 user nova-compute[82479]: </disk>
Apr 14 00:17:39 user nova-compute[82479]:  {{(pid=82479) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 00:17:39 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-b4104ceb-7e1f-45c9-b527-4542b81adec4 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Successfully detached device vdc from instance 1cfe388b-396b-4ce9-97aa-9049cbcb32f4 from the persistent domain config.
Apr 14 00:17:39 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-b4104ceb-7e1f-45c9-b527-4542b81adec4 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 1cfe388b-396b-4ce9-97aa-9049cbcb32f4 from the live domain config. {{(pid=82479) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 00:17:39 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-b4104ceb-7e1f-45c9-b527-4542b81adec4 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 00:17:39 user nova-compute[82479]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:17:39 user nova-compute[82479]:   <source dev="/dev/sdg"/>
Apr 14 00:17:39 user nova-compute[82479]:   <target dev="vdc" bus="virtio"/>
Apr 14 00:17:39 user nova-compute[82479]:   <serial>a7501233-eeb6-4ef4-8e07-4f0b28e2f902</serial>
Apr 14 00:17:39 user nova-compute[82479]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 14 00:17:39 user nova-compute[82479]: </disk>
Apr 14 00:17:39 user nova-compute[82479]:  {{(pid=82479) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 00:17:39 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Received event <DeviceRemovedEvent: 1681431459.5309532, 1cfe388b-396b-4ce9-97aa-9049cbcb32f4 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=82479) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 00:17:39 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-b4104ceb-7e1f-45c9-b527-4542b81adec4 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 1cfe388b-396b-4ce9-97aa-9049cbcb32f4 {{(pid=82479) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 00:17:39 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-b4104ceb-7e1f-45c9-b527-4542b81adec4 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Successfully detached device vdc from instance 1cfe388b-396b-4ce9-97aa-9049cbcb32f4 from the live domain config.
Apr 14 00:17:39 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4104ceb-7e1f-45c9-b527-4542b81adec4 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] calling os-brick to detach iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 00:17:39 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4104ceb-7e1f-45c9-b527-4542b81adec4 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, {'target_iqn': 'iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PtALrNGE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:17:39 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-b4104ceb-7e1f-45c9-b527-4542b81adec4 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:17:39 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-b4104ceb-7e1f-45c9-b527-4542b81adec4 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:17:39 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-b4104ceb-7e1f-45c9-b527-4542b81adec4 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:17:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:39 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f8cb15-7eba-40f9-977c-4d9890f85bfa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:17:39 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4104ceb-7e1f-45c9-b527-4542b81adec4 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 00:17:39 user nova-compute[82479]: No targets found.
Apr 14 00:17:39 user nova-compute[82479]: iSNS:
Apr 14 00:17:39 user nova-compute[82479]: No targets found.
Apr 14 00:17:39 user nova-compute[82479]: STATIC:
Apr 14 00:17:39 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc
Apr 14 00:17:39 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:17:39 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:17:39 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7
Apr 14 00:17:39 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:17:39 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:17:39 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e
Apr 14 00:17:39 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:17:39 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:17:39 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99
Apr 14 00:17:39 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:17:39 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:17:39 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902
Apr 14 00:17:39 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:17:39 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:17:39 user nova-compute[82479]: FIRMWARE:
Apr 14 00:17:39 user nova-compute[82479]: No targets found.
Apr 14 00:17:39 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:17:39 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4104ceb-7e1f-45c9-b527-4542b81adec4 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 00:17:39 user nova-compute[82479]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 00:17:39 user nova-compute[82479]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82479) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 00:17:39 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4104ceb-7e1f-45c9-b527-4542b81adec4 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902', 0)] {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 00:17:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:39 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e236cca-786c-49bc-9e31-ae23e8e1429a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:17:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:39 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[0794530e-97d4-4c72-9d43-e606ecb2611e]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:17:39 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4104ceb-7e1f-45c9-b527-4542b81adec4 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:17:39 user nova-compute[82479]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e (non-flash)
Apr 14 00:17:39 user nova-compute[82479]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 (non-flash)
Apr 14 00:17:39 user nova-compute[82479]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 (non-flash)
Apr 14 00:17:39 user nova-compute[82479]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902 (non-flash)
Apr 14 00:17:39 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:17:39 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4104ceb-7e1f-45c9-b527-4542b81adec4 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:17:39 user nova-compute[82479]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e (non-flash)
Apr 14 00:17:39 user nova-compute[82479]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 (non-flash)
Apr 14 00:17:39 user nova-compute[82479]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 (non-flash)
Apr 14 00:17:39 user nova-compute[82479]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902 (non-flash)
Apr 14 00:17:39 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:17:39 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4104ceb-7e1f-45c9-b527-4542b81adec4 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3338308f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902'): ({'sdg'}, set())}) {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 00:17:39 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-b4104ceb-7e1f-45c9-b527-4542b81adec4 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Removing single pathed devices sdg {{(pid=82479) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 00:17:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:39 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c27430-d51d-4549-a82b-eca1d5a8f324]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:17:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:39 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2fee766-f3a5-487c-8abd-8c17745565a2]: (4, ('ok\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:17:39 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-b4104ceb-7e1f-45c9-b527-4542b81adec4 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Flushing IO for device /dev/sdg {{(pid=82479) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 00:17:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:39 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[558a7fa0-5b6c-4274-8656-fbbf5c61a855]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:17:39 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-b4104ceb-7e1f-45c9-b527-4542b81adec4 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=82479) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 00:17:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.044s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:39 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eba1bc1-2cbe-4216-9954-8125cbf40d61]: (4, ('1', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:17:39 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-b4104ceb-7e1f-45c9-b527-4542b81adec4 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 00:17:39 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-b4104ceb-7e1f-45c9-b527-4542b81adec4 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] SCSI volumes sdg have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 00:17:39 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4104ceb-7e1f-45c9-b527-4542b81adec4 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902')] {{(pid=82479) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 00:17:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:39 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[98443b3b-d9d6-43cb-951e-4701f850448f]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:17:39 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4104ceb-7e1f-45c9-b527-4542b81adec4 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:17:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902 -p 172.16.0.220:3260 --logout {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:39 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[4684c06a-478b-4850-b979-b25a8eff264f]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:17:39 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4104ceb-7e1f-45c9-b527-4542b81adec4 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902, portal: 172.16.0.220,3260]
Apr 14 00:17:39 user nova-compute[82479]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902, portal: 172.16.0.220,3260] successful.
Apr 14 00:17:39 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:17:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902 -p 172.16.0.220:3260 --op delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:39 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d884f7-7771-4ff7-83c2-871a8f3c7b41]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:17:39 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4104ceb-7e1f-45c9-b527-4542b81adec4 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:17:39 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-b4104ceb-7e1f-45c9-b527-4542b81adec4 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:17:39 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4104ceb-7e1f-45c9-b527-4542b81adec4 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] <== disconnect_volume: return (314ms) None {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:17:39 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4104ceb-7e1f-45c9-b527-4542b81adec4 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Disconnected iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 00:17:40 user nova-compute[82479]: DEBUG nova.objects.instance [None req-b4104ceb-7e1f-45c9-b527-4542b81adec4 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lazy-loading 'flavor' on Instance uuid 1cfe388b-396b-4ce9-97aa-9049cbcb32f4 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:17:40 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-b4104ceb-7e1f-45c9-b527-4542b81adec4 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "1cfe388b-396b-4ce9-97aa-9049cbcb32f4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.883s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:17:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:17:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-11f225d9-7551-4b28-be50-94ced4e40848 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "1cfe388b-396b-4ce9-97aa-9049cbcb32f4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:17:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-11f225d9-7551-4b28-be50-94ced4e40848 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "1cfe388b-396b-4ce9-97aa-9049cbcb32f4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:17:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-11f225d9-7551-4b28-be50-94ced4e40848 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "1cfe388b-396b-4ce9-97aa-9049cbcb32f4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:17:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-11f225d9-7551-4b28-be50-94ced4e40848 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "1cfe388b-396b-4ce9-97aa-9049cbcb32f4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:17:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-11f225d9-7551-4b28-be50-94ced4e40848 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "1cfe388b-396b-4ce9-97aa-9049cbcb32f4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:17:41 user nova-compute[82479]: INFO nova.compute.manager [None req-11f225d9-7551-4b28-be50-94ced4e40848 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Terminating instance
Apr 14 00:17:41 user nova-compute[82479]: DEBUG nova.compute.manager [None req-11f225d9-7551-4b28-be50-94ced4e40848 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Start destroying the instance on the hypervisor. {{(pid=82479) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 00:17:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:17:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:17:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:17:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:17:41 user nova-compute[82479]: DEBUG nova.compute.manager [req-9057144c-8f40-4793-b0fb-2efd5ff86343 req-67b4339b-0bd7-4061-8275-d15fcd1b9a10 service nova] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Received event network-vif-unplugged-7c1bd582-678f-4d5e-9f6e-e60edd6f037b {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:17:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-9057144c-8f40-4793-b0fb-2efd5ff86343 req-67b4339b-0bd7-4061-8275-d15fcd1b9a10 service nova] Acquiring lock "1cfe388b-396b-4ce9-97aa-9049cbcb32f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:17:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-9057144c-8f40-4793-b0fb-2efd5ff86343 req-67b4339b-0bd7-4061-8275-d15fcd1b9a10 service nova] Lock "1cfe388b-396b-4ce9-97aa-9049cbcb32f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:17:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-9057144c-8f40-4793-b0fb-2efd5ff86343 req-67b4339b-0bd7-4061-8275-d15fcd1b9a10 service nova] Lock "1cfe388b-396b-4ce9-97aa-9049cbcb32f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:17:41 user nova-compute[82479]: DEBUG nova.compute.manager [req-9057144c-8f40-4793-b0fb-2efd5ff86343 req-67b4339b-0bd7-4061-8275-d15fcd1b9a10 service nova] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] No waiting events found dispatching network-vif-unplugged-7c1bd582-678f-4d5e-9f6e-e60edd6f037b {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:17:41 user nova-compute[82479]: DEBUG nova.compute.manager [req-9057144c-8f40-4793-b0fb-2efd5ff86343 req-67b4339b-0bd7-4061-8275-d15fcd1b9a10 service nova] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Received event network-vif-unplugged-7c1bd582-678f-4d5e-9f6e-e60edd6f037b for instance with task_state deleting. {{(pid=82479) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 00:17:42 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Instance destroyed successfully.
Apr 14 00:17:42 user nova-compute[82479]: DEBUG nova.objects.instance [None req-11f225d9-7551-4b28-be50-94ced4e40848 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lazy-loading 'resources' on Instance uuid 1cfe388b-396b-4ce9-97aa-9049cbcb32f4 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:17:42 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-11f225d9-7551-4b28-be50-94ced4e40848 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:15:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1072577782',display_name='tempest-AttachVolumeTestJSON-server-1072577782',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1072577782',id=26,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNeu3sLSv8MjRHlPE0XtJ4rNeSiWhefKhtVNlkDogqACZkiI1sdRyNSDtHyBnSkkNhIwyCmjqAmbXkqQdo4qEaGe/zgoUlWHrCvPiCy5gC+LrtY/wQVkC2HqO/3lmIrXQw==',key_name='tempest-keypair-1596000720',keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:15:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ec1aab0338ff4bd195a37a4199a378eb',ramdisk_id='',reservation_id='r-xp4uiih8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1885059489',owner_user_name='tempest-AttachVolumeTestJSON-1885059489-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T00:15:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='44530987616b417d87ce5909d8de1871',uuid=1cfe388b-396b-4ce9-97aa-9049cbcb32f4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7c1bd582-678f-4d5e-9f6e-e60edd6f037b", "address": "fa:16:3e:58:24:c8", "network": {"id": "368d9445-850e-4f74-b5cc-86d1eaa95d63", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374332689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec1aab0338ff4bd195a37a4199a378eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c1bd582-67", "ovs_interfaceid": "7c1bd582-678f-4d5e-9f6e-e60edd6f037b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 00:17:42 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-11f225d9-7551-4b28-be50-94ced4e40848 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Converting VIF {"id": "7c1bd582-678f-4d5e-9f6e-e60edd6f037b", "address": "fa:16:3e:58:24:c8", "network": {"id": "368d9445-850e-4f74-b5cc-86d1eaa95d63", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-374332689-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec1aab0338ff4bd195a37a4199a378eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c1bd582-67", "ovs_interfaceid": "7c1bd582-678f-4d5e-9f6e-e60edd6f037b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:17:42 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-11f225d9-7551-4b28-be50-94ced4e40848 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:58:24:c8,bridge_name='br-int',has_traffic_filtering=True,id=7c1bd582-678f-4d5e-9f6e-e60edd6f037b,network=Network(368d9445-850e-4f74-b5cc-86d1eaa95d63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c1bd582-67') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:17:42 user nova-compute[82479]: DEBUG os_vif [None req-11f225d9-7551-4b28-be50-94ced4e40848 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:24:c8,bridge_name='br-int',has_traffic_filtering=True,id=7c1bd582-678f-4d5e-9f6e-e60edd6f037b,network=Network(368d9445-850e-4f74-b5cc-86d1eaa95d63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c1bd582-67') {{(pid=82479) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 00:17:42 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:17:42 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7c1bd582-67, bridge=br-int, if_exists=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:17:42 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:17:42 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:17:42 user nova-compute[82479]: INFO os_vif [None req-11f225d9-7551-4b28-be50-94ced4e40848 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:24:c8,bridge_name='br-int',has_traffic_filtering=True,id=7c1bd582-678f-4d5e-9f6e-e60edd6f037b,network=Network(368d9445-850e-4f74-b5cc-86d1eaa95d63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c1bd582-67')
Apr 14 00:17:42 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-11f225d9-7551-4b28-be50-94ced4e40848 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Deleting instance files /opt/stack/data/nova/instances/1cfe388b-396b-4ce9-97aa-9049cbcb32f4_del
Apr 14 00:17:42 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-11f225d9-7551-4b28-be50-94ced4e40848 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Deletion of /opt/stack/data/nova/instances/1cfe388b-396b-4ce9-97aa-9049cbcb32f4_del complete
Apr 14 00:17:42 user nova-compute[82479]: INFO nova.compute.manager [None req-11f225d9-7551-4b28-be50-94ced4e40848 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Took 0.89 seconds to destroy the instance on the hypervisor.
Apr 14 00:17:42 user nova-compute[82479]: DEBUG oslo.service.loopingcall [None req-11f225d9-7551-4b28-be50-94ced4e40848 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82479) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 00:17:42 user nova-compute[82479]: DEBUG nova.compute.manager [-] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Deallocating network for instance {{(pid=82479) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 00:17:42 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] deallocate_for_instance() {{(pid=82479) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 00:17:42 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "fd5afe9f-e6b0-4564-a5cf-b4e0047a5503" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:17:42 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "fd5afe9f-e6b0-4564-a5cf-b4e0047a5503" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:17:43 user nova-compute[82479]: DEBUG nova.compute.manager [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Starting instance... {{(pid=82479) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 00:17:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:17:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:17:43 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82479) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 00:17:43 user nova-compute[82479]: INFO nova.compute.claims [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Claim successful on node user
Apr 14 00:17:43 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Updating instance_info_cache with network_info: [] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:17:43 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Took 1.00 seconds to deallocate network for instance.
Apr 14 00:17:43 user nova-compute[82479]: DEBUG nova.compute.manager [req-0fdc9cb3-ed6d-4572-88f0-7acf52753dd8 req-6a372763-a352-4824-b7c7-79c3b5317e3c service nova] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Received event network-vif-deleted-7c1bd582-678f-4d5e-9f6e-e60edd6f037b {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:17:43 user nova-compute[82479]: INFO nova.compute.manager [req-0fdc9cb3-ed6d-4572-88f0-7acf52753dd8 req-6a372763-a352-4824-b7c7-79c3b5317e3c service nova] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Neutron deleted interface 7c1bd582-678f-4d5e-9f6e-e60edd6f037b; detaching it from the instance and deleting it from the info cache
Apr 14 00:17:43 user nova-compute[82479]: DEBUG nova.network.neutron [req-0fdc9cb3-ed6d-4572-88f0-7acf52753dd8 req-6a372763-a352-4824-b7c7-79c3b5317e3c service nova] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Updating instance_info_cache with network_info: [] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:17:43 user nova-compute[82479]: DEBUG nova.compute.manager [req-0fdc9cb3-ed6d-4572-88f0-7acf52753dd8 req-6a372763-a352-4824-b7c7-79c3b5317e3c service nova] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Detach interface failed, port_id=7c1bd582-678f-4d5e-9f6e-e60edd6f037b, reason: Instance 1cfe388b-396b-4ce9-97aa-9049cbcb32f4 could not be found. {{(pid=82479) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 00:17:43 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:17:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-11f225d9-7551-4b28-be50-94ced4e40848 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:17:43 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:17:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.485s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:17:43 user nova-compute[82479]: DEBUG nova.compute.manager [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Start building networks asynchronously for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 00:17:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-11f225d9-7551-4b28-be50-94ced4e40848 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.046s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:17:43 user nova-compute[82479]: DEBUG nova.compute.manager [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Allocating IP information in the background. {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 00:17:43 user nova-compute[82479]: DEBUG nova.network.neutron [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] allocate_for_instance() {{(pid=82479) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 00:17:43 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 00:17:43 user nova-compute[82479]: DEBUG nova.compute.manager [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Start building block device mappings for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 00:17:43 user nova-compute[82479]: DEBUG nova.policy [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fb293fdfc658466aaa7134269fa46a7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c9d67ad2fa4cb9ab309b98f8fe051a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82479) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 00:17:43 user nova-compute[82479]: DEBUG nova.compute.manager [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Start spawning the instance on the hypervisor. {{(pid=82479) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 00:17:43 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Creating instance directory {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 00:17:43 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Creating image(s)
Apr 14 00:17:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "/opt/stack/data/nova/instances/fd5afe9f-e6b0-4564-a5cf-b4e0047a5503/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:17:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "/opt/stack/data/nova/instances/fd5afe9f-e6b0-4564-a5cf-b4e0047a5503/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:17:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "/opt/stack/data/nova/instances/fd5afe9f-e6b0-4564-a5cf-b4e0047a5503/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:17:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:43 user nova-compute[82479]: DEBUG nova.compute.manager [req-d6a8c62a-2b50-4102-bc8b-e471d0bbb998 req-1e1b297c-9a7d-4945-b248-4cf3e295e25f service nova] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Received event network-vif-plugged-7c1bd582-678f-4d5e-9f6e-e60edd6f037b {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:17:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-d6a8c62a-2b50-4102-bc8b-e471d0bbb998 req-1e1b297c-9a7d-4945-b248-4cf3e295e25f service nova] Acquiring lock "1cfe388b-396b-4ce9-97aa-9049cbcb32f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:17:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-d6a8c62a-2b50-4102-bc8b-e471d0bbb998 req-1e1b297c-9a7d-4945-b248-4cf3e295e25f service nova] Lock "1cfe388b-396b-4ce9-97aa-9049cbcb32f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:17:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-d6a8c62a-2b50-4102-bc8b-e471d0bbb998 req-1e1b297c-9a7d-4945-b248-4cf3e295e25f service nova] Lock "1cfe388b-396b-4ce9-97aa-9049cbcb32f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:17:43 user nova-compute[82479]: DEBUG nova.compute.manager [req-d6a8c62a-2b50-4102-bc8b-e471d0bbb998 req-1e1b297c-9a7d-4945-b248-4cf3e295e25f service nova] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] No waiting events found dispatching network-vif-plugged-7c1bd582-678f-4d5e-9f6e-e60edd6f037b {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:17:43 user nova-compute[82479]: WARNING nova.compute.manager [req-d6a8c62a-2b50-4102-bc8b-e471d0bbb998 req-1e1b297c-9a7d-4945-b248-4cf3e295e25f service nova] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Received unexpected event network-vif-plugged-7c1bd582-678f-4d5e-9f6e-e60edd6f037b for instance with vm_state deleted and task_state None.
Apr 14 00:17:43 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-11f225d9-7551-4b28-be50-94ced4e40848 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:17:43 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-11f225d9-7551-4b28-be50-94ced4e40848 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:17:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.146s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "3e200e101633f2016e569ae4c0a352380507d1e4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:17:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "3e200e101633f2016e569ae4c0a352380507d1e4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:17:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-11f225d9-7551-4b28-be50-94ced4e40848 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.455s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:17:44 user nova-compute[82479]: INFO nova.scheduler.client.report [None req-11f225d9-7551-4b28-be50-94ced4e40848 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Deleted allocations for instance 1cfe388b-396b-4ce9-97aa-9049cbcb32f4
Apr 14 00:17:44 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.141s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:44 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/fd5afe9f-e6b0-4564-a5cf-b4e0047a5503/disk 1073741824 {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-11f225d9-7551-4b28-be50-94ced4e40848 tempest-AttachVolumeTestJSON-1885059489 tempest-AttachVolumeTestJSON-1885059489-project-member] Lock "1cfe388b-396b-4ce9-97aa-9049cbcb32f4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.637s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:17:44 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/fd5afe9f-e6b0-4564-a5cf-b4e0047a5503/disk 1073741824" returned: 0 in 0.089s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "3e200e101633f2016e569ae4c0a352380507d1e4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:17:44 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:44 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.137s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:44 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fd5afe9f-e6b0-4564-a5cf-b4e0047a5503/disk. size=1073741824 {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 00:17:44 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd5afe9f-e6b0-4564-a5cf-b4e0047a5503/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:44 user nova-compute[82479]: DEBUG nova.network.neutron [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Successfully created port: 9a6ef0bb-aaa8-4fe9-a3ea-cc1352c783cb {{(pid=82479) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 00:17:44 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd5afe9f-e6b0-4564-a5cf-b4e0047a5503/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:44 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Cannot resize image /opt/stack/data/nova/instances/fd5afe9f-e6b0-4564-a5cf-b4e0047a5503/disk to a smaller size. {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 00:17:44 user nova-compute[82479]: DEBUG nova.objects.instance [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lazy-loading 'migration_context' on Instance uuid fd5afe9f-e6b0-4564-a5cf-b4e0047a5503 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:17:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Created local disks {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 00:17:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Ensure instance console log exists: /opt/stack/data/nova/instances/fd5afe9f-e6b0-4564-a5cf-b4e0047a5503/console.log {{(pid=82479) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 00:17:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:17:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:17:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:17:45 user nova-compute[82479]: DEBUG nova.network.neutron [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Successfully updated port: 9a6ef0bb-aaa8-4fe9-a3ea-cc1352c783cb {{(pid=82479) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 00:17:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "refresh_cache-fd5afe9f-e6b0-4564-a5cf-b4e0047a5503" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:17:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquired lock "refresh_cache-fd5afe9f-e6b0-4564-a5cf-b4e0047a5503" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:17:45 user nova-compute[82479]: DEBUG nova.network.neutron [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 00:17:45 user nova-compute[82479]: DEBUG nova.compute.manager [req-f2d79ce7-57f0-46c1-8edd-dd4b80978e9f req-408b091b-1b6c-4623-ba4a-3727ded7a5cb service nova] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Received event network-changed-9a6ef0bb-aaa8-4fe9-a3ea-cc1352c783cb {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:17:45 user nova-compute[82479]: DEBUG nova.compute.manager [req-f2d79ce7-57f0-46c1-8edd-dd4b80978e9f req-408b091b-1b6c-4623-ba4a-3727ded7a5cb service nova] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Refreshing instance network info cache due to event network-changed-9a6ef0bb-aaa8-4fe9-a3ea-cc1352c783cb. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:17:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-f2d79ce7-57f0-46c1-8edd-dd4b80978e9f req-408b091b-1b6c-4623-ba4a-3727ded7a5cb service nova] Acquiring lock "refresh_cache-fd5afe9f-e6b0-4564-a5cf-b4e0047a5503" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:17:45 user nova-compute[82479]: DEBUG nova.network.neutron [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Instance cache missing network info. {{(pid=82479) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 00:17:46 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:17:46 user nova-compute[82479]: DEBUG nova.network.neutron [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Updating instance_info_cache with network_info: [{"id": "9a6ef0bb-aaa8-4fe9-a3ea-cc1352c783cb", "address": "fa:16:3e:52:6f:81", "network": {"id": "6d80f923-8aef-45df-921b-f77ed4ff0e75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-696070096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44c9d67ad2fa4cb9ab309b98f8fe051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a6ef0bb-aa", "ovs_interfaceid": "9a6ef0bb-aaa8-4fe9-a3ea-cc1352c783cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:17:46 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Releasing lock "refresh_cache-fd5afe9f-e6b0-4564-a5cf-b4e0047a5503" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:17:46 user nova-compute[82479]: DEBUG nova.compute.manager [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Instance network_info: |[{"id": "9a6ef0bb-aaa8-4fe9-a3ea-cc1352c783cb", "address": "fa:16:3e:52:6f:81", "network": {"id": "6d80f923-8aef-45df-921b-f77ed4ff0e75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-696070096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44c9d67ad2fa4cb9ab309b98f8fe051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a6ef0bb-aa", "ovs_interfaceid": "9a6ef0bb-aaa8-4fe9-a3ea-cc1352c783cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 00:17:46 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-f2d79ce7-57f0-46c1-8edd-dd4b80978e9f req-408b091b-1b6c-4623-ba4a-3727ded7a5cb service nova] Acquired lock "refresh_cache-fd5afe9f-e6b0-4564-a5cf-b4e0047a5503" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:17:46 user nova-compute[82479]: DEBUG nova.network.neutron [req-f2d79ce7-57f0-46c1-8edd-dd4b80978e9f req-408b091b-1b6c-4623-ba4a-3727ded7a5cb service nova] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Refreshing network info cache for port 9a6ef0bb-aaa8-4fe9-a3ea-cc1352c783cb {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:17:46 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Start _get_guest_xml network_info=[{"id": "9a6ef0bb-aaa8-4fe9-a3ea-cc1352c783cb", "address": "fa:16:3e:52:6f:81", "network": {"id": "6d80f923-8aef-45df-921b-f77ed4ff0e75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-696070096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44c9d67ad2fa4cb9ab309b98f8fe051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a6ef0bb-aa", "ovs_interfaceid": "9a6ef0bb-aaa8-4fe9-a3ea-cc1352c783cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 00:17:46 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:17:46 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:17:46 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82479) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 00:17:46 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T00:02:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 00:17:46 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Flavor limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 00:17:46 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Image limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 00:17:46 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Flavor pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 00:17:46 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Image pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 00:17:46 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 00:17:46 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 00:17:46 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 00:17:46 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Got 1 possible topologies {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 00:17:46 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 00:17:46 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 00:17:46 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:17:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2010253673',display_name='tempest-AttachVolumeNegativeTest-server-2010253673',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2010253673',id=30,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPr0jyTwvDHPJLpGUrzkkGrxlDbGIF7ZL08n94HAoGHssCr+iA4uVoJBoD+5iWgWcLutO8dmofk8s0wiKfrqS9Pq9CO1MVlpiKLplRNt4H2+cAhTa75oMeQEi6CQ3pbgw==',key_name='tempest-keypair-1861608591',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44c9d67ad2fa4cb9ab309b98f8fe051a',ramdisk_id='',reservation_id='r-13td5mkv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-719597397',owner_user_name='tempest-AttachVolumeNegativeTest-719597397-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:17:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb293fdfc658466aaa7134269fa46a7c',uuid=fd5afe9f-e6b0-4564-a5cf-b4e0047a5503,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a6ef0bb-aaa8-4fe9-a3ea-cc1352c783cb", "address": "fa:16:3e:52:6f:81", "network": {"id": "6d80f923-8aef-45df-921b-f77ed4ff0e75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-696070096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44c9d67ad2fa4cb9ab309b98f8fe051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a6ef0bb-aa", "ovs_interfaceid": "9a6ef0bb-aaa8-4fe9-a3ea-cc1352c783cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82479) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 00:17:46 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Converting VIF {"id": "9a6ef0bb-aaa8-4fe9-a3ea-cc1352c783cb", "address": "fa:16:3e:52:6f:81", "network": {"id": "6d80f923-8aef-45df-921b-f77ed4ff0e75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-696070096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44c9d67ad2fa4cb9ab309b98f8fe051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a6ef0bb-aa", "ovs_interfaceid": "9a6ef0bb-aaa8-4fe9-a3ea-cc1352c783cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:17:46 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:6f:81,bridge_name='br-int',has_traffic_filtering=True,id=9a6ef0bb-aaa8-4fe9-a3ea-cc1352c783cb,network=Network(6d80f923-8aef-45df-921b-f77ed4ff0e75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a6ef0bb-aa') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:17:46 user nova-compute[82479]: DEBUG nova.objects.instance [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lazy-loading 'pci_devices' on Instance uuid fd5afe9f-e6b0-4564-a5cf-b4e0047a5503 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:17:46 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] End _get_guest_xml xml=<domain type="kvm">
Apr 14 00:17:46 user nova-compute[82479]:   <uuid>fd5afe9f-e6b0-4564-a5cf-b4e0047a5503</uuid>
Apr 14 00:17:46 user nova-compute[82479]:   <name>instance-0000001e</name>
Apr 14 00:17:46 user nova-compute[82479]:   <memory>131072</memory>
Apr 14 00:17:46 user nova-compute[82479]:   <vcpu>1</vcpu>
Apr 14 00:17:46 user nova-compute[82479]:   <metadata>
Apr 14 00:17:46 user nova-compute[82479]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 00:17:46 user nova-compute[82479]:       <nova:package version="0.0.0"/>
Apr 14 00:17:46 user nova-compute[82479]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2010253673</nova:name>
Apr 14 00:17:46 user nova-compute[82479]:       <nova:creationTime>2023-04-14 00:17:46</nova:creationTime>
Apr 14 00:17:46 user nova-compute[82479]:       <nova:flavor name="m1.nano">
Apr 14 00:17:46 user nova-compute[82479]:         <nova:memory>128</nova:memory>
Apr 14 00:17:46 user nova-compute[82479]:         <nova:disk>1</nova:disk>
Apr 14 00:17:46 user nova-compute[82479]:         <nova:swap>0</nova:swap>
Apr 14 00:17:46 user nova-compute[82479]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 00:17:46 user nova-compute[82479]:         <nova:vcpus>1</nova:vcpus>
Apr 14 00:17:46 user nova-compute[82479]:       </nova:flavor>
Apr 14 00:17:46 user nova-compute[82479]:       <nova:owner>
Apr 14 00:17:46 user nova-compute[82479]:         <nova:user uuid="fb293fdfc658466aaa7134269fa46a7c">tempest-AttachVolumeNegativeTest-719597397-project-member</nova:user>
Apr 14 00:17:46 user nova-compute[82479]:         <nova:project uuid="44c9d67ad2fa4cb9ab309b98f8fe051a">tempest-AttachVolumeNegativeTest-719597397</nova:project>
Apr 14 00:17:46 user nova-compute[82479]:       </nova:owner>
Apr 14 00:17:46 user nova-compute[82479]:       <nova:root type="image" uuid="6db62068-7278-4cd8-b41f-d0140d89e199"/>
Apr 14 00:17:46 user nova-compute[82479]:       <nova:ports>
Apr 14 00:17:46 user nova-compute[82479]:         <nova:port uuid="9a6ef0bb-aaa8-4fe9-a3ea-cc1352c783cb">
Apr 14 00:17:46 user nova-compute[82479]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 14 00:17:46 user nova-compute[82479]:         </nova:port>
Apr 14 00:17:46 user nova-compute[82479]:       </nova:ports>
Apr 14 00:17:46 user nova-compute[82479]:     </nova:instance>
Apr 14 00:17:46 user nova-compute[82479]:   </metadata>
Apr 14 00:17:46 user nova-compute[82479]:   <sysinfo type="smbios">
Apr 14 00:17:46 user nova-compute[82479]:     <system>
Apr 14 00:17:46 user nova-compute[82479]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 00:17:46 user nova-compute[82479]:       <entry name="product">OpenStack Nova</entry>
Apr 14 00:17:46 user nova-compute[82479]:       <entry name="version">0.0.0</entry>
Apr 14 00:17:46 user nova-compute[82479]:       <entry name="serial">fd5afe9f-e6b0-4564-a5cf-b4e0047a5503</entry>
Apr 14 00:17:46 user nova-compute[82479]:       <entry name="uuid">fd5afe9f-e6b0-4564-a5cf-b4e0047a5503</entry>
Apr 14 00:17:46 user nova-compute[82479]:       <entry name="family">Virtual Machine</entry>
Apr 14 00:17:46 user nova-compute[82479]:     </system>
Apr 14 00:17:46 user nova-compute[82479]:   </sysinfo>
Apr 14 00:17:46 user nova-compute[82479]:   <os>
Apr 14 00:17:46 user nova-compute[82479]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 00:17:46 user nova-compute[82479]:     <boot dev="hd"/>
Apr 14 00:17:46 user nova-compute[82479]:     <smbios mode="sysinfo"/>
Apr 14 00:17:46 user nova-compute[82479]:   </os>
Apr 14 00:17:46 user nova-compute[82479]:   <features>
Apr 14 00:17:46 user nova-compute[82479]:     <acpi/>
Apr 14 00:17:46 user nova-compute[82479]:     <apic/>
Apr 14 00:17:46 user nova-compute[82479]:     <vmcoreinfo/>
Apr 14 00:17:46 user nova-compute[82479]:   </features>
Apr 14 00:17:46 user nova-compute[82479]:   <clock offset="utc">
Apr 14 00:17:46 user nova-compute[82479]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 00:17:46 user nova-compute[82479]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 00:17:46 user nova-compute[82479]:     <timer name="hpet" present="no"/>
Apr 14 00:17:46 user nova-compute[82479]:   </clock>
Apr 14 00:17:46 user nova-compute[82479]:   <cpu mode="custom" match="exact">
Apr 14 00:17:46 user nova-compute[82479]:     <model>Nehalem</model>
Apr 14 00:17:46 user nova-compute[82479]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 00:17:46 user nova-compute[82479]:   </cpu>
Apr 14 00:17:46 user nova-compute[82479]:   <devices>
Apr 14 00:17:46 user nova-compute[82479]:     <disk type="file" device="disk">
Apr 14 00:17:46 user nova-compute[82479]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 00:17:46 user nova-compute[82479]:       <source file="/opt/stack/data/nova/instances/fd5afe9f-e6b0-4564-a5cf-b4e0047a5503/disk"/>
Apr 14 00:17:46 user nova-compute[82479]:       <target dev="vda" bus="virtio"/>
Apr 14 00:17:46 user nova-compute[82479]:     </disk>
Apr 14 00:17:46 user nova-compute[82479]:     <interface type="ethernet">
Apr 14 00:17:46 user nova-compute[82479]:       <mac address="fa:16:3e:52:6f:81"/>
Apr 14 00:17:46 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:17:46 user nova-compute[82479]:       <mtu size="1442"/>
Apr 14 00:17:46 user nova-compute[82479]:       <target dev="tap9a6ef0bb-aa"/>
Apr 14 00:17:46 user nova-compute[82479]:     </interface>
Apr 14 00:17:46 user nova-compute[82479]:     <serial type="pty">
Apr 14 00:17:46 user nova-compute[82479]:       <log file="/opt/stack/data/nova/instances/fd5afe9f-e6b0-4564-a5cf-b4e0047a5503/console.log" append="off"/>
Apr 14 00:17:46 user nova-compute[82479]:     </serial>
Apr 14 00:17:46 user nova-compute[82479]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 00:17:46 user nova-compute[82479]:     <video>
Apr 14 00:17:46 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:17:46 user nova-compute[82479]:     </video>
Apr 14 00:17:46 user nova-compute[82479]:     <rng model="virtio">
Apr 14 00:17:46 user nova-compute[82479]:       <backend model="random">/dev/urandom</backend>
Apr 14 00:17:46 user nova-compute[82479]:     </rng>
Apr 14 00:17:46 user nova-compute[82479]:     <controller type="usb" index="0" model="none"/>
Apr 14 00:17:46 user nova-compute[82479]:     <memballoon model="virtio">
Apr 14 00:17:46 user nova-compute[82479]:       <stats period="10"/>
Apr 14 00:17:46 user nova-compute[82479]:     </memballoon>
Apr 14 00:17:46 user nova-compute[82479]:   </devices>
Apr 14 00:17:46 user nova-compute[82479]: </domain>
Apr 14 00:17:46 user nova-compute[82479]:  {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 00:17:46 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:17:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2010253673',display_name='tempest-AttachVolumeNegativeTest-server-2010253673',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2010253673',id=30,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPr0jyTwvDHPJLpGUrzkkGrxlDbGIF7ZL08n94HAoGHssCr+iA4uVoJBoD+5iWgWcLutO8dmofk8s0wiKfrqS9Pq9CO1MVlpiKLplRNt4H2+cAhTa75oMeQEi6CQ3pbgw==',key_name='tempest-keypair-1861608591',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44c9d67ad2fa4cb9ab309b98f8fe051a',ramdisk_id='',reservation_id='r-13td5mkv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-719597397',owner_user_name='tempest-AttachVolumeNegativeTest-719597397-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:17:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb293fdfc658466aaa7134269fa46a7c',uuid=fd5afe9f-e6b0-4564-a5cf-b4e0047a5503,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a6ef0bb-aaa8-4fe9-a3ea-cc1352c783cb", "address": "fa:16:3e:52:6f:81", "network": {"id": "6d80f923-8aef-45df-921b-f77ed4ff0e75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-696070096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44c9d67ad2fa4cb9ab309b98f8fe051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a6ef0bb-aa", "ovs_interfaceid": "9a6ef0bb-aaa8-4fe9-a3ea-cc1352c783cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 00:17:46 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Converting VIF {"id": "9a6ef0bb-aaa8-4fe9-a3ea-cc1352c783cb", "address": "fa:16:3e:52:6f:81", "network": {"id": "6d80f923-8aef-45df-921b-f77ed4ff0e75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-696070096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44c9d67ad2fa4cb9ab309b98f8fe051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a6ef0bb-aa", "ovs_interfaceid": "9a6ef0bb-aaa8-4fe9-a3ea-cc1352c783cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:17:46 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:6f:81,bridge_name='br-int',has_traffic_filtering=True,id=9a6ef0bb-aaa8-4fe9-a3ea-cc1352c783cb,network=Network(6d80f923-8aef-45df-921b-f77ed4ff0e75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a6ef0bb-aa') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:17:46 user nova-compute[82479]: DEBUG os_vif [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:6f:81,bridge_name='br-int',has_traffic_filtering=True,id=9a6ef0bb-aaa8-4fe9-a3ea-cc1352c783cb,network=Network(6d80f923-8aef-45df-921b-f77ed4ff0e75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a6ef0bb-aa') {{(pid=82479) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 00:17:46 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:17:46 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:17:46 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 00:17:46 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:17:46 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9a6ef0bb-aa, may_exist=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:17:46 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9a6ef0bb-aa, col_values=(('external_ids', {'iface-id': '9a6ef0bb-aaa8-4fe9-a3ea-cc1352c783cb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:6f:81', 'vm-uuid': 'fd5afe9f-e6b0-4564-a5cf-b4e0047a5503'}),)) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:17:46 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:17:46 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:17:46 user nova-compute[82479]: INFO os_vif [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:6f:81,bridge_name='br-int',has_traffic_filtering=True,id=9a6ef0bb-aaa8-4fe9-a3ea-cc1352c783cb,network=Network(6d80f923-8aef-45df-921b-f77ed4ff0e75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a6ef0bb-aa')
Apr 14 00:17:46 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:17:46 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] No VIF found with MAC fa:16:3e:52:6f:81, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:17:46 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:17:46 user nova-compute[82479]: DEBUG nova.network.neutron [req-f2d79ce7-57f0-46c1-8edd-dd4b80978e9f req-408b091b-1b6c-4623-ba4a-3727ded7a5cb service nova] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Updated VIF entry in instance network info cache for port 9a6ef0bb-aaa8-4fe9-a3ea-cc1352c783cb. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:17:46 user nova-compute[82479]: DEBUG nova.network.neutron [req-f2d79ce7-57f0-46c1-8edd-dd4b80978e9f req-408b091b-1b6c-4623-ba4a-3727ded7a5cb service nova] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Updating instance_info_cache with network_info: [{"id": "9a6ef0bb-aaa8-4fe9-a3ea-cc1352c783cb", "address": "fa:16:3e:52:6f:81", "network": {"id": "6d80f923-8aef-45df-921b-f77ed4ff0e75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-696070096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44c9d67ad2fa4cb9ab309b98f8fe051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a6ef0bb-aa", "ovs_interfaceid": "9a6ef0bb-aaa8-4fe9-a3ea-cc1352c783cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:17:46 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-f2d79ce7-57f0-46c1-8edd-dd4b80978e9f req-408b091b-1b6c-4623-ba4a-3727ded7a5cb service nova] Releasing lock "refresh_cache-fd5afe9f-e6b0-4564-a5cf-b4e0047a5503" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:17:47 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:17:47 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:17:47 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:17:47 user nova-compute[82479]: DEBUG nova.compute.manager [req-f0d5dd95-edf8-4af2-996e-d9bffcd03060 req-815b45b2-39d0-41f9-9344-2406d3d09869 service nova] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Received event network-vif-plugged-9a6ef0bb-aaa8-4fe9-a3ea-cc1352c783cb {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:17:47 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-f0d5dd95-edf8-4af2-996e-d9bffcd03060 req-815b45b2-39d0-41f9-9344-2406d3d09869 service nova] Acquiring lock "fd5afe9f-e6b0-4564-a5cf-b4e0047a5503-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:17:47 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-f0d5dd95-edf8-4af2-996e-d9bffcd03060 req-815b45b2-39d0-41f9-9344-2406d3d09869 service nova] Lock "fd5afe9f-e6b0-4564-a5cf-b4e0047a5503-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:17:47 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-f0d5dd95-edf8-4af2-996e-d9bffcd03060 req-815b45b2-39d0-41f9-9344-2406d3d09869 service nova] Lock "fd5afe9f-e6b0-4564-a5cf-b4e0047a5503-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:17:47 user nova-compute[82479]: DEBUG nova.compute.manager [req-f0d5dd95-edf8-4af2-996e-d9bffcd03060 req-815b45b2-39d0-41f9-9344-2406d3d09869 service nova] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] No waiting events found dispatching network-vif-plugged-9a6ef0bb-aaa8-4fe9-a3ea-cc1352c783cb {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:17:47 user nova-compute[82479]: WARNING nova.compute.manager [req-f0d5dd95-edf8-4af2-996e-d9bffcd03060 req-815b45b2-39d0-41f9-9344-2406d3d09869 service nova] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Received unexpected event network-vif-plugged-9a6ef0bb-aaa8-4fe9-a3ea-cc1352c783cb for instance with vm_state building and task_state spawning.
Apr 14 00:17:48 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:17:48 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:17:48 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:17:48 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:17:49 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:17:49 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Starting heal instance info cache {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 00:17:49 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Didn't find any instances for network info cache update. {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 00:17:49 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:17:49 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681431469.816844, fd5afe9f-e6b0-4564-a5cf-b4e0047a5503 => Resumed> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:17:49 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] VM Resumed (Lifecycle Event)
Apr 14 00:17:49 user nova-compute[82479]: DEBUG nova.compute.manager [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Instance event wait completed in 0 seconds for  {{(pid=82479) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 00:17:49 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Guest created on hypervisor {{(pid=82479) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 00:17:49 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Instance spawned successfully.
Apr 14 00:17:49 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 00:17:49 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:17:49 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:17:49 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Found default for hw_cdrom_bus of ide {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:17:49 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Found default for hw_disk_bus of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:17:49 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Found default for hw_input_bus of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:17:49 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Found default for hw_pointer_model of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:17:49 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Found default for hw_video_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:17:49 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Found default for hw_vif_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:17:49 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:17:49 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681431469.8181374, fd5afe9f-e6b0-4564-a5cf-b4e0047a5503 => Started> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:17:49 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] VM Started (Lifecycle Event)
Apr 14 00:17:49 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:17:49 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:17:49 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:17:49 user nova-compute[82479]: INFO nova.compute.manager [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Took 6.10 seconds to spawn the instance on the hypervisor.
Apr 14 00:17:49 user nova-compute[82479]: DEBUG nova.compute.manager [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:17:50 user nova-compute[82479]: INFO nova.compute.manager [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Took 6.94 seconds to build instance.
Apr 14 00:17:50 user nova-compute[82479]: DEBUG nova.compute.manager [req-a5133a31-b782-4f62-81d6-f6d6a438fbb7 req-95d93297-f9ef-4f86-bea3-02d87cb74ca9 service nova] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Received event network-vif-plugged-9a6ef0bb-aaa8-4fe9-a3ea-cc1352c783cb {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:17:50 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-a5133a31-b782-4f62-81d6-f6d6a438fbb7 req-95d93297-f9ef-4f86-bea3-02d87cb74ca9 service nova] Acquiring lock "fd5afe9f-e6b0-4564-a5cf-b4e0047a5503-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:17:50 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-a5133a31-b782-4f62-81d6-f6d6a438fbb7 req-95d93297-f9ef-4f86-bea3-02d87cb74ca9 service nova] Lock "fd5afe9f-e6b0-4564-a5cf-b4e0047a5503-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:17:50 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-a5133a31-b782-4f62-81d6-f6d6a438fbb7 req-95d93297-f9ef-4f86-bea3-02d87cb74ca9 service nova] Lock "fd5afe9f-e6b0-4564-a5cf-b4e0047a5503-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:17:50 user nova-compute[82479]: DEBUG nova.compute.manager [req-a5133a31-b782-4f62-81d6-f6d6a438fbb7 req-95d93297-f9ef-4f86-bea3-02d87cb74ca9 service nova] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] No waiting events found dispatching network-vif-plugged-9a6ef0bb-aaa8-4fe9-a3ea-cc1352c783cb {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:17:50 user nova-compute[82479]: WARNING nova.compute.manager [req-a5133a31-b782-4f62-81d6-f6d6a438fbb7 req-95d93297-f9ef-4f86-bea3-02d87cb74ca9 service nova] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Received unexpected event network-vif-plugged-9a6ef0bb-aaa8-4fe9-a3ea-cc1352c783cb for instance with vm_state active and task_state None.
Apr 14 00:17:50 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-b1e78c70-3b95-49e3-b308-ddb33f2fb439 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "fd5afe9f-e6b0-4564-a5cf-b4e0047a5503" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.059s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:17:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:17:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:17:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-4e16781d-9d4a-47ea-b707-fadff038ad35 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Acquiring lock "02f97792-efc1-4976-bde1-70d7f9047cb5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:17:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-4e16781d-9d4a-47ea-b707-fadff038ad35 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lock "02f97792-efc1-4976-bde1-70d7f9047cb5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:17:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-4e16781d-9d4a-47ea-b707-fadff038ad35 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Acquiring lock "02f97792-efc1-4976-bde1-70d7f9047cb5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:17:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-4e16781d-9d4a-47ea-b707-fadff038ad35 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lock "02f97792-efc1-4976-bde1-70d7f9047cb5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:17:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-4e16781d-9d4a-47ea-b707-fadff038ad35 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lock "02f97792-efc1-4976-bde1-70d7f9047cb5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:17:52 user nova-compute[82479]: INFO nova.compute.manager [None req-4e16781d-9d4a-47ea-b707-fadff038ad35 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] Terminating instance
Apr 14 00:17:52 user nova-compute[82479]: DEBUG nova.compute.manager [None req-4e16781d-9d4a-47ea-b707-fadff038ad35 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] Start destroying the instance on the hypervisor. {{(pid=82479) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 00:17:53 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:17:53 user nova-compute[82479]: DEBUG nova.compute.manager [req-693f4cb0-5144-4818-b96d-d6016a6862f2 req-7c531867-4e63-4dfc-954e-b8539d8c102e service nova] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] Received event network-vif-unplugged-91cab0f7-d11a-451f-8708-b1d2917834cc {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:17:53 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-693f4cb0-5144-4818-b96d-d6016a6862f2 req-7c531867-4e63-4dfc-954e-b8539d8c102e service nova] Acquiring lock "02f97792-efc1-4976-bde1-70d7f9047cb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:17:53 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-693f4cb0-5144-4818-b96d-d6016a6862f2 req-7c531867-4e63-4dfc-954e-b8539d8c102e service nova] Lock "02f97792-efc1-4976-bde1-70d7f9047cb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:17:53 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-693f4cb0-5144-4818-b96d-d6016a6862f2 req-7c531867-4e63-4dfc-954e-b8539d8c102e service nova] Lock "02f97792-efc1-4976-bde1-70d7f9047cb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:17:53 user nova-compute[82479]: DEBUG nova.compute.manager [req-693f4cb0-5144-4818-b96d-d6016a6862f2 req-7c531867-4e63-4dfc-954e-b8539d8c102e service nova] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] No waiting events found dispatching network-vif-unplugged-91cab0f7-d11a-451f-8708-b1d2917834cc {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:17:53 user nova-compute[82479]: DEBUG nova.compute.manager [req-693f4cb0-5144-4818-b96d-d6016a6862f2 req-7c531867-4e63-4dfc-954e-b8539d8c102e service nova] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] Received event network-vif-unplugged-91cab0f7-d11a-451f-8708-b1d2917834cc for instance with task_state deleting. {{(pid=82479) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 00:17:53 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:17:53 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] Instance destroyed successfully.
Apr 14 00:17:53 user nova-compute[82479]: DEBUG nova.objects.instance [None req-4e16781d-9d4a-47ea-b707-fadff038ad35 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lazy-loading 'resources' on Instance uuid 02f97792-efc1-4976-bde1-70d7f9047cb5 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:17:53 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-4e16781d-9d4a-47ea-b707-fadff038ad35 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:16:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-642127814',display_name='tempest-VolumesActionsTest-instance-642127814',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-642127814',id=27,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:16:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='67e9bf71f0644907979ec775c62a0b39',ramdisk_id='',reservation_id='r-qe4vz5ir',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-422643142',owner_user_name='tempest-VolumesActionsTest-422643142-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T00:16:09Z,user_data=None,user_id='719f2342cc1d452daae3a4ded790f69a',uuid=02f97792-efc1-4976-bde1-70d7f9047cb5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "91cab0f7-d11a-451f-8708-b1d2917834cc", "address": "fa:16:3e:b1:7f:8d", "network": {"id": "e3acf139-a0c8-4b33-aae5-26131d3dccb5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1150180978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "67e9bf71f0644907979ec775c62a0b39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91cab0f7-d1", "ovs_interfaceid": "91cab0f7-d11a-451f-8708-b1d2917834cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 00:17:53 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-4e16781d-9d4a-47ea-b707-fadff038ad35 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Converting VIF {"id": "91cab0f7-d11a-451f-8708-b1d2917834cc", "address": "fa:16:3e:b1:7f:8d", "network": {"id": "e3acf139-a0c8-4b33-aae5-26131d3dccb5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1150180978-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "67e9bf71f0644907979ec775c62a0b39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91cab0f7-d1", "ovs_interfaceid": "91cab0f7-d11a-451f-8708-b1d2917834cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:17:53 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-4e16781d-9d4a-47ea-b707-fadff038ad35 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:7f:8d,bridge_name='br-int',has_traffic_filtering=True,id=91cab0f7-d11a-451f-8708-b1d2917834cc,network=Network(e3acf139-a0c8-4b33-aae5-26131d3dccb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91cab0f7-d1') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:17:53 user nova-compute[82479]: DEBUG os_vif [None req-4e16781d-9d4a-47ea-b707-fadff038ad35 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:7f:8d,bridge_name='br-int',has_traffic_filtering=True,id=91cab0f7-d11a-451f-8708-b1d2917834cc,network=Network(e3acf139-a0c8-4b33-aae5-26131d3dccb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91cab0f7-d1') {{(pid=82479) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 00:17:53 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:17:53 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap91cab0f7-d1, bridge=br-int, if_exists=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:17:53 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:17:53 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:17:53 user nova-compute[82479]: INFO os_vif [None req-4e16781d-9d4a-47ea-b707-fadff038ad35 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:7f:8d,bridge_name='br-int',has_traffic_filtering=True,id=91cab0f7-d11a-451f-8708-b1d2917834cc,network=Network(e3acf139-a0c8-4b33-aae5-26131d3dccb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91cab0f7-d1')
Apr 14 00:17:53 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-4e16781d-9d4a-47ea-b707-fadff038ad35 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] Deleting instance files /opt/stack/data/nova/instances/02f97792-efc1-4976-bde1-70d7f9047cb5_del
Apr 14 00:17:53 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-4e16781d-9d4a-47ea-b707-fadff038ad35 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] Deletion of /opt/stack/data/nova/instances/02f97792-efc1-4976-bde1-70d7f9047cb5_del complete
Apr 14 00:17:53 user nova-compute[82479]: INFO nova.compute.manager [None req-4e16781d-9d4a-47ea-b707-fadff038ad35 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] Took 0.86 seconds to destroy the instance on the hypervisor.
Apr 14 00:17:53 user nova-compute[82479]: DEBUG oslo.service.loopingcall [None req-4e16781d-9d4a-47ea-b707-fadff038ad35 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82479) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 00:17:53 user nova-compute[82479]: DEBUG nova.compute.manager [-] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] Deallocating network for instance {{(pid=82479) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 00:17:53 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] deallocate_for_instance() {{(pid=82479) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 00:17:54 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] Updating instance_info_cache with network_info: [] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:17:54 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] Took 0.56 seconds to deallocate network for instance.
Apr 14 00:17:54 user nova-compute[82479]: DEBUG nova.compute.manager [req-e0abfb57-50f5-4c7c-b544-0f05f26d2bc0 req-518af642-82ba-4fa8-b4c1-2e6297b0f4c2 service nova] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] Received event network-vif-deleted-91cab0f7-d11a-451f-8708-b1d2917834cc {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:17:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-4e16781d-9d4a-47ea-b707-fadff038ad35 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:17:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-4e16781d-9d4a-47ea-b707-fadff038ad35 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:17:54 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:17:54 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:17:54 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-4e16781d-9d4a-47ea-b707-fadff038ad35 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:17:54 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-4e16781d-9d4a-47ea-b707-fadff038ad35 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:17:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-4e16781d-9d4a-47ea-b707-fadff038ad35 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.325s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:17:54 user nova-compute[82479]: INFO nova.scheduler.client.report [None req-4e16781d-9d4a-47ea-b707-fadff038ad35 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Deleted allocations for instance 02f97792-efc1-4976-bde1-70d7f9047cb5
Apr 14 00:17:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-4e16781d-9d4a-47ea-b707-fadff038ad35 tempest-VolumesActionsTest-422643142 tempest-VolumesActionsTest-422643142-project-member] Lock "02f97792-efc1-4976-bde1-70d7f9047cb5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.989s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:17:55 user nova-compute[82479]: DEBUG nova.compute.manager [req-723444a7-e16b-4794-873e-ab9f502eeb1c req-c913bf59-8a65-410e-896b-3795c753c95f service nova] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] Received event network-vif-plugged-91cab0f7-d11a-451f-8708-b1d2917834cc {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:17:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-723444a7-e16b-4794-873e-ab9f502eeb1c req-c913bf59-8a65-410e-896b-3795c753c95f service nova] Acquiring lock "02f97792-efc1-4976-bde1-70d7f9047cb5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:17:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-723444a7-e16b-4794-873e-ab9f502eeb1c req-c913bf59-8a65-410e-896b-3795c753c95f service nova] Lock "02f97792-efc1-4976-bde1-70d7f9047cb5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:17:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-723444a7-e16b-4794-873e-ab9f502eeb1c req-c913bf59-8a65-410e-896b-3795c753c95f service nova] Lock "02f97792-efc1-4976-bde1-70d7f9047cb5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:17:55 user nova-compute[82479]: DEBUG nova.compute.manager [req-723444a7-e16b-4794-873e-ab9f502eeb1c req-c913bf59-8a65-410e-896b-3795c753c95f service nova] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] No waiting events found dispatching network-vif-plugged-91cab0f7-d11a-451f-8708-b1d2917834cc {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:17:55 user nova-compute[82479]: WARNING nova.compute.manager [req-723444a7-e16b-4794-873e-ab9f502eeb1c req-c913bf59-8a65-410e-896b-3795c753c95f service nova] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] Received unexpected event network-vif-plugged-91cab0f7-d11a-451f-8708-b1d2917834cc for instance with vm_state deleted and task_state None.
Apr 14 00:17:55 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:17:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:17:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:17:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:17:55 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Auditing locally available compute resources for user (node: user) {{(pid=82479) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 00:17:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:56 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:17:56 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:17:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:56 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:17:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:56 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:17:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd5afe9f-e6b0-4564-a5cf-b4e0047a5503/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd5afe9f-e6b0-4564-a5cf-b4e0047a5503/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd5afe9f-e6b0-4564-a5cf-b4e0047a5503/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd5afe9f-e6b0-4564-a5cf-b4e0047a5503/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2793d412-f405-4452-8e46-c192e3c92ccb/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2793d412-f405-4452-8e46-c192e3c92ccb/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2793d412-f405-4452-8e46-c192e3c92ccb/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2793d412-f405-4452-8e46-c192e3c92ccb/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c35b78e-41e3-40c1-b265-8e1fa5e859c6/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:57 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c35b78e-41e3-40c1-b265-8e1fa5e859c6/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:57 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c35b78e-41e3-40c1-b265-8e1fa5e859c6/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:57 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c35b78e-41e3-40c1-b265-8e1fa5e859c6/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:57 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk.rescue --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:57 user nova-compute[82479]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681431462.3634, 1cfe388b-396b-4ce9-97aa-9049cbcb32f4 => Stopped> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:17:57 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] VM Stopped (Lifecycle Event)
Apr 14 00:17:57 user nova-compute[82479]: DEBUG nova.compute.manager [None req-2602fcd5-3811-43d0-a3b5-1f841a7373bf None None] [instance: 1cfe388b-396b-4ce9-97aa-9049cbcb32f4] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:17:57 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:57 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk.rescue --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:57 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:57 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:57 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:57 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:57 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:57 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:57 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:57 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:17:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:17:58 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:17:58 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:17:58 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:17:58 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Hypervisor/Node resource view: name=user free_ram=7753MB free_disk=26.145339965820312GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82479) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 00:17:58 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:17:58 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:17:58 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 23718fd0-58b8-47f9-b1ef-a26a90741ecc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:17:58 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 17c6c147-fb62-4204-a416-792b94d3f7dd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:17:58 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:17:58 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:17:58 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance b3475e7e-ceb4-452a-a045-dbf43c5944dd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:17:58 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 2793d412-f405-4452-8e46-c192e3c92ccb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:17:58 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 6c35b78e-41e3-40c1-b265-8e1fa5e859c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:17:58 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance c7e1f470-fe8a-455e-aa0b-0d2475957fc0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:17:58 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 13a94e92-54cf-49b7-ae71-32b3c48df332 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:17:58 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance fd5afe9f-e6b0-4564-a5cf-b4e0047a5503 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:17:58 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 00:17:58 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 00:17:58 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:17:59 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:17:59 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:17:59 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-6622de56-858b-432f-bf81-41e395e354fc tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6c35b78e-41e3-40c1-b265-8e1fa5e859c6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:17:59 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-6622de56-858b-432f-bf81-41e395e354fc tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6c35b78e-41e3-40c1-b265-8e1fa5e859c6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:17:59 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-6622de56-858b-432f-bf81-41e395e354fc tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "6c35b78e-41e3-40c1-b265-8e1fa5e859c6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:17:59 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-6622de56-858b-432f-bf81-41e395e354fc tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6c35b78e-41e3-40c1-b265-8e1fa5e859c6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:17:59 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-6622de56-858b-432f-bf81-41e395e354fc tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6c35b78e-41e3-40c1-b265-8e1fa5e859c6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:17:59 user nova-compute[82479]: INFO nova.compute.manager [None req-6622de56-858b-432f-bf81-41e395e354fc tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Terminating instance
Apr 14 00:17:59 user nova-compute[82479]: DEBUG nova.compute.manager [None req-6622de56-858b-432f-bf81-41e395e354fc tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Start destroying the instance on the hypervisor. {{(pid=82479) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 00:17:59 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Compute_service record updated for user:user {{(pid=82479) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 00:17:59 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.552s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:17:59 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:17:59 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:17:59 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:17:59 user nova-compute[82479]: DEBUG nova.compute.manager [req-89675936-3db1-41e6-b005-b656f95c58bc req-1c30f21c-92fb-486b-8e3e-de8769b53a09 service nova] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Received event network-vif-unplugged-62d9fce8-6815-4a29-ab53-d1205a2db648 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:17:59 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-89675936-3db1-41e6-b005-b656f95c58bc req-1c30f21c-92fb-486b-8e3e-de8769b53a09 service nova] Acquiring lock "6c35b78e-41e3-40c1-b265-8e1fa5e859c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:17:59 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-89675936-3db1-41e6-b005-b656f95c58bc req-1c30f21c-92fb-486b-8e3e-de8769b53a09 service nova] Lock "6c35b78e-41e3-40c1-b265-8e1fa5e859c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:17:59 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-89675936-3db1-41e6-b005-b656f95c58bc req-1c30f21c-92fb-486b-8e3e-de8769b53a09 service nova] Lock "6c35b78e-41e3-40c1-b265-8e1fa5e859c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:17:59 user nova-compute[82479]: DEBUG nova.compute.manager [req-89675936-3db1-41e6-b005-b656f95c58bc req-1c30f21c-92fb-486b-8e3e-de8769b53a09 service nova] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] No waiting events found dispatching network-vif-unplugged-62d9fce8-6815-4a29-ab53-d1205a2db648 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:17:59 user nova-compute[82479]: DEBUG nova.compute.manager [req-89675936-3db1-41e6-b005-b656f95c58bc req-1c30f21c-92fb-486b-8e3e-de8769b53a09 service nova] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Received event network-vif-unplugged-62d9fce8-6815-4a29-ab53-d1205a2db648 for instance with task_state deleting. {{(pid=82479) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 00:17:59 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Instance destroyed successfully.
Apr 14 00:17:59 user nova-compute[82479]: DEBUG nova.objects.instance [None req-6622de56-858b-432f-bf81-41e395e354fc tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lazy-loading 'resources' on Instance uuid 6c35b78e-41e3-40c1-b265-8e1fa5e859c6 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:17:59 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-6622de56-858b-432f-bf81-41e395e354fc tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T00:12:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1217758263',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1217758263',id=21,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL4UEOyJwYDEnyxQAY/gseNadkyiHeTpfezaewpCqENgdXuLtykmPySbfnvUAXob1mjZ2nh6y7mHb/UX7vHeRXLyyBaoGtHKG1dH84NmufncEafrHDE/Zf0amaymIZieug==',key_name='tempest-keypair-749403403',keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:16:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4f20caf676a64b9b97027f3fc9bc724c',ramdisk_id='',reservation_id='r-5zzsx975',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1395403129',owner_user_name='tempest-AttachVolumeShelveTestJSON-1395403129-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T00:16:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f8b18d40ecd4b4e976cf2018af8220c',uuid=6c35b78e-41e3-40c1-b265-8e1fa5e859c6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "62d9fce8-6815-4a29-ab53-d1205a2db648", "address": "fa:16:3e:46:a4:3f", "network": {"id": "66316d10-fed3-4fb9-877e-a01542ca5855", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-93456010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f20caf676a64b9b97027f3fc9bc724c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62d9fce8-68", "ovs_interfaceid": "62d9fce8-6815-4a29-ab53-d1205a2db648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 00:17:59 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-6622de56-858b-432f-bf81-41e395e354fc tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Converting VIF {"id": "62d9fce8-6815-4a29-ab53-d1205a2db648", "address": "fa:16:3e:46:a4:3f", "network": {"id": "66316d10-fed3-4fb9-877e-a01542ca5855", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-93456010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f20caf676a64b9b97027f3fc9bc724c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62d9fce8-68", "ovs_interfaceid": "62d9fce8-6815-4a29-ab53-d1205a2db648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:17:59 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-6622de56-858b-432f-bf81-41e395e354fc tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:a4:3f,bridge_name='br-int',has_traffic_filtering=True,id=62d9fce8-6815-4a29-ab53-d1205a2db648,network=Network(66316d10-fed3-4fb9-877e-a01542ca5855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62d9fce8-68') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:17:59 user nova-compute[82479]: DEBUG os_vif [None req-6622de56-858b-432f-bf81-41e395e354fc tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:a4:3f,bridge_name='br-int',has_traffic_filtering=True,id=62d9fce8-6815-4a29-ab53-d1205a2db648,network=Network(66316d10-fed3-4fb9-877e-a01542ca5855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62d9fce8-68') {{(pid=82479) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 00:17:59 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:17:59 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap62d9fce8-68, bridge=br-int, if_exists=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:17:59 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:17:59 user nova-compute[82479]: INFO os_vif [None req-6622de56-858b-432f-bf81-41e395e354fc tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:a4:3f,bridge_name='br-int',has_traffic_filtering=True,id=62d9fce8-6815-4a29-ab53-d1205a2db648,network=Network(66316d10-fed3-4fb9-877e-a01542ca5855),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62d9fce8-68')
Apr 14 00:17:59 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-6622de56-858b-432f-bf81-41e395e354fc tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Deleting instance files /opt/stack/data/nova/instances/6c35b78e-41e3-40c1-b265-8e1fa5e859c6_del
Apr 14 00:17:59 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-6622de56-858b-432f-bf81-41e395e354fc tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Deletion of /opt/stack/data/nova/instances/6c35b78e-41e3-40c1-b265-8e1fa5e859c6_del complete
Apr 14 00:18:00 user nova-compute[82479]: INFO nova.compute.manager [None req-6622de56-858b-432f-bf81-41e395e354fc tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Took 0.90 seconds to destroy the instance on the hypervisor.
Apr 14 00:18:00 user nova-compute[82479]: DEBUG oslo.service.loopingcall [None req-6622de56-858b-432f-bf81-41e395e354fc tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82479) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 00:18:00 user nova-compute[82479]: DEBUG nova.compute.manager [-] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Deallocating network for instance {{(pid=82479) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 00:18:00 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] deallocate_for_instance() {{(pid=82479) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 00:18:00 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:18:00 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:18:00 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82479) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 00:18:00 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Updating instance_info_cache with network_info: [] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:18:00 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Took 0.94 seconds to deallocate network for instance.
Apr 14 00:18:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-6622de56-858b-432f-bf81-41e395e354fc tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:18:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-6622de56-858b-432f-bf81-41e395e354fc tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:18:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:18:01 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-6622de56-858b-432f-bf81-41e395e354fc tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:18:01 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-6622de56-858b-432f-bf81-41e395e354fc tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:18:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-6622de56-858b-432f-bf81-41e395e354fc tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.339s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:18:01 user nova-compute[82479]: INFO nova.scheduler.client.report [None req-6622de56-858b-432f-bf81-41e395e354fc tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Deleted allocations for instance 6c35b78e-41e3-40c1-b265-8e1fa5e859c6
Apr 14 00:18:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-6622de56-858b-432f-bf81-41e395e354fc tempest-AttachVolumeShelveTestJSON-1395403129 tempest-AttachVolumeShelveTestJSON-1395403129-project-member] Lock "6c35b78e-41e3-40c1-b265-8e1fa5e859c6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.414s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:18:01 user nova-compute[82479]: DEBUG nova.compute.manager [req-98c6fdba-209e-45c4-a66d-048011878c3a req-11b75e93-c77f-446e-b4e9-4eee8e6cfc7c service nova] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Received event network-vif-plugged-62d9fce8-6815-4a29-ab53-d1205a2db648 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:18:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-98c6fdba-209e-45c4-a66d-048011878c3a req-11b75e93-c77f-446e-b4e9-4eee8e6cfc7c service nova] Acquiring lock "6c35b78e-41e3-40c1-b265-8e1fa5e859c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:18:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-98c6fdba-209e-45c4-a66d-048011878c3a req-11b75e93-c77f-446e-b4e9-4eee8e6cfc7c service nova] Lock "6c35b78e-41e3-40c1-b265-8e1fa5e859c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:18:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-98c6fdba-209e-45c4-a66d-048011878c3a req-11b75e93-c77f-446e-b4e9-4eee8e6cfc7c service nova] Lock "6c35b78e-41e3-40c1-b265-8e1fa5e859c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:18:01 user nova-compute[82479]: DEBUG nova.compute.manager [req-98c6fdba-209e-45c4-a66d-048011878c3a req-11b75e93-c77f-446e-b4e9-4eee8e6cfc7c service nova] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] No waiting events found dispatching network-vif-plugged-62d9fce8-6815-4a29-ab53-d1205a2db648 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:18:01 user nova-compute[82479]: WARNING nova.compute.manager [req-98c6fdba-209e-45c4-a66d-048011878c3a req-11b75e93-c77f-446e-b4e9-4eee8e6cfc7c service nova] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Received unexpected event network-vif-plugged-62d9fce8-6815-4a29-ab53-d1205a2db648 for instance with vm_state deleted and task_state None.
Apr 14 00:18:01 user nova-compute[82479]: DEBUG nova.compute.manager [req-98c6fdba-209e-45c4-a66d-048011878c3a req-11b75e93-c77f-446e-b4e9-4eee8e6cfc7c service nova] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Received event network-vif-deleted-62d9fce8-6815-4a29-ab53-d1205a2db648 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:18:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:18:06 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:18:08 user nova-compute[82479]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681431473.7406723, 02f97792-efc1-4976-bde1-70d7f9047cb5 => Stopped> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:18:08 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] VM Stopped (Lifecycle Event)
Apr 14 00:18:08 user nova-compute[82479]: DEBUG nova.compute.manager [None req-e823db4f-7c5c-4c4d-b49a-efeca6333172 None None] [instance: 02f97792-efc1-4976-bde1-70d7f9047cb5] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:18:09 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:18:11 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:18:14 user nova-compute[82479]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681431479.91747, 6c35b78e-41e3-40c1-b265-8e1fa5e859c6 => Stopped> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:18:14 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] VM Stopped (Lifecycle Event)
Apr 14 00:18:14 user nova-compute[82479]: DEBUG nova.compute.manager [None req-a0ff40fb-3d10-4f37-adcb-b7660726356b None None] [instance: 6c35b78e-41e3-40c1-b265-8e1fa5e859c6] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:18:14 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:18:16 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:18:19 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:18:21 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:18:24 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:18:26 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:18:28 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "ade24ab6-1a93-4449-b5e9-ec3de357665b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:18:28 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "ade24ab6-1a93-4449-b5e9-ec3de357665b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:18:28 user nova-compute[82479]: DEBUG nova.compute.manager [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Starting instance... {{(pid=82479) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 00:18:28 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:18:28 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:18:28 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82479) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 00:18:28 user nova-compute[82479]: INFO nova.compute.claims [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Claim successful on node user
Apr 14 00:18:29 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:18:29 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:18:29 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.392s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:18:29 user nova-compute[82479]: DEBUG nova.compute.manager [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Start building networks asynchronously for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 00:18:29 user nova-compute[82479]: DEBUG nova.compute.manager [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Allocating IP information in the background. {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 00:18:29 user nova-compute[82479]: DEBUG nova.network.neutron [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] allocate_for_instance() {{(pid=82479) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 00:18:29 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 00:18:29 user nova-compute[82479]: DEBUG nova.compute.manager [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Start building block device mappings for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 00:18:29 user nova-compute[82479]: DEBUG nova.policy [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f43f3171ccad4167ac783bbdfe2df478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '524265958bd24a6cb94aa3115eb2b6c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82479) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 00:18:29 user nova-compute[82479]: DEBUG nova.compute.manager [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Start spawning the instance on the hypervisor. {{(pid=82479) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 00:18:29 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Creating instance directory {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 00:18:29 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Creating image(s)
Apr 14 00:18:29 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "/opt/stack/data/nova/instances/ade24ab6-1a93-4449-b5e9-ec3de357665b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:18:29 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "/opt/stack/data/nova/instances/ade24ab6-1a93-4449-b5e9-ec3de357665b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:18:29 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "/opt/stack/data/nova/instances/ade24ab6-1a93-4449-b5e9-ec3de357665b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:18:29 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:18:29 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.140s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:18:29 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "3e200e101633f2016e569ae4c0a352380507d1e4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:18:29 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "3e200e101633f2016e569ae4c0a352380507d1e4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:18:29 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:18:29 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.132s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:18:29 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/ade24ab6-1a93-4449-b5e9-ec3de357665b/disk 1073741824 {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:18:29 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/ade24ab6-1a93-4449-b5e9-ec3de357665b/disk 1073741824" returned: 0 in 0.049s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:18:29 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "3e200e101633f2016e569ae4c0a352380507d1e4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.191s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:18:29 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:18:29 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.136s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:18:29 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ade24ab6-1a93-4449-b5e9-ec3de357665b/disk. size=1073741824 {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 00:18:29 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ade24ab6-1a93-4449-b5e9-ec3de357665b/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:18:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:18:30 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ade24ab6-1a93-4449-b5e9-ec3de357665b/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:18:30 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Cannot resize image /opt/stack/data/nova/instances/ade24ab6-1a93-4449-b5e9-ec3de357665b/disk to a smaller size. {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 00:18:30 user nova-compute[82479]: DEBUG nova.objects.instance [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lazy-loading 'migration_context' on Instance uuid ade24ab6-1a93-4449-b5e9-ec3de357665b {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:18:30 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Created local disks {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 00:18:30 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Ensure instance console log exists: /opt/stack/data/nova/instances/ade24ab6-1a93-4449-b5e9-ec3de357665b/console.log {{(pid=82479) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 00:18:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:18:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:18:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:18:30 user nova-compute[82479]: DEBUG nova.network.neutron [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Successfully created port: 11344eed-48f5-49c5-a770-c9c298f7185e {{(pid=82479) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 00:18:30 user nova-compute[82479]: DEBUG nova.network.neutron [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Successfully updated port: 11344eed-48f5-49c5-a770-c9c298f7185e {{(pid=82479) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 00:18:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "refresh_cache-ade24ab6-1a93-4449-b5e9-ec3de357665b" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:18:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquired lock "refresh_cache-ade24ab6-1a93-4449-b5e9-ec3de357665b" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:18:30 user nova-compute[82479]: DEBUG nova.network.neutron [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 00:18:31 user nova-compute[82479]: DEBUG nova.compute.manager [req-3270724c-666b-473e-b5e3-831451e9e874 req-db72c936-70a9-4b19-9eaa-41547a8f36dc service nova] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Received event network-changed-11344eed-48f5-49c5-a770-c9c298f7185e {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:18:31 user nova-compute[82479]: DEBUG nova.compute.manager [req-3270724c-666b-473e-b5e3-831451e9e874 req-db72c936-70a9-4b19-9eaa-41547a8f36dc service nova] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Refreshing instance network info cache due to event network-changed-11344eed-48f5-49c5-a770-c9c298f7185e. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:18:31 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-3270724c-666b-473e-b5e3-831451e9e874 req-db72c936-70a9-4b19-9eaa-41547a8f36dc service nova] Acquiring lock "refresh_cache-ade24ab6-1a93-4449-b5e9-ec3de357665b" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:18:31 user nova-compute[82479]: DEBUG nova.network.neutron [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Instance cache missing network info. {{(pid=82479) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 00:18:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:18:31 user nova-compute[82479]: DEBUG nova.network.neutron [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Updating instance_info_cache with network_info: [{"id": "11344eed-48f5-49c5-a770-c9c298f7185e", "address": "fa:16:3e:cd:dc:0b", "network": {"id": "08106daa-a35e-4376-8c46-2b4baa51c6ea", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321730350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524265958bd24a6cb94aa3115eb2b6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11344eed-48", "ovs_interfaceid": "11344eed-48f5-49c5-a770-c9c298f7185e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:18:31 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Releasing lock "refresh_cache-ade24ab6-1a93-4449-b5e9-ec3de357665b" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:18:31 user nova-compute[82479]: DEBUG nova.compute.manager [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Instance network_info: |[{"id": "11344eed-48f5-49c5-a770-c9c298f7185e", "address": "fa:16:3e:cd:dc:0b", "network": {"id": "08106daa-a35e-4376-8c46-2b4baa51c6ea", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321730350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524265958bd24a6cb94aa3115eb2b6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11344eed-48", "ovs_interfaceid": "11344eed-48f5-49c5-a770-c9c298f7185e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 00:18:31 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-3270724c-666b-473e-b5e3-831451e9e874 req-db72c936-70a9-4b19-9eaa-41547a8f36dc service nova] Acquired lock "refresh_cache-ade24ab6-1a93-4449-b5e9-ec3de357665b" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:18:31 user nova-compute[82479]: DEBUG nova.network.neutron [req-3270724c-666b-473e-b5e3-831451e9e874 req-db72c936-70a9-4b19-9eaa-41547a8f36dc service nova] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Refreshing network info cache for port 11344eed-48f5-49c5-a770-c9c298f7185e {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:18:31 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Start _get_guest_xml network_info=[{"id": "11344eed-48f5-49c5-a770-c9c298f7185e", "address": "fa:16:3e:cd:dc:0b", "network": {"id": "08106daa-a35e-4376-8c46-2b4baa51c6ea", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321730350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524265958bd24a6cb94aa3115eb2b6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11344eed-48", "ovs_interfaceid": "11344eed-48f5-49c5-a770-c9c298f7185e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 00:18:31 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:18:31 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:18:31 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82479) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 00:18:31 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T00:02:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 00:18:31 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Flavor limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 00:18:31 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Image limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 00:18:31 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Flavor pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 00:18:31 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Image pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 00:18:31 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 00:18:31 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 00:18:31 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 00:18:31 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Got 1 possible topologies {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 00:18:31 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 00:18:31 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 00:18:31 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:18:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-576521395',display_name='tempest-ServerRescueNegativeTestJSON-server-576521395',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-576521395',id=31,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPJl6SDPfCFQp4baCPxy+GI6LhLuQU3NPsG3291XLwXmLvJxDSbMZPnAUG2FnoP7gWRMoPh0RxuN0i+Igwez3QU2DJmViyuFIRLYjK8+Jg8nIMy2dRZs6Aqrth2wJ7mNQ==',key_name='tempest-keypair-2020248029',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='524265958bd24a6cb94aa3115eb2b6c7',ramdisk_id='',reservation_id='r-a4yceyqy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1055458768',owner_user_name='tempest-ServerRescueNegativeTestJSON-1055458768-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:18:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f43f3171ccad4167ac783bbdfe2df478',uuid=ade24ab6-1a93-4449-b5e9-ec3de357665b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11344eed-48f5-49c5-a770-c9c298f7185e", "address": "fa:16:3e:cd:dc:0b", "network": {"id": "08106daa-a35e-4376-8c46-2b4baa51c6ea", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321730350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524265958bd24a6cb94aa3115eb2b6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11344eed-48", "ovs_interfaceid": "11344eed-48f5-49c5-a770-c9c298f7185e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82479) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 00:18:31 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Converting VIF {"id": "11344eed-48f5-49c5-a770-c9c298f7185e", "address": "fa:16:3e:cd:dc:0b", "network": {"id": "08106daa-a35e-4376-8c46-2b4baa51c6ea", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321730350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524265958bd24a6cb94aa3115eb2b6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11344eed-48", "ovs_interfaceid": "11344eed-48f5-49c5-a770-c9c298f7185e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:18:31 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:dc:0b,bridge_name='br-int',has_traffic_filtering=True,id=11344eed-48f5-49c5-a770-c9c298f7185e,network=Network(08106daa-a35e-4376-8c46-2b4baa51c6ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11344eed-48') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:18:31 user nova-compute[82479]: DEBUG nova.objects.instance [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lazy-loading 'pci_devices' on Instance uuid ade24ab6-1a93-4449-b5e9-ec3de357665b {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:18:31 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] End _get_guest_xml xml=<domain type="kvm">
Apr 14 00:18:31 user nova-compute[82479]:   <uuid>ade24ab6-1a93-4449-b5e9-ec3de357665b</uuid>
Apr 14 00:18:31 user nova-compute[82479]:   <name>instance-0000001f</name>
Apr 14 00:18:31 user nova-compute[82479]:   <memory>131072</memory>
Apr 14 00:18:31 user nova-compute[82479]:   <vcpu>1</vcpu>
Apr 14 00:18:31 user nova-compute[82479]:   <metadata>
Apr 14 00:18:31 user nova-compute[82479]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 00:18:31 user nova-compute[82479]:       <nova:package version="0.0.0"/>
Apr 14 00:18:31 user nova-compute[82479]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-576521395</nova:name>
Apr 14 00:18:31 user nova-compute[82479]:       <nova:creationTime>2023-04-14 00:18:31</nova:creationTime>
Apr 14 00:18:31 user nova-compute[82479]:       <nova:flavor name="m1.nano">
Apr 14 00:18:31 user nova-compute[82479]:         <nova:memory>128</nova:memory>
Apr 14 00:18:31 user nova-compute[82479]:         <nova:disk>1</nova:disk>
Apr 14 00:18:31 user nova-compute[82479]:         <nova:swap>0</nova:swap>
Apr 14 00:18:31 user nova-compute[82479]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 00:18:31 user nova-compute[82479]:         <nova:vcpus>1</nova:vcpus>
Apr 14 00:18:31 user nova-compute[82479]:       </nova:flavor>
Apr 14 00:18:31 user nova-compute[82479]:       <nova:owner>
Apr 14 00:18:31 user nova-compute[82479]:         <nova:user uuid="f43f3171ccad4167ac783bbdfe2df478">tempest-ServerRescueNegativeTestJSON-1055458768-project-member</nova:user>
Apr 14 00:18:31 user nova-compute[82479]:         <nova:project uuid="524265958bd24a6cb94aa3115eb2b6c7">tempest-ServerRescueNegativeTestJSON-1055458768</nova:project>
Apr 14 00:18:31 user nova-compute[82479]:       </nova:owner>
Apr 14 00:18:31 user nova-compute[82479]:       <nova:root type="image" uuid="6db62068-7278-4cd8-b41f-d0140d89e199"/>
Apr 14 00:18:31 user nova-compute[82479]:       <nova:ports>
Apr 14 00:18:31 user nova-compute[82479]:         <nova:port uuid="11344eed-48f5-49c5-a770-c9c298f7185e">
Apr 14 00:18:31 user nova-compute[82479]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 14 00:18:31 user nova-compute[82479]:         </nova:port>
Apr 14 00:18:31 user nova-compute[82479]:       </nova:ports>
Apr 14 00:18:31 user nova-compute[82479]:     </nova:instance>
Apr 14 00:18:31 user nova-compute[82479]:   </metadata>
Apr 14 00:18:31 user nova-compute[82479]:   <sysinfo type="smbios">
Apr 14 00:18:31 user nova-compute[82479]:     <system>
Apr 14 00:18:31 user nova-compute[82479]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 00:18:31 user nova-compute[82479]:       <entry name="product">OpenStack Nova</entry>
Apr 14 00:18:31 user nova-compute[82479]:       <entry name="version">0.0.0</entry>
Apr 14 00:18:31 user nova-compute[82479]:       <entry name="serial">ade24ab6-1a93-4449-b5e9-ec3de357665b</entry>
Apr 14 00:18:31 user nova-compute[82479]:       <entry name="uuid">ade24ab6-1a93-4449-b5e9-ec3de357665b</entry>
Apr 14 00:18:31 user nova-compute[82479]:       <entry name="family">Virtual Machine</entry>
Apr 14 00:18:31 user nova-compute[82479]:     </system>
Apr 14 00:18:31 user nova-compute[82479]:   </sysinfo>
Apr 14 00:18:31 user nova-compute[82479]:   <os>
Apr 14 00:18:31 user nova-compute[82479]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 00:18:31 user nova-compute[82479]:     <boot dev="hd"/>
Apr 14 00:18:31 user nova-compute[82479]:     <smbios mode="sysinfo"/>
Apr 14 00:18:31 user nova-compute[82479]:   </os>
Apr 14 00:18:31 user nova-compute[82479]:   <features>
Apr 14 00:18:31 user nova-compute[82479]:     <acpi/>
Apr 14 00:18:31 user nova-compute[82479]:     <apic/>
Apr 14 00:18:31 user nova-compute[82479]:     <vmcoreinfo/>
Apr 14 00:18:31 user nova-compute[82479]:   </features>
Apr 14 00:18:31 user nova-compute[82479]:   <clock offset="utc">
Apr 14 00:18:31 user nova-compute[82479]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 00:18:31 user nova-compute[82479]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 00:18:31 user nova-compute[82479]:     <timer name="hpet" present="no"/>
Apr 14 00:18:31 user nova-compute[82479]:   </clock>
Apr 14 00:18:31 user nova-compute[82479]:   <cpu mode="custom" match="exact">
Apr 14 00:18:31 user nova-compute[82479]:     <model>Nehalem</model>
Apr 14 00:18:31 user nova-compute[82479]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 00:18:31 user nova-compute[82479]:   </cpu>
Apr 14 00:18:31 user nova-compute[82479]:   <devices>
Apr 14 00:18:31 user nova-compute[82479]:     <disk type="file" device="disk">
Apr 14 00:18:31 user nova-compute[82479]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 00:18:31 user nova-compute[82479]:       <source file="/opt/stack/data/nova/instances/ade24ab6-1a93-4449-b5e9-ec3de357665b/disk"/>
Apr 14 00:18:31 user nova-compute[82479]:       <target dev="vda" bus="virtio"/>
Apr 14 00:18:31 user nova-compute[82479]:     </disk>
Apr 14 00:18:31 user nova-compute[82479]:     <interface type="ethernet">
Apr 14 00:18:31 user nova-compute[82479]:       <mac address="fa:16:3e:cd:dc:0b"/>
Apr 14 00:18:31 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:18:31 user nova-compute[82479]:       <mtu size="1442"/>
Apr 14 00:18:31 user nova-compute[82479]:       <target dev="tap11344eed-48"/>
Apr 14 00:18:31 user nova-compute[82479]:     </interface>
Apr 14 00:18:31 user nova-compute[82479]:     <serial type="pty">
Apr 14 00:18:31 user nova-compute[82479]:       <log file="/opt/stack/data/nova/instances/ade24ab6-1a93-4449-b5e9-ec3de357665b/console.log" append="off"/>
Apr 14 00:18:31 user nova-compute[82479]:     </serial>
Apr 14 00:18:31 user nova-compute[82479]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 00:18:31 user nova-compute[82479]:     <video>
Apr 14 00:18:31 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:18:31 user nova-compute[82479]:     </video>
Apr 14 00:18:31 user nova-compute[82479]:     <rng model="virtio">
Apr 14 00:18:31 user nova-compute[82479]:       <backend model="random">/dev/urandom</backend>
Apr 14 00:18:31 user nova-compute[82479]:     </rng>
Apr 14 00:18:31 user nova-compute[82479]:     <controller type="usb" index="0" model="none"/>
Apr 14 00:18:31 user nova-compute[82479]:     <memballoon model="virtio">
Apr 14 00:18:31 user nova-compute[82479]:       <stats period="10"/>
Apr 14 00:18:31 user nova-compute[82479]:     </memballoon>
Apr 14 00:18:31 user nova-compute[82479]:   </devices>
Apr 14 00:18:31 user nova-compute[82479]: </domain>
Apr 14 00:18:31 user nova-compute[82479]:  {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 00:18:31 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:18:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-576521395',display_name='tempest-ServerRescueNegativeTestJSON-server-576521395',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-576521395',id=31,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPJl6SDPfCFQp4baCPxy+GI6LhLuQU3NPsG3291XLwXmLvJxDSbMZPnAUG2FnoP7gWRMoPh0RxuN0i+Igwez3QU2DJmViyuFIRLYjK8+Jg8nIMy2dRZs6Aqrth2wJ7mNQ==',key_name='tempest-keypair-2020248029',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='524265958bd24a6cb94aa3115eb2b6c7',ramdisk_id='',reservation_id='r-a4yceyqy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1055458768',owner_user_name='tempest-ServerRescueNegativeTestJSON-1055458768-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:18:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f43f3171ccad4167ac783bbdfe2df478',uuid=ade24ab6-1a93-4449-b5e9-ec3de357665b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11344eed-48f5-49c5-a770-c9c298f7185e", "address": "fa:16:3e:cd:dc:0b", "network": {"id": "08106daa-a35e-4376-8c46-2b4baa51c6ea", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321730350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524265958bd24a6cb94aa3115eb2b6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11344eed-48", "ovs_interfaceid": "11344eed-48f5-49c5-a770-c9c298f7185e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 00:18:31 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Converting VIF {"id": "11344eed-48f5-49c5-a770-c9c298f7185e", "address": "fa:16:3e:cd:dc:0b", "network": {"id": "08106daa-a35e-4376-8c46-2b4baa51c6ea", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321730350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524265958bd24a6cb94aa3115eb2b6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11344eed-48", "ovs_interfaceid": "11344eed-48f5-49c5-a770-c9c298f7185e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:18:31 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:dc:0b,bridge_name='br-int',has_traffic_filtering=True,id=11344eed-48f5-49c5-a770-c9c298f7185e,network=Network(08106daa-a35e-4376-8c46-2b4baa51c6ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11344eed-48') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:18:31 user nova-compute[82479]: DEBUG os_vif [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:dc:0b,bridge_name='br-int',has_traffic_filtering=True,id=11344eed-48f5-49c5-a770-c9c298f7185e,network=Network(08106daa-a35e-4376-8c46-2b4baa51c6ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11344eed-48') {{(pid=82479) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 00:18:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:18:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:18:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 00:18:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:18:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap11344eed-48, may_exist=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:18:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap11344eed-48, col_values=(('external_ids', {'iface-id': '11344eed-48f5-49c5-a770-c9c298f7185e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:dc:0b', 'vm-uuid': 'ade24ab6-1a93-4449-b5e9-ec3de357665b'}),)) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:18:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:18:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:18:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:18:31 user nova-compute[82479]: INFO os_vif [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:dc:0b,bridge_name='br-int',has_traffic_filtering=True,id=11344eed-48f5-49c5-a770-c9c298f7185e,network=Network(08106daa-a35e-4376-8c46-2b4baa51c6ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11344eed-48')
Apr 14 00:18:31 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:18:31 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] No VIF found with MAC fa:16:3e:cd:dc:0b, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:18:32 user nova-compute[82479]: DEBUG nova.network.neutron [req-3270724c-666b-473e-b5e3-831451e9e874 req-db72c936-70a9-4b19-9eaa-41547a8f36dc service nova] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Updated VIF entry in instance network info cache for port 11344eed-48f5-49c5-a770-c9c298f7185e. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:18:32 user nova-compute[82479]: DEBUG nova.network.neutron [req-3270724c-666b-473e-b5e3-831451e9e874 req-db72c936-70a9-4b19-9eaa-41547a8f36dc service nova] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Updating instance_info_cache with network_info: [{"id": "11344eed-48f5-49c5-a770-c9c298f7185e", "address": "fa:16:3e:cd:dc:0b", "network": {"id": "08106daa-a35e-4376-8c46-2b4baa51c6ea", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321730350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524265958bd24a6cb94aa3115eb2b6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11344eed-48", "ovs_interfaceid": "11344eed-48f5-49c5-a770-c9c298f7185e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:18:32 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-3270724c-666b-473e-b5e3-831451e9e874 req-db72c936-70a9-4b19-9eaa-41547a8f36dc service nova] Releasing lock "refresh_cache-ade24ab6-1a93-4449-b5e9-ec3de357665b" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:18:33 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:18:33 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:18:33 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:18:33 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:18:33 user nova-compute[82479]: DEBUG nova.compute.manager [req-4e467a95-7ffa-452b-b40b-6993b1c936bf req-1c6aea71-dddd-4d73-8c22-0a5e15e2591b service nova] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Received event network-vif-plugged-11344eed-48f5-49c5-a770-c9c298f7185e {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:18:33 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-4e467a95-7ffa-452b-b40b-6993b1c936bf req-1c6aea71-dddd-4d73-8c22-0a5e15e2591b service nova] Acquiring lock "ade24ab6-1a93-4449-b5e9-ec3de357665b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:18:33 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-4e467a95-7ffa-452b-b40b-6993b1c936bf req-1c6aea71-dddd-4d73-8c22-0a5e15e2591b service nova] Lock "ade24ab6-1a93-4449-b5e9-ec3de357665b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:18:33 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-4e467a95-7ffa-452b-b40b-6993b1c936bf req-1c6aea71-dddd-4d73-8c22-0a5e15e2591b service nova] Lock "ade24ab6-1a93-4449-b5e9-ec3de357665b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:18:33 user nova-compute[82479]: DEBUG nova.compute.manager [req-4e467a95-7ffa-452b-b40b-6993b1c936bf req-1c6aea71-dddd-4d73-8c22-0a5e15e2591b service nova] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] No waiting events found dispatching network-vif-plugged-11344eed-48f5-49c5-a770-c9c298f7185e {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:18:33 user nova-compute[82479]: WARNING nova.compute.manager [req-4e467a95-7ffa-452b-b40b-6993b1c936bf req-1c6aea71-dddd-4d73-8c22-0a5e15e2591b service nova] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Received unexpected event network-vif-plugged-11344eed-48f5-49c5-a770-c9c298f7185e for instance with vm_state building and task_state spawning.
Apr 14 00:18:35 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681431515.410318, ade24ab6-1a93-4449-b5e9-ec3de357665b => Resumed> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:18:35 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] VM Resumed (Lifecycle Event)
Apr 14 00:18:35 user nova-compute[82479]: DEBUG nova.compute.manager [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Instance event wait completed in 0 seconds for  {{(pid=82479) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 00:18:35 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Guest created on hypervisor {{(pid=82479) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 00:18:35 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Instance spawned successfully.
Apr 14 00:18:35 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 00:18:35 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:18:35 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:18:35 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Found default for hw_cdrom_bus of ide {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:18:35 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Found default for hw_disk_bus of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:18:35 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Found default for hw_input_bus of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:18:35 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Found default for hw_pointer_model of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:18:35 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Found default for hw_video_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:18:35 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Found default for hw_vif_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:18:35 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:18:35 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681431515.4151351, ade24ab6-1a93-4449-b5e9-ec3de357665b => Started> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:18:35 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] VM Started (Lifecycle Event)
Apr 14 00:18:35 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:18:35 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:18:35 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:18:35 user nova-compute[82479]: INFO nova.compute.manager [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Took 6.12 seconds to spawn the instance on the hypervisor.
Apr 14 00:18:35 user nova-compute[82479]: DEBUG nova.compute.manager [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:18:35 user nova-compute[82479]: DEBUG nova.compute.manager [req-b1be9386-1cf8-40a6-92d9-333600a5fef5 req-e3381a7f-6576-4962-8d00-547766ca6769 service nova] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Received event network-vif-plugged-11344eed-48f5-49c5-a770-c9c298f7185e {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:18:35 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-b1be9386-1cf8-40a6-92d9-333600a5fef5 req-e3381a7f-6576-4962-8d00-547766ca6769 service nova] Acquiring lock "ade24ab6-1a93-4449-b5e9-ec3de357665b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:18:35 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-b1be9386-1cf8-40a6-92d9-333600a5fef5 req-e3381a7f-6576-4962-8d00-547766ca6769 service nova] Lock "ade24ab6-1a93-4449-b5e9-ec3de357665b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:18:35 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-b1be9386-1cf8-40a6-92d9-333600a5fef5 req-e3381a7f-6576-4962-8d00-547766ca6769 service nova] Lock "ade24ab6-1a93-4449-b5e9-ec3de357665b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:18:35 user nova-compute[82479]: DEBUG nova.compute.manager [req-b1be9386-1cf8-40a6-92d9-333600a5fef5 req-e3381a7f-6576-4962-8d00-547766ca6769 service nova] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] No waiting events found dispatching network-vif-plugged-11344eed-48f5-49c5-a770-c9c298f7185e {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:18:35 user nova-compute[82479]: WARNING nova.compute.manager [req-b1be9386-1cf8-40a6-92d9-333600a5fef5 req-e3381a7f-6576-4962-8d00-547766ca6769 service nova] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Received unexpected event network-vif-plugged-11344eed-48f5-49c5-a770-c9c298f7185e for instance with vm_state building and task_state spawning.
Apr 14 00:18:35 user nova-compute[82479]: INFO nova.compute.manager [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Took 6.87 seconds to build instance.
Apr 14 00:18:35 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8dbd0c1a-3c42-441b-aa65-8439a13f995c tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "ade24ab6-1a93-4449-b5e9-ec3de357665b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.960s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:18:36 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:18:36 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:18:40 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-76bd4151-57a8-4b55-bdd7-443d0f4855a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:18:40 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-76bd4151-57a8-4b55-bdd7-443d0f4855a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:18:40 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-76bd4151-57a8-4b55-bdd7-443d0f4855a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:18:40 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-76bd4151-57a8-4b55-bdd7-443d0f4855a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:18:40 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-76bd4151-57a8-4b55-bdd7-443d0f4855a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:18:40 user nova-compute[82479]: INFO nova.compute.manager [None req-76bd4151-57a8-4b55-bdd7-443d0f4855a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Terminating instance
Apr 14 00:18:40 user nova-compute[82479]: DEBUG nova.compute.manager [None req-76bd4151-57a8-4b55-bdd7-443d0f4855a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Start destroying the instance on the hypervisor. {{(pid=82479) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 00:18:40 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:18:40 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:18:40 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:18:40 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:18:40 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:18:40 user nova-compute[82479]: DEBUG nova.compute.manager [req-7751f115-4889-44c0-9464-7658abdb274d req-67658657-367f-454d-a7ad-823f0b9faa42 service nova] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Received event network-vif-unplugged-617f05b8-c04e-4abf-b4e5-a0234209624a {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:18:40 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-7751f115-4889-44c0-9464-7658abdb274d req-67658657-367f-454d-a7ad-823f0b9faa42 service nova] Acquiring lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:18:40 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-7751f115-4889-44c0-9464-7658abdb274d req-67658657-367f-454d-a7ad-823f0b9faa42 service nova] Lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:18:40 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-7751f115-4889-44c0-9464-7658abdb274d req-67658657-367f-454d-a7ad-823f0b9faa42 service nova] Lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:18:40 user nova-compute[82479]: DEBUG nova.compute.manager [req-7751f115-4889-44c0-9464-7658abdb274d req-67658657-367f-454d-a7ad-823f0b9faa42 service nova] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] No waiting events found dispatching network-vif-unplugged-617f05b8-c04e-4abf-b4e5-a0234209624a {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:18:40 user nova-compute[82479]: DEBUG nova.compute.manager [req-7751f115-4889-44c0-9464-7658abdb274d req-67658657-367f-454d-a7ad-823f0b9faa42 service nova] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Received event network-vif-unplugged-617f05b8-c04e-4abf-b4e5-a0234209624a for instance with task_state deleting. {{(pid=82479) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 00:18:41 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Instance destroyed successfully.
Apr 14 00:18:41 user nova-compute[82479]: DEBUG nova.objects.instance [None req-76bd4151-57a8-4b55-bdd7-443d0f4855a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lazy-loading 'resources' on Instance uuid b3475e7e-ceb4-452a-a045-dbf43c5944dd {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:18:41 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-76bd4151-57a8-4b55-bdd7-443d0f4855a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T00:05:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-2144192259',display_name='tempest-ServerActionsTestJSON-server-1662090424',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-2144192259',id=6,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD8E1mkrqLo3jsCiJcIvha4CNzW2T6/HQ38hZ5dGaGtUghmrHejTJlAuKgmy6xusLbaAzGTrJCKVkdgQ5v0CqCqGeNMDA89aLJgLl5KHn3gvI39SkbPja84HarSvbQbbXg==',key_name='tempest-keypair-1040271550',keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:16:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bf8663ccad9047f4b11b9ae0646c287a',ramdisk_id='',reservation_id='r-amqn5295',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-948553482',owner_user_name='tempest-ServerActionsTestJSON-948553482-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T00:16:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d86662f2c7648daad87118b7e9f757c',uuid=b3475e7e-ceb4-452a-a045-dbf43c5944dd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "617f05b8-c04e-4abf-b4e5-a0234209624a", "address": "fa:16:3e:f9:fd:1a", "network": {"id": "cb8c9bb1-a885-486d-aa6a-de600bc01c2e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1676259779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8663ccad9047f4b11b9ae0646c287a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617f05b8-c0", "ovs_interfaceid": "617f05b8-c04e-4abf-b4e5-a0234209624a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 00:18:41 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-76bd4151-57a8-4b55-bdd7-443d0f4855a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Converting VIF {"id": "617f05b8-c04e-4abf-b4e5-a0234209624a", "address": "fa:16:3e:f9:fd:1a", "network": {"id": "cb8c9bb1-a885-486d-aa6a-de600bc01c2e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1676259779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8663ccad9047f4b11b9ae0646c287a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap617f05b8-c0", "ovs_interfaceid": "617f05b8-c04e-4abf-b4e5-a0234209624a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:18:41 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-76bd4151-57a8-4b55-bdd7-443d0f4855a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:fd:1a,bridge_name='br-int',has_traffic_filtering=True,id=617f05b8-c04e-4abf-b4e5-a0234209624a,network=Network(cb8c9bb1-a885-486d-aa6a-de600bc01c2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap617f05b8-c0') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:18:41 user nova-compute[82479]: DEBUG os_vif [None req-76bd4151-57a8-4b55-bdd7-443d0f4855a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:fd:1a,bridge_name='br-int',has_traffic_filtering=True,id=617f05b8-c04e-4abf-b4e5-a0234209624a,network=Network(cb8c9bb1-a885-486d-aa6a-de600bc01c2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap617f05b8-c0') {{(pid=82479) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 00:18:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:18:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap617f05b8-c0, bridge=br-int, if_exists=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:18:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:18:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:18:41 user nova-compute[82479]: INFO os_vif [None req-76bd4151-57a8-4b55-bdd7-443d0f4855a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:fd:1a,bridge_name='br-int',has_traffic_filtering=True,id=617f05b8-c04e-4abf-b4e5-a0234209624a,network=Network(cb8c9bb1-a885-486d-aa6a-de600bc01c2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap617f05b8-c0')
Apr 14 00:18:41 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76bd4151-57a8-4b55-bdd7-443d0f4855a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] calling os-brick to detach iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 00:18:41 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-76bd4151-57a8-4b55-bdd7-443d0f4855a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, {'target_iqn': 'iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YrRJCHcL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:18:41 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-76bd4151-57a8-4b55-bdd7-443d0f4855a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:18:41 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-76bd4151-57a8-4b55-bdd7-443d0f4855a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:18:41 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-76bd4151-57a8-4b55-bdd7-443d0f4855a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:18:41 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:18:41 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:18:41 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e554a0d-03ad-4303-ba76-1da0b7828387]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:18:41 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-76bd4151-57a8-4b55-bdd7-443d0f4855a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 00:18:41 user nova-compute[82479]: No targets found.
Apr 14 00:18:41 user nova-compute[82479]: iSNS:
Apr 14 00:18:41 user nova-compute[82479]: No targets found.
Apr 14 00:18:41 user nova-compute[82479]: STATIC:
Apr 14 00:18:41 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc
Apr 14 00:18:41 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:18:41 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:18:41 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7
Apr 14 00:18:41 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:18:41 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:18:41 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e
Apr 14 00:18:41 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:18:41 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:18:41 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99
Apr 14 00:18:41 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:18:41 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:18:41 user nova-compute[82479]: FIRMWARE:
Apr 14 00:18:41 user nova-compute[82479]: No targets found.
Apr 14 00:18:41 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:18:41 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-76bd4151-57a8-4b55-bdd7-443d0f4855a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 00:18:41 user nova-compute[82479]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 00:18:41 user nova-compute[82479]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82479) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 00:18:41 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-76bd4151-57a8-4b55-bdd7-443d0f4855a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e', 0)] {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 00:18:41 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:18:41 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:18:41 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[6adfc38c-15f5-4b6f-9eee-58ce3637b138]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:18:41 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:18:41 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:18:41 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f8e380-791f-4210-967f-7ac4bf85684c]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:18:41 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-76bd4151-57a8-4b55-bdd7-443d0f4855a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:18:41 user nova-compute[82479]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e (non-flash)
Apr 14 00:18:41 user nova-compute[82479]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 (non-flash)
Apr 14 00:18:41 user nova-compute[82479]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 (non-flash)
Apr 14 00:18:41 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:18:41 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-76bd4151-57a8-4b55-bdd7-443d0f4855a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:18:41 user nova-compute[82479]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e (non-flash)
Apr 14 00:18:41 user nova-compute[82479]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 (non-flash)
Apr 14 00:18:41 user nova-compute[82479]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 (non-flash)
Apr 14 00:18:41 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:18:41 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-76bd4151-57a8-4b55-bdd7-443d0f4855a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f333826ab90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e'): ({'sdb'}, set())}) {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 00:18:41 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-76bd4151-57a8-4b55-bdd7-443d0f4855a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Removing single pathed devices sdb {{(pid=82479) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 00:18:41 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:18:41 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:18:41 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[343c1123-e817-4aa1-a3ab-8191ff3e84af]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:18:41 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:18:41 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:18:41 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[536e2921-9126-48d6-9271-ce8726718768]: (4, ('ok\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:18:41 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-76bd4151-57a8-4b55-bdd7-443d0f4855a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Flushing IO for device /dev/sdb {{(pid=82479) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 00:18:41 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:18:41 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:18:41 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[9658cdda-a858-4260-8f6c-6eb07571180e]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:18:41 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-76bd4151-57a8-4b55-bdd7-443d0f4855a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82479) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 00:18:41 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:18:41 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:18:41 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b158c7e-b26f-4b54-bc87-28682b61062b]: (4, ('1', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:18:41 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-76bd4151-57a8-4b55-bdd7-443d0f4855a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 00:18:41 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-76bd4151-57a8-4b55-bdd7-443d0f4855a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] SCSI volumes sdb have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 00:18:41 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-76bd4151-57a8-4b55-bdd7-443d0f4855a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e')] {{(pid=82479) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 00:18:41 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:18:41 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:18:41 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[01de9c91-ba06-481e-ac96-d3802b92bd54]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:18:41 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-76bd4151-57a8-4b55-bdd7-443d0f4855a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:18:41 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e -p 172.16.0.220:3260 --logout {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:18:41 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:18:41 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d24a7d5-2926-4dd3-9669-0d357f9f28e3]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:18:41 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-76bd4151-57a8-4b55-bdd7-443d0f4855a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e, portal: 172.16.0.220,3260]
Apr 14 00:18:41 user nova-compute[82479]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e, portal: 172.16.0.220,3260] successful.
Apr 14 00:18:41 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:18:41 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e -p 172.16.0.220:3260 --op delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:18:41 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:18:41 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f3fe7d7-7c31-4b8f-9b33-6c31fc11fc72]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:18:41 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-76bd4151-57a8-4b55-bdd7-443d0f4855a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:18:41 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-76bd4151-57a8-4b55-bdd7-443d0f4855a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:18:41 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-76bd4151-57a8-4b55-bdd7-443d0f4855a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] <== disconnect_volume: return (330ms) None {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:18:41 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76bd4151-57a8-4b55-bdd7-443d0f4855a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Disconnected iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 00:18:41 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-76bd4151-57a8-4b55-bdd7-443d0f4855a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Deleting instance files /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd_del
Apr 14 00:18:41 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-76bd4151-57a8-4b55-bdd7-443d0f4855a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Deletion of /opt/stack/data/nova/instances/b3475e7e-ceb4-452a-a045-dbf43c5944dd_del complete
Apr 14 00:18:41 user nova-compute[82479]: INFO nova.compute.manager [None req-76bd4151-57a8-4b55-bdd7-443d0f4855a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Took 1.24 seconds to destroy the instance on the hypervisor.
Apr 14 00:18:41 user nova-compute[82479]: DEBUG oslo.service.loopingcall [None req-76bd4151-57a8-4b55-bdd7-443d0f4855a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82479) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 00:18:41 user nova-compute[82479]: DEBUG nova.compute.manager [-] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Deallocating network for instance {{(pid=82479) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 00:18:41 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] deallocate_for_instance() {{(pid=82479) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 00:18:42 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Updating instance_info_cache with network_info: [] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:18:42 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Took 0.96 seconds to deallocate network for instance.
Apr 14 00:18:42 user nova-compute[82479]: DEBUG nova.compute.manager [req-adebd0ea-1c64-4ecc-a312-5c4cc99f6d99 req-8f5cd116-2ea7-4458-a86a-46509934dc74 service nova] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Received event network-vif-deleted-617f05b8-c04e-4abf-b4e5-a0234209624a {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:18:42 user nova-compute[82479]: DEBUG nova.compute.manager [req-3e197268-a85d-488f-a160-5f94e0c5e287 req-f0b26e06-2600-44e6-9fec-51b0badb738b service nova] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Received event network-vif-plugged-617f05b8-c04e-4abf-b4e5-a0234209624a {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:18:42 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-3e197268-a85d-488f-a160-5f94e0c5e287 req-f0b26e06-2600-44e6-9fec-51b0badb738b service nova] Acquiring lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:18:42 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-3e197268-a85d-488f-a160-5f94e0c5e287 req-f0b26e06-2600-44e6-9fec-51b0badb738b service nova] Lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:18:42 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-3e197268-a85d-488f-a160-5f94e0c5e287 req-f0b26e06-2600-44e6-9fec-51b0badb738b service nova] Lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:18:42 user nova-compute[82479]: DEBUG nova.compute.manager [req-3e197268-a85d-488f-a160-5f94e0c5e287 req-f0b26e06-2600-44e6-9fec-51b0badb738b service nova] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] No waiting events found dispatching network-vif-plugged-617f05b8-c04e-4abf-b4e5-a0234209624a {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:18:42 user nova-compute[82479]: WARNING nova.compute.manager [req-3e197268-a85d-488f-a160-5f94e0c5e287 req-f0b26e06-2600-44e6-9fec-51b0badb738b service nova] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Received unexpected event network-vif-plugged-617f05b8-c04e-4abf-b4e5-a0234209624a for instance with vm_state active and task_state deleting.
Apr 14 00:18:43 user nova-compute[82479]: INFO nova.compute.manager [None req-76bd4151-57a8-4b55-bdd7-443d0f4855a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Took 0.96 seconds to detach 1 volumes for instance.
Apr 14 00:18:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-76bd4151-57a8-4b55-bdd7-443d0f4855a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:18:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-76bd4151-57a8-4b55-bdd7-443d0f4855a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:18:43 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-76bd4151-57a8-4b55-bdd7-443d0f4855a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:18:43 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-76bd4151-57a8-4b55-bdd7-443d0f4855a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:18:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-76bd4151-57a8-4b55-bdd7-443d0f4855a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.369s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:18:44 user nova-compute[82479]: INFO nova.scheduler.client.report [None req-76bd4151-57a8-4b55-bdd7-443d0f4855a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Deleted allocations for instance b3475e7e-ceb4-452a-a045-dbf43c5944dd
Apr 14 00:18:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-76bd4151-57a8-4b55-bdd7-443d0f4855a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "b3475e7e-ceb4-452a-a045-dbf43c5944dd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.804s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:18:45 user nova-compute[82479]: DEBUG nova.compute.manager [req-69f4ad46-01e7-466f-80b1-e2acedb01f66 req-7b7d8893-3e4e-4d0c-8f94-e1aedc22818b service nova] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Received event network-changed-0f90a627-4dab-4a2a-a2c2-eaae2910b379 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:18:45 user nova-compute[82479]: DEBUG nova.compute.manager [req-69f4ad46-01e7-466f-80b1-e2acedb01f66 req-7b7d8893-3e4e-4d0c-8f94-e1aedc22818b service nova] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Refreshing instance network info cache due to event network-changed-0f90a627-4dab-4a2a-a2c2-eaae2910b379. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:18:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-69f4ad46-01e7-466f-80b1-e2acedb01f66 req-7b7d8893-3e4e-4d0c-8f94-e1aedc22818b service nova] Acquiring lock "refresh_cache-c7e1f470-fe8a-455e-aa0b-0d2475957fc0" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:18:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-69f4ad46-01e7-466f-80b1-e2acedb01f66 req-7b7d8893-3e4e-4d0c-8f94-e1aedc22818b service nova] Acquired lock "refresh_cache-c7e1f470-fe8a-455e-aa0b-0d2475957fc0" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:18:45 user nova-compute[82479]: DEBUG nova.network.neutron [req-69f4ad46-01e7-466f-80b1-e2acedb01f66 req-7b7d8893-3e4e-4d0c-8f94-e1aedc22818b service nova] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Refreshing network info cache for port 0f90a627-4dab-4a2a-a2c2-eaae2910b379 {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:18:45 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:18:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-082496c2-5103-4cdc-bd75-e33ecb9c797c tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Acquiring lock "c7e1f470-fe8a-455e-aa0b-0d2475957fc0" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:18:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-082496c2-5103-4cdc-bd75-e33ecb9c797c tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "c7e1f470-fe8a-455e-aa0b-0d2475957fc0" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:18:45 user nova-compute[82479]: INFO nova.compute.manager [None req-082496c2-5103-4cdc-bd75-e33ecb9c797c tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Shelve offloading
Apr 14 00:18:46 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:18:46 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:18:46 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:18:46 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:18:46 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:18:46 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:18:46 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:18:46 user nova-compute[82479]: DEBUG nova.network.neutron [req-69f4ad46-01e7-466f-80b1-e2acedb01f66 req-7b7d8893-3e4e-4d0c-8f94-e1aedc22818b service nova] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Updated VIF entry in instance network info cache for port 0f90a627-4dab-4a2a-a2c2-eaae2910b379. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:18:46 user nova-compute[82479]: DEBUG nova.network.neutron [req-69f4ad46-01e7-466f-80b1-e2acedb01f66 req-7b7d8893-3e4e-4d0c-8f94-e1aedc22818b service nova] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Updating instance_info_cache with network_info: [{"id": "0f90a627-4dab-4a2a-a2c2-eaae2910b379", "address": "fa:16:3e:e2:65:cb", "network": {"id": "9f0b7c66-0d95-4c5f-8c77-6f12228c20fc", "bridge": "br-int", "label": "tempest-TestShelveInstance-940455626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6be95e5c8d94269802ecf487ff73104", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f90a627-4d", "ovs_interfaceid": "0f90a627-4dab-4a2a-a2c2-eaae2910b379", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:18:46 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-69f4ad46-01e7-466f-80b1-e2acedb01f66 req-7b7d8893-3e4e-4d0c-8f94-e1aedc22818b service nova] Releasing lock "refresh_cache-c7e1f470-fe8a-455e-aa0b-0d2475957fc0" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:18:46 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:18:46 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:18:46 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:18:46 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Instance destroyed successfully.
Apr 14 00:18:46 user nova-compute[82479]: DEBUG nova.compute.manager [None req-082496c2-5103-4cdc-bd75-e33ecb9c797c tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:18:46 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-082496c2-5103-4cdc-bd75-e33ecb9c797c tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Acquiring lock "refresh_cache-c7e1f470-fe8a-455e-aa0b-0d2475957fc0" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:18:46 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-082496c2-5103-4cdc-bd75-e33ecb9c797c tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Acquired lock "refresh_cache-c7e1f470-fe8a-455e-aa0b-0d2475957fc0" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:18:46 user nova-compute[82479]: DEBUG nova.network.neutron [None req-082496c2-5103-4cdc-bd75-e33ecb9c797c tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 00:18:47 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:18:47 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:18:47 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:18:47 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:18:47 user nova-compute[82479]: DEBUG nova.network.neutron [None req-082496c2-5103-4cdc-bd75-e33ecb9c797c tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Updating instance_info_cache with network_info: [{"id": "0f90a627-4dab-4a2a-a2c2-eaae2910b379", "address": "fa:16:3e:e2:65:cb", "network": {"id": "9f0b7c66-0d95-4c5f-8c77-6f12228c20fc", "bridge": "br-int", "label": "tempest-TestShelveInstance-940455626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6be95e5c8d94269802ecf487ff73104", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f90a627-4d", "ovs_interfaceid": "0f90a627-4dab-4a2a-a2c2-eaae2910b379", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:18:47 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-082496c2-5103-4cdc-bd75-e33ecb9c797c tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Releasing lock "refresh_cache-c7e1f470-fe8a-455e-aa0b-0d2475957fc0" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:18:47 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:18:47 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:18:47 user nova-compute[82479]: DEBUG nova.compute.manager [req-e47e9d46-549d-482b-a072-581eaa89dc1d req-7c882303-fe78-4bd7-955a-d1d248396313 service nova] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Received event network-vif-unplugged-0f90a627-4dab-4a2a-a2c2-eaae2910b379 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:18:47 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-e47e9d46-549d-482b-a072-581eaa89dc1d req-7c882303-fe78-4bd7-955a-d1d248396313 service nova] Acquiring lock "c7e1f470-fe8a-455e-aa0b-0d2475957fc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:18:47 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-e47e9d46-549d-482b-a072-581eaa89dc1d req-7c882303-fe78-4bd7-955a-d1d248396313 service nova] Lock "c7e1f470-fe8a-455e-aa0b-0d2475957fc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:18:47 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-e47e9d46-549d-482b-a072-581eaa89dc1d req-7c882303-fe78-4bd7-955a-d1d248396313 service nova] Lock "c7e1f470-fe8a-455e-aa0b-0d2475957fc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:18:47 user nova-compute[82479]: DEBUG nova.compute.manager [req-e47e9d46-549d-482b-a072-581eaa89dc1d req-7c882303-fe78-4bd7-955a-d1d248396313 service nova] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] No waiting events found dispatching network-vif-unplugged-0f90a627-4dab-4a2a-a2c2-eaae2910b379 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:18:47 user nova-compute[82479]: WARNING nova.compute.manager [req-e47e9d46-549d-482b-a072-581eaa89dc1d req-7c882303-fe78-4bd7-955a-d1d248396313 service nova] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Received unexpected event network-vif-unplugged-0f90a627-4dab-4a2a-a2c2-eaae2910b379 for instance with vm_state active and task_state shelving.
Apr 14 00:18:47 user nova-compute[82479]: DEBUG nova.compute.manager [req-e47e9d46-549d-482b-a072-581eaa89dc1d req-7c882303-fe78-4bd7-955a-d1d248396313 service nova] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Received event network-vif-plugged-0f90a627-4dab-4a2a-a2c2-eaae2910b379 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:18:47 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-e47e9d46-549d-482b-a072-581eaa89dc1d req-7c882303-fe78-4bd7-955a-d1d248396313 service nova] Acquiring lock "c7e1f470-fe8a-455e-aa0b-0d2475957fc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:18:47 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-e47e9d46-549d-482b-a072-581eaa89dc1d req-7c882303-fe78-4bd7-955a-d1d248396313 service nova] Lock "c7e1f470-fe8a-455e-aa0b-0d2475957fc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:18:47 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-e47e9d46-549d-482b-a072-581eaa89dc1d req-7c882303-fe78-4bd7-955a-d1d248396313 service nova] Lock "c7e1f470-fe8a-455e-aa0b-0d2475957fc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:18:47 user nova-compute[82479]: DEBUG nova.compute.manager [req-e47e9d46-549d-482b-a072-581eaa89dc1d req-7c882303-fe78-4bd7-955a-d1d248396313 service nova] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] No waiting events found dispatching network-vif-plugged-0f90a627-4dab-4a2a-a2c2-eaae2910b379 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:18:47 user nova-compute[82479]: WARNING nova.compute.manager [req-e47e9d46-549d-482b-a072-581eaa89dc1d req-7c882303-fe78-4bd7-955a-d1d248396313 service nova] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Received unexpected event network-vif-plugged-0f90a627-4dab-4a2a-a2c2-eaae2910b379 for instance with vm_state active and task_state shelving.
Apr 14 00:18:48 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Instance destroyed successfully.
Apr 14 00:18:48 user nova-compute[82479]: DEBUG nova.objects.instance [None req-082496c2-5103-4cdc-bd75-e33ecb9c797c tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lazy-loading 'resources' on Instance uuid c7e1f470-fe8a-455e-aa0b-0d2475957fc0 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:18:48 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-082496c2-5103-4cdc-bd75-e33ecb9c797c tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:16:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-454867915',display_name='tempest-TestShelveInstance-server-454867915',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-454867915',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC+PTdQ169W4Ik0XJKAX1vms0H6bKP2Yz2If5eK4IKeWDFl4zKDtIms+QmK6CN9t818K0haZCxWGM5VZYA/HUy2ewr54rCodMDtSTJaDzyD+lhV417bVgrES1KaG3eBq0w==',key_name='tempest-TestShelveInstance-266505447',keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:17:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e6be95e5c8d94269802ecf487ff73104',ramdisk_id='',reservation_id='r-el3udybd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-5222591',owner_user_name='tempest-TestShelveInstance-5222591-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T00:17:04Z,user_data=None,user_id='b81e5ce5d2414980a506d0f3b37d0d5c',uuid=c7e1f470-fe8a-455e-aa0b-0d2475957fc0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0f90a627-4dab-4a2a-a2c2-eaae2910b379", "address": "fa:16:3e:e2:65:cb", "network": {"id": "9f0b7c66-0d95-4c5f-8c77-6f12228c20fc", "bridge": "br-int", "label": "tempest-TestShelveInstance-940455626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6be95e5c8d94269802ecf487ff73104", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f90a627-4d", "ovs_interfaceid": "0f90a627-4dab-4a2a-a2c2-eaae2910b379", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 00:18:48 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-082496c2-5103-4cdc-bd75-e33ecb9c797c tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Converting VIF {"id": "0f90a627-4dab-4a2a-a2c2-eaae2910b379", "address": "fa:16:3e:e2:65:cb", "network": {"id": "9f0b7c66-0d95-4c5f-8c77-6f12228c20fc", "bridge": "br-int", "label": "tempest-TestShelveInstance-940455626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6be95e5c8d94269802ecf487ff73104", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f90a627-4d", "ovs_interfaceid": "0f90a627-4dab-4a2a-a2c2-eaae2910b379", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:18:48 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-082496c2-5103-4cdc-bd75-e33ecb9c797c tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:65:cb,bridge_name='br-int',has_traffic_filtering=True,id=0f90a627-4dab-4a2a-a2c2-eaae2910b379,network=Network(9f0b7c66-0d95-4c5f-8c77-6f12228c20fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f90a627-4d') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:18:48 user nova-compute[82479]: DEBUG os_vif [None req-082496c2-5103-4cdc-bd75-e33ecb9c797c tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:65:cb,bridge_name='br-int',has_traffic_filtering=True,id=0f90a627-4dab-4a2a-a2c2-eaae2910b379,network=Network(9f0b7c66-0d95-4c5f-8c77-6f12228c20fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f90a627-4d') {{(pid=82479) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 00:18:48 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:18:48 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0f90a627-4d, bridge=br-int, if_exists=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:18:48 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:18:48 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:18:48 user nova-compute[82479]: INFO os_vif [None req-082496c2-5103-4cdc-bd75-e33ecb9c797c tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:65:cb,bridge_name='br-int',has_traffic_filtering=True,id=0f90a627-4dab-4a2a-a2c2-eaae2910b379,network=Network(9f0b7c66-0d95-4c5f-8c77-6f12228c20fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f90a627-4d')
Apr 14 00:18:48 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-082496c2-5103-4cdc-bd75-e33ecb9c797c tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] calling os-brick to detach iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 00:18:48 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-082496c2-5103-4cdc-bd75-e33ecb9c797c tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, {'target_iqn': 'iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FZCpIqMc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:18:48 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-082496c2-5103-4cdc-bd75-e33ecb9c797c tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:18:48 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-082496c2-5103-4cdc-bd75-e33ecb9c797c tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:18:48 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-082496c2-5103-4cdc-bd75-e33ecb9c797c tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:18:48 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:18:48 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:18:48 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[c28bd9ad-22ad-4c61-9eb3-93ddbe6006c3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:18:48 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-082496c2-5103-4cdc-bd75-e33ecb9c797c tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 00:18:48 user nova-compute[82479]: No targets found.
Apr 14 00:18:48 user nova-compute[82479]: iSNS:
Apr 14 00:18:48 user nova-compute[82479]: No targets found.
Apr 14 00:18:48 user nova-compute[82479]: STATIC:
Apr 14 00:18:48 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc
Apr 14 00:18:48 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:18:48 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:18:48 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7
Apr 14 00:18:48 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:18:48 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:18:48 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99
Apr 14 00:18:48 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:18:48 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:18:48 user nova-compute[82479]: FIRMWARE:
Apr 14 00:18:48 user nova-compute[82479]: No targets found.
Apr 14 00:18:48 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:18:48 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-082496c2-5103-4cdc-bd75-e33ecb9c797c tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 00:18:48 user nova-compute[82479]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 00:18:48 user nova-compute[82479]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82479) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 00:18:48 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-082496c2-5103-4cdc-bd75-e33ecb9c797c tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7', 0)] {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 00:18:48 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:18:48 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:18:48 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46d50db-f73c-4709-aa48-f2a97df6ae96]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:18:48 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:18:48 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:18:48 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[450efe91-cef3-44c1-9870-b15ecb5e2cdd]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:18:48 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-082496c2-5103-4cdc-bd75-e33ecb9c797c tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:18:48 user nova-compute[82479]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 (non-flash)
Apr 14 00:18:48 user nova-compute[82479]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 (non-flash)
Apr 14 00:18:48 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:18:48 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-082496c2-5103-4cdc-bd75-e33ecb9c797c tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:18:48 user nova-compute[82479]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 (non-flash)
Apr 14 00:18:48 user nova-compute[82479]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 (non-flash)
Apr 14 00:18:48 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:18:48 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-082496c2-5103-4cdc-bd75-e33ecb9c797c tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f333830ab00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7'): ({'sdd'}, set())}) {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 00:18:48 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-082496c2-5103-4cdc-bd75-e33ecb9c797c tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Removing single pathed devices sdd {{(pid=82479) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 00:18:48 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:18:48 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:18:48 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ee1b90-d281-420a-834e-ab53a0a518aa]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:18:48 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:18:48 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:18:48 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc8269f-f358-493e-8ce6-0d6545b99201]: (4, ('ok\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:18:48 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-082496c2-5103-4cdc-bd75-e33ecb9c797c tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Flushing IO for device /dev/sdd {{(pid=82479) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 00:18:48 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:18:48 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:18:48 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[96122fae-8922-4630-911c-f3323b9ac12e]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:18:48 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-082496c2-5103-4cdc-bd75-e33ecb9c797c tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=82479) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 00:18:48 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:18:48 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.037s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:18:48 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a869153-1a1b-4b5b-9534-1ef56c885456]: (4, ('1', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:18:48 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-082496c2-5103-4cdc-bd75-e33ecb9c797c tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 00:18:48 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-082496c2-5103-4cdc-bd75-e33ecb9c797c tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] SCSI volumes sdd have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 00:18:48 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-082496c2-5103-4cdc-bd75-e33ecb9c797c tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7')] {{(pid=82479) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 00:18:48 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:18:48 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:18:48 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[211b0bcf-acff-49e7-9074-0472d5790859]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:18:48 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-082496c2-5103-4cdc-bd75-e33ecb9c797c tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:18:48 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 -p 172.16.0.220:3260 --logout {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:18:48 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:18:48 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1677e3a-6d90-495a-bdbc-59d91f4ce256]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:18:48 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-082496c2-5103-4cdc-bd75-e33ecb9c797c tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7, portal: 172.16.0.220,3260]
Apr 14 00:18:48 user nova-compute[82479]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7, portal: 172.16.0.220,3260] successful.
Apr 14 00:18:48 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:18:48 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 -p 172.16.0.220:3260 --op delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:18:48 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:18:48 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a920e4-1e3b-4d2a-9287-9ce5757ee793]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:18:48 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-082496c2-5103-4cdc-bd75-e33ecb9c797c tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:18:48 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-082496c2-5103-4cdc-bd75-e33ecb9c797c tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:18:48 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-082496c2-5103-4cdc-bd75-e33ecb9c797c tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] <== disconnect_volume: return (307ms) None {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:18:48 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-082496c2-5103-4cdc-bd75-e33ecb9c797c tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Disconnected iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 00:18:48 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-082496c2-5103-4cdc-bd75-e33ecb9c797c tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Deleting instance files /opt/stack/data/nova/instances/c7e1f470-fe8a-455e-aa0b-0d2475957fc0_del
Apr 14 00:18:48 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-082496c2-5103-4cdc-bd75-e33ecb9c797c tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Deletion of /opt/stack/data/nova/instances/c7e1f470-fe8a-455e-aa0b-0d2475957fc0_del complete
Apr 14 00:18:48 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:18:49 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:18:49 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Starting heal instance info cache {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 00:18:49 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Rebuilding the list of instances to heal {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 00:18:49 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "refresh_cache-23718fd0-58b8-47f9-b1ef-a26a90741ecc" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:18:49 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquired lock "refresh_cache-23718fd0-58b8-47f9-b1ef-a26a90741ecc" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:18:49 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Forcefully refreshing network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 00:18:49 user nova-compute[82479]: DEBUG nova.objects.instance [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lazy-loading 'info_cache' on Instance uuid 23718fd0-58b8-47f9-b1ef-a26a90741ecc {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:18:49 user nova-compute[82479]: DEBUG nova.compute.manager [req-0e037423-0ada-425b-80c7-461d594deec1 req-79f70d64-9d27-4dc6-9082-a5b648b11194 service nova] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Received event network-changed-0f90a627-4dab-4a2a-a2c2-eaae2910b379 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:18:49 user nova-compute[82479]: DEBUG nova.compute.manager [req-0e037423-0ada-425b-80c7-461d594deec1 req-79f70d64-9d27-4dc6-9082-a5b648b11194 service nova] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Refreshing instance network info cache due to event network-changed-0f90a627-4dab-4a2a-a2c2-eaae2910b379. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:18:49 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0e037423-0ada-425b-80c7-461d594deec1 req-79f70d64-9d27-4dc6-9082-a5b648b11194 service nova] Acquiring lock "refresh_cache-c7e1f470-fe8a-455e-aa0b-0d2475957fc0" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:18:49 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0e037423-0ada-425b-80c7-461d594deec1 req-79f70d64-9d27-4dc6-9082-a5b648b11194 service nova] Acquired lock "refresh_cache-c7e1f470-fe8a-455e-aa0b-0d2475957fc0" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:18:49 user nova-compute[82479]: DEBUG nova.network.neutron [req-0e037423-0ada-425b-80c7-461d594deec1 req-79f70d64-9d27-4dc6-9082-a5b648b11194 service nova] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Refreshing network info cache for port 0f90a627-4dab-4a2a-a2c2-eaae2910b379 {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:18:49 user nova-compute[82479]: INFO nova.scheduler.client.report [None req-082496c2-5103-4cdc-bd75-e33ecb9c797c tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Deleted allocations for instance c7e1f470-fe8a-455e-aa0b-0d2475957fc0
Apr 14 00:18:49 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-082496c2-5103-4cdc-bd75-e33ecb9c797c tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:18:49 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-082496c2-5103-4cdc-bd75-e33ecb9c797c tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:18:49 user nova-compute[82479]: DEBUG nova.objects.instance [None req-082496c2-5103-4cdc-bd75-e33ecb9c797c tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lazy-loading 'numa_topology' on Instance uuid c7e1f470-fe8a-455e-aa0b-0d2475957fc0 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:18:50 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-082496c2-5103-4cdc-bd75-e33ecb9c797c tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:18:50 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-082496c2-5103-4cdc-bd75-e33ecb9c797c tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:18:50 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-082496c2-5103-4cdc-bd75-e33ecb9c797c tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.309s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:18:50 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-082496c2-5103-4cdc-bd75-e33ecb9c797c tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "c7e1f470-fe8a-455e-aa0b-0d2475957fc0" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.549s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:18:50 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Updating instance_info_cache with network_info: [{"id": "db4fcb1f-e93d-4eee-851d-0c47f24dcdb3", "address": "fa:16:3e:28:8a:3c", "network": {"id": "491696ea-38ef-4c19-9d94-a61223c1fa00", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1323121698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3f111e24414976beddba7ef90c4793", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb4fcb1f-e9", "ovs_interfaceid": "db4fcb1f-e93d-4eee-851d-0c47f24dcdb3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:18:50 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Releasing lock "refresh_cache-23718fd0-58b8-47f9-b1ef-a26a90741ecc" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:18:50 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Updated the network info_cache for instance {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 00:18:50 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:18:51 user nova-compute[82479]: DEBUG nova.network.neutron [req-0e037423-0ada-425b-80c7-461d594deec1 req-79f70d64-9d27-4dc6-9082-a5b648b11194 service nova] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Updated VIF entry in instance network info cache for port 0f90a627-4dab-4a2a-a2c2-eaae2910b379. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:18:51 user nova-compute[82479]: DEBUG nova.network.neutron [req-0e037423-0ada-425b-80c7-461d594deec1 req-79f70d64-9d27-4dc6-9082-a5b648b11194 service nova] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Updating instance_info_cache with network_info: [{"id": "0f90a627-4dab-4a2a-a2c2-eaae2910b379", "address": "fa:16:3e:e2:65:cb", "network": {"id": "9f0b7c66-0d95-4c5f-8c77-6f12228c20fc", "bridge": null, "label": "tempest-TestShelveInstance-940455626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6be95e5c8d94269802ecf487ff73104", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap0f90a627-4d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:18:51 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0e037423-0ada-425b-80c7-461d594deec1 req-79f70d64-9d27-4dc6-9082-a5b648b11194 service nova] Releasing lock "refresh_cache-c7e1f470-fe8a-455e-aa0b-0d2475957fc0" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:18:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:18:53 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:18:54 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:18:54 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:18:54 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:18:55 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:18:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:18:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:18:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:18:55 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Auditing locally available compute resources for user (node: user) {{(pid=82479) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 00:18:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:18:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:18:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:18:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:18:56 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:18:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd5afe9f-e6b0-4564-a5cf-b4e0047a5503/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:18:56 user nova-compute[82479]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681431521.1462095, b3475e7e-ceb4-452a-a045-dbf43c5944dd => Stopped> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:18:56 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] VM Stopped (Lifecycle Event)
Apr 14 00:18:56 user nova-compute[82479]: DEBUG nova.compute.manager [None req-2ad04cca-902a-4148-bab3-23bafba76ed2 None None] [instance: b3475e7e-ceb4-452a-a045-dbf43c5944dd] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:18:56 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:18:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd5afe9f-e6b0-4564-a5cf-b4e0047a5503/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:18:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd5afe9f-e6b0-4564-a5cf-b4e0047a5503/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:18:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd5afe9f-e6b0-4564-a5cf-b4e0047a5503/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:18:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2793d412-f405-4452-8e46-c192e3c92ccb/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:18:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2793d412-f405-4452-8e46-c192e3c92ccb/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:18:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2793d412-f405-4452-8e46-c192e3c92ccb/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:18:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2793d412-f405-4452-8e46-c192e3c92ccb/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:18:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk.rescue --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:18:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk.rescue --force-share --output=json" returned: 0 in 0.165s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:18:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk.rescue --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:18:57 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:18:57 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:18:57 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:18:57 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:18:57 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:18:57 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:18:57 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:18:57 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:18:57 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:18:57 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ade24ab6-1a93-4449-b5e9-ec3de357665b/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:18:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ade24ab6-1a93-4449-b5e9-ec3de357665b/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:18:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ade24ab6-1a93-4449-b5e9-ec3de357665b/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:18:58 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:18:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ade24ab6-1a93-4449-b5e9-ec3de357665b/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:18:58 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:18:58 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:18:58 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:18:58 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Hypervisor/Node resource view: name=user free_ram=7958MB free_disk=25.994815826416016GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82479) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 00:18:58 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:18:58 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:18:59 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 23718fd0-58b8-47f9-b1ef-a26a90741ecc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:18:59 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 17c6c147-fb62-4204-a416-792b94d3f7dd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:18:59 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:18:59 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:18:59 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 2793d412-f405-4452-8e46-c192e3c92ccb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:18:59 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 13a94e92-54cf-49b7-ae71-32b3c48df332 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:18:59 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance fd5afe9f-e6b0-4564-a5cf-b4e0047a5503 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:18:59 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance ade24ab6-1a93-4449-b5e9-ec3de357665b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:18:59 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 00:18:59 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 00:18:59 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:18:59 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:18:59 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Compute_service record updated for user:user {{(pid=82479) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 00:18:59 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.541s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:19:00 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:19:00 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:19:00 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:19:00 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:19:00 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82479) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 00:19:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:19:01 user nova-compute[82479]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681431526.7534637, c7e1f470-fe8a-455e-aa0b-0d2475957fc0 => Stopped> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:19:01 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] VM Stopped (Lifecycle Event)
Apr 14 00:19:01 user nova-compute[82479]: DEBUG nova.compute.manager [None req-2fe6e744-14dc-44a1-877d-9e1711a7ba43 None None] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:19:03 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:19:06 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:19:07 user nova-compute[82479]: INFO nova.compute.manager [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Rescuing
Apr 14 00:19:07 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "refresh_cache-13a94e92-54cf-49b7-ae71-32b3c48df332" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:19:07 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquired lock "refresh_cache-13a94e92-54cf-49b7-ae71-32b3c48df332" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:19:07 user nova-compute[82479]: DEBUG nova.network.neutron [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 00:19:08 user nova-compute[82479]: DEBUG nova.network.neutron [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Updating instance_info_cache with network_info: [{"id": "4788878b-ac88-49ff-a42d-df57ef410442", "address": "fa:16:3e:97:9a:e9", "network": {"id": "491696ea-38ef-4c19-9d94-a61223c1fa00", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1323121698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3f111e24414976beddba7ef90c4793", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4788878b-ac", "ovs_interfaceid": "4788878b-ac88-49ff-a42d-df57ef410442", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:19:08 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Releasing lock "refresh_cache-13a94e92-54cf-49b7-ae71-32b3c48df332" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:19:08 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:19:08 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:19:08 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:19:08 user nova-compute[82479]: DEBUG nova.compute.manager [req-a149373c-85d6-497a-aac4-c5d00634fb9d req-8015f7a1-a79d-44fe-832b-364174786801 service nova] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Received event network-vif-unplugged-4788878b-ac88-49ff-a42d-df57ef410442 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:19:08 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-a149373c-85d6-497a-aac4-c5d00634fb9d req-8015f7a1-a79d-44fe-832b-364174786801 service nova] Acquiring lock "13a94e92-54cf-49b7-ae71-32b3c48df332-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:19:08 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-a149373c-85d6-497a-aac4-c5d00634fb9d req-8015f7a1-a79d-44fe-832b-364174786801 service nova] Lock "13a94e92-54cf-49b7-ae71-32b3c48df332-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:19:08 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-a149373c-85d6-497a-aac4-c5d00634fb9d req-8015f7a1-a79d-44fe-832b-364174786801 service nova] Lock "13a94e92-54cf-49b7-ae71-32b3c48df332-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:19:08 user nova-compute[82479]: DEBUG nova.compute.manager [req-a149373c-85d6-497a-aac4-c5d00634fb9d req-8015f7a1-a79d-44fe-832b-364174786801 service nova] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] No waiting events found dispatching network-vif-unplugged-4788878b-ac88-49ff-a42d-df57ef410442 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:19:08 user nova-compute[82479]: WARNING nova.compute.manager [req-a149373c-85d6-497a-aac4-c5d00634fb9d req-8015f7a1-a79d-44fe-832b-364174786801 service nova] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Received unexpected event network-vif-unplugged-4788878b-ac88-49ff-a42d-df57ef410442 for instance with vm_state active and task_state rescuing.
Apr 14 00:19:08 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:19:08 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:19:08 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:19:09 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:19:09 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Instance destroyed successfully.
Apr 14 00:19:09 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Attempting a stable device rescue
Apr 14 00:19:09 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=82479) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 14 00:19:09 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Instance directory exists: not creating {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 00:19:09 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Creating image(s)
Apr 14 00:19:09 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "/opt/stack/data/nova/instances/13a94e92-54cf-49b7-ae71-32b3c48df332/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:19:09 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "/opt/stack/data/nova/instances/13a94e92-54cf-49b7-ae71-32b3c48df332/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:19:09 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "/opt/stack/data/nova/instances/13a94e92-54cf-49b7-ae71-32b3c48df332/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:19:09 user nova-compute[82479]: DEBUG nova.objects.instance [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lazy-loading 'trusted_certs' on Instance uuid 13a94e92-54cf-49b7-ae71-32b3c48df332 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:19:09 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "2e082cf3dca1b4faa0412b293755b87fb31401cf" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:19:09 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "2e082cf3dca1b4faa0412b293755b87fb31401cf" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:19:10 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e082cf3dca1b4faa0412b293755b87fb31401cf.part --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:19:10 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e082cf3dca1b4faa0412b293755b87fb31401cf.part --force-share --output=json" returned: 0 in 0.169s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:19:10 user nova-compute[82479]: DEBUG nova.virt.images [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] 981cdd24-b6a7-4af7-ab41-830fdcd0e314 was qcow2, converting to raw {{(pid=82479) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 00:19:10 user nova-compute[82479]: DEBUG nova.privsep.utils [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82479) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 00:19:10 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2e082cf3dca1b4faa0412b293755b87fb31401cf.part /opt/stack/data/nova/instances/_base/2e082cf3dca1b4faa0412b293755b87fb31401cf.converted {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:19:10 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2e082cf3dca1b4faa0412b293755b87fb31401cf.part /opt/stack/data/nova/instances/_base/2e082cf3dca1b4faa0412b293755b87fb31401cf.converted" returned: 0 in 0.184s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:19:10 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e082cf3dca1b4faa0412b293755b87fb31401cf.converted --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:19:10 user nova-compute[82479]: DEBUG nova.compute.manager [req-b2373fcf-51b1-4be9-afe8-b71f82f5e466 req-91a21536-72bb-4275-a7b7-ca0430b2cac5 service nova] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Received event network-vif-plugged-4788878b-ac88-49ff-a42d-df57ef410442 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:19:10 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-b2373fcf-51b1-4be9-afe8-b71f82f5e466 req-91a21536-72bb-4275-a7b7-ca0430b2cac5 service nova] Acquiring lock "13a94e92-54cf-49b7-ae71-32b3c48df332-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:19:10 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-b2373fcf-51b1-4be9-afe8-b71f82f5e466 req-91a21536-72bb-4275-a7b7-ca0430b2cac5 service nova] Lock "13a94e92-54cf-49b7-ae71-32b3c48df332-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:19:10 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-b2373fcf-51b1-4be9-afe8-b71f82f5e466 req-91a21536-72bb-4275-a7b7-ca0430b2cac5 service nova] Lock "13a94e92-54cf-49b7-ae71-32b3c48df332-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:19:10 user nova-compute[82479]: DEBUG nova.compute.manager [req-b2373fcf-51b1-4be9-afe8-b71f82f5e466 req-91a21536-72bb-4275-a7b7-ca0430b2cac5 service nova] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] No waiting events found dispatching network-vif-plugged-4788878b-ac88-49ff-a42d-df57ef410442 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:19:10 user nova-compute[82479]: WARNING nova.compute.manager [req-b2373fcf-51b1-4be9-afe8-b71f82f5e466 req-91a21536-72bb-4275-a7b7-ca0430b2cac5 service nova] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Received unexpected event network-vif-plugged-4788878b-ac88-49ff-a42d-df57ef410442 for instance with vm_state active and task_state rescuing.
Apr 14 00:19:10 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e082cf3dca1b4faa0412b293755b87fb31401cf.converted --force-share --output=json" returned: 0 in 0.139s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:19:10 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "2e082cf3dca1b4faa0412b293755b87fb31401cf" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.521s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:19:10 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "2e082cf3dca1b4faa0412b293755b87fb31401cf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:19:10 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "2e082cf3dca1b4faa0412b293755b87fb31401cf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:19:10 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e082cf3dca1b4faa0412b293755b87fb31401cf --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:19:10 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e082cf3dca1b4faa0412b293755b87fb31401cf --force-share --output=json" returned: 0 in 0.150s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:19:10 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e082cf3dca1b4faa0412b293755b87fb31401cf,backing_fmt=raw /opt/stack/data/nova/instances/13a94e92-54cf-49b7-ae71-32b3c48df332/disk.rescue {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:19:10 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e082cf3dca1b4faa0412b293755b87fb31401cf,backing_fmt=raw /opt/stack/data/nova/instances/13a94e92-54cf-49b7-ae71-32b3c48df332/disk.rescue" returned: 0 in 0.054s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:19:10 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "2e082cf3dca1b4faa0412b293755b87fb31401cf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.209s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:19:10 user nova-compute[82479]: DEBUG nova.objects.instance [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lazy-loading 'migration_context' on Instance uuid 13a94e92-54cf-49b7-ae71-32b3c48df332 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:19:10 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Created local disks {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 00:19:10 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Start _get_guest_xml network_info=[{"id": "4788878b-ac88-49ff-a42d-df57ef410442", "address": "fa:16:3e:97:9a:e9", "network": {"id": "491696ea-38ef-4c19-9d94-a61223c1fa00", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1323121698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1323121698-network", "vif_mac": "fa:16:3e:97:9a:e9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3f111e24414976beddba7ef90c4793", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4788878b-ac", "ovs_interfaceid": "4788878b-ac88-49ff-a42d-df57ef410442", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '981cdd24-b6a7-4af7-ab41-830fdcd0e314', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': False, 'attachment_id': '9e5814ce-b181-44ee-877c-53333941f6ac', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NhaiJkPC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '13a94e92-54cf-49b7-ae71-32b3c48df332', 'attached_at': '', 'detached_at': '', 'volume_id': '2681b171-ba2b-44b0-8a6a-e89a52fafc99', 'serial': '2681b171-ba2b-44b0-8a6a-e89a52fafc99'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 00:19:10 user nova-compute[82479]: DEBUG nova.objects.instance [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lazy-loading 'resources' on Instance uuid 13a94e92-54cf-49b7-ae71-32b3c48df332 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:19:10 user nova-compute[82479]: DEBUG nova.objects.instance [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lazy-loading 'numa_topology' on Instance uuid 13a94e92-54cf-49b7-ae71-32b3c48df332 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:19:10 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:19:10 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:19:10 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82479) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 00:19:10 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T00:02:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 00:19:10 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Flavor limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 00:19:10 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Image limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 00:19:10 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Flavor pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 00:19:10 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Image pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 00:19:10 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 00:19:10 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 00:19:10 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 00:19:10 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Got 1 possible topologies {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 00:19:10 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 00:19:10 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 00:19:10 user nova-compute[82479]: DEBUG nova.objects.instance [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lazy-loading 'vcpu_model' on Instance uuid 13a94e92-54cf-49b7-ae71-32b3c48df332 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:19:11 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Calling os-brick to attach iSCSI Volume {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 00:19:11 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NhaiJkPC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:19:11 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:19:11 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:19:11 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:19:11 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:19:11 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:19:11 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:19:11 user nova-compute[82479]: INFO os_brick.initiator.connectors.iscsi [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 00:19:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 -p 172.16.0.220:3260 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:19:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 -p 172.16.0.220:3260" returned: 0 in 0.030s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:19:11 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f05e303-06cf-44de-9698-ee1fbb48f0bd]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = NhaiJkPC\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:19:11 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 14 00:19:11 user nova-compute[82479]: node.name = iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99
Apr 14 00:19:11 user nova-compute[82479]: node.tpgt = -1
Apr 14 00:19:11 user nova-compute[82479]: node.startup = automatic
Apr 14 00:19:11 user nova-compute[82479]: node.leading_login = No
Apr 14 00:19:11 user nova-compute[82479]: iface.iscsi_ifacename = default
Apr 14 00:19:11 user nova-compute[82479]: iface.net_ifacename = <empty>
Apr 14 00:19:11 user nova-compute[82479]: iface.ipaddress = <empty>
Apr 14 00:19:11 user nova-compute[82479]: iface.prefix_len = 0
Apr 14 00:19:11 user nova-compute[82479]: iface.hwaddress = <empty>
Apr 14 00:19:11 user nova-compute[82479]: iface.transport_name = tcp
Apr 14 00:19:11 user nova-compute[82479]: iface.initiatorname = <empty>
Apr 14 00:19:11 user nova-compute[82479]: iface.state = <empty>
Apr 14 00:19:11 user nova-compute[82479]: iface.vlan_id = 0
Apr 14 00:19:11 user nova-compute[82479]: iface.vlan_priority = 0
Apr 14 00:19:11 user nova-compute[82479]: iface.vlan_state = <empty>
Apr 14 00:19:11 user nova-compute[82479]: iface.iface_num = 0
Apr 14 00:19:11 user nova-compute[82479]: iface.mtu = 0
Apr 14 00:19:11 user nova-compute[82479]: iface.port = 0
Apr 14 00:19:11 user nova-compute[82479]: iface.bootproto = <empty>
Apr 14 00:19:11 user nova-compute[82479]: iface.subnet_mask = <empty>
Apr 14 00:19:11 user nova-compute[82479]: iface.gateway = <empty>
Apr 14 00:19:11 user nova-compute[82479]: iface.dhcp_alt_client_id_state = <empty>
Apr 14 00:19:11 user nova-compute[82479]: iface.dhcp_alt_client_id = <empty>
Apr 14 00:19:11 user nova-compute[82479]: iface.dhcp_dns = <empty>
Apr 14 00:19:11 user nova-compute[82479]: iface.dhcp_learn_iqn = <empty>
Apr 14 00:19:11 user nova-compute[82479]: iface.dhcp_req_vendor_id_state = <empty>
Apr 14 00:19:11 user nova-compute[82479]: iface.dhcp_vendor_id_state = <empty>
Apr 14 00:19:11 user nova-compute[82479]: iface.dhcp_vendor_id = <empty>
Apr 14 00:19:11 user nova-compute[82479]: iface.dhcp_slp_da = <empty>
Apr 14 00:19:11 user nova-compute[82479]: iface.fragmentation = <empty>
Apr 14 00:19:11 user nova-compute[82479]: iface.gratuitous_arp = <empty>
Apr 14 00:19:11 user nova-compute[82479]: iface.incoming_forwarding = <empty>
Apr 14 00:19:11 user nova-compute[82479]: iface.tos_state = <empty>
Apr 14 00:19:11 user nova-compute[82479]: iface.tos = 0
Apr 14 00:19:11 user nova-compute[82479]: iface.ttl = 0
Apr 14 00:19:11 user nova-compute[82479]: iface.delayed_ack = <empty>
Apr 14 00:19:11 user nova-compute[82479]: iface.tcp_nagle = <empty>
Apr 14 00:19:11 user nova-compute[82479]: iface.tcp_wsf_state = <empty>
Apr 14 00:19:11 user nova-compute[82479]: iface.tcp_wsf = 0
Apr 14 00:19:11 user nova-compute[82479]: iface.tcp_timer_scale = 0
Apr 14 00:19:11 user nova-compute[82479]: iface.tcp_timestamp = <empty>
Apr 14 00:19:11 user nova-compute[82479]: iface.redirect = <empty>
Apr 14 00:19:11 user nova-compute[82479]: iface.def_task_mgmt_timeout = 0
Apr 14 00:19:11 user nova-compute[82479]: iface.header_digest = <empty>
Apr 14 00:19:11 user nova-compute[82479]: iface.data_digest = <empty>
Apr 14 00:19:11 user nova-compute[82479]: iface.immediate_data = <empty>
Apr 14 00:19:11 user nova-compute[82479]: iface.initial_r2t = <empty>
Apr 14 00:19:11 user nova-compute[82479]: iface.data_seq_inorder = <empty>
Apr 14 00:19:11 user nova-compute[82479]: iface.data_pdu_inorder = <empty>
Apr 14 00:19:11 user nova-compute[82479]: iface.erl = 0
Apr 14 00:19:11 user nova-compute[82479]: iface.max_receive_data_len = 0
Apr 14 00:19:11 user nova-compute[82479]: iface.first_burst_len = 0
Apr 14 00:19:11 user nova-compute[82479]: iface.max_outstanding_r2t = 0
Apr 14 00:19:11 user nova-compute[82479]: iface.max_burst_len = 0
Apr 14 00:19:11 user nova-compute[82479]: iface.chap_auth = <empty>
Apr 14 00:19:11 user nova-compute[82479]: iface.bidi_chap = <empty>
Apr 14 00:19:11 user nova-compute[82479]: iface.strict_login_compliance = <empty>
Apr 14 00:19:11 user nova-compute[82479]: iface.discovery_auth = <empty>
Apr 14 00:19:11 user nova-compute[82479]: iface.discovery_logout = <empty>
Apr 14 00:19:11 user nova-compute[82479]: node.discovery_address = <empty>
Apr 14 00:19:11 user nova-compute[82479]: node.discovery_port = 0
Apr 14 00:19:11 user nova-compute[82479]: node.discovery_type = static
Apr 14 00:19:11 user nova-compute[82479]: node.session.initial_cmdsn = 0
Apr 14 00:19:11 user nova-compute[82479]: node.session.initial_login_retry_max = 8
Apr 14 00:19:11 user nova-compute[82479]: node.session.xmit_thread_priority = -20
Apr 14 00:19:11 user nova-compute[82479]: node.session.cmds_max = 128
Apr 14 00:19:11 user nova-compute[82479]: node.session.queue_depth = 32
Apr 14 00:19:11 user nova-compute[82479]: node.session.nr_sessions = 1
Apr 14 00:19:11 user nova-compute[82479]: node.session.auth.authmethod = CHAP
Apr 14 00:19:11 user nova-compute[82479]: node.session.auth.username = NhaiJkPC
Apr 14 00:19:11 user nova-compute[82479]: node.session.auth.password = ***
Apr 14 00:19:11 user nova-compute[82479]: node.session.auth.username_in = <empty>
Apr 14 00:19:11 user nova-compute[82479]: node.session.auth.password_in = <empty>
Apr 14 00:19:11 user nova-compute[82479]: node.session.auth.chap_algs = MD5
Apr 14 00:19:11 user nova-compute[82479]: node.session.timeo.replacement_timeout = 120
Apr 14 00:19:11 user nova-compute[82479]: node.session.err_timeo.abort_timeout = 15
Apr 14 00:19:11 user nova-compute[82479]: node.session.err_timeo.lu_reset_timeout = 30
Apr 14 00:19:11 user nova-compute[82479]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 14 00:19:11 user nova-compute[82479]: node.session.err_timeo.host_reset_timeout = 60
Apr 14 00:19:11 user nova-compute[82479]: node.session.iscsi.FastAbort = Yes
Apr 14 00:19:11 user nova-compute[82479]: node.session.iscsi.InitialR2T = No
Apr 14 00:19:11 user nova-compute[82479]: node.session.iscsi.ImmediateData = Yes
Apr 14 00:19:11 user nova-compute[82479]: node.session.iscsi.FirstBurstLength = 262144
Apr 14 00:19:11 user nova-compute[82479]: node.session.iscsi.MaxBurstLength = 16776192
Apr 14 00:19:11 user nova-compute[82479]: node.session.iscsi.DefaultTime2Retain = 0
Apr 14 00:19:11 user nova-compute[82479]: node.session.iscsi.DefaultTime2Wait = 2
Apr 14 00:19:11 user nova-compute[82479]: node.session.iscsi.MaxConnections = 1
Apr 14 00:19:11 user nova-compute[82479]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 14 00:19:11 user nova-compute[82479]: node.session.iscsi.ERL = 0
Apr 14 00:19:11 user nova-compute[82479]: node.session.scan = manual
Apr 14 00:19:11 user nova-compute[82479]: node.session.reopen_max = 0
Apr 14 00:19:11 user nova-compute[82479]: node.conn[0].address = 172.16.0.220
Apr 14 00:19:11 user nova-compute[82479]: node.conn[0].port = 3260
Apr 14 00:19:11 user nova-compute[82479]: node.conn[0].startup = manual
Apr 14 00:19:11 user nova-compute[82479]: node.conn[0].tcp.window_size = 524288
Apr 14 00:19:11 user nova-compute[82479]: node.conn[0].tcp.type_of_service = 0
Apr 14 00:19:11 user nova-compute[82479]: node.conn[0].timeo.logout_timeout = 15
Apr 14 00:19:11 user nova-compute[82479]: node.conn[0].timeo.login_timeout = 15
Apr 14 00:19:11 user nova-compute[82479]: node.conn[0].timeo.auth_timeout = 45
Apr 14 00:19:11 user nova-compute[82479]: node.conn[0].timeo.noop_out_interval = 5
Apr 14 00:19:11 user nova-compute[82479]: node.conn[0].timeo.noop_out_timeout = 5
Apr 14 00:19:11 user nova-compute[82479]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 14 00:19:11 user nova-compute[82479]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 14 00:19:11 user nova-compute[82479]: node.conn[0].iscsi.HeaderDigest = None
Apr 14 00:19:11 user nova-compute[82479]: node.conn[0].iscsi.DataDigest = None
Apr 14 00:19:11 user nova-compute[82479]: node.conn[0].iscsi.IFMarker = No
Apr 14 00:19:11 user nova-compute[82479]: node.conn[0].iscsi.OFMarker = No
Apr 14 00:19:11 user nova-compute[82479]: # END RECORD
Apr 14 00:19:11 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:19:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:19:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.036s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:19:11 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0d10eb-8d62-42a6-bc62-e904bb68499f]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:19:11 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:19:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:19:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:19:11 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b98a41-0b82-4750-b05d-a878a428480f]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:19:11 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:19:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NhaiJkPC {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:19:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NhaiJkPC" returned: 0 in 0.029s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:19:11 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d50ed9e-c7c0-4f47-9494-3c3710749578]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:19:11 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NhaiJkPC'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:19:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:19:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:19:11 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18ee180-4c1b-40d0-9a61-ae4fffc7d246]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:19:11 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:19:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:19:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.059s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:19:11 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f7b218-7c26-4580-a944-63fb66232a56]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:19:11 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:19:11 user nova-compute[82479]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 (non-flash)
Apr 14 00:19:11 user nova-compute[82479]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 (non-flash)
Apr 14 00:19:11 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:19:11 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:19:11 user nova-compute[82479]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 (non-flash)
Apr 14 00:19:11 user nova-compute[82479]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 (non-flash)
Apr 14 00:19:11 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:19:11 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.220s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:19:11 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Connected to 172.16.0.220:3260 {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 00:19:11 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] HCTL ('37', '0', '0', 0) found on session 29 with lun 0 {{(pid=82479) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 00:19:11 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=82479) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 00:19:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:19:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:19:11 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa784498-e266-4087-9f67-1fd4521d51d9]: (4, ('0 0 0', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:19:11 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Searching for a device in session 29 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=82479) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 00:19:11 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NhaiJkPC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 00:19:11 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.257s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:19:11 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] <== connect_volume: return (258ms) {'type': 'block', 'scsi_wwn': '26236666663313066', 'path': '/dev/sdf'} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:19:11 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236666663313066', 'path': '/dev/sdf'} {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 00:19:11 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:17:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1831378742',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1831378742',id=29,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:17:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ba3f111e24414976beddba7ef90c4793',ramdisk_id='',reservation_id='r-ba0cm12p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1545234843',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:17:33Z,user_data=None,user_id='90bad96535c3453792982c5acab9dbc6',uuid=13a94e92-54cf-49b7-ae71-32b3c48df332,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4788878b-ac88-49ff-a42d-df57ef410442", "address": "fa:16:3e:97:9a:e9", "network": {"id": "491696ea-38ef-4c19-9d94-a61223c1fa00", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1323121698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1323121698-network", "vif_mac": "fa:16:3e:97:9a:e9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3f111e24414976beddba7ef90c4793", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4788878b-ac", "ovs_interfaceid": "4788878b-ac88-49ff-a42d-df57ef410442", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82479) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 00:19:11 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Converting VIF {"id": "4788878b-ac88-49ff-a42d-df57ef410442", "address": "fa:16:3e:97:9a:e9", "network": {"id": "491696ea-38ef-4c19-9d94-a61223c1fa00", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1323121698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1323121698-network", "vif_mac": "fa:16:3e:97:9a:e9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3f111e24414976beddba7ef90c4793", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4788878b-ac", "ovs_interfaceid": "4788878b-ac88-49ff-a42d-df57ef410442", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:19:11 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:97:9a:e9,bridge_name='br-int',has_traffic_filtering=True,id=4788878b-ac88-49ff-a42d-df57ef410442,network=Network(491696ea-38ef-4c19-9d94-a61223c1fa00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4788878b-ac') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:19:11 user nova-compute[82479]: DEBUG nova.objects.instance [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lazy-loading 'pci_devices' on Instance uuid 13a94e92-54cf-49b7-ae71-32b3c48df332 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:19:11 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] End _get_guest_xml xml=<domain type="kvm">
Apr 14 00:19:11 user nova-compute[82479]:   <uuid>13a94e92-54cf-49b7-ae71-32b3c48df332</uuid>
Apr 14 00:19:11 user nova-compute[82479]:   <name>instance-0000001d</name>
Apr 14 00:19:11 user nova-compute[82479]:   <memory>131072</memory>
Apr 14 00:19:11 user nova-compute[82479]:   <vcpu>1</vcpu>
Apr 14 00:19:11 user nova-compute[82479]:   <metadata>
Apr 14 00:19:11 user nova-compute[82479]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 00:19:11 user nova-compute[82479]:       <nova:package version="0.0.0"/>
Apr 14 00:19:11 user nova-compute[82479]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1831378742</nova:name>
Apr 14 00:19:11 user nova-compute[82479]:       <nova:creationTime>2023-04-14 00:19:10</nova:creationTime>
Apr 14 00:19:11 user nova-compute[82479]:       <nova:flavor name="m1.nano">
Apr 14 00:19:11 user nova-compute[82479]:         <nova:memory>128</nova:memory>
Apr 14 00:19:11 user nova-compute[82479]:         <nova:disk>1</nova:disk>
Apr 14 00:19:11 user nova-compute[82479]:         <nova:swap>0</nova:swap>
Apr 14 00:19:11 user nova-compute[82479]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 00:19:11 user nova-compute[82479]:         <nova:vcpus>1</nova:vcpus>
Apr 14 00:19:11 user nova-compute[82479]:       </nova:flavor>
Apr 14 00:19:11 user nova-compute[82479]:       <nova:owner>
Apr 14 00:19:11 user nova-compute[82479]:         <nova:user uuid="90bad96535c3453792982c5acab9dbc6">tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member</nova:user>
Apr 14 00:19:11 user nova-compute[82479]:         <nova:project uuid="ba3f111e24414976beddba7ef90c4793">tempest-ServerBootFromVolumeStableRescueTest-1545234843</nova:project>
Apr 14 00:19:11 user nova-compute[82479]:       </nova:owner>
Apr 14 00:19:11 user nova-compute[82479]:       <nova:root type="image" uuid="6db62068-7278-4cd8-b41f-d0140d89e199"/>
Apr 14 00:19:11 user nova-compute[82479]:       <nova:ports>
Apr 14 00:19:11 user nova-compute[82479]:         <nova:port uuid="4788878b-ac88-49ff-a42d-df57ef410442">
Apr 14 00:19:11 user nova-compute[82479]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 00:19:11 user nova-compute[82479]:         </nova:port>
Apr 14 00:19:11 user nova-compute[82479]:       </nova:ports>
Apr 14 00:19:11 user nova-compute[82479]:     </nova:instance>
Apr 14 00:19:11 user nova-compute[82479]:   </metadata>
Apr 14 00:19:11 user nova-compute[82479]:   <sysinfo type="smbios">
Apr 14 00:19:11 user nova-compute[82479]:     <system>
Apr 14 00:19:11 user nova-compute[82479]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 00:19:11 user nova-compute[82479]:       <entry name="product">OpenStack Nova</entry>
Apr 14 00:19:11 user nova-compute[82479]:       <entry name="version">0.0.0</entry>
Apr 14 00:19:11 user nova-compute[82479]:       <entry name="serial">13a94e92-54cf-49b7-ae71-32b3c48df332</entry>
Apr 14 00:19:11 user nova-compute[82479]:       <entry name="uuid">13a94e92-54cf-49b7-ae71-32b3c48df332</entry>
Apr 14 00:19:11 user nova-compute[82479]:       <entry name="family">Virtual Machine</entry>
Apr 14 00:19:11 user nova-compute[82479]:     </system>
Apr 14 00:19:11 user nova-compute[82479]:   </sysinfo>
Apr 14 00:19:11 user nova-compute[82479]:   <os>
Apr 14 00:19:11 user nova-compute[82479]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 00:19:11 user nova-compute[82479]:     <smbios mode="sysinfo"/>
Apr 14 00:19:11 user nova-compute[82479]:   </os>
Apr 14 00:19:11 user nova-compute[82479]:   <features>
Apr 14 00:19:11 user nova-compute[82479]:     <acpi/>
Apr 14 00:19:11 user nova-compute[82479]:     <apic/>
Apr 14 00:19:11 user nova-compute[82479]:     <vmcoreinfo/>
Apr 14 00:19:11 user nova-compute[82479]:   </features>
Apr 14 00:19:11 user nova-compute[82479]:   <clock offset="utc">
Apr 14 00:19:11 user nova-compute[82479]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 00:19:11 user nova-compute[82479]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 00:19:11 user nova-compute[82479]:     <timer name="hpet" present="no"/>
Apr 14 00:19:11 user nova-compute[82479]:   </clock>
Apr 14 00:19:11 user nova-compute[82479]:   <cpu mode="custom" match="exact">
Apr 14 00:19:11 user nova-compute[82479]:     <model>Nehalem</model>
Apr 14 00:19:11 user nova-compute[82479]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 00:19:11 user nova-compute[82479]:   </cpu>
Apr 14 00:19:11 user nova-compute[82479]:   <devices>
Apr 14 00:19:11 user nova-compute[82479]:     <disk type="block" device="disk">
Apr 14 00:19:11 user nova-compute[82479]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:19:11 user nova-compute[82479]:       <source dev="/dev/sdf"/>
Apr 14 00:19:11 user nova-compute[82479]:       <target dev="vda" bus="virtio"/>
Apr 14 00:19:11 user nova-compute[82479]:       <serial>2681b171-ba2b-44b0-8a6a-e89a52fafc99</serial>
Apr 14 00:19:11 user nova-compute[82479]:     </disk>
Apr 14 00:19:11 user nova-compute[82479]:     <disk type="file" device="disk">
Apr 14 00:19:11 user nova-compute[82479]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 00:19:11 user nova-compute[82479]:       <source file="/opt/stack/data/nova/instances/13a94e92-54cf-49b7-ae71-32b3c48df332/disk.rescue"/>
Apr 14 00:19:11 user nova-compute[82479]:       <target dev="vdb" bus="virtio"/>
Apr 14 00:19:11 user nova-compute[82479]:       <boot order="1"/>
Apr 14 00:19:11 user nova-compute[82479]:     </disk>
Apr 14 00:19:11 user nova-compute[82479]:     <interface type="ethernet">
Apr 14 00:19:11 user nova-compute[82479]:       <mac address="fa:16:3e:97:9a:e9"/>
Apr 14 00:19:11 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:19:11 user nova-compute[82479]:       <mtu size="1442"/>
Apr 14 00:19:11 user nova-compute[82479]:       <target dev="tap4788878b-ac"/>
Apr 14 00:19:11 user nova-compute[82479]:     </interface>
Apr 14 00:19:11 user nova-compute[82479]:     <serial type="pty">
Apr 14 00:19:11 user nova-compute[82479]:       <log file="/opt/stack/data/nova/instances/13a94e92-54cf-49b7-ae71-32b3c48df332/console.log" append="off"/>
Apr 14 00:19:11 user nova-compute[82479]:     </serial>
Apr 14 00:19:11 user nova-compute[82479]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 00:19:11 user nova-compute[82479]:     <video>
Apr 14 00:19:11 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:19:11 user nova-compute[82479]:     </video>
Apr 14 00:19:11 user nova-compute[82479]:     <rng model="virtio">
Apr 14 00:19:11 user nova-compute[82479]:       <backend model="random">/dev/urandom</backend>
Apr 14 00:19:11 user nova-compute[82479]:     </rng>
Apr 14 00:19:11 user nova-compute[82479]:     <controller type="usb" index="0" model="none"/>
Apr 14 00:19:11 user nova-compute[82479]:     <memballoon model="virtio">
Apr 14 00:19:11 user nova-compute[82479]:       <stats period="10"/>
Apr 14 00:19:11 user nova-compute[82479]:     </memballoon>
Apr 14 00:19:11 user nova-compute[82479]:   </devices>
Apr 14 00:19:11 user nova-compute[82479]: </domain>
Apr 14 00:19:11 user nova-compute[82479]:  {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 00:19:11 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Instance destroyed successfully.
Apr 14 00:19:11 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:19:11 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:19:11 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] No VIF found with MAC fa:16:3e:97:9a:e9, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:19:12 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:19:12 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:19:12 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:19:13 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:19:13 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:19:13 user nova-compute[82479]: DEBUG nova.compute.manager [req-fc93f22d-1a23-4aa6-9351-41760450b137 req-28282907-1e85-407e-b653-89210d65c1ac service nova] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Received event network-vif-plugged-4788878b-ac88-49ff-a42d-df57ef410442 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:19:13 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-fc93f22d-1a23-4aa6-9351-41760450b137 req-28282907-1e85-407e-b653-89210d65c1ac service nova] Acquiring lock "13a94e92-54cf-49b7-ae71-32b3c48df332-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:19:13 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-fc93f22d-1a23-4aa6-9351-41760450b137 req-28282907-1e85-407e-b653-89210d65c1ac service nova] Lock "13a94e92-54cf-49b7-ae71-32b3c48df332-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:19:13 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-fc93f22d-1a23-4aa6-9351-41760450b137 req-28282907-1e85-407e-b653-89210d65c1ac service nova] Lock "13a94e92-54cf-49b7-ae71-32b3c48df332-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:19:13 user nova-compute[82479]: DEBUG nova.compute.manager [req-fc93f22d-1a23-4aa6-9351-41760450b137 req-28282907-1e85-407e-b653-89210d65c1ac service nova] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] No waiting events found dispatching network-vif-plugged-4788878b-ac88-49ff-a42d-df57ef410442 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:19:13 user nova-compute[82479]: WARNING nova.compute.manager [req-fc93f22d-1a23-4aa6-9351-41760450b137 req-28282907-1e85-407e-b653-89210d65c1ac service nova] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Received unexpected event network-vif-plugged-4788878b-ac88-49ff-a42d-df57ef410442 for instance with vm_state active and task_state rescuing.
Apr 14 00:19:13 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:19:15 user nova-compute[82479]: DEBUG nova.compute.manager [req-ed11f1f6-d069-425d-9636-bc3f189ca114 req-41bbb0eb-602d-4a24-8366-2a06d897349c service nova] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Received event network-vif-plugged-4788878b-ac88-49ff-a42d-df57ef410442 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:19:15 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-ed11f1f6-d069-425d-9636-bc3f189ca114 req-41bbb0eb-602d-4a24-8366-2a06d897349c service nova] Acquiring lock "13a94e92-54cf-49b7-ae71-32b3c48df332-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:19:15 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-ed11f1f6-d069-425d-9636-bc3f189ca114 req-41bbb0eb-602d-4a24-8366-2a06d897349c service nova] Lock "13a94e92-54cf-49b7-ae71-32b3c48df332-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:19:15 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-ed11f1f6-d069-425d-9636-bc3f189ca114 req-41bbb0eb-602d-4a24-8366-2a06d897349c service nova] Lock "13a94e92-54cf-49b7-ae71-32b3c48df332-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:19:15 user nova-compute[82479]: DEBUG nova.compute.manager [req-ed11f1f6-d069-425d-9636-bc3f189ca114 req-41bbb0eb-602d-4a24-8366-2a06d897349c service nova] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] No waiting events found dispatching network-vif-plugged-4788878b-ac88-49ff-a42d-df57ef410442 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:19:15 user nova-compute[82479]: WARNING nova.compute.manager [req-ed11f1f6-d069-425d-9636-bc3f189ca114 req-41bbb0eb-602d-4a24-8366-2a06d897349c service nova] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Received unexpected event network-vif-plugged-4788878b-ac88-49ff-a42d-df57ef410442 for instance with vm_state active and task_state rescuing.
Apr 14 00:19:15 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Removed pending event for 13a94e92-54cf-49b7-ae71-32b3c48df332 due to event {{(pid=82479) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 00:19:15 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681431555.269703, 13a94e92-54cf-49b7-ae71-32b3c48df332 => Resumed> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:19:15 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] VM Resumed (Lifecycle Event)
Apr 14 00:19:15 user nova-compute[82479]: DEBUG nova.compute.manager [None req-d2eb759d-ab0c-4033-ba21-dc90427bc178 tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:19:15 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:19:15 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:19:15 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 14 00:19:15 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681431555.2718587, 13a94e92-54cf-49b7-ae71-32b3c48df332 => Started> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:19:15 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] VM Started (Lifecycle Event)
Apr 14 00:19:15 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:19:15 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:19:16 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:19:18 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:19:21 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:19:23 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:19:28 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:19:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:19:32 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "785033c7-e14b-418e-952a-248328b75d60" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:19:32 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "785033c7-e14b-418e-952a-248328b75d60" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:19:32 user nova-compute[82479]: DEBUG nova.compute.manager [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: 785033c7-e14b-418e-952a-248328b75d60] Starting instance... {{(pid=82479) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 00:19:32 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:19:32 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:19:32 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82479) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 00:19:32 user nova-compute[82479]: INFO nova.compute.claims [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: 785033c7-e14b-418e-952a-248328b75d60] Claim successful on node user
Apr 14 00:19:33 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:19:33 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:19:33 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:19:33 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.728s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:19:33 user nova-compute[82479]: DEBUG nova.compute.manager [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: 785033c7-e14b-418e-952a-248328b75d60] Start building networks asynchronously for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 00:19:33 user nova-compute[82479]: DEBUG nova.compute.manager [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: 785033c7-e14b-418e-952a-248328b75d60] Allocating IP information in the background. {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 00:19:33 user nova-compute[82479]: DEBUG nova.network.neutron [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: 785033c7-e14b-418e-952a-248328b75d60] allocate_for_instance() {{(pid=82479) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 00:19:33 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: 785033c7-e14b-418e-952a-248328b75d60] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 00:19:33 user nova-compute[82479]: DEBUG nova.compute.manager [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: 785033c7-e14b-418e-952a-248328b75d60] Start building block device mappings for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 00:19:33 user nova-compute[82479]: DEBUG nova.compute.manager [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: 785033c7-e14b-418e-952a-248328b75d60] Start spawning the instance on the hypervisor. {{(pid=82479) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 00:19:33 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: 785033c7-e14b-418e-952a-248328b75d60] Creating instance directory {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 00:19:33 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: 785033c7-e14b-418e-952a-248328b75d60] Creating image(s)
Apr 14 00:19:33 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "/opt/stack/data/nova/instances/785033c7-e14b-418e-952a-248328b75d60/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:19:33 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "/opt/stack/data/nova/instances/785033c7-e14b-418e-952a-248328b75d60/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:19:33 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "/opt/stack/data/nova/instances/785033c7-e14b-418e-952a-248328b75d60/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:19:33 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:19:33 user nova-compute[82479]: DEBUG nova.policy [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3d86662f2c7648daad87118b7e9f757c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8663ccad9047f4b11b9ae0646c287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82479) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 00:19:33 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.197s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:19:33 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "3e200e101633f2016e569ae4c0a352380507d1e4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:19:33 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "3e200e101633f2016e569ae4c0a352380507d1e4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:19:33 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:19:34 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.176s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:19:34 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/785033c7-e14b-418e-952a-248328b75d60/disk 1073741824 {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:19:34 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/785033c7-e14b-418e-952a-248328b75d60/disk 1073741824" returned: 0 in 0.066s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:19:34 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "3e200e101633f2016e569ae4c0a352380507d1e4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:19:34 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:19:34 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.162s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:19:34 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Checking if we can resize image /opt/stack/data/nova/instances/785033c7-e14b-418e-952a-248328b75d60/disk. size=1073741824 {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 00:19:34 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785033c7-e14b-418e-952a-248328b75d60/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:19:34 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785033c7-e14b-418e-952a-248328b75d60/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:19:34 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Cannot resize image /opt/stack/data/nova/instances/785033c7-e14b-418e-952a-248328b75d60/disk to a smaller size. {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 00:19:34 user nova-compute[82479]: DEBUG nova.objects.instance [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lazy-loading 'migration_context' on Instance uuid 785033c7-e14b-418e-952a-248328b75d60 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:19:34 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: 785033c7-e14b-418e-952a-248328b75d60] Created local disks {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 00:19:34 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: 785033c7-e14b-418e-952a-248328b75d60] Ensure instance console log exists: /opt/stack/data/nova/instances/785033c7-e14b-418e-952a-248328b75d60/console.log {{(pid=82479) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 00:19:34 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:19:34 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:19:34 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:19:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:19:34 user nova-compute[82479]: DEBUG nova.network.neutron [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: 785033c7-e14b-418e-952a-248328b75d60] Successfully created port: 29f1f1cc-0517-49a1-b8f1-61a7c3ee1002 {{(pid=82479) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 00:19:34 user nova-compute[82479]: DEBUG nova.compute.manager [req-dc6bf05c-4b34-42a5-bd3f-6d264274ff1a req-882f8d68-9774-4a04-adb3-f1a87cccca53 service nova] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Received event network-changed-9a6ef0bb-aaa8-4fe9-a3ea-cc1352c783cb {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:19:34 user nova-compute[82479]: DEBUG nova.compute.manager [req-dc6bf05c-4b34-42a5-bd3f-6d264274ff1a req-882f8d68-9774-4a04-adb3-f1a87cccca53 service nova] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Refreshing instance network info cache due to event network-changed-9a6ef0bb-aaa8-4fe9-a3ea-cc1352c783cb. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:19:34 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-dc6bf05c-4b34-42a5-bd3f-6d264274ff1a req-882f8d68-9774-4a04-adb3-f1a87cccca53 service nova] Acquiring lock "refresh_cache-fd5afe9f-e6b0-4564-a5cf-b4e0047a5503" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:19:34 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-dc6bf05c-4b34-42a5-bd3f-6d264274ff1a req-882f8d68-9774-4a04-adb3-f1a87cccca53 service nova] Acquired lock "refresh_cache-fd5afe9f-e6b0-4564-a5cf-b4e0047a5503" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:19:34 user nova-compute[82479]: DEBUG nova.network.neutron [req-dc6bf05c-4b34-42a5-bd3f-6d264274ff1a req-882f8d68-9774-4a04-adb3-f1a87cccca53 service nova] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Refreshing network info cache for port 9a6ef0bb-aaa8-4fe9-a3ea-cc1352c783cb {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:19:36 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:19:36 user nova-compute[82479]: DEBUG nova.network.neutron [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: 785033c7-e14b-418e-952a-248328b75d60] Successfully updated port: 29f1f1cc-0517-49a1-b8f1-61a7c3ee1002 {{(pid=82479) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 00:19:36 user nova-compute[82479]: DEBUG nova.compute.manager [req-180b9061-e527-4f44-9240-a992255f3542 req-37ce01bd-6fa2-4b9e-86c3-0d22640235d3 service nova] [instance: 785033c7-e14b-418e-952a-248328b75d60] Received event network-changed-29f1f1cc-0517-49a1-b8f1-61a7c3ee1002 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:19:36 user nova-compute[82479]: DEBUG nova.compute.manager [req-180b9061-e527-4f44-9240-a992255f3542 req-37ce01bd-6fa2-4b9e-86c3-0d22640235d3 service nova] [instance: 785033c7-e14b-418e-952a-248328b75d60] Refreshing instance network info cache due to event network-changed-29f1f1cc-0517-49a1-b8f1-61a7c3ee1002. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:19:36 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-180b9061-e527-4f44-9240-a992255f3542 req-37ce01bd-6fa2-4b9e-86c3-0d22640235d3 service nova] Acquiring lock "refresh_cache-785033c7-e14b-418e-952a-248328b75d60" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:19:36 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-180b9061-e527-4f44-9240-a992255f3542 req-37ce01bd-6fa2-4b9e-86c3-0d22640235d3 service nova] Acquired lock "refresh_cache-785033c7-e14b-418e-952a-248328b75d60" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:19:36 user nova-compute[82479]: DEBUG nova.network.neutron [req-180b9061-e527-4f44-9240-a992255f3542 req-37ce01bd-6fa2-4b9e-86c3-0d22640235d3 service nova] [instance: 785033c7-e14b-418e-952a-248328b75d60] Refreshing network info cache for port 29f1f1cc-0517-49a1-b8f1-61a7c3ee1002 {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:19:36 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "refresh_cache-785033c7-e14b-418e-952a-248328b75d60" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:19:36 user nova-compute[82479]: DEBUG nova.network.neutron [req-180b9061-e527-4f44-9240-a992255f3542 req-37ce01bd-6fa2-4b9e-86c3-0d22640235d3 service nova] [instance: 785033c7-e14b-418e-952a-248328b75d60] Instance cache missing network info. {{(pid=82479) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 00:19:36 user nova-compute[82479]: DEBUG nova.network.neutron [req-dc6bf05c-4b34-42a5-bd3f-6d264274ff1a req-882f8d68-9774-4a04-adb3-f1a87cccca53 service nova] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Updated VIF entry in instance network info cache for port 9a6ef0bb-aaa8-4fe9-a3ea-cc1352c783cb. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:19:36 user nova-compute[82479]: DEBUG nova.network.neutron [req-dc6bf05c-4b34-42a5-bd3f-6d264274ff1a req-882f8d68-9774-4a04-adb3-f1a87cccca53 service nova] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Updating instance_info_cache with network_info: [{"id": "9a6ef0bb-aaa8-4fe9-a3ea-cc1352c783cb", "address": "fa:16:3e:52:6f:81", "network": {"id": "6d80f923-8aef-45df-921b-f77ed4ff0e75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-696070096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44c9d67ad2fa4cb9ab309b98f8fe051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a6ef0bb-aa", "ovs_interfaceid": "9a6ef0bb-aaa8-4fe9-a3ea-cc1352c783cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:19:36 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-dc6bf05c-4b34-42a5-bd3f-6d264274ff1a req-882f8d68-9774-4a04-adb3-f1a87cccca53 service nova] Releasing lock "refresh_cache-fd5afe9f-e6b0-4564-a5cf-b4e0047a5503" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:19:36 user nova-compute[82479]: DEBUG nova.network.neutron [req-180b9061-e527-4f44-9240-a992255f3542 req-37ce01bd-6fa2-4b9e-86c3-0d22640235d3 service nova] [instance: 785033c7-e14b-418e-952a-248328b75d60] Updating instance_info_cache with network_info: [] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:19:36 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-180b9061-e527-4f44-9240-a992255f3542 req-37ce01bd-6fa2-4b9e-86c3-0d22640235d3 service nova] Releasing lock "refresh_cache-785033c7-e14b-418e-952a-248328b75d60" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:19:36 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquired lock "refresh_cache-785033c7-e14b-418e-952a-248328b75d60" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:19:36 user nova-compute[82479]: DEBUG nova.network.neutron [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: 785033c7-e14b-418e-952a-248328b75d60] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 00:19:36 user nova-compute[82479]: DEBUG nova.network.neutron [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: 785033c7-e14b-418e-952a-248328b75d60] Instance cache missing network info. {{(pid=82479) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 00:19:37 user nova-compute[82479]: DEBUG nova.network.neutron [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: 785033c7-e14b-418e-952a-248328b75d60] Updating instance_info_cache with network_info: [{"id": "29f1f1cc-0517-49a1-b8f1-61a7c3ee1002", "address": "fa:16:3e:59:e0:37", "network": {"id": "cb8c9bb1-a885-486d-aa6a-de600bc01c2e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1676259779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8663ccad9047f4b11b9ae0646c287a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29f1f1cc-05", "ovs_interfaceid": "29f1f1cc-0517-49a1-b8f1-61a7c3ee1002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:19:37 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Releasing lock "refresh_cache-785033c7-e14b-418e-952a-248328b75d60" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:19:37 user nova-compute[82479]: DEBUG nova.compute.manager [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: 785033c7-e14b-418e-952a-248328b75d60] Instance network_info: |[{"id": "29f1f1cc-0517-49a1-b8f1-61a7c3ee1002", "address": "fa:16:3e:59:e0:37", "network": {"id": "cb8c9bb1-a885-486d-aa6a-de600bc01c2e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1676259779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8663ccad9047f4b11b9ae0646c287a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29f1f1cc-05", "ovs_interfaceid": "29f1f1cc-0517-49a1-b8f1-61a7c3ee1002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 00:19:37 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: 785033c7-e14b-418e-952a-248328b75d60] Start _get_guest_xml network_info=[{"id": "29f1f1cc-0517-49a1-b8f1-61a7c3ee1002", "address": "fa:16:3e:59:e0:37", "network": {"id": "cb8c9bb1-a885-486d-aa6a-de600bc01c2e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1676259779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8663ccad9047f4b11b9ae0646c287a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29f1f1cc-05", "ovs_interfaceid": "29f1f1cc-0517-49a1-b8f1-61a7c3ee1002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 00:19:37 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:19:37 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:19:37 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82479) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 00:19:37 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T00:02:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 00:19:37 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Flavor limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 00:19:37 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Image limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 00:19:37 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Flavor pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 00:19:37 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Image pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 00:19:37 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 00:19:37 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 00:19:37 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 00:19:37 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Got 1 possible topologies {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 00:19:37 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 00:19:37 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 00:19:37 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:19:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1841222453',display_name='tempest-ServerActionsTestJSON-server-1841222453',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1841222453',id=32,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD8E1mkrqLo3jsCiJcIvha4CNzW2T6/HQ38hZ5dGaGtUghmrHejTJlAuKgmy6xusLbaAzGTrJCKVkdgQ5v0CqCqGeNMDA89aLJgLl5KHn3gvI39SkbPja84HarSvbQbbXg==',key_name='tempest-keypair-1040271550',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf8663ccad9047f4b11b9ae0646c287a',ramdisk_id='',reservation_id='r-vno1kjy0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-948553482',owner_user_name='tempest-ServerActionsTestJSON-948553482-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:19:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d86662f2c7648daad87118b7e9f757c',uuid=785033c7-e14b-418e-952a-248328b75d60,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29f1f1cc-0517-49a1-b8f1-61a7c3ee1002", "address": "fa:16:3e:59:e0:37", "network": {"id": "cb8c9bb1-a885-486d-aa6a-de600bc01c2e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1676259779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8663ccad9047f4b11b9ae0646c287a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29f1f1cc-05", "ovs_interfaceid": "29f1f1cc-0517-49a1-b8f1-61a7c3ee1002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82479) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 00:19:37 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Converting VIF {"id": "29f1f1cc-0517-49a1-b8f1-61a7c3ee1002", "address": "fa:16:3e:59:e0:37", "network": {"id": "cb8c9bb1-a885-486d-aa6a-de600bc01c2e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1676259779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8663ccad9047f4b11b9ae0646c287a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29f1f1cc-05", "ovs_interfaceid": "29f1f1cc-0517-49a1-b8f1-61a7c3ee1002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:19:37 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:e0:37,bridge_name='br-int',has_traffic_filtering=True,id=29f1f1cc-0517-49a1-b8f1-61a7c3ee1002,network=Network(cb8c9bb1-a885-486d-aa6a-de600bc01c2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29f1f1cc-05') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:19:37 user nova-compute[82479]: DEBUG nova.objects.instance [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lazy-loading 'pci_devices' on Instance uuid 785033c7-e14b-418e-952a-248328b75d60 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:19:37 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: 785033c7-e14b-418e-952a-248328b75d60] End _get_guest_xml xml=<domain type="kvm">
Apr 14 00:19:37 user nova-compute[82479]:   <uuid>785033c7-e14b-418e-952a-248328b75d60</uuid>
Apr 14 00:19:37 user nova-compute[82479]:   <name>instance-00000020</name>
Apr 14 00:19:37 user nova-compute[82479]:   <memory>131072</memory>
Apr 14 00:19:37 user nova-compute[82479]:   <vcpu>1</vcpu>
Apr 14 00:19:37 user nova-compute[82479]:   <metadata>
Apr 14 00:19:37 user nova-compute[82479]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 00:19:37 user nova-compute[82479]:       <nova:package version="0.0.0"/>
Apr 14 00:19:37 user nova-compute[82479]:       <nova:name>tempest-ServerActionsTestJSON-server-1841222453</nova:name>
Apr 14 00:19:37 user nova-compute[82479]:       <nova:creationTime>2023-04-14 00:19:37</nova:creationTime>
Apr 14 00:19:37 user nova-compute[82479]:       <nova:flavor name="m1.nano">
Apr 14 00:19:37 user nova-compute[82479]:         <nova:memory>128</nova:memory>
Apr 14 00:19:37 user nova-compute[82479]:         <nova:disk>1</nova:disk>
Apr 14 00:19:37 user nova-compute[82479]:         <nova:swap>0</nova:swap>
Apr 14 00:19:37 user nova-compute[82479]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 00:19:37 user nova-compute[82479]:         <nova:vcpus>1</nova:vcpus>
Apr 14 00:19:37 user nova-compute[82479]:       </nova:flavor>
Apr 14 00:19:37 user nova-compute[82479]:       <nova:owner>
Apr 14 00:19:37 user nova-compute[82479]:         <nova:user uuid="3d86662f2c7648daad87118b7e9f757c">tempest-ServerActionsTestJSON-948553482-project-member</nova:user>
Apr 14 00:19:37 user nova-compute[82479]:         <nova:project uuid="bf8663ccad9047f4b11b9ae0646c287a">tempest-ServerActionsTestJSON-948553482</nova:project>
Apr 14 00:19:37 user nova-compute[82479]:       </nova:owner>
Apr 14 00:19:37 user nova-compute[82479]:       <nova:root type="image" uuid="6db62068-7278-4cd8-b41f-d0140d89e199"/>
Apr 14 00:19:37 user nova-compute[82479]:       <nova:ports>
Apr 14 00:19:37 user nova-compute[82479]:         <nova:port uuid="29f1f1cc-0517-49a1-b8f1-61a7c3ee1002">
Apr 14 00:19:37 user nova-compute[82479]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 14 00:19:37 user nova-compute[82479]:         </nova:port>
Apr 14 00:19:37 user nova-compute[82479]:       </nova:ports>
Apr 14 00:19:37 user nova-compute[82479]:     </nova:instance>
Apr 14 00:19:37 user nova-compute[82479]:   </metadata>
Apr 14 00:19:37 user nova-compute[82479]:   <sysinfo type="smbios">
Apr 14 00:19:37 user nova-compute[82479]:     <system>
Apr 14 00:19:37 user nova-compute[82479]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 00:19:37 user nova-compute[82479]:       <entry name="product">OpenStack Nova</entry>
Apr 14 00:19:37 user nova-compute[82479]:       <entry name="version">0.0.0</entry>
Apr 14 00:19:37 user nova-compute[82479]:       <entry name="serial">785033c7-e14b-418e-952a-248328b75d60</entry>
Apr 14 00:19:37 user nova-compute[82479]:       <entry name="uuid">785033c7-e14b-418e-952a-248328b75d60</entry>
Apr 14 00:19:37 user nova-compute[82479]:       <entry name="family">Virtual Machine</entry>
Apr 14 00:19:37 user nova-compute[82479]:     </system>
Apr 14 00:19:37 user nova-compute[82479]:   </sysinfo>
Apr 14 00:19:37 user nova-compute[82479]:   <os>
Apr 14 00:19:37 user nova-compute[82479]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 00:19:37 user nova-compute[82479]:     <boot dev="hd"/>
Apr 14 00:19:37 user nova-compute[82479]:     <smbios mode="sysinfo"/>
Apr 14 00:19:37 user nova-compute[82479]:   </os>
Apr 14 00:19:37 user nova-compute[82479]:   <features>
Apr 14 00:19:37 user nova-compute[82479]:     <acpi/>
Apr 14 00:19:37 user nova-compute[82479]:     <apic/>
Apr 14 00:19:37 user nova-compute[82479]:     <vmcoreinfo/>
Apr 14 00:19:37 user nova-compute[82479]:   </features>
Apr 14 00:19:37 user nova-compute[82479]:   <clock offset="utc">
Apr 14 00:19:37 user nova-compute[82479]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 00:19:37 user nova-compute[82479]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 00:19:37 user nova-compute[82479]:     <timer name="hpet" present="no"/>
Apr 14 00:19:37 user nova-compute[82479]:   </clock>
Apr 14 00:19:37 user nova-compute[82479]:   <cpu mode="custom" match="exact">
Apr 14 00:19:37 user nova-compute[82479]:     <model>Nehalem</model>
Apr 14 00:19:37 user nova-compute[82479]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 00:19:37 user nova-compute[82479]:   </cpu>
Apr 14 00:19:37 user nova-compute[82479]:   <devices>
Apr 14 00:19:37 user nova-compute[82479]:     <disk type="file" device="disk">
Apr 14 00:19:37 user nova-compute[82479]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 00:19:37 user nova-compute[82479]:       <source file="/opt/stack/data/nova/instances/785033c7-e14b-418e-952a-248328b75d60/disk"/>
Apr 14 00:19:37 user nova-compute[82479]:       <target dev="vda" bus="virtio"/>
Apr 14 00:19:37 user nova-compute[82479]:     </disk>
Apr 14 00:19:37 user nova-compute[82479]:     <interface type="ethernet">
Apr 14 00:19:37 user nova-compute[82479]:       <mac address="fa:16:3e:59:e0:37"/>
Apr 14 00:19:37 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:19:37 user nova-compute[82479]:       <mtu size="1442"/>
Apr 14 00:19:37 user nova-compute[82479]:       <target dev="tap29f1f1cc-05"/>
Apr 14 00:19:37 user nova-compute[82479]:     </interface>
Apr 14 00:19:37 user nova-compute[82479]:     <serial type="pty">
Apr 14 00:19:37 user nova-compute[82479]:       <log file="/opt/stack/data/nova/instances/785033c7-e14b-418e-952a-248328b75d60/console.log" append="off"/>
Apr 14 00:19:37 user nova-compute[82479]:     </serial>
Apr 14 00:19:37 user nova-compute[82479]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 00:19:37 user nova-compute[82479]:     <video>
Apr 14 00:19:37 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:19:37 user nova-compute[82479]:     </video>
Apr 14 00:19:37 user nova-compute[82479]:     <rng model="virtio">
Apr 14 00:19:37 user nova-compute[82479]:       <backend model="random">/dev/urandom</backend>
Apr 14 00:19:37 user nova-compute[82479]:     </rng>
Apr 14 00:19:37 user nova-compute[82479]:     <controller type="usb" index="0" model="none"/>
Apr 14 00:19:37 user nova-compute[82479]:     <memballoon model="virtio">
Apr 14 00:19:37 user nova-compute[82479]:       <stats period="10"/>
Apr 14 00:19:37 user nova-compute[82479]:     </memballoon>
Apr 14 00:19:37 user nova-compute[82479]:   </devices>
Apr 14 00:19:37 user nova-compute[82479]: </domain>
Apr 14 00:19:37 user nova-compute[82479]:  {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 00:19:37 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:19:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1841222453',display_name='tempest-ServerActionsTestJSON-server-1841222453',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1841222453',id=32,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD8E1mkrqLo3jsCiJcIvha4CNzW2T6/HQ38hZ5dGaGtUghmrHejTJlAuKgmy6xusLbaAzGTrJCKVkdgQ5v0CqCqGeNMDA89aLJgLl5KHn3gvI39SkbPja84HarSvbQbbXg==',key_name='tempest-keypair-1040271550',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf8663ccad9047f4b11b9ae0646c287a',ramdisk_id='',reservation_id='r-vno1kjy0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-948553482',owner_user_name='tempest-ServerActionsTestJSON-948553482-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:19:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d86662f2c7648daad87118b7e9f757c',uuid=785033c7-e14b-418e-952a-248328b75d60,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29f1f1cc-0517-49a1-b8f1-61a7c3ee1002", "address": "fa:16:3e:59:e0:37", "network": {"id": "cb8c9bb1-a885-486d-aa6a-de600bc01c2e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1676259779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8663ccad9047f4b11b9ae0646c287a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29f1f1cc-05", "ovs_interfaceid": "29f1f1cc-0517-49a1-b8f1-61a7c3ee1002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 00:19:37 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Converting VIF {"id": "29f1f1cc-0517-49a1-b8f1-61a7c3ee1002", "address": "fa:16:3e:59:e0:37", "network": {"id": "cb8c9bb1-a885-486d-aa6a-de600bc01c2e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1676259779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8663ccad9047f4b11b9ae0646c287a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29f1f1cc-05", "ovs_interfaceid": "29f1f1cc-0517-49a1-b8f1-61a7c3ee1002", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:19:37 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:e0:37,bridge_name='br-int',has_traffic_filtering=True,id=29f1f1cc-0517-49a1-b8f1-61a7c3ee1002,network=Network(cb8c9bb1-a885-486d-aa6a-de600bc01c2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29f1f1cc-05') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:19:37 user nova-compute[82479]: DEBUG os_vif [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:e0:37,bridge_name='br-int',has_traffic_filtering=True,id=29f1f1cc-0517-49a1-b8f1-61a7c3ee1002,network=Network(cb8c9bb1-a885-486d-aa6a-de600bc01c2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29f1f1cc-05') {{(pid=82479) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 00:19:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:19:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:19:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 00:19:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:19:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap29f1f1cc-05, may_exist=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:19:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap29f1f1cc-05, col_values=(('external_ids', {'iface-id': '29f1f1cc-0517-49a1-b8f1-61a7c3ee1002', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:e0:37', 'vm-uuid': '785033c7-e14b-418e-952a-248328b75d60'}),)) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:19:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:19:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:19:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:19:37 user nova-compute[82479]: INFO os_vif [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:e0:37,bridge_name='br-int',has_traffic_filtering=True,id=29f1f1cc-0517-49a1-b8f1-61a7c3ee1002,network=Network(cb8c9bb1-a885-486d-aa6a-de600bc01c2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29f1f1cc-05')
Apr 14 00:19:37 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:19:37 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] No VIF found with MAC fa:16:3e:59:e0:37, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:19:37 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "fd5afe9f-e6b0-4564-a5cf-b4e0047a5503" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:19:37 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "fd5afe9f-e6b0-4564-a5cf-b4e0047a5503" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:19:38 user nova-compute[82479]: DEBUG nova.objects.instance [None req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lazy-loading 'flavor' on Instance uuid fd5afe9f-e6b0-4564-a5cf-b4e0047a5503 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:19:38 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "fd5afe9f-e6b0-4564-a5cf-b4e0047a5503" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:19:38 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "fd5afe9f-e6b0-4564-a5cf-b4e0047a5503" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:19:38 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "fd5afe9f-e6b0-4564-a5cf-b4e0047a5503" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:19:38 user nova-compute[82479]: INFO nova.compute.manager [None req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Attaching volume bca83f34-5989-4188-abaa-205a9770d290 to /dev/vdb
Apr 14 00:19:38 user nova-compute[82479]: DEBUG os_brick.utils [None req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:19:38 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:19:38 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:19:38 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f08d49d-a997-4513-8382-b707a5b46af0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fec92fcfdd3\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:19:38 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:19:38 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:19:38 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf13ccc-ce98-444b-b108-4eeb5be09fb5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:19:38 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:19:38 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.033s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:19:38 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a22ecd-be6f-4fa6-8b14-55913843a7f2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:19:38 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d03ded5-d547-4f0e-8ac7-527db635e936]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:19:38 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Running cmd (subprocess): nvme version {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:19:38 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] 'nvme version' failed. Not Retrying. {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:19:38 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.nvmeof [None req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] nvme not present on system {{(pid=82479) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 00:19:38 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:19:38 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:19:38 user nova-compute[82479]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 00:19:38 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cad4fc6-94b8-4e8e-b020-7659313ced9b]: (4, '') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:19:38 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82479) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 00:19:38 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 00:19:38 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] LIGHTOS: no hostnqn found. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 00:19:38 user nova-compute[82479]: DEBUG os_brick.utils [None req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] <== get_connector_properties: return (162ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fec92fcfdd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:19:38 user nova-compute[82479]: DEBUG nova.virt.block_device [None req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Updating existing volume attachment record: e467c4d8-36db-43d6-b51d-b2870d751a8e {{(pid=82479) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 00:19:38 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:19:38 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:19:38 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:19:38 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:19:39 user nova-compute[82479]: DEBUG nova.compute.manager [req-bd8aab23-e818-4414-b3cd-0503248f14bc req-7f1006f5-8e8d-4d9c-8b54-a0fd4560f39e service nova] [instance: 785033c7-e14b-418e-952a-248328b75d60] Received event network-vif-plugged-29f1f1cc-0517-49a1-b8f1-61a7c3ee1002 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:19:39 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-bd8aab23-e818-4414-b3cd-0503248f14bc req-7f1006f5-8e8d-4d9c-8b54-a0fd4560f39e service nova] Acquiring lock "785033c7-e14b-418e-952a-248328b75d60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:19:39 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-bd8aab23-e818-4414-b3cd-0503248f14bc req-7f1006f5-8e8d-4d9c-8b54-a0fd4560f39e service nova] Lock "785033c7-e14b-418e-952a-248328b75d60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:19:39 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-bd8aab23-e818-4414-b3cd-0503248f14bc req-7f1006f5-8e8d-4d9c-8b54-a0fd4560f39e service nova] Lock "785033c7-e14b-418e-952a-248328b75d60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:19:39 user nova-compute[82479]: DEBUG nova.compute.manager [req-bd8aab23-e818-4414-b3cd-0503248f14bc req-7f1006f5-8e8d-4d9c-8b54-a0fd4560f39e service nova] [instance: 785033c7-e14b-418e-952a-248328b75d60] No waiting events found dispatching network-vif-plugged-29f1f1cc-0517-49a1-b8f1-61a7c3ee1002 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:19:39 user nova-compute[82479]: WARNING nova.compute.manager [req-bd8aab23-e818-4414-b3cd-0503248f14bc req-7f1006f5-8e8d-4d9c-8b54-a0fd4560f39e service nova] [instance: 785033c7-e14b-418e-952a-248328b75d60] Received unexpected event network-vif-plugged-29f1f1cc-0517-49a1-b8f1-61a7c3ee1002 for instance with vm_state building and task_state spawning.
Apr 14 00:19:39 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:19:39 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:19:39 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:19:41 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681431581.0096228, 785033c7-e14b-418e-952a-248328b75d60 => Resumed> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:19:41 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 785033c7-e14b-418e-952a-248328b75d60] VM Resumed (Lifecycle Event)
Apr 14 00:19:41 user nova-compute[82479]: DEBUG nova.compute.manager [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: 785033c7-e14b-418e-952a-248328b75d60] Instance event wait completed in 0 seconds for  {{(pid=82479) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 00:19:41 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: 785033c7-e14b-418e-952a-248328b75d60] Guest created on hypervisor {{(pid=82479) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 00:19:41 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 785033c7-e14b-418e-952a-248328b75d60] Instance spawned successfully.
Apr 14 00:19:41 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: 785033c7-e14b-418e-952a-248328b75d60] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 00:19:41 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 785033c7-e14b-418e-952a-248328b75d60] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:19:41 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 785033c7-e14b-418e-952a-248328b75d60] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:19:41 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: 785033c7-e14b-418e-952a-248328b75d60] Found default for hw_cdrom_bus of ide {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:19:41 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: 785033c7-e14b-418e-952a-248328b75d60] Found default for hw_disk_bus of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:19:41 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: 785033c7-e14b-418e-952a-248328b75d60] Found default for hw_input_bus of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:19:41 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: 785033c7-e14b-418e-952a-248328b75d60] Found default for hw_pointer_model of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:19:41 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: 785033c7-e14b-418e-952a-248328b75d60] Found default for hw_video_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:19:41 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: 785033c7-e14b-418e-952a-248328b75d60] Found default for hw_vif_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:19:41 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 785033c7-e14b-418e-952a-248328b75d60] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:19:41 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681431581.0124419, 785033c7-e14b-418e-952a-248328b75d60 => Started> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:19:41 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 785033c7-e14b-418e-952a-248328b75d60] VM Started (Lifecycle Event)
Apr 14 00:19:41 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 785033c7-e14b-418e-952a-248328b75d60] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:19:41 user nova-compute[82479]: INFO nova.compute.manager [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: 785033c7-e14b-418e-952a-248328b75d60] Took 7.39 seconds to spawn the instance on the hypervisor.
Apr 14 00:19:41 user nova-compute[82479]: DEBUG nova.compute.manager [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: 785033c7-e14b-418e-952a-248328b75d60] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:19:41 user nova-compute[82479]: DEBUG nova.compute.manager [req-b38860fd-880c-4e17-9fb6-f5e55aad3067 req-54858d18-4550-473d-a98b-a58e009eeb4d service nova] [instance: 785033c7-e14b-418e-952a-248328b75d60] Received event network-vif-plugged-29f1f1cc-0517-49a1-b8f1-61a7c3ee1002 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:19:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-b38860fd-880c-4e17-9fb6-f5e55aad3067 req-54858d18-4550-473d-a98b-a58e009eeb4d service nova] Acquiring lock "785033c7-e14b-418e-952a-248328b75d60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:19:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-b38860fd-880c-4e17-9fb6-f5e55aad3067 req-54858d18-4550-473d-a98b-a58e009eeb4d service nova] Lock "785033c7-e14b-418e-952a-248328b75d60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:19:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-b38860fd-880c-4e17-9fb6-f5e55aad3067 req-54858d18-4550-473d-a98b-a58e009eeb4d service nova] Lock "785033c7-e14b-418e-952a-248328b75d60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:19:41 user nova-compute[82479]: DEBUG nova.compute.manager [req-b38860fd-880c-4e17-9fb6-f5e55aad3067 req-54858d18-4550-473d-a98b-a58e009eeb4d service nova] [instance: 785033c7-e14b-418e-952a-248328b75d60] No waiting events found dispatching network-vif-plugged-29f1f1cc-0517-49a1-b8f1-61a7c3ee1002 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:19:41 user nova-compute[82479]: WARNING nova.compute.manager [req-b38860fd-880c-4e17-9fb6-f5e55aad3067 req-54858d18-4550-473d-a98b-a58e009eeb4d service nova] [instance: 785033c7-e14b-418e-952a-248328b75d60] Received unexpected event network-vif-plugged-29f1f1cc-0517-49a1-b8f1-61a7c3ee1002 for instance with vm_state building and task_state spawning.
Apr 14 00:19:41 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 785033c7-e14b-418e-952a-248328b75d60] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:19:41 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 785033c7-e14b-418e-952a-248328b75d60] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:19:41 user nova-compute[82479]: INFO nova.compute.manager [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: 785033c7-e14b-418e-952a-248328b75d60] Took 8.53 seconds to build instance.
Apr 14 00:19:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f02ef90d-a4e1-4c45-bcfb-6640ec4868a5 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "785033c7-e14b-418e-952a-248328b75d60" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.659s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:19:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:19:42 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:19:43 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Calling os-brick to attach iSCSI Volume {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 00:19:43 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zWIOlNdw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:19:43 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:19:43 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:19:43 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:19:43 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:19:43 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:19:43 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:19:43 user nova-compute[82479]: INFO os_brick.initiator.connectors.iscsi [None req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 00:19:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290 -p 172.16.0.220:3260 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:19:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:19:43 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2ec941-bdc7-4312-8ef1-18e9dabab68d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:19:43 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 00:19:43 user nova-compute[82479]:  {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:19:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290 -p 172.16.0.220:3260 --interface default --op new {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:19:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:19:43 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf93430f-db1c-4cc7-b3cc-d93dcf07f61e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290] added\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:19:43 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290] added
Apr 14 00:19:43 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:19:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:19:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:19:43 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e03592-078c-4a6a-b44d-e7d5c0b5afd7]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:19:43 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:19:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:19:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:19:43 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7e2bde-b77b-4a4f-972e-f690186ec252]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:19:43 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:19:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zWIOlNdw {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:19:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zWIOlNdw" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:19:43 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[4793f4dd-363f-4a30-a568-e83d6a32dd5c]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:19:43 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zWIOlNdw'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:19:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:19:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:19:43 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[7363bf23-7893-4c16-a567-681c9d60bb8d]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:19:43 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:19:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:19:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:19:43 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[49830660-2e77-4a8c-8ccc-961d6fcccd7d]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:19:43 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:19:43 user nova-compute[82479]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 (non-flash)
Apr 14 00:19:43 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:19:43 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:19:43 user nova-compute[82479]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 (non-flash)
Apr 14 00:19:43 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:19:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290 -p 172.16.0.220:3260 --login {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:19:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:19:43 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[717e61fa-a97c-4705-9497-9c9b286ed83e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:19:43 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290, portal: 172.16.0.220,3260]
Apr 14 00:19:43 user nova-compute[82479]: Login to [iface: default, target: iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290, portal: 172.16.0.220,3260] successful.
Apr 14 00:19:43 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:19:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:19:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:19:43 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[300105c1-9c48-472d-ba81-9474a18e6718]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:19:43 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:19:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:19:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:19:43 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0608e3e-c9a3-478b-9860-1ab5bd6c146b]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:19:43 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:19:43 user nova-compute[82479]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 (non-flash)
Apr 14 00:19:43 user nova-compute[82479]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290 (non-flash)
Apr 14 00:19:43 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:19:43 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:19:43 user nova-compute[82479]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 (non-flash)
Apr 14 00:19:43 user nova-compute[82479]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290 (non-flash)
Apr 14 00:19:43 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:19:43 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.354s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:19:43 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Connected to 172.16.0.220:3260 {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 00:19:43 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] HCTL ('33', '-', '-', 0) found on session 32 with lun 0 {{(pid=82479) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 00:19:43 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82479) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 00:19:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:19:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.026s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:19:43 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e5071f-10a3-41c6-a649-efb6a857d11a]: (4, ('- - 0', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:19:43 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Searching for a device in session 32 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82479) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 00:19:43 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zWIOlNdw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 00:19:44 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.399s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:19:44 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] <== connect_volume: return (1402ms) {'type': 'block', 'scsi_wwn': '26531326663356339', 'path': '/dev/sdb'} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:19:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26531326663356339', 'path': '/dev/sdb'} {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 00:19:44 user nova-compute[82479]: DEBUG nova.objects.instance [None req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lazy-loading 'flavor' on Instance uuid fd5afe9f-e6b0-4564-a5cf-b4e0047a5503 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:19:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 00:19:44 user nova-compute[82479]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:19:44 user nova-compute[82479]:   <source dev="/dev/sdb"/>
Apr 14 00:19:44 user nova-compute[82479]:   <target dev="vdb" bus="virtio"/>
Apr 14 00:19:44 user nova-compute[82479]:   <serial>bca83f34-5989-4188-abaa-205a9770d290</serial>
Apr 14 00:19:44 user nova-compute[82479]: </disk>
Apr 14 00:19:44 user nova-compute[82479]:  {{(pid=82479) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 00:19:45 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:19:45 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:19:45 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] No VIF found with MAC fa:16:3e:52:6f:81, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:19:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "fd5afe9f-e6b0-4564-a5cf-b4e0047a5503" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.234s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:19:46 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:19:46 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0bd88877-83e7-4a16-8fe4-f7da2326e034 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "fd5afe9f-e6b0-4564-a5cf-b4e0047a5503" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:19:46 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0bd88877-83e7-4a16-8fe4-f7da2326e034 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "fd5afe9f-e6b0-4564-a5cf-b4e0047a5503" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:19:46 user nova-compute[82479]: INFO nova.compute.manager [None req-0bd88877-83e7-4a16-8fe4-f7da2326e034 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Detaching volume bca83f34-5989-4188-abaa-205a9770d290
Apr 14 00:19:46 user nova-compute[82479]: INFO nova.virt.block_device [None req-0bd88877-83e7-4a16-8fe4-f7da2326e034 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Attempting to driver detach volume bca83f34-5989-4188-abaa-205a9770d290 from mountpoint /dev/vdb
Apr 14 00:19:46 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-0bd88877-83e7-4a16-8fe4-f7da2326e034 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Attempting to detach device vdb from instance fd5afe9f-e6b0-4564-a5cf-b4e0047a5503 from the persistent domain config. {{(pid=82479) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 00:19:46 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-0bd88877-83e7-4a16-8fe4-f7da2326e034 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 00:19:46 user nova-compute[82479]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:19:46 user nova-compute[82479]:   <source dev="/dev/sdb"/>
Apr 14 00:19:46 user nova-compute[82479]:   <target dev="vdb" bus="virtio"/>
Apr 14 00:19:46 user nova-compute[82479]:   <serial>bca83f34-5989-4188-abaa-205a9770d290</serial>
Apr 14 00:19:46 user nova-compute[82479]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 00:19:46 user nova-compute[82479]: </disk>
Apr 14 00:19:46 user nova-compute[82479]:  {{(pid=82479) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 00:19:46 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-0bd88877-83e7-4a16-8fe4-f7da2326e034 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Successfully detached device vdb from instance fd5afe9f-e6b0-4564-a5cf-b4e0047a5503 from the persistent domain config.
Apr 14 00:19:46 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-0bd88877-83e7-4a16-8fe4-f7da2326e034 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fd5afe9f-e6b0-4564-a5cf-b4e0047a5503 from the live domain config. {{(pid=82479) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 00:19:46 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-0bd88877-83e7-4a16-8fe4-f7da2326e034 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 00:19:46 user nova-compute[82479]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:19:46 user nova-compute[82479]:   <source dev="/dev/sdb"/>
Apr 14 00:19:46 user nova-compute[82479]:   <target dev="vdb" bus="virtio"/>
Apr 14 00:19:46 user nova-compute[82479]:   <serial>bca83f34-5989-4188-abaa-205a9770d290</serial>
Apr 14 00:19:46 user nova-compute[82479]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 00:19:46 user nova-compute[82479]: </disk>
Apr 14 00:19:46 user nova-compute[82479]:  {{(pid=82479) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 00:19:47 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Received event <DeviceRemovedEvent: 1681431587.174663, fd5afe9f-e6b0-4564-a5cf-b4e0047a5503 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82479) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 00:19:47 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-0bd88877-83e7-4a16-8fe4-f7da2326e034 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fd5afe9f-e6b0-4564-a5cf-b4e0047a5503 {{(pid=82479) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 00:19:47 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-0bd88877-83e7-4a16-8fe4-f7da2326e034 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Successfully detached device vdb from instance fd5afe9f-e6b0-4564-a5cf-b4e0047a5503 from the live domain config.
Apr 14 00:19:47 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0bd88877-83e7-4a16-8fe4-f7da2326e034 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] calling os-brick to detach iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 00:19:47 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd88877-83e7-4a16-8fe4-f7da2326e034 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, {'target_iqn': 'iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zWIOlNdw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:19:47 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-0bd88877-83e7-4a16-8fe4-f7da2326e034 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:19:47 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-0bd88877-83e7-4a16-8fe4-f7da2326e034 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:19:47 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-0bd88877-83e7-4a16-8fe4-f7da2326e034 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:19:47 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:19:47 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:19:47 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[10902f12-124c-4585-bb0f-4ac0d21727b5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:19:47 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd88877-83e7-4a16-8fe4-f7da2326e034 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 00:19:47 user nova-compute[82479]: No targets found.
Apr 14 00:19:47 user nova-compute[82479]: iSNS:
Apr 14 00:19:47 user nova-compute[82479]: No targets found.
Apr 14 00:19:47 user nova-compute[82479]: STATIC:
Apr 14 00:19:47 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc
Apr 14 00:19:47 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:19:47 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:19:47 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290
Apr 14 00:19:47 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:19:47 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:19:47 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99
Apr 14 00:19:47 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:19:47 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:19:47 user nova-compute[82479]: FIRMWARE:
Apr 14 00:19:47 user nova-compute[82479]: No targets found.
Apr 14 00:19:47 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:19:47 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd88877-83e7-4a16-8fe4-f7da2326e034 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 00:19:47 user nova-compute[82479]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 00:19:47 user nova-compute[82479]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82479) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 00:19:47 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd88877-83e7-4a16-8fe4-f7da2326e034 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290', 0)] {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 00:19:47 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:19:47 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:19:47 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[32feb296-ad97-4bc4-8c26-1d7a95d29745]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:19:47 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:19:47 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:19:47 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8f6c89-fbfc-4248-a1a2-d65152618dd8]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:19:47 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd88877-83e7-4a16-8fe4-f7da2326e034 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:19:47 user nova-compute[82479]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 (non-flash)
Apr 14 00:19:47 user nova-compute[82479]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290 (non-flash)
Apr 14 00:19:47 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:19:47 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd88877-83e7-4a16-8fe4-f7da2326e034 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:19:47 user nova-compute[82479]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 (non-flash)
Apr 14 00:19:47 user nova-compute[82479]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290 (non-flash)
Apr 14 00:19:47 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:19:47 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd88877-83e7-4a16-8fe4-f7da2326e034 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f33382192d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290'): ({'sdb'}, set())}) {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 00:19:47 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-0bd88877-83e7-4a16-8fe4-f7da2326e034 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Removing single pathed devices sdb {{(pid=82479) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 00:19:47 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:19:47 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:19:47 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f89e59d-7c75-4f85-8f43-f0a201dd62d4]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:19:47 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:19:47 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:19:47 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[16318c72-e85c-45f2-bd7a-30544923d388]: (4, ('ok\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:19:47 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-0bd88877-83e7-4a16-8fe4-f7da2326e034 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Flushing IO for device /dev/sdb {{(pid=82479) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 00:19:47 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:19:47 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:19:47 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[105e38d1-5893-4f2a-a87a-44f0f85059c7]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:19:47 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-0bd88877-83e7-4a16-8fe4-f7da2326e034 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82479) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 00:19:47 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:19:47 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:19:47 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6da2c16-3daa-4fc9-a416-31e0cd43f96b]: (4, ('1', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:19:47 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-0bd88877-83e7-4a16-8fe4-f7da2326e034 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 00:19:47 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-0bd88877-83e7-4a16-8fe4-f7da2326e034 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] SCSI volumes sdb have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 00:19:47 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd88877-83e7-4a16-8fe4-f7da2326e034 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290')] {{(pid=82479) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 00:19:47 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:19:47 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:19:47 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:19:47 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6fd56ff-aa4c-44d5-841c-46e2c19bb408]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:19:47 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd88877-83e7-4a16-8fe4-f7da2326e034 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:19:47 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290 -p 172.16.0.220:3260 --logout {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:19:47 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:19:47 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d2c6e52-7665-4307-906b-d5625fd45619]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:19:47 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd88877-83e7-4a16-8fe4-f7da2326e034 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290, portal: 172.16.0.220,3260]
Apr 14 00:19:47 user nova-compute[82479]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290, portal: 172.16.0.220,3260] successful.
Apr 14 00:19:47 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:19:47 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290 -p 172.16.0.220:3260 --op delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:19:47 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:19:47 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cbd3c3d-9943-4ef1-9cf3-1658d29661da]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:19:47 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd88877-83e7-4a16-8fe4-f7da2326e034 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:19:47 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-0bd88877-83e7-4a16-8fe4-f7da2326e034 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:19:47 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bd88877-83e7-4a16-8fe4-f7da2326e034 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] <== disconnect_volume: return (331ms) None {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:19:47 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0bd88877-83e7-4a16-8fe4-f7da2326e034 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Disconnected iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 00:19:48 user nova-compute[82479]: DEBUG nova.objects.instance [None req-0bd88877-83e7-4a16-8fe4-f7da2326e034 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lazy-loading 'flavor' on Instance uuid fd5afe9f-e6b0-4564-a5cf-b4e0047a5503 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:19:48 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0bd88877-83e7-4a16-8fe4-f7da2326e034 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "fd5afe9f-e6b0-4564-a5cf-b4e0047a5503" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.983s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:19:48 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:19:49 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:19:49 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Starting heal instance info cache {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 00:19:49 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "refresh_cache-17c6c147-fb62-4204-a416-792b94d3f7dd" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:19:49 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquired lock "refresh_cache-17c6c147-fb62-4204-a416-792b94d3f7dd" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:19:49 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Forcefully refreshing network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 00:19:50 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Updating instance_info_cache with network_info: [{"id": "102987de-d5e4-4ccd-b4fd-7ca7c131e379", "address": "fa:16:3e:23:dd:a5", "network": {"id": "491696ea-38ef-4c19-9d94-a61223c1fa00", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1323121698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3f111e24414976beddba7ef90c4793", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap102987de-d5", "ovs_interfaceid": "102987de-d5e4-4ccd-b4fd-7ca7c131e379", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:19:50 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Releasing lock "refresh_cache-17c6c147-fb62-4204-a416-792b94d3f7dd" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:19:50 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Updated the network info_cache for instance {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 00:19:50 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:19:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:19:52 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:19:53 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:19:56 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:19:56 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:19:57 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:19:57 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:19:57 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:19:57 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:19:57 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:19:57 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:19:57 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Auditing locally available compute resources for user (node: user) {{(pid=82479) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 00:19:57 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:19:57 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:19:57 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:19:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:19:58 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:19:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785033c7-e14b-418e-952a-248328b75d60/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:19:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785033c7-e14b-418e-952a-248328b75d60/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:19:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785033c7-e14b-418e-952a-248328b75d60/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:19:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785033c7-e14b-418e-952a-248328b75d60/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:19:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd5afe9f-e6b0-4564-a5cf-b4e0047a5503/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:19:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd5afe9f-e6b0-4564-a5cf-b4e0047a5503/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:19:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd5afe9f-e6b0-4564-a5cf-b4e0047a5503/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:19:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd5afe9f-e6b0-4564-a5cf-b4e0047a5503/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:19:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2793d412-f405-4452-8e46-c192e3c92ccb/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:19:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2793d412-f405-4452-8e46-c192e3c92ccb/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:19:58 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2793d412-f405-4452-8e46-c192e3c92ccb/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:19:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2793d412-f405-4452-8e46-c192e3c92ccb/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:19:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk.rescue --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:19:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:19:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk.rescue --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:19:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:19:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:19:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:19:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:19:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:19:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:19:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:19:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:20:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:20:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ade24ab6-1a93-4449-b5e9-ec3de357665b/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:20:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ade24ab6-1a93-4449-b5e9-ec3de357665b/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:20:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ade24ab6-1a93-4449-b5e9-ec3de357665b/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:20:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ade24ab6-1a93-4449-b5e9-ec3de357665b/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:20:00 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:20:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13a94e92-54cf-49b7-ae71-32b3c48df332/disk.rescue --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:20:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13a94e92-54cf-49b7-ae71-32b3c48df332/disk.rescue --force-share --output=json" returned: 0 in 0.153s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:20:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13a94e92-54cf-49b7-ae71-32b3c48df332/disk.rescue --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:20:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13a94e92-54cf-49b7-ae71-32b3c48df332/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:20:01 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:20:01 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:20:01 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Hypervisor/Node resource view: name=user free_ram=7847MB free_disk=26.027873992919922GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82479) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 00:20:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:20:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:20:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:20:01 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 23718fd0-58b8-47f9-b1ef-a26a90741ecc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:20:01 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 17c6c147-fb62-4204-a416-792b94d3f7dd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:20:01 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:20:01 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:20:01 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 2793d412-f405-4452-8e46-c192e3c92ccb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:20:01 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 13a94e92-54cf-49b7-ae71-32b3c48df332 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:20:01 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance fd5afe9f-e6b0-4564-a5cf-b4e0047a5503 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:20:01 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance ade24ab6-1a93-4449-b5e9-ec3de357665b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:20:01 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 785033c7-e14b-418e-952a-248328b75d60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:20:01 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 00:20:01 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 00:20:01 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:20:01 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:20:01 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Compute_service record updated for user:user {{(pid=82479) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 00:20:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.484s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:20:02 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:20:02 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:20:02 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:20:02 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82479) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 00:20:06 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:20:07 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:20:11 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:20:12 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:20:17 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:20:19 user nova-compute[82479]: DEBUG nova.compute.manager [req-a19430d3-994f-4ffa-aea5-42cd40c4eaa0 req-2ff9dc47-1e55-41af-b9c3-5f33f3fd318b service nova] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Received event network-changed-11344eed-48f5-49c5-a770-c9c298f7185e {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:20:19 user nova-compute[82479]: DEBUG nova.compute.manager [req-a19430d3-994f-4ffa-aea5-42cd40c4eaa0 req-2ff9dc47-1e55-41af-b9c3-5f33f3fd318b service nova] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Refreshing instance network info cache due to event network-changed-11344eed-48f5-49c5-a770-c9c298f7185e. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:20:19 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-a19430d3-994f-4ffa-aea5-42cd40c4eaa0 req-2ff9dc47-1e55-41af-b9c3-5f33f3fd318b service nova] Acquiring lock "refresh_cache-ade24ab6-1a93-4449-b5e9-ec3de357665b" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:20:19 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-a19430d3-994f-4ffa-aea5-42cd40c4eaa0 req-2ff9dc47-1e55-41af-b9c3-5f33f3fd318b service nova] Acquired lock "refresh_cache-ade24ab6-1a93-4449-b5e9-ec3de357665b" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:20:19 user nova-compute[82479]: DEBUG nova.network.neutron [req-a19430d3-994f-4ffa-aea5-42cd40c4eaa0 req-2ff9dc47-1e55-41af-b9c3-5f33f3fd318b service nova] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Refreshing network info cache for port 11344eed-48f5-49c5-a770-c9c298f7185e {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:20:20 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-79dada32-ccc3-4094-b048-5f386a0d32e9 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "ade24ab6-1a93-4449-b5e9-ec3de357665b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:20:20 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-79dada32-ccc3-4094-b048-5f386a0d32e9 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "ade24ab6-1a93-4449-b5e9-ec3de357665b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:20:20 user nova-compute[82479]: DEBUG nova.objects.instance [None req-79dada32-ccc3-4094-b048-5f386a0d32e9 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lazy-loading 'flavor' on Instance uuid ade24ab6-1a93-4449-b5e9-ec3de357665b {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:20:20 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-79dada32-ccc3-4094-b048-5f386a0d32e9 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "ade24ab6-1a93-4449-b5e9-ec3de357665b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:20:20 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-79dada32-ccc3-4094-b048-5f386a0d32e9 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "ade24ab6-1a93-4449-b5e9-ec3de357665b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:20:20 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-79dada32-ccc3-4094-b048-5f386a0d32e9 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "ade24ab6-1a93-4449-b5e9-ec3de357665b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:20:20 user nova-compute[82479]: INFO nova.compute.manager [None req-79dada32-ccc3-4094-b048-5f386a0d32e9 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Attaching volume 0c953a4d-d77b-4d17-bcad-ea49b45adbb9 to /dev/vdb
Apr 14 00:20:20 user nova-compute[82479]: DEBUG os_brick.utils [None req-79dada32-ccc3-4094-b048-5f386a0d32e9 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:20:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:20:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:20:20 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[da05af84-3769-4bf2-a527-a2d48555c3c9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fec92fcfdd3\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:20:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:20:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:20:20 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b89c6f-4c50-4cc4-8c53-745facfc379b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:20:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:20:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:20:20 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f14a47d-b571-46b6-947d-b08c38758071]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:20:20 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7990fa6-c2d9-4b23-aceb-9fdb044711a3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:20:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-79dada32-ccc3-4094-b048-5f386a0d32e9 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Running cmd (subprocess): nvme version {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:20:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-79dada32-ccc3-4094-b048-5f386a0d32e9 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] 'nvme version' failed. Not Retrying. {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:20:20 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.nvmeof [None req-79dada32-ccc3-4094-b048-5f386a0d32e9 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] nvme not present on system {{(pid=82479) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 00:20:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:20:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:20:20 user nova-compute[82479]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 00:20:20 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d5c5df-2b91-40e0-b5a3-8af8150ec0bf]: (4, '') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:20:20 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-79dada32-ccc3-4094-b048-5f386a0d32e9 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82479) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 00:20:20 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-79dada32-ccc3-4094-b048-5f386a0d32e9 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 00:20:20 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-79dada32-ccc3-4094-b048-5f386a0d32e9 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] LIGHTOS: no hostnqn found. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 00:20:20 user nova-compute[82479]: DEBUG os_brick.utils [None req-79dada32-ccc3-4094-b048-5f386a0d32e9 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fec92fcfdd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:20:20 user nova-compute[82479]: DEBUG nova.virt.block_device [None req-79dada32-ccc3-4094-b048-5f386a0d32e9 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Updating existing volume attachment record: a6056597-9848-4805-827e-8c95d7f7332e {{(pid=82479) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 00:20:20 user nova-compute[82479]: DEBUG nova.network.neutron [req-a19430d3-994f-4ffa-aea5-42cd40c4eaa0 req-2ff9dc47-1e55-41af-b9c3-5f33f3fd318b service nova] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Updated VIF entry in instance network info cache for port 11344eed-48f5-49c5-a770-c9c298f7185e. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:20:20 user nova-compute[82479]: DEBUG nova.network.neutron [req-a19430d3-994f-4ffa-aea5-42cd40c4eaa0 req-2ff9dc47-1e55-41af-b9c3-5f33f3fd318b service nova] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Updating instance_info_cache with network_info: [{"id": "11344eed-48f5-49c5-a770-c9c298f7185e", "address": "fa:16:3e:cd:dc:0b", "network": {"id": "08106daa-a35e-4376-8c46-2b4baa51c6ea", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321730350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524265958bd24a6cb94aa3115eb2b6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11344eed-48", "ovs_interfaceid": "11344eed-48f5-49c5-a770-c9c298f7185e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:20:20 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-a19430d3-994f-4ffa-aea5-42cd40c4eaa0 req-2ff9dc47-1e55-41af-b9c3-5f33f3fd318b service nova] Releasing lock "refresh_cache-ade24ab6-1a93-4449-b5e9-ec3de357665b" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:20:21 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:20:22 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:20:25 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79dada32-ccc3-4094-b048-5f386a0d32e9 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Calling os-brick to attach iSCSI Volume {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 00:20:25 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-79dada32-ccc3-4094-b048-5f386a0d32e9 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RxsEKbZB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:20:25 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-79dada32-ccc3-4094-b048-5f386a0d32e9 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:20:25 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-79dada32-ccc3-4094-b048-5f386a0d32e9 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:20:25 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-79dada32-ccc3-4094-b048-5f386a0d32e9 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:20:25 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-79dada32-ccc3-4094-b048-5f386a0d32e9 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:20:25 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-79dada32-ccc3-4094-b048-5f386a0d32e9 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:20:25 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-79dada32-ccc3-4094-b048-5f386a0d32e9 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:20:25 user nova-compute[82479]: INFO os_brick.initiator.connectors.iscsi [None req-79dada32-ccc3-4094-b048-5f386a0d32e9 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 00:20:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 -p 172.16.0.220:3260 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:20:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:20:25 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09bf8dd-c6ed-4a86-a73d-4e5a5fe746af]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:20:25 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-79dada32-ccc3-4094-b048-5f386a0d32e9 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 00:20:25 user nova-compute[82479]:  {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:20:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 -p 172.16.0.220:3260 --interface default --op new {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:20:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:20:25 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2b1bdc-b48c-4517-a6b7-d9337bdae790]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9] added\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:20:25 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-79dada32-ccc3-4094-b048-5f386a0d32e9 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9] added
Apr 14 00:20:25 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:20:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:20:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:20:25 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a218e1e-ce92-485f-b78b-9241d80726da]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:20:25 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-79dada32-ccc3-4094-b048-5f386a0d32e9 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:20:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:20:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:20:25 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f3505a-af77-459f-a7f3-e3c7dea6ffac]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:20:25 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-79dada32-ccc3-4094-b048-5f386a0d32e9 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:20:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RxsEKbZB {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:20:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RxsEKbZB" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:20:25 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d31cd78-ca86-44d5-a074-01cfb620e77e]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:20:25 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-79dada32-ccc3-4094-b048-5f386a0d32e9 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RxsEKbZB'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:20:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:20:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:20:25 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[635cf3a7-6f4a-4157-bfe3-f1de3d01bcc8]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:20:25 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-79dada32-ccc3-4094-b048-5f386a0d32e9 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:20:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:20:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:20:25 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d18f2a-6ff0-47e2-bebf-431e72941d26]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:20:25 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-79dada32-ccc3-4094-b048-5f386a0d32e9 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:20:25 user nova-compute[82479]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 (non-flash)
Apr 14 00:20:25 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:20:25 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-79dada32-ccc3-4094-b048-5f386a0d32e9 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:20:25 user nova-compute[82479]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 (non-flash)
Apr 14 00:20:25 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:20:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 -p 172.16.0.220:3260 --login {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:20:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:20:25 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a337c4-c172-4c57-abeb-5ba45828f931]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:20:25 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-79dada32-ccc3-4094-b048-5f386a0d32e9 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9, portal: 172.16.0.220,3260]
Apr 14 00:20:25 user nova-compute[82479]: Login to [iface: default, target: iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9, portal: 172.16.0.220,3260] successful.
Apr 14 00:20:25 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:20:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:20:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:20:25 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b96a6e-8d04-4b21-99f8-281662c04967]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:20:25 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-79dada32-ccc3-4094-b048-5f386a0d32e9 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:20:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:20:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:20:25 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d749f4-e5a9-4ac6-8e98-bd2ea5108a10]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:20:25 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-79dada32-ccc3-4094-b048-5f386a0d32e9 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:20:25 user nova-compute[82479]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 (non-flash)
Apr 14 00:20:25 user nova-compute[82479]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 (non-flash)
Apr 14 00:20:25 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:20:25 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-79dada32-ccc3-4094-b048-5f386a0d32e9 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:20:25 user nova-compute[82479]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 (non-flash)
Apr 14 00:20:25 user nova-compute[82479]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 (non-flash)
Apr 14 00:20:25 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:20:25 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-79dada32-ccc3-4094-b048-5f386a0d32e9 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:20:25 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-79dada32-ccc3-4094-b048-5f386a0d32e9 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Connected to 172.16.0.220:3260 {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 00:20:25 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-79dada32-ccc3-4094-b048-5f386a0d32e9 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] HCTL ('33', '-', '-', 0) found on session 33 with lun 0 {{(pid=82479) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 00:20:25 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-79dada32-ccc3-4094-b048-5f386a0d32e9 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82479) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 00:20:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:20:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.025s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:20:25 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[941d6c5c-35cd-4e01-885c-80317f445bbc]: (4, ('- - 0', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:20:25 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-79dada32-ccc3-4094-b048-5f386a0d32e9 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Searching for a device in session 33 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82479) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 00:20:25 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-79dada32-ccc3-4094-b048-5f386a0d32e9 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RxsEKbZB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 00:20:26 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:20:26 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-79dada32-ccc3-4094-b048-5f386a0d32e9 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:20:26 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-79dada32-ccc3-4094-b048-5f386a0d32e9 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '26334396636613565', 'path': '/dev/sdb'} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:20:26 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79dada32-ccc3-4094-b048-5f386a0d32e9 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26334396636613565', 'path': '/dev/sdb'} {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 00:20:26 user nova-compute[82479]: DEBUG nova.objects.instance [None req-79dada32-ccc3-4094-b048-5f386a0d32e9 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lazy-loading 'flavor' on Instance uuid ade24ab6-1a93-4449-b5e9-ec3de357665b {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:20:27 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-79dada32-ccc3-4094-b048-5f386a0d32e9 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 00:20:27 user nova-compute[82479]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:20:27 user nova-compute[82479]:   <source dev="/dev/sdb"/>
Apr 14 00:20:27 user nova-compute[82479]:   <target dev="vdb" bus="virtio"/>
Apr 14 00:20:27 user nova-compute[82479]:   <serial>0c953a4d-d77b-4d17-bcad-ea49b45adbb9</serial>
Apr 14 00:20:27 user nova-compute[82479]: </disk>
Apr 14 00:20:27 user nova-compute[82479]:  {{(pid=82479) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 00:20:27 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-79dada32-ccc3-4094-b048-5f386a0d32e9 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:20:27 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-79dada32-ccc3-4094-b048-5f386a0d32e9 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:20:27 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-79dada32-ccc3-4094-b048-5f386a0d32e9 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] No VIF found with MAC fa:16:3e:cd:dc:0b, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:20:27 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:20:27 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-79dada32-ccc3-4094-b048-5f386a0d32e9 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "ade24ab6-1a93-4449-b5e9-ec3de357665b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.247s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:20:28 user nova-compute[82479]: INFO nova.compute.manager [None req-6ac3e122-3e72-49de-8d4b-ab420ff95b16 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Rescuing
Apr 14 00:20:28 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-6ac3e122-3e72-49de-8d4b-ab420ff95b16 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "refresh_cache-ade24ab6-1a93-4449-b5e9-ec3de357665b" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:20:28 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-6ac3e122-3e72-49de-8d4b-ab420ff95b16 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquired lock "refresh_cache-ade24ab6-1a93-4449-b5e9-ec3de357665b" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:20:28 user nova-compute[82479]: DEBUG nova.network.neutron [None req-6ac3e122-3e72-49de-8d4b-ab420ff95b16 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 00:20:28 user nova-compute[82479]: DEBUG nova.network.neutron [None req-6ac3e122-3e72-49de-8d4b-ab420ff95b16 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Updating instance_info_cache with network_info: [{"id": "11344eed-48f5-49c5-a770-c9c298f7185e", "address": "fa:16:3e:cd:dc:0b", "network": {"id": "08106daa-a35e-4376-8c46-2b4baa51c6ea", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321730350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524265958bd24a6cb94aa3115eb2b6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11344eed-48", "ovs_interfaceid": "11344eed-48f5-49c5-a770-c9c298f7185e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:20:28 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-6ac3e122-3e72-49de-8d4b-ab420ff95b16 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Releasing lock "refresh_cache-ade24ab6-1a93-4449-b5e9-ec3de357665b" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:20:28 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:20:28 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:20:29 user nova-compute[82479]: DEBUG nova.compute.manager [req-55a1bbe8-d2e3-4c41-929b-fe93adb94b58 req-cc03fafa-9af7-4a2f-89ac-a51aef25b07b service nova] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Received event network-vif-unplugged-11344eed-48f5-49c5-a770-c9c298f7185e {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:20:29 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-55a1bbe8-d2e3-4c41-929b-fe93adb94b58 req-cc03fafa-9af7-4a2f-89ac-a51aef25b07b service nova] Acquiring lock "ade24ab6-1a93-4449-b5e9-ec3de357665b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:20:29 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-55a1bbe8-d2e3-4c41-929b-fe93adb94b58 req-cc03fafa-9af7-4a2f-89ac-a51aef25b07b service nova] Lock "ade24ab6-1a93-4449-b5e9-ec3de357665b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:20:29 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-55a1bbe8-d2e3-4c41-929b-fe93adb94b58 req-cc03fafa-9af7-4a2f-89ac-a51aef25b07b service nova] Lock "ade24ab6-1a93-4449-b5e9-ec3de357665b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:20:29 user nova-compute[82479]: DEBUG nova.compute.manager [req-55a1bbe8-d2e3-4c41-929b-fe93adb94b58 req-cc03fafa-9af7-4a2f-89ac-a51aef25b07b service nova] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] No waiting events found dispatching network-vif-unplugged-11344eed-48f5-49c5-a770-c9c298f7185e {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:20:29 user nova-compute[82479]: WARNING nova.compute.manager [req-55a1bbe8-d2e3-4c41-929b-fe93adb94b58 req-cc03fafa-9af7-4a2f-89ac-a51aef25b07b service nova] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Received unexpected event network-vif-unplugged-11344eed-48f5-49c5-a770-c9c298f7185e for instance with vm_state active and task_state rescuing.
Apr 14 00:20:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:20:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:20:29 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Instance destroyed successfully.
Apr 14 00:20:29 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-6ac3e122-3e72-49de-8d4b-ab420ff95b16 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Attempting rescue
Apr 14 00:20:29 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-6ac3e122-3e72-49de-8d4b-ab420ff95b16 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=82479) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 14 00:20:29 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-6ac3e122-3e72-49de-8d4b-ab420ff95b16 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Instance directory exists: not creating {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 00:20:29 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-6ac3e122-3e72-49de-8d4b-ab420ff95b16 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Creating image(s)
Apr 14 00:20:29 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-6ac3e122-3e72-49de-8d4b-ab420ff95b16 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "/opt/stack/data/nova/instances/ade24ab6-1a93-4449-b5e9-ec3de357665b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:20:29 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-6ac3e122-3e72-49de-8d4b-ab420ff95b16 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "/opt/stack/data/nova/instances/ade24ab6-1a93-4449-b5e9-ec3de357665b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:20:29 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-6ac3e122-3e72-49de-8d4b-ab420ff95b16 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "/opt/stack/data/nova/instances/ade24ab6-1a93-4449-b5e9-ec3de357665b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:20:29 user nova-compute[82479]: DEBUG nova.objects.instance [None req-6ac3e122-3e72-49de-8d4b-ab420ff95b16 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lazy-loading 'trusted_certs' on Instance uuid ade24ab6-1a93-4449-b5e9-ec3de357665b {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:20:29 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-6ac3e122-3e72-49de-8d4b-ab420ff95b16 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "3e200e101633f2016e569ae4c0a352380507d1e4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:20:29 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-6ac3e122-3e72-49de-8d4b-ab420ff95b16 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "3e200e101633f2016e569ae4c0a352380507d1e4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:20:29 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-6ac3e122-3e72-49de-8d4b-ab420ff95b16 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:20:29 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-6ac3e122-3e72-49de-8d4b-ab420ff95b16 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.140s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:20:29 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-6ac3e122-3e72-49de-8d4b-ab420ff95b16 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/ade24ab6-1a93-4449-b5e9-ec3de357665b/disk.rescue {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:20:29 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-6ac3e122-3e72-49de-8d4b-ab420ff95b16 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/ade24ab6-1a93-4449-b5e9-ec3de357665b/disk.rescue" returned: 0 in 0.048s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:20:29 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-6ac3e122-3e72-49de-8d4b-ab420ff95b16 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "3e200e101633f2016e569ae4c0a352380507d1e4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:20:29 user nova-compute[82479]: DEBUG nova.objects.instance [None req-6ac3e122-3e72-49de-8d4b-ab420ff95b16 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lazy-loading 'migration_context' on Instance uuid ade24ab6-1a93-4449-b5e9-ec3de357665b {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:20:29 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-6ac3e122-3e72-49de-8d4b-ab420ff95b16 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Created local disks {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 00:20:29 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-6ac3e122-3e72-49de-8d4b-ab420ff95b16 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Start _get_guest_xml network_info=[{"id": "11344eed-48f5-49c5-a770-c9c298f7185e", "address": "fa:16:3e:cd:dc:0b", "network": {"id": "08106daa-a35e-4376-8c46-2b4baa51c6ea", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321730350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1321730350-network", "vif_mac": "fa:16:3e:cd:dc:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524265958bd24a6cb94aa3115eb2b6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11344eed-48", "ovs_interfaceid": "11344eed-48f5-49c5-a770-c9c298f7185e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 00:20:29 user nova-compute[82479]: DEBUG nova.objects.instance [None req-6ac3e122-3e72-49de-8d4b-ab420ff95b16 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lazy-loading 'resources' on Instance uuid ade24ab6-1a93-4449-b5e9-ec3de357665b {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:20:29 user nova-compute[82479]: DEBUG nova.objects.instance [None req-6ac3e122-3e72-49de-8d4b-ab420ff95b16 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lazy-loading 'numa_topology' on Instance uuid ade24ab6-1a93-4449-b5e9-ec3de357665b {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:20:29 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-6ac3e122-3e72-49de-8d4b-ab420ff95b16 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:20:29 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-6ac3e122-3e72-49de-8d4b-ab420ff95b16 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:20:29 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-6ac3e122-3e72-49de-8d4b-ab420ff95b16 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82479) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 00:20:29 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-6ac3e122-3e72-49de-8d4b-ab420ff95b16 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T00:02:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 00:20:29 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-6ac3e122-3e72-49de-8d4b-ab420ff95b16 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Flavor limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 00:20:29 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-6ac3e122-3e72-49de-8d4b-ab420ff95b16 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Image limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 00:20:29 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-6ac3e122-3e72-49de-8d4b-ab420ff95b16 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Flavor pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 00:20:29 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-6ac3e122-3e72-49de-8d4b-ab420ff95b16 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Image pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 00:20:29 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-6ac3e122-3e72-49de-8d4b-ab420ff95b16 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 00:20:29 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-6ac3e122-3e72-49de-8d4b-ab420ff95b16 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 00:20:29 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-6ac3e122-3e72-49de-8d4b-ab420ff95b16 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 00:20:29 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-6ac3e122-3e72-49de-8d4b-ab420ff95b16 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Got 1 possible topologies {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 00:20:29 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-6ac3e122-3e72-49de-8d4b-ab420ff95b16 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 00:20:29 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-6ac3e122-3e72-49de-8d4b-ab420ff95b16 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 00:20:29 user nova-compute[82479]: DEBUG nova.objects.instance [None req-6ac3e122-3e72-49de-8d4b-ab420ff95b16 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lazy-loading 'vcpu_model' on Instance uuid ade24ab6-1a93-4449-b5e9-ec3de357665b {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:20:29 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-6ac3e122-3e72-49de-8d4b-ab420ff95b16 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:18:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-576521395',display_name='tempest-ServerRescueNegativeTestJSON-server-576521395',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-576521395',id=31,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPJl6SDPfCFQp4baCPxy+GI6LhLuQU3NPsG3291XLwXmLvJxDSbMZPnAUG2FnoP7gWRMoPh0RxuN0i+Igwez3QU2DJmViyuFIRLYjK8+Jg8nIMy2dRZs6Aqrth2wJ7mNQ==',key_name='tempest-keypair-2020248029',keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:18:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='524265958bd24a6cb94aa3115eb2b6c7',ramdisk_id='',reservation_id='r-a4yceyqy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1055458768',owner_user_name='tempest-ServerRescueNegativeTestJSON-1055458768-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:18:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f43f3171ccad4167ac783bbdfe2df478',uuid=ade24ab6-1a93-4449-b5e9-ec3de357665b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "11344eed-48f5-49c5-a770-c9c298f7185e", "address": "fa:16:3e:cd:dc:0b", "network": {"id": "08106daa-a35e-4376-8c46-2b4baa51c6ea", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321730350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1321730350-network", "vif_mac": "fa:16:3e:cd:dc:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524265958bd24a6cb94aa3115eb2b6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11344eed-48", "ovs_interfaceid": "11344eed-48f5-49c5-a770-c9c298f7185e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82479) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 00:20:29 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-6ac3e122-3e72-49de-8d4b-ab420ff95b16 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Converting VIF {"id": "11344eed-48f5-49c5-a770-c9c298f7185e", "address": "fa:16:3e:cd:dc:0b", "network": {"id": "08106daa-a35e-4376-8c46-2b4baa51c6ea", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321730350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1321730350-network", "vif_mac": "fa:16:3e:cd:dc:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524265958bd24a6cb94aa3115eb2b6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11344eed-48", "ovs_interfaceid": "11344eed-48f5-49c5-a770-c9c298f7185e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:20:29 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-6ac3e122-3e72-49de-8d4b-ab420ff95b16 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:dc:0b,bridge_name='br-int',has_traffic_filtering=True,id=11344eed-48f5-49c5-a770-c9c298f7185e,network=Network(08106daa-a35e-4376-8c46-2b4baa51c6ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11344eed-48') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:20:29 user nova-compute[82479]: DEBUG nova.objects.instance [None req-6ac3e122-3e72-49de-8d4b-ab420ff95b16 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lazy-loading 'pci_devices' on Instance uuid ade24ab6-1a93-4449-b5e9-ec3de357665b {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:20:29 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-6ac3e122-3e72-49de-8d4b-ab420ff95b16 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] End _get_guest_xml xml=<domain type="kvm">
Apr 14 00:20:29 user nova-compute[82479]:   <uuid>ade24ab6-1a93-4449-b5e9-ec3de357665b</uuid>
Apr 14 00:20:29 user nova-compute[82479]:   <name>instance-0000001f</name>
Apr 14 00:20:29 user nova-compute[82479]:   <memory>131072</memory>
Apr 14 00:20:29 user nova-compute[82479]:   <vcpu>1</vcpu>
Apr 14 00:20:29 user nova-compute[82479]:   <metadata>
Apr 14 00:20:29 user nova-compute[82479]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 00:20:29 user nova-compute[82479]:       <nova:package version="0.0.0"/>
Apr 14 00:20:29 user nova-compute[82479]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-576521395</nova:name>
Apr 14 00:20:29 user nova-compute[82479]:       <nova:creationTime>2023-04-14 00:20:29</nova:creationTime>
Apr 14 00:20:29 user nova-compute[82479]:       <nova:flavor name="m1.nano">
Apr 14 00:20:29 user nova-compute[82479]:         <nova:memory>128</nova:memory>
Apr 14 00:20:29 user nova-compute[82479]:         <nova:disk>1</nova:disk>
Apr 14 00:20:29 user nova-compute[82479]:         <nova:swap>0</nova:swap>
Apr 14 00:20:29 user nova-compute[82479]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 00:20:29 user nova-compute[82479]:         <nova:vcpus>1</nova:vcpus>
Apr 14 00:20:29 user nova-compute[82479]:       </nova:flavor>
Apr 14 00:20:29 user nova-compute[82479]:       <nova:owner>
Apr 14 00:20:29 user nova-compute[82479]:         <nova:user uuid="f43f3171ccad4167ac783bbdfe2df478">tempest-ServerRescueNegativeTestJSON-1055458768-project-member</nova:user>
Apr 14 00:20:29 user nova-compute[82479]:         <nova:project uuid="524265958bd24a6cb94aa3115eb2b6c7">tempest-ServerRescueNegativeTestJSON-1055458768</nova:project>
Apr 14 00:20:29 user nova-compute[82479]:       </nova:owner>
Apr 14 00:20:29 user nova-compute[82479]:       <nova:root type="image" uuid="6db62068-7278-4cd8-b41f-d0140d89e199"/>
Apr 14 00:20:29 user nova-compute[82479]:       <nova:ports>
Apr 14 00:20:29 user nova-compute[82479]:         <nova:port uuid="11344eed-48f5-49c5-a770-c9c298f7185e">
Apr 14 00:20:29 user nova-compute[82479]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 14 00:20:29 user nova-compute[82479]:         </nova:port>
Apr 14 00:20:29 user nova-compute[82479]:       </nova:ports>
Apr 14 00:20:29 user nova-compute[82479]:     </nova:instance>
Apr 14 00:20:29 user nova-compute[82479]:   </metadata>
Apr 14 00:20:29 user nova-compute[82479]:   <sysinfo type="smbios">
Apr 14 00:20:29 user nova-compute[82479]:     <system>
Apr 14 00:20:29 user nova-compute[82479]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 00:20:29 user nova-compute[82479]:       <entry name="product">OpenStack Nova</entry>
Apr 14 00:20:29 user nova-compute[82479]:       <entry name="version">0.0.0</entry>
Apr 14 00:20:29 user nova-compute[82479]:       <entry name="serial">ade24ab6-1a93-4449-b5e9-ec3de357665b</entry>
Apr 14 00:20:29 user nova-compute[82479]:       <entry name="uuid">ade24ab6-1a93-4449-b5e9-ec3de357665b</entry>
Apr 14 00:20:29 user nova-compute[82479]:       <entry name="family">Virtual Machine</entry>
Apr 14 00:20:29 user nova-compute[82479]:     </system>
Apr 14 00:20:29 user nova-compute[82479]:   </sysinfo>
Apr 14 00:20:29 user nova-compute[82479]:   <os>
Apr 14 00:20:29 user nova-compute[82479]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 00:20:29 user nova-compute[82479]:     <smbios mode="sysinfo"/>
Apr 14 00:20:29 user nova-compute[82479]:   </os>
Apr 14 00:20:29 user nova-compute[82479]:   <features>
Apr 14 00:20:29 user nova-compute[82479]:     <acpi/>
Apr 14 00:20:29 user nova-compute[82479]:     <apic/>
Apr 14 00:20:29 user nova-compute[82479]:     <vmcoreinfo/>
Apr 14 00:20:29 user nova-compute[82479]:   </features>
Apr 14 00:20:29 user nova-compute[82479]:   <clock offset="utc">
Apr 14 00:20:29 user nova-compute[82479]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 00:20:29 user nova-compute[82479]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 00:20:29 user nova-compute[82479]:     <timer name="hpet" present="no"/>
Apr 14 00:20:29 user nova-compute[82479]:   </clock>
Apr 14 00:20:29 user nova-compute[82479]:   <cpu mode="custom" match="exact">
Apr 14 00:20:29 user nova-compute[82479]:     <model>Nehalem</model>
Apr 14 00:20:29 user nova-compute[82479]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 00:20:29 user nova-compute[82479]:   </cpu>
Apr 14 00:20:29 user nova-compute[82479]:   <devices>
Apr 14 00:20:29 user nova-compute[82479]:     <disk type="file" device="disk">
Apr 14 00:20:29 user nova-compute[82479]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 00:20:29 user nova-compute[82479]:       <source file="/opt/stack/data/nova/instances/ade24ab6-1a93-4449-b5e9-ec3de357665b/disk.rescue"/>
Apr 14 00:20:29 user nova-compute[82479]:       <target dev="vda" bus="virtio"/>
Apr 14 00:20:29 user nova-compute[82479]:     </disk>
Apr 14 00:20:29 user nova-compute[82479]:     <disk type="file" device="disk">
Apr 14 00:20:29 user nova-compute[82479]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 00:20:29 user nova-compute[82479]:       <source file="/opt/stack/data/nova/instances/ade24ab6-1a93-4449-b5e9-ec3de357665b/disk"/>
Apr 14 00:20:29 user nova-compute[82479]:       <target dev="vdb" bus="virtio"/>
Apr 14 00:20:29 user nova-compute[82479]:     </disk>
Apr 14 00:20:29 user nova-compute[82479]:     <interface type="ethernet">
Apr 14 00:20:29 user nova-compute[82479]:       <mac address="fa:16:3e:cd:dc:0b"/>
Apr 14 00:20:29 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:20:29 user nova-compute[82479]:       <mtu size="1442"/>
Apr 14 00:20:29 user nova-compute[82479]:       <target dev="tap11344eed-48"/>
Apr 14 00:20:29 user nova-compute[82479]:     </interface>
Apr 14 00:20:29 user nova-compute[82479]:     <serial type="pty">
Apr 14 00:20:29 user nova-compute[82479]:       <log file="/opt/stack/data/nova/instances/ade24ab6-1a93-4449-b5e9-ec3de357665b/console.log" append="off"/>
Apr 14 00:20:29 user nova-compute[82479]:     </serial>
Apr 14 00:20:29 user nova-compute[82479]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 00:20:29 user nova-compute[82479]:     <video>
Apr 14 00:20:29 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:20:29 user nova-compute[82479]:     </video>
Apr 14 00:20:29 user nova-compute[82479]:     <rng model="virtio">
Apr 14 00:20:29 user nova-compute[82479]:       <backend model="random">/dev/urandom</backend>
Apr 14 00:20:29 user nova-compute[82479]:     </rng>
Apr 14 00:20:29 user nova-compute[82479]:     <controller type="usb" index="0" model="none"/>
Apr 14 00:20:29 user nova-compute[82479]:     <memballoon model="virtio">
Apr 14 00:20:29 user nova-compute[82479]:       <stats period="10"/>
Apr 14 00:20:29 user nova-compute[82479]:     </memballoon>
Apr 14 00:20:29 user nova-compute[82479]:   </devices>
Apr 14 00:20:29 user nova-compute[82479]: </domain>
Apr 14 00:20:29 user nova-compute[82479]:  {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 00:20:29 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Instance destroyed successfully.
Apr 14 00:20:29 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-6ac3e122-3e72-49de-8d4b-ab420ff95b16 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:20:29 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-6ac3e122-3e72-49de-8d4b-ab420ff95b16 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:20:29 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-6ac3e122-3e72-49de-8d4b-ab420ff95b16 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] No VIF found with MAC fa:16:3e:cd:dc:0b, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:20:31 user nova-compute[82479]: DEBUG nova.compute.manager [req-afda89dd-68a6-4a58-ab91-8cd957a284cc req-61b58995-c150-44d2-be95-2cd3c1d4a0e9 service nova] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Received event network-vif-plugged-11344eed-48f5-49c5-a770-c9c298f7185e {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:20:31 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-afda89dd-68a6-4a58-ab91-8cd957a284cc req-61b58995-c150-44d2-be95-2cd3c1d4a0e9 service nova] Acquiring lock "ade24ab6-1a93-4449-b5e9-ec3de357665b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:20:31 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-afda89dd-68a6-4a58-ab91-8cd957a284cc req-61b58995-c150-44d2-be95-2cd3c1d4a0e9 service nova] Lock "ade24ab6-1a93-4449-b5e9-ec3de357665b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:20:31 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-afda89dd-68a6-4a58-ab91-8cd957a284cc req-61b58995-c150-44d2-be95-2cd3c1d4a0e9 service nova] Lock "ade24ab6-1a93-4449-b5e9-ec3de357665b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:20:31 user nova-compute[82479]: DEBUG nova.compute.manager [req-afda89dd-68a6-4a58-ab91-8cd957a284cc req-61b58995-c150-44d2-be95-2cd3c1d4a0e9 service nova] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] No waiting events found dispatching network-vif-plugged-11344eed-48f5-49c5-a770-c9c298f7185e {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:20:31 user nova-compute[82479]: WARNING nova.compute.manager [req-afda89dd-68a6-4a58-ab91-8cd957a284cc req-61b58995-c150-44d2-be95-2cd3c1d4a0e9 service nova] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Received unexpected event network-vif-plugged-11344eed-48f5-49c5-a770-c9c298f7185e for instance with vm_state active and task_state rescuing.
Apr 14 00:20:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:20:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:20:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:20:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:20:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:20:32 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:20:33 user nova-compute[82479]: DEBUG nova.compute.manager [req-459b3c53-d2eb-48e7-8ac6-ea69c60491ae req-fe2878a4-1398-49d6-bbff-1f91544b5912 service nova] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Received event network-vif-plugged-11344eed-48f5-49c5-a770-c9c298f7185e {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:20:33 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-459b3c53-d2eb-48e7-8ac6-ea69c60491ae req-fe2878a4-1398-49d6-bbff-1f91544b5912 service nova] Acquiring lock "ade24ab6-1a93-4449-b5e9-ec3de357665b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:20:33 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-459b3c53-d2eb-48e7-8ac6-ea69c60491ae req-fe2878a4-1398-49d6-bbff-1f91544b5912 service nova] Lock "ade24ab6-1a93-4449-b5e9-ec3de357665b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:20:33 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-459b3c53-d2eb-48e7-8ac6-ea69c60491ae req-fe2878a4-1398-49d6-bbff-1f91544b5912 service nova] Lock "ade24ab6-1a93-4449-b5e9-ec3de357665b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:20:33 user nova-compute[82479]: DEBUG nova.compute.manager [req-459b3c53-d2eb-48e7-8ac6-ea69c60491ae req-fe2878a4-1398-49d6-bbff-1f91544b5912 service nova] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] No waiting events found dispatching network-vif-plugged-11344eed-48f5-49c5-a770-c9c298f7185e {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:20:33 user nova-compute[82479]: WARNING nova.compute.manager [req-459b3c53-d2eb-48e7-8ac6-ea69c60491ae req-fe2878a4-1398-49d6-bbff-1f91544b5912 service nova] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Received unexpected event network-vif-plugged-11344eed-48f5-49c5-a770-c9c298f7185e for instance with vm_state active and task_state rescuing.
Apr 14 00:20:33 user nova-compute[82479]: DEBUG nova.compute.manager [req-459b3c53-d2eb-48e7-8ac6-ea69c60491ae req-fe2878a4-1398-49d6-bbff-1f91544b5912 service nova] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Received event network-vif-plugged-11344eed-48f5-49c5-a770-c9c298f7185e {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:20:33 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-459b3c53-d2eb-48e7-8ac6-ea69c60491ae req-fe2878a4-1398-49d6-bbff-1f91544b5912 service nova] Acquiring lock "ade24ab6-1a93-4449-b5e9-ec3de357665b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:20:33 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-459b3c53-d2eb-48e7-8ac6-ea69c60491ae req-fe2878a4-1398-49d6-bbff-1f91544b5912 service nova] Lock "ade24ab6-1a93-4449-b5e9-ec3de357665b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:20:33 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-459b3c53-d2eb-48e7-8ac6-ea69c60491ae req-fe2878a4-1398-49d6-bbff-1f91544b5912 service nova] Lock "ade24ab6-1a93-4449-b5e9-ec3de357665b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:20:33 user nova-compute[82479]: DEBUG nova.compute.manager [req-459b3c53-d2eb-48e7-8ac6-ea69c60491ae req-fe2878a4-1398-49d6-bbff-1f91544b5912 service nova] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] No waiting events found dispatching network-vif-plugged-11344eed-48f5-49c5-a770-c9c298f7185e {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:20:33 user nova-compute[82479]: WARNING nova.compute.manager [req-459b3c53-d2eb-48e7-8ac6-ea69c60491ae req-fe2878a4-1398-49d6-bbff-1f91544b5912 service nova] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Received unexpected event network-vif-plugged-11344eed-48f5-49c5-a770-c9c298f7185e for instance with vm_state active and task_state rescuing.
Apr 14 00:20:33 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Removed pending event for ade24ab6-1a93-4449-b5e9-ec3de357665b due to event {{(pid=82479) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 00:20:33 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681431633.8701909, ade24ab6-1a93-4449-b5e9-ec3de357665b => Resumed> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:20:33 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] VM Resumed (Lifecycle Event)
Apr 14 00:20:33 user nova-compute[82479]: DEBUG nova.compute.manager [None req-6ac3e122-3e72-49de-8d4b-ab420ff95b16 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:20:33 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:20:33 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:20:33 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 14 00:20:33 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681431633.8713906, ade24ab6-1a93-4449-b5e9-ec3de357665b => Started> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:20:33 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] VM Started (Lifecycle Event)
Apr 14 00:20:33 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:20:33 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:20:34 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 14 00:20:36 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:20:36 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f775802a-a29c-4dc1-b87a-8a48e8e4bcc6 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "fd5afe9f-e6b0-4564-a5cf-b4e0047a5503" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:20:36 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f775802a-a29c-4dc1-b87a-8a48e8e4bcc6 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "fd5afe9f-e6b0-4564-a5cf-b4e0047a5503" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:20:36 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f775802a-a29c-4dc1-b87a-8a48e8e4bcc6 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "fd5afe9f-e6b0-4564-a5cf-b4e0047a5503-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:20:36 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f775802a-a29c-4dc1-b87a-8a48e8e4bcc6 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "fd5afe9f-e6b0-4564-a5cf-b4e0047a5503-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:20:36 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f775802a-a29c-4dc1-b87a-8a48e8e4bcc6 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "fd5afe9f-e6b0-4564-a5cf-b4e0047a5503-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:20:36 user nova-compute[82479]: INFO nova.compute.manager [None req-f775802a-a29c-4dc1-b87a-8a48e8e4bcc6 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Terminating instance
Apr 14 00:20:36 user nova-compute[82479]: DEBUG nova.compute.manager [None req-f775802a-a29c-4dc1-b87a-8a48e8e4bcc6 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Start destroying the instance on the hypervisor. {{(pid=82479) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 00:20:36 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:20:36 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:20:36 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:20:36 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:20:37 user nova-compute[82479]: DEBUG nova.compute.manager [req-452676c9-b9f9-4d38-9364-4f569ed2fa89 req-b5c29225-ac26-493a-8f29-6dd272f1b8c8 service nova] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Received event network-vif-unplugged-9a6ef0bb-aaa8-4fe9-a3ea-cc1352c783cb {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:20:37 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-452676c9-b9f9-4d38-9364-4f569ed2fa89 req-b5c29225-ac26-493a-8f29-6dd272f1b8c8 service nova] Acquiring lock "fd5afe9f-e6b0-4564-a5cf-b4e0047a5503-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:20:37 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-452676c9-b9f9-4d38-9364-4f569ed2fa89 req-b5c29225-ac26-493a-8f29-6dd272f1b8c8 service nova] Lock "fd5afe9f-e6b0-4564-a5cf-b4e0047a5503-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:20:37 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-452676c9-b9f9-4d38-9364-4f569ed2fa89 req-b5c29225-ac26-493a-8f29-6dd272f1b8c8 service nova] Lock "fd5afe9f-e6b0-4564-a5cf-b4e0047a5503-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:20:37 user nova-compute[82479]: DEBUG nova.compute.manager [req-452676c9-b9f9-4d38-9364-4f569ed2fa89 req-b5c29225-ac26-493a-8f29-6dd272f1b8c8 service nova] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] No waiting events found dispatching network-vif-unplugged-9a6ef0bb-aaa8-4fe9-a3ea-cc1352c783cb {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:20:37 user nova-compute[82479]: DEBUG nova.compute.manager [req-452676c9-b9f9-4d38-9364-4f569ed2fa89 req-b5c29225-ac26-493a-8f29-6dd272f1b8c8 service nova] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Received event network-vif-unplugged-9a6ef0bb-aaa8-4fe9-a3ea-cc1352c783cb for instance with task_state deleting. {{(pid=82479) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 00:20:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:20:37 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Instance destroyed successfully.
Apr 14 00:20:37 user nova-compute[82479]: DEBUG nova.objects.instance [None req-f775802a-a29c-4dc1-b87a-8a48e8e4bcc6 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lazy-loading 'resources' on Instance uuid fd5afe9f-e6b0-4564-a5cf-b4e0047a5503 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:20:37 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-f775802a-a29c-4dc1-b87a-8a48e8e4bcc6 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:17:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2010253673',display_name='tempest-AttachVolumeNegativeTest-server-2010253673',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2010253673',id=30,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPr0jyTwvDHPJLpGUrzkkGrxlDbGIF7ZL08n94HAoGHssCr+iA4uVoJBoD+5iWgWcLutO8dmofk8s0wiKfrqS9Pq9CO1MVlpiKLplRNt4H2+cAhTa75oMeQEi6CQ3pbgw==',key_name='tempest-keypair-1861608591',keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:17:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='44c9d67ad2fa4cb9ab309b98f8fe051a',ramdisk_id='',reservation_id='r-13td5mkv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-719597397',owner_user_name='tempest-AttachVolumeNegativeTest-719597397-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T00:17:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb293fdfc658466aaa7134269fa46a7c',uuid=fd5afe9f-e6b0-4564-a5cf-b4e0047a5503,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9a6ef0bb-aaa8-4fe9-a3ea-cc1352c783cb", "address": "fa:16:3e:52:6f:81", "network": {"id": "6d80f923-8aef-45df-921b-f77ed4ff0e75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-696070096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44c9d67ad2fa4cb9ab309b98f8fe051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a6ef0bb-aa", "ovs_interfaceid": "9a6ef0bb-aaa8-4fe9-a3ea-cc1352c783cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 00:20:37 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-f775802a-a29c-4dc1-b87a-8a48e8e4bcc6 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Converting VIF {"id": "9a6ef0bb-aaa8-4fe9-a3ea-cc1352c783cb", "address": "fa:16:3e:52:6f:81", "network": {"id": "6d80f923-8aef-45df-921b-f77ed4ff0e75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-696070096-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44c9d67ad2fa4cb9ab309b98f8fe051a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a6ef0bb-aa", "ovs_interfaceid": "9a6ef0bb-aaa8-4fe9-a3ea-cc1352c783cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:20:37 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-f775802a-a29c-4dc1-b87a-8a48e8e4bcc6 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:52:6f:81,bridge_name='br-int',has_traffic_filtering=True,id=9a6ef0bb-aaa8-4fe9-a3ea-cc1352c783cb,network=Network(6d80f923-8aef-45df-921b-f77ed4ff0e75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a6ef0bb-aa') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:20:37 user nova-compute[82479]: DEBUG os_vif [None req-f775802a-a29c-4dc1-b87a-8a48e8e4bcc6 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:6f:81,bridge_name='br-int',has_traffic_filtering=True,id=9a6ef0bb-aaa8-4fe9-a3ea-cc1352c783cb,network=Network(6d80f923-8aef-45df-921b-f77ed4ff0e75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a6ef0bb-aa') {{(pid=82479) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 00:20:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:20:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9a6ef0bb-aa, bridge=br-int, if_exists=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:20:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:20:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:20:37 user nova-compute[82479]: INFO os_vif [None req-f775802a-a29c-4dc1-b87a-8a48e8e4bcc6 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:6f:81,bridge_name='br-int',has_traffic_filtering=True,id=9a6ef0bb-aaa8-4fe9-a3ea-cc1352c783cb,network=Network(6d80f923-8aef-45df-921b-f77ed4ff0e75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a6ef0bb-aa')
Apr 14 00:20:37 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-f775802a-a29c-4dc1-b87a-8a48e8e4bcc6 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Deleting instance files /opt/stack/data/nova/instances/fd5afe9f-e6b0-4564-a5cf-b4e0047a5503_del
Apr 14 00:20:37 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-f775802a-a29c-4dc1-b87a-8a48e8e4bcc6 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Deletion of /opt/stack/data/nova/instances/fd5afe9f-e6b0-4564-a5cf-b4e0047a5503_del complete
Apr 14 00:20:37 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Acquiring lock "c7e1f470-fe8a-455e-aa0b-0d2475957fc0" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:20:37 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "c7e1f470-fe8a-455e-aa0b-0d2475957fc0" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:20:37 user nova-compute[82479]: INFO nova.compute.manager [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Unshelving
Apr 14 00:20:37 user nova-compute[82479]: INFO nova.compute.manager [None req-f775802a-a29c-4dc1-b87a-8a48e8e4bcc6 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Took 0.95 seconds to destroy the instance on the hypervisor.
Apr 14 00:20:37 user nova-compute[82479]: DEBUG oslo.service.loopingcall [None req-f775802a-a29c-4dc1-b87a-8a48e8e4bcc6 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82479) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 00:20:37 user nova-compute[82479]: DEBUG nova.compute.manager [-] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Deallocating network for instance {{(pid=82479) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 00:20:37 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] deallocate_for_instance() {{(pid=82479) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 00:20:37 user nova-compute[82479]: INFO nova.virt.block_device [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Booting with volume 69599ada-93d4-425a-ae12-e52cafcc29f7 at /dev/vda
Apr 14 00:20:37 user nova-compute[82479]: DEBUG os_brick.utils [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:20:37 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:20:37 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:20:37 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f7fc75-913c-4055-846f-bd77a95d182d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fec92fcfdd3\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:20:37 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:20:37 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:20:37 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[5586a58d-5bc9-45b8-a8cb-7098f6650e00]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:20:37 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:20:37 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:20:37 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f26e901-7267-4db6-8af3-42932c8f30a1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:20:37 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4c852c-d33c-4fd4-88ce-96e4d0f73387]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:20:37 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Running cmd (subprocess): nvme version {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:20:38 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] 'nvme version' failed. Not Retrying. {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:20:38 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.nvmeof [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] nvme not present on system {{(pid=82479) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 00:20:38 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:20:38 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:20:38 user nova-compute[82479]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 00:20:38 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[eddbcb9c-cb9a-4f84-a163-f14306eeddf0]: (4, '') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:20:38 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82479) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 00:20:38 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 00:20:38 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] LIGHTOS: no hostnqn found. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 00:20:38 user nova-compute[82479]: DEBUG os_brick.utils [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fec92fcfdd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:20:38 user nova-compute[82479]: DEBUG nova.virt.block_device [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Updating existing volume attachment record: 869fd580-1919-4a5c-b29a-b85fcc14094b {{(pid=82479) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 00:20:38 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:20:38 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Updating instance_info_cache with network_info: [] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:20:38 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Took 0.86 seconds to deallocate network for instance.
Apr 14 00:20:38 user nova-compute[82479]: DEBUG nova.compute.manager [req-c336c047-938d-48b9-9013-ae86ad0a1a98 req-3a3b12ad-12b0-48af-99de-86dbeb8f0e2e service nova] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Received event network-vif-deleted-9a6ef0bb-aaa8-4fe9-a3ea-cc1352c783cb {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:20:38 user nova-compute[82479]: INFO nova.compute.manager [req-c336c047-938d-48b9-9013-ae86ad0a1a98 req-3a3b12ad-12b0-48af-99de-86dbeb8f0e2e service nova] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Neutron deleted interface 9a6ef0bb-aaa8-4fe9-a3ea-cc1352c783cb; detaching it from the instance and deleting it from the info cache
Apr 14 00:20:38 user nova-compute[82479]: DEBUG nova.network.neutron [req-c336c047-938d-48b9-9013-ae86ad0a1a98 req-3a3b12ad-12b0-48af-99de-86dbeb8f0e2e service nova] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Updating instance_info_cache with network_info: [] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:20:38 user nova-compute[82479]: DEBUG nova.compute.manager [req-c336c047-938d-48b9-9013-ae86ad0a1a98 req-3a3b12ad-12b0-48af-99de-86dbeb8f0e2e service nova] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Detach interface failed, port_id=9a6ef0bb-aaa8-4fe9-a3ea-cc1352c783cb, reason: Instance fd5afe9f-e6b0-4564-a5cf-b4e0047a5503 could not be found. {{(pid=82479) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 00:20:38 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f775802a-a29c-4dc1-b87a-8a48e8e4bcc6 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:20:38 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f775802a-a29c-4dc1-b87a-8a48e8e4bcc6 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.005s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:20:39 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-f775802a-a29c-4dc1-b87a-8a48e8e4bcc6 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:20:39 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-f775802a-a29c-4dc1-b87a-8a48e8e4bcc6 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:20:39 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f775802a-a29c-4dc1-b87a-8a48e8e4bcc6 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.384s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:20:39 user nova-compute[82479]: INFO nova.scheduler.client.report [None req-f775802a-a29c-4dc1-b87a-8a48e8e4bcc6 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Deleted allocations for instance fd5afe9f-e6b0-4564-a5cf-b4e0047a5503
Apr 14 00:20:39 user nova-compute[82479]: DEBUG nova.compute.manager [req-a23081a1-3814-485a-870c-b86c0386d315 req-f2b469b3-4df1-42b6-af3e-5be6f382ff3a service nova] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Received event network-vif-plugged-9a6ef0bb-aaa8-4fe9-a3ea-cc1352c783cb {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:20:39 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-a23081a1-3814-485a-870c-b86c0386d315 req-f2b469b3-4df1-42b6-af3e-5be6f382ff3a service nova] Acquiring lock "fd5afe9f-e6b0-4564-a5cf-b4e0047a5503-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:20:39 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-a23081a1-3814-485a-870c-b86c0386d315 req-f2b469b3-4df1-42b6-af3e-5be6f382ff3a service nova] Lock "fd5afe9f-e6b0-4564-a5cf-b4e0047a5503-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:20:39 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-a23081a1-3814-485a-870c-b86c0386d315 req-f2b469b3-4df1-42b6-af3e-5be6f382ff3a service nova] Lock "fd5afe9f-e6b0-4564-a5cf-b4e0047a5503-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:20:39 user nova-compute[82479]: DEBUG nova.compute.manager [req-a23081a1-3814-485a-870c-b86c0386d315 req-f2b469b3-4df1-42b6-af3e-5be6f382ff3a service nova] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] No waiting events found dispatching network-vif-plugged-9a6ef0bb-aaa8-4fe9-a3ea-cc1352c783cb {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:20:39 user nova-compute[82479]: WARNING nova.compute.manager [req-a23081a1-3814-485a-870c-b86c0386d315 req-f2b469b3-4df1-42b6-af3e-5be6f382ff3a service nova] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Received unexpected event network-vif-plugged-9a6ef0bb-aaa8-4fe9-a3ea-cc1352c783cb for instance with vm_state deleted and task_state None.
Apr 14 00:20:39 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f775802a-a29c-4dc1-b87a-8a48e8e4bcc6 tempest-AttachVolumeNegativeTest-719597397 tempest-AttachVolumeNegativeTest-719597397-project-member] Lock "fd5afe9f-e6b0-4564-a5cf-b4e0047a5503" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.435s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:20:42 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:20:42 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:20:42 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:20:42 user nova-compute[82479]: DEBUG nova.objects.instance [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lazy-loading 'pci_requests' on Instance uuid c7e1f470-fe8a-455e-aa0b-0d2475957fc0 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:20:42 user nova-compute[82479]: DEBUG nova.objects.instance [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lazy-loading 'numa_topology' on Instance uuid c7e1f470-fe8a-455e-aa0b-0d2475957fc0 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:20:42 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82479) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 00:20:42 user nova-compute[82479]: INFO nova.compute.claims [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Claim successful on node user
Apr 14 00:20:43 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:20:43 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:20:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.394s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:20:43 user nova-compute[82479]: INFO nova.network.neutron [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Updating port 0f90a627-4dab-4a2a-a2c2-eaae2910b379 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 14 00:20:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Acquiring lock "refresh_cache-c7e1f470-fe8a-455e-aa0b-0d2475957fc0" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:20:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Acquired lock "refresh_cache-c7e1f470-fe8a-455e-aa0b-0d2475957fc0" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:20:43 user nova-compute[82479]: DEBUG nova.network.neutron [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG nova.compute.manager [req-e5d55665-2d3b-42c9-b453-3b6e1441fe30 req-add6f7e2-0fed-49c0-b1ed-581b18f41f8a service nova] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Received event network-changed-0f90a627-4dab-4a2a-a2c2-eaae2910b379 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG nova.compute.manager [req-e5d55665-2d3b-42c9-b453-3b6e1441fe30 req-add6f7e2-0fed-49c0-b1ed-581b18f41f8a service nova] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Refreshing instance network info cache due to event network-changed-0f90a627-4dab-4a2a-a2c2-eaae2910b379. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-e5d55665-2d3b-42c9-b453-3b6e1441fe30 req-add6f7e2-0fed-49c0-b1ed-581b18f41f8a service nova] Acquiring lock "refresh_cache-c7e1f470-fe8a-455e-aa0b-0d2475957fc0" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG nova.network.neutron [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Updating instance_info_cache with network_info: [{"id": "0f90a627-4dab-4a2a-a2c2-eaae2910b379", "address": "fa:16:3e:e2:65:cb", "network": {"id": "9f0b7c66-0d95-4c5f-8c77-6f12228c20fc", "bridge": "br-int", "label": "tempest-TestShelveInstance-940455626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6be95e5c8d94269802ecf487ff73104", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f90a627-4d", "ovs_interfaceid": "0f90a627-4dab-4a2a-a2c2-eaae2910b379", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Releasing lock "refresh_cache-c7e1f470-fe8a-455e-aa0b-0d2475957fc0" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Creating instance directory {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 00:20:44 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Creating image(s)
Apr 14 00:20:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Did not create local disks {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Ensure instance console log exists: /opt/stack/data/nova/instances/c7e1f470-fe8a-455e-aa0b-0d2475957fc0/console.log {{(pid=82479) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Start _get_guest_xml network_info=[{"id": "0f90a627-4dab-4a2a-a2c2-eaae2910b379", "address": "fa:16:3e:e2:65:cb", "network": {"id": "9f0b7c66-0d95-4c5f-8c77-6f12228c20fc", "bridge": "br-int", "label": "tempest-TestShelveInstance-940455626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6be95e5c8d94269802ecf487ff73104", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f90a627-4d", "ovs_interfaceid": "0f90a627-4dab-4a2a-a2c2-eaae2910b379", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': True, 'attachment_id': '869fd580-1919-4a5c-b29a-b85fcc14094b', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FZCpIqMc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c7e1f470-fe8a-455e-aa0b-0d2475957fc0', 'attached_at': '', 'detached_at': '', 'volume_id': '69599ada-93d4-425a-ae12-e52cafcc29f7', 'serial': '69599ada-93d4-425a-ae12-e52cafcc29f7'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-e5d55665-2d3b-42c9-b453-3b6e1441fe30 req-add6f7e2-0fed-49c0-b1ed-581b18f41f8a service nova] Acquired lock "refresh_cache-c7e1f470-fe8a-455e-aa0b-0d2475957fc0" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG nova.network.neutron [req-e5d55665-2d3b-42c9-b453-3b6e1441fe30 req-add6f7e2-0fed-49c0-b1ed-581b18f41f8a service nova] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Refreshing network info cache for port 0f90a627-4dab-4a2a-a2c2-eaae2910b379 {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:20:44 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:20:44 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:20:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82479) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T00:02:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Flavor limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Image limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Flavor pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Image pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Got 1 possible topologies {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG nova.objects.instance [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lazy-loading 'vcpu_model' on Instance uuid c7e1f470-fe8a-455e-aa0b-0d2475957fc0 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Calling os-brick to attach iSCSI Volume {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FZCpIqMc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:20:44 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:20:44 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:20:44 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:20:44 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:20:44 user nova-compute[82479]: INFO os_brick.initiator.connectors.iscsi [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 00:20:44 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 -p 172.16.0.220:3260 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 -p 172.16.0.220:3260" returned: 21 in 0.035s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[54daf74b-ee75-48c7-8996-67ed70ca0932]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 00:20:44 user nova-compute[82479]:  {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 -p 172.16.0.220:3260 --interface default --op new {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f3333e-e9ba-4a21-a602-a1a8d979d908]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7] added\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7] added
Apr 14 00:20:44 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf514dcb-761e-44a2-afd5-072f3161d60e]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[39878cf2-5daa-4b3d-97c4-ada4f1420b44]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FZCpIqMc {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FZCpIqMc" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ae4e54-54f3-4187-a171-ac168ccf5247]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FZCpIqMc'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d9f28a2-4270-4a48-9e7f-60c95bc47271]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[113e1ac1-0035-4a81-b900-ed76bf88a708]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:20:44 user nova-compute[82479]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 (non-flash)
Apr 14 00:20:44 user nova-compute[82479]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 (non-flash)
Apr 14 00:20:44 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:20:44 user nova-compute[82479]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 (non-flash)
Apr 14 00:20:44 user nova-compute[82479]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 (non-flash)
Apr 14 00:20:44 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 -p 172.16.0.220:3260 --login {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[95197aec-c498-4ae9-9a6f-94d7947f7668]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7, portal: 172.16.0.220,3260]
Apr 14 00:20:44 user nova-compute[82479]: Login to [iface: default, target: iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7, portal: 172.16.0.220,3260] successful.
Apr 14 00:20:44 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.036s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e18c03d-b3ed-47d3-af1f-0e6583f46579]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[363d8265-452a-4cdb-9478-385afd53d568]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:20:44 user nova-compute[82479]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 (non-flash)
Apr 14 00:20:44 user nova-compute[82479]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 (non-flash)
Apr 14 00:20:44 user nova-compute[82479]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 (non-flash)
Apr 14 00:20:44 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:20:44 user nova-compute[82479]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 (non-flash)
Apr 14 00:20:44 user nova-compute[82479]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 (non-flash)
Apr 14 00:20:44 user nova-compute[82479]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 (non-flash)
Apr 14 00:20:44 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Connected to 172.16.0.220:3260 {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] HCTL ('35', '-', '-', 0) found on session 34 with lun 0 {{(pid=82479) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=82479) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e2bdc9b-8fef-4f34-b098-caf6afcb29b3]: (4, ('- - 0', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Searching for a device in session 34 and hctl ['35', '*', '*', 0] yield: None {{(pid=82479) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG nova.network.neutron [req-e5d55665-2d3b-42c9-b453-3b6e1441fe30 req-add6f7e2-0fed-49c0-b1ed-581b18f41f8a service nova] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Updated VIF entry in instance network info cache for port 0f90a627-4dab-4a2a-a2c2-eaae2910b379. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:20:44 user nova-compute[82479]: DEBUG nova.network.neutron [req-e5d55665-2d3b-42c9-b453-3b6e1441fe30 req-add6f7e2-0fed-49c0-b1ed-581b18f41f8a service nova] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Updating instance_info_cache with network_info: [{"id": "0f90a627-4dab-4a2a-a2c2-eaae2910b379", "address": "fa:16:3e:e2:65:cb", "network": {"id": "9f0b7c66-0d95-4c5f-8c77-6f12228c20fc", "bridge": "br-int", "label": "tempest-TestShelveInstance-940455626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6be95e5c8d94269802ecf487ff73104", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f90a627-4d", "ovs_interfaceid": "0f90a627-4dab-4a2a-a2c2-eaae2910b379", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:20:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-e5d55665-2d3b-42c9-b453-3b6e1441fe30 req-add6f7e2-0fed-49c0-b1ed-581b18f41f8a service nova] Releasing lock "refresh_cache-c7e1f470-fe8a-455e-aa0b-0d2475957fc0" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:20:45 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Searching for a device in session 34 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=82479) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 00:20:45 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FZCpIqMc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 00:20:45 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:20:45 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] <== connect_volume: return (1360ms) {'type': 'block', 'scsi_wwn': '26630376635613839', 'path': '/dev/sdd'} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:20:45 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630376635613839', 'path': '/dev/sdd'} {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 00:20:45 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T00:16:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-454867915',display_name='tempest-TestShelveInstance-server-454867915',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-454867915',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-266505447',keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:17:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='e6be95e5c8d94269802ecf487ff73104',ramdisk_id='',reservation_id='r-el3udybd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-5222591',owner_user_name='tempest-TestShelveInstance-5222591-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T00:20:38Z,user_data=None,user_id='b81e5ce5d2414980a506d0f3b37d0d5c',uuid=c7e1f470-fe8a-455e-aa0b-0d2475957fc0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "0f90a627-4dab-4a2a-a2c2-eaae2910b379", "address": "fa:16:3e:e2:65:cb", "network": {"id": "9f0b7c66-0d95-4c5f-8c77-6f12228c20fc", "bridge": "br-int", "label": "tempest-TestShelveInstance-940455626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6be95e5c8d94269802ecf487ff73104", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f90a627-4d", "ovs_interfaceid": "0f90a627-4dab-4a2a-a2c2-eaae2910b379", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82479) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 00:20:45 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Converting VIF {"id": "0f90a627-4dab-4a2a-a2c2-eaae2910b379", "address": "fa:16:3e:e2:65:cb", "network": {"id": "9f0b7c66-0d95-4c5f-8c77-6f12228c20fc", "bridge": "br-int", "label": "tempest-TestShelveInstance-940455626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6be95e5c8d94269802ecf487ff73104", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f90a627-4d", "ovs_interfaceid": "0f90a627-4dab-4a2a-a2c2-eaae2910b379", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:20:45 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:65:cb,bridge_name='br-int',has_traffic_filtering=True,id=0f90a627-4dab-4a2a-a2c2-eaae2910b379,network=Network(9f0b7c66-0d95-4c5f-8c77-6f12228c20fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f90a627-4d') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:20:45 user nova-compute[82479]: DEBUG nova.objects.instance [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lazy-loading 'pci_devices' on Instance uuid c7e1f470-fe8a-455e-aa0b-0d2475957fc0 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:20:45 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] End _get_guest_xml xml=<domain type="kvm">
Apr 14 00:20:45 user nova-compute[82479]:   <uuid>c7e1f470-fe8a-455e-aa0b-0d2475957fc0</uuid>
Apr 14 00:20:45 user nova-compute[82479]:   <name>instance-0000001c</name>
Apr 14 00:20:45 user nova-compute[82479]:   <memory>131072</memory>
Apr 14 00:20:45 user nova-compute[82479]:   <vcpu>1</vcpu>
Apr 14 00:20:45 user nova-compute[82479]:   <metadata>
Apr 14 00:20:45 user nova-compute[82479]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 00:20:45 user nova-compute[82479]:       <nova:package version="0.0.0"/>
Apr 14 00:20:45 user nova-compute[82479]:       <nova:name>tempest-TestShelveInstance-server-454867915</nova:name>
Apr 14 00:20:45 user nova-compute[82479]:       <nova:creationTime>2023-04-14 00:20:44</nova:creationTime>
Apr 14 00:20:45 user nova-compute[82479]:       <nova:flavor name="m1.nano">
Apr 14 00:20:45 user nova-compute[82479]:         <nova:memory>128</nova:memory>
Apr 14 00:20:45 user nova-compute[82479]:         <nova:disk>1</nova:disk>
Apr 14 00:20:45 user nova-compute[82479]:         <nova:swap>0</nova:swap>
Apr 14 00:20:45 user nova-compute[82479]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 00:20:45 user nova-compute[82479]:         <nova:vcpus>1</nova:vcpus>
Apr 14 00:20:45 user nova-compute[82479]:       </nova:flavor>
Apr 14 00:20:45 user nova-compute[82479]:       <nova:owner>
Apr 14 00:20:45 user nova-compute[82479]:         <nova:user uuid="b81e5ce5d2414980a506d0f3b37d0d5c">tempest-TestShelveInstance-5222591-project-member</nova:user>
Apr 14 00:20:45 user nova-compute[82479]:         <nova:project uuid="e6be95e5c8d94269802ecf487ff73104">tempest-TestShelveInstance-5222591</nova:project>
Apr 14 00:20:45 user nova-compute[82479]:       </nova:owner>
Apr 14 00:20:45 user nova-compute[82479]:       <nova:ports>
Apr 14 00:20:45 user nova-compute[82479]:         <nova:port uuid="0f90a627-4dab-4a2a-a2c2-eaae2910b379">
Apr 14 00:20:45 user nova-compute[82479]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 14 00:20:45 user nova-compute[82479]:         </nova:port>
Apr 14 00:20:45 user nova-compute[82479]:       </nova:ports>
Apr 14 00:20:45 user nova-compute[82479]:     </nova:instance>
Apr 14 00:20:45 user nova-compute[82479]:   </metadata>
Apr 14 00:20:45 user nova-compute[82479]:   <sysinfo type="smbios">
Apr 14 00:20:45 user nova-compute[82479]:     <system>
Apr 14 00:20:45 user nova-compute[82479]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 00:20:45 user nova-compute[82479]:       <entry name="product">OpenStack Nova</entry>
Apr 14 00:20:45 user nova-compute[82479]:       <entry name="version">0.0.0</entry>
Apr 14 00:20:45 user nova-compute[82479]:       <entry name="serial">c7e1f470-fe8a-455e-aa0b-0d2475957fc0</entry>
Apr 14 00:20:45 user nova-compute[82479]:       <entry name="uuid">c7e1f470-fe8a-455e-aa0b-0d2475957fc0</entry>
Apr 14 00:20:45 user nova-compute[82479]:       <entry name="family">Virtual Machine</entry>
Apr 14 00:20:45 user nova-compute[82479]:     </system>
Apr 14 00:20:45 user nova-compute[82479]:   </sysinfo>
Apr 14 00:20:45 user nova-compute[82479]:   <os>
Apr 14 00:20:45 user nova-compute[82479]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 00:20:45 user nova-compute[82479]:     <boot dev="hd"/>
Apr 14 00:20:45 user nova-compute[82479]:     <smbios mode="sysinfo"/>
Apr 14 00:20:45 user nova-compute[82479]:   </os>
Apr 14 00:20:45 user nova-compute[82479]:   <features>
Apr 14 00:20:45 user nova-compute[82479]:     <acpi/>
Apr 14 00:20:45 user nova-compute[82479]:     <apic/>
Apr 14 00:20:45 user nova-compute[82479]:     <vmcoreinfo/>
Apr 14 00:20:45 user nova-compute[82479]:   </features>
Apr 14 00:20:45 user nova-compute[82479]:   <clock offset="utc">
Apr 14 00:20:45 user nova-compute[82479]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 00:20:45 user nova-compute[82479]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 00:20:45 user nova-compute[82479]:     <timer name="hpet" present="no"/>
Apr 14 00:20:45 user nova-compute[82479]:   </clock>
Apr 14 00:20:45 user nova-compute[82479]:   <cpu mode="custom" match="exact">
Apr 14 00:20:45 user nova-compute[82479]:     <model>Nehalem</model>
Apr 14 00:20:45 user nova-compute[82479]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 00:20:45 user nova-compute[82479]:   </cpu>
Apr 14 00:20:45 user nova-compute[82479]:   <devices>
Apr 14 00:20:45 user nova-compute[82479]:     <disk type="block" device="disk">
Apr 14 00:20:45 user nova-compute[82479]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:20:45 user nova-compute[82479]:       <source dev="/dev/sdd"/>
Apr 14 00:20:45 user nova-compute[82479]:       <target dev="vda" bus="virtio"/>
Apr 14 00:20:45 user nova-compute[82479]:       <serial>69599ada-93d4-425a-ae12-e52cafcc29f7</serial>
Apr 14 00:20:45 user nova-compute[82479]:     </disk>
Apr 14 00:20:45 user nova-compute[82479]:     <interface type="ethernet">
Apr 14 00:20:45 user nova-compute[82479]:       <mac address="fa:16:3e:e2:65:cb"/>
Apr 14 00:20:45 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:20:45 user nova-compute[82479]:       <mtu size="1442"/>
Apr 14 00:20:45 user nova-compute[82479]:       <target dev="tap0f90a627-4d"/>
Apr 14 00:20:45 user nova-compute[82479]:     </interface>
Apr 14 00:20:45 user nova-compute[82479]:     <serial type="pty">
Apr 14 00:20:45 user nova-compute[82479]:       <log file="/opt/stack/data/nova/instances/c7e1f470-fe8a-455e-aa0b-0d2475957fc0/console.log" append="off"/>
Apr 14 00:20:45 user nova-compute[82479]:     </serial>
Apr 14 00:20:45 user nova-compute[82479]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 00:20:45 user nova-compute[82479]:     <video>
Apr 14 00:20:45 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:20:45 user nova-compute[82479]:     </video>
Apr 14 00:20:45 user nova-compute[82479]:     <rng model="virtio">
Apr 14 00:20:45 user nova-compute[82479]:       <backend model="random">/dev/urandom</backend>
Apr 14 00:20:45 user nova-compute[82479]:     </rng>
Apr 14 00:20:45 user nova-compute[82479]:     <controller type="usb" index="0" model="none"/>
Apr 14 00:20:45 user nova-compute[82479]:     <memballoon model="virtio">
Apr 14 00:20:45 user nova-compute[82479]:       <stats period="10"/>
Apr 14 00:20:45 user nova-compute[82479]:     </memballoon>
Apr 14 00:20:45 user nova-compute[82479]:   </devices>
Apr 14 00:20:45 user nova-compute[82479]: </domain>
Apr 14 00:20:45 user nova-compute[82479]:  {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 00:20:45 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T00:16:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-454867915',display_name='tempest-TestShelveInstance-server-454867915',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-454867915',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-266505447',keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:17:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='e6be95e5c8d94269802ecf487ff73104',ramdisk_id='',reservation_id='r-el3udybd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-5222591',owner_user_name='tempest-TestShelveInstance-5222591-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T00:20:38Z,user_data=None,user_id='b81e5ce5d2414980a506d0f3b37d0d5c',uuid=c7e1f470-fe8a-455e-aa0b-0d2475957fc0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "0f90a627-4dab-4a2a-a2c2-eaae2910b379", "address": "fa:16:3e:e2:65:cb", "network": {"id": "9f0b7c66-0d95-4c5f-8c77-6f12228c20fc", "bridge": "br-int", "label": "tempest-TestShelveInstance-940455626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6be95e5c8d94269802ecf487ff73104", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f90a627-4d", "ovs_interfaceid": "0f90a627-4dab-4a2a-a2c2-eaae2910b379", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 00:20:45 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Converting VIF {"id": "0f90a627-4dab-4a2a-a2c2-eaae2910b379", "address": "fa:16:3e:e2:65:cb", "network": {"id": "9f0b7c66-0d95-4c5f-8c77-6f12228c20fc", "bridge": "br-int", "label": "tempest-TestShelveInstance-940455626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6be95e5c8d94269802ecf487ff73104", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f90a627-4d", "ovs_interfaceid": "0f90a627-4dab-4a2a-a2c2-eaae2910b379", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:20:45 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:65:cb,bridge_name='br-int',has_traffic_filtering=True,id=0f90a627-4dab-4a2a-a2c2-eaae2910b379,network=Network(9f0b7c66-0d95-4c5f-8c77-6f12228c20fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f90a627-4d') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:20:45 user nova-compute[82479]: DEBUG os_vif [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:65:cb,bridge_name='br-int',has_traffic_filtering=True,id=0f90a627-4dab-4a2a-a2c2-eaae2910b379,network=Network(9f0b7c66-0d95-4c5f-8c77-6f12228c20fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f90a627-4d') {{(pid=82479) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 00:20:45 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:20:45 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:20:45 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 00:20:45 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:20:45 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0f90a627-4d, may_exist=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:20:45 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0f90a627-4d, col_values=(('external_ids', {'iface-id': '0f90a627-4dab-4a2a-a2c2-eaae2910b379', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:65:cb', 'vm-uuid': 'c7e1f470-fe8a-455e-aa0b-0d2475957fc0'}),)) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:20:45 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:20:45 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:20:45 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:20:46 user nova-compute[82479]: INFO os_vif [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:65:cb,bridge_name='br-int',has_traffic_filtering=True,id=0f90a627-4dab-4a2a-a2c2-eaae2910b379,network=Network(9f0b7c66-0d95-4c5f-8c77-6f12228c20fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f90a627-4d')
Apr 14 00:20:46 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:20:46 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] No VIF found with MAC fa:16:3e:e2:65:cb, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:20:46 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:20:47 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:20:47 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:20:47 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:20:47 user nova-compute[82479]: DEBUG nova.compute.manager [req-3b903dd5-1f72-4484-a2cf-7677f9492738 req-2e811e8f-2708-407e-b3e8-63bb718373e1 service nova] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Received event network-vif-plugged-0f90a627-4dab-4a2a-a2c2-eaae2910b379 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:20:47 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-3b903dd5-1f72-4484-a2cf-7677f9492738 req-2e811e8f-2708-407e-b3e8-63bb718373e1 service nova] Acquiring lock "c7e1f470-fe8a-455e-aa0b-0d2475957fc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:20:47 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-3b903dd5-1f72-4484-a2cf-7677f9492738 req-2e811e8f-2708-407e-b3e8-63bb718373e1 service nova] Lock "c7e1f470-fe8a-455e-aa0b-0d2475957fc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:20:47 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-3b903dd5-1f72-4484-a2cf-7677f9492738 req-2e811e8f-2708-407e-b3e8-63bb718373e1 service nova] Lock "c7e1f470-fe8a-455e-aa0b-0d2475957fc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:20:47 user nova-compute[82479]: DEBUG nova.compute.manager [req-3b903dd5-1f72-4484-a2cf-7677f9492738 req-2e811e8f-2708-407e-b3e8-63bb718373e1 service nova] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] No waiting events found dispatching network-vif-plugged-0f90a627-4dab-4a2a-a2c2-eaae2910b379 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:20:47 user nova-compute[82479]: WARNING nova.compute.manager [req-3b903dd5-1f72-4484-a2cf-7677f9492738 req-2e811e8f-2708-407e-b3e8-63bb718373e1 service nova] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Received unexpected event network-vif-plugged-0f90a627-4dab-4a2a-a2c2-eaae2910b379 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 14 00:20:48 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:20:48 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:20:48 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:20:48 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:20:49 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681431649.3580728, c7e1f470-fe8a-455e-aa0b-0d2475957fc0 => Resumed> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:20:49 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] VM Resumed (Lifecycle Event)
Apr 14 00:20:49 user nova-compute[82479]: DEBUG nova.compute.manager [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Instance event wait completed in 0 seconds for  {{(pid=82479) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 00:20:49 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Guest created on hypervisor {{(pid=82479) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 00:20:49 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Instance spawned successfully.
Apr 14 00:20:49 user nova-compute[82479]: DEBUG nova.compute.manager [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:20:49 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:20:49 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:20:49 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:20:49 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681431649.3597777, c7e1f470-fe8a-455e-aa0b-0d2475957fc0 => Started> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:20:49 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] VM Started (Lifecycle Event)
Apr 14 00:20:49 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:20:49 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:20:49 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-90939012-bce7-4d7e-ad99-12b48484f092 tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "c7e1f470-fe8a-455e-aa0b-0d2475957fc0" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.700s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:20:49 user nova-compute[82479]: DEBUG nova.compute.manager [req-01cd23f0-1908-4f2a-bba7-344757ae582f req-475b1ca8-558b-4822-95b5-28000183117d service nova] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Received event network-vif-plugged-0f90a627-4dab-4a2a-a2c2-eaae2910b379 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:20:49 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-01cd23f0-1908-4f2a-bba7-344757ae582f req-475b1ca8-558b-4822-95b5-28000183117d service nova] Acquiring lock "c7e1f470-fe8a-455e-aa0b-0d2475957fc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:20:49 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-01cd23f0-1908-4f2a-bba7-344757ae582f req-475b1ca8-558b-4822-95b5-28000183117d service nova] Lock "c7e1f470-fe8a-455e-aa0b-0d2475957fc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:20:49 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-01cd23f0-1908-4f2a-bba7-344757ae582f req-475b1ca8-558b-4822-95b5-28000183117d service nova] Lock "c7e1f470-fe8a-455e-aa0b-0d2475957fc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:20:49 user nova-compute[82479]: DEBUG nova.compute.manager [req-01cd23f0-1908-4f2a-bba7-344757ae582f req-475b1ca8-558b-4822-95b5-28000183117d service nova] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] No waiting events found dispatching network-vif-plugged-0f90a627-4dab-4a2a-a2c2-eaae2910b379 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:20:49 user nova-compute[82479]: WARNING nova.compute.manager [req-01cd23f0-1908-4f2a-bba7-344757ae582f req-475b1ca8-558b-4822-95b5-28000183117d service nova] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Received unexpected event network-vif-plugged-0f90a627-4dab-4a2a-a2c2-eaae2910b379 for instance with vm_state active and task_state None.
Apr 14 00:20:49 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:20:49 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Starting heal instance info cache {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 00:20:49 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "refresh_cache-6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:20:49 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquired lock "refresh_cache-6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:20:49 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Forcefully refreshing network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 00:20:50 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Updating instance_info_cache with network_info: [{"id": "10a32c68-570b-4ba1-ba36-6ecaf135c9bb", "address": "fa:16:3e:a4:44:5a", "network": {"id": "08106daa-a35e-4376-8c46-2b4baa51c6ea", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321730350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524265958bd24a6cb94aa3115eb2b6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10a32c68-57", "ovs_interfaceid": "10a32c68-570b-4ba1-ba36-6ecaf135c9bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:20:50 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Releasing lock "refresh_cache-6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:20:50 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Updated the network info_cache for instance {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 00:20:50 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:20:50 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:20:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:20:52 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:20:52 user nova-compute[82479]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681431637.607263, fd5afe9f-e6b0-4564-a5cf-b4e0047a5503 => Stopped> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:20:52 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] VM Stopped (Lifecycle Event)
Apr 14 00:20:52 user nova-compute[82479]: DEBUG nova.compute.manager [None req-a420a13c-2a3d-45b2-bd3c-72de5637177f None None] [instance: fd5afe9f-e6b0-4564-a5cf-b4e0047a5503] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:20:53 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:20:55 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:20:55 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:20:56 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:20:56 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:20:57 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:20:58 user nova-compute[82479]: INFO nova.compute.manager [None req-fea765c1-11b7-436b-a99f-7cecf7684ced tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Unrescuing
Apr 14 00:20:58 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-fea765c1-11b7-436b-a99f-7cecf7684ced tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "refresh_cache-13a94e92-54cf-49b7-ae71-32b3c48df332" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:20:58 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-fea765c1-11b7-436b-a99f-7cecf7684ced tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquired lock "refresh_cache-13a94e92-54cf-49b7-ae71-32b3c48df332" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:20:58 user nova-compute[82479]: DEBUG nova.network.neutron [None req-fea765c1-11b7-436b-a99f-7cecf7684ced tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 00:20:58 user nova-compute[82479]: DEBUG nova.network.neutron [None req-fea765c1-11b7-436b-a99f-7cecf7684ced tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Updating instance_info_cache with network_info: [{"id": "4788878b-ac88-49ff-a42d-df57ef410442", "address": "fa:16:3e:97:9a:e9", "network": {"id": "491696ea-38ef-4c19-9d94-a61223c1fa00", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1323121698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3f111e24414976beddba7ef90c4793", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4788878b-ac", "ovs_interfaceid": "4788878b-ac88-49ff-a42d-df57ef410442", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:20:58 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-fea765c1-11b7-436b-a99f-7cecf7684ced tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Releasing lock "refresh_cache-13a94e92-54cf-49b7-ae71-32b3c48df332" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:20:58 user nova-compute[82479]: DEBUG nova.objects.instance [None req-fea765c1-11b7-436b-a99f-7cecf7684ced tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lazy-loading 'flavor' on Instance uuid 13a94e92-54cf-49b7-ae71-32b3c48df332 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:20:58 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:20:58 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:20:58 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:20:58 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:20:58 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Auditing locally available compute resources for user (node: user) {{(pid=82479) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 00:20:58 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:20:58 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:20:58 user nova-compute[82479]: DEBUG nova.compute.manager [req-b89ba420-7cd0-4f69-b335-6b6d4f0872c8 req-8d960692-7afc-4160-9a6d-b7ed3e0d624f service nova] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Received event network-vif-unplugged-4788878b-ac88-49ff-a42d-df57ef410442 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:20:58 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-b89ba420-7cd0-4f69-b335-6b6d4f0872c8 req-8d960692-7afc-4160-9a6d-b7ed3e0d624f service nova] Acquiring lock "13a94e92-54cf-49b7-ae71-32b3c48df332-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:20:58 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-b89ba420-7cd0-4f69-b335-6b6d4f0872c8 req-8d960692-7afc-4160-9a6d-b7ed3e0d624f service nova] Lock "13a94e92-54cf-49b7-ae71-32b3c48df332-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:20:58 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-b89ba420-7cd0-4f69-b335-6b6d4f0872c8 req-8d960692-7afc-4160-9a6d-b7ed3e0d624f service nova] Lock "13a94e92-54cf-49b7-ae71-32b3c48df332-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:20:58 user nova-compute[82479]: DEBUG nova.compute.manager [req-b89ba420-7cd0-4f69-b335-6b6d4f0872c8 req-8d960692-7afc-4160-9a6d-b7ed3e0d624f service nova] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] No waiting events found dispatching network-vif-unplugged-4788878b-ac88-49ff-a42d-df57ef410442 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:20:58 user nova-compute[82479]: WARNING nova.compute.manager [req-b89ba420-7cd0-4f69-b335-6b6d4f0872c8 req-8d960692-7afc-4160-9a6d-b7ed3e0d624f service nova] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Received unexpected event network-vif-unplugged-4788878b-ac88-49ff-a42d-df57ef410442 for instance with vm_state rescued and task_state unrescuing.
Apr 14 00:20:58 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:20:58 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:20:59 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Instance destroyed successfully.
Apr 14 00:20:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:20:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:20:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:20:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:20:59 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:20:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785033c7-e14b-418e-952a-248328b75d60/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:20:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785033c7-e14b-418e-952a-248328b75d60/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:20:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785033c7-e14b-418e-952a-248328b75d60/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:21:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785033c7-e14b-418e-952a-248328b75d60/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:21:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2793d412-f405-4452-8e46-c192e3c92ccb/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:21:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2793d412-f405-4452-8e46-c192e3c92ccb/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:21:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2793d412-f405-4452-8e46-c192e3c92ccb/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:21:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2793d412-f405-4452-8e46-c192e3c92ccb/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:21:00 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:21:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk.rescue --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:21:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:21:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk.rescue --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:21:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:21:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:21:00 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:21:00 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:21:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:21:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:21:00 user nova-compute[82479]: DEBUG nova.compute.manager [req-56a1de67-fbc0-4784-b864-535432885169 req-20a2256f-8ae8-4b7c-b35e-54c6548ea2d4 service nova] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Received event network-vif-plugged-4788878b-ac88-49ff-a42d-df57ef410442 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:21:00 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-56a1de67-fbc0-4784-b864-535432885169 req-20a2256f-8ae8-4b7c-b35e-54c6548ea2d4 service nova] Acquiring lock "13a94e92-54cf-49b7-ae71-32b3c48df332-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:21:00 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-56a1de67-fbc0-4784-b864-535432885169 req-20a2256f-8ae8-4b7c-b35e-54c6548ea2d4 service nova] Lock "13a94e92-54cf-49b7-ae71-32b3c48df332-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:21:00 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-56a1de67-fbc0-4784-b864-535432885169 req-20a2256f-8ae8-4b7c-b35e-54c6548ea2d4 service nova] Lock "13a94e92-54cf-49b7-ae71-32b3c48df332-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:21:00 user nova-compute[82479]: DEBUG nova.compute.manager [req-56a1de67-fbc0-4784-b864-535432885169 req-20a2256f-8ae8-4b7c-b35e-54c6548ea2d4 service nova] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] No waiting events found dispatching network-vif-plugged-4788878b-ac88-49ff-a42d-df57ef410442 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:21:00 user nova-compute[82479]: WARNING nova.compute.manager [req-56a1de67-fbc0-4784-b864-535432885169 req-20a2256f-8ae8-4b7c-b35e-54c6548ea2d4 service nova] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Received unexpected event network-vif-plugged-4788878b-ac88-49ff-a42d-df57ef410442 for instance with vm_state rescued and task_state unrescuing.
Apr 14 00:21:00 user nova-compute[82479]: DEBUG nova.compute.manager [req-56a1de67-fbc0-4784-b864-535432885169 req-20a2256f-8ae8-4b7c-b35e-54c6548ea2d4 service nova] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Received event network-vif-plugged-4788878b-ac88-49ff-a42d-df57ef410442 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:21:00 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-56a1de67-fbc0-4784-b864-535432885169 req-20a2256f-8ae8-4b7c-b35e-54c6548ea2d4 service nova] Acquiring lock "13a94e92-54cf-49b7-ae71-32b3c48df332-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:21:00 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-56a1de67-fbc0-4784-b864-535432885169 req-20a2256f-8ae8-4b7c-b35e-54c6548ea2d4 service nova] Lock "13a94e92-54cf-49b7-ae71-32b3c48df332-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:21:00 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-56a1de67-fbc0-4784-b864-535432885169 req-20a2256f-8ae8-4b7c-b35e-54c6548ea2d4 service nova] Lock "13a94e92-54cf-49b7-ae71-32b3c48df332-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:21:00 user nova-compute[82479]: DEBUG nova.compute.manager [req-56a1de67-fbc0-4784-b864-535432885169 req-20a2256f-8ae8-4b7c-b35e-54c6548ea2d4 service nova] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] No waiting events found dispatching network-vif-plugged-4788878b-ac88-49ff-a42d-df57ef410442 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:21:00 user nova-compute[82479]: WARNING nova.compute.manager [req-56a1de67-fbc0-4784-b864-535432885169 req-20a2256f-8ae8-4b7c-b35e-54c6548ea2d4 service nova] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Received unexpected event network-vif-plugged-4788878b-ac88-49ff-a42d-df57ef410442 for instance with vm_state rescued and task_state unrescuing.
Apr 14 00:21:00 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:21:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:21:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:21:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:21:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:21:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:21:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ade24ab6-1a93-4449-b5e9-ec3de357665b/disk.rescue --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:21:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:21:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ade24ab6-1a93-4449-b5e9-ec3de357665b/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:21:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ade24ab6-1a93-4449-b5e9-ec3de357665b/disk.rescue --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:21:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ade24ab6-1a93-4449-b5e9-ec3de357665b/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:21:01 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] skipping disk /opt/stack/data/nova/instances/ade24ab6-1a93-4449-b5e9-ec3de357665b/disk (vdb) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:21:01 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:21:02 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:21:02 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:21:02 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Hypervisor/Node resource view: name=user free_ram=8038MB free_disk=26.023181915283203GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82479) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 00:21:02 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:21:02 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:21:02 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 23718fd0-58b8-47f9-b1ef-a26a90741ecc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:21:02 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 17c6c147-fb62-4204-a416-792b94d3f7dd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:21:02 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:21:02 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:21:02 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 2793d412-f405-4452-8e46-c192e3c92ccb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:21:02 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 13a94e92-54cf-49b7-ae71-32b3c48df332 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:21:02 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance ade24ab6-1a93-4449-b5e9-ec3de357665b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:21:02 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 785033c7-e14b-418e-952a-248328b75d60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:21:02 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance c7e1f470-fe8a-455e-aa0b-0d2475957fc0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:21:02 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 00:21:02 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 00:21:02 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Refreshing inventories for resource provider 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 00:21:02 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Updating ProviderTree inventory for provider 3847975a-19aa-4b27-9180-14b5cc49044a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 00:21:02 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Updating inventory in ProviderTree for provider 3847975a-19aa-4b27-9180-14b5cc49044a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 00:21:02 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Refreshing aggregate associations for resource provider 3847975a-19aa-4b27-9180-14b5cc49044a, aggregates: None {{(pid=82479) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 00:21:02 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Refreshing trait associations for resource provider 3847975a-19aa-4b27-9180-14b5cc49044a, traits: COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,HW_CPU_X86_SSE42,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO {{(pid=82479) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 00:21:02 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:21:02 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:21:02 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Compute_service record updated for user:user {{(pid=82479) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 00:21:02 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.672s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:21:02 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:21:02 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Cleaning up deleted instances {{(pid=82479) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 00:21:02 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] There are 0 instances to clean {{(pid=82479) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 00:21:02 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:21:02 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Cleaning up deleted instances with incomplete migration  {{(pid=82479) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 00:21:02 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Removed pending event for 13a94e92-54cf-49b7-ae71-32b3c48df332 due to event {{(pid=82479) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 00:21:02 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681431662.8401246, 13a94e92-54cf-49b7-ae71-32b3c48df332 => Resumed> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:21:02 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] VM Resumed (Lifecycle Event)
Apr 14 00:21:02 user nova-compute[82479]: DEBUG nova.compute.manager [None req-fea765c1-11b7-436b-a99f-7cecf7684ced tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:21:02 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:21:02 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:21:02 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 14 00:21:02 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681431662.8417752, 13a94e92-54cf-49b7-ae71-32b3c48df332 => Started> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:21:02 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] VM Started (Lifecycle Event)
Apr 14 00:21:02 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:21:02 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:21:03 user nova-compute[82479]: DEBUG nova.compute.manager [req-85276156-b5c7-4b66-b26f-23338a248930 req-1ee21c9b-c565-47be-ad1c-d320571a7b1b service nova] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Received event network-vif-plugged-4788878b-ac88-49ff-a42d-df57ef410442 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:21:03 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-85276156-b5c7-4b66-b26f-23338a248930 req-1ee21c9b-c565-47be-ad1c-d320571a7b1b service nova] Acquiring lock "13a94e92-54cf-49b7-ae71-32b3c48df332-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:21:03 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-85276156-b5c7-4b66-b26f-23338a248930 req-1ee21c9b-c565-47be-ad1c-d320571a7b1b service nova] Lock "13a94e92-54cf-49b7-ae71-32b3c48df332-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:21:03 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-85276156-b5c7-4b66-b26f-23338a248930 req-1ee21c9b-c565-47be-ad1c-d320571a7b1b service nova] Lock "13a94e92-54cf-49b7-ae71-32b3c48df332-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:21:03 user nova-compute[82479]: DEBUG nova.compute.manager [req-85276156-b5c7-4b66-b26f-23338a248930 req-1ee21c9b-c565-47be-ad1c-d320571a7b1b service nova] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] No waiting events found dispatching network-vif-plugged-4788878b-ac88-49ff-a42d-df57ef410442 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:21:03 user nova-compute[82479]: WARNING nova.compute.manager [req-85276156-b5c7-4b66-b26f-23338a248930 req-1ee21c9b-c565-47be-ad1c-d320571a7b1b service nova] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Received unexpected event network-vif-plugged-4788878b-ac88-49ff-a42d-df57ef410442 for instance with vm_state active and task_state None.
Apr 14 00:21:04 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:21:04 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:21:04 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82479) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 00:21:05 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:21:06 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:21:10 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:21:10 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:21:11 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:21:16 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:21:16 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:21:21 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:21:21 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:21:23 user nova-compute[82479]: DEBUG nova.compute.manager [req-9c89da4e-a275-40e3-a3c3-a732e1c36fe0 req-eeadb324-5757-4f92-b1e1-87ee96e577a0 service nova] [instance: 785033c7-e14b-418e-952a-248328b75d60] Received event network-changed-29f1f1cc-0517-49a1-b8f1-61a7c3ee1002 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:21:23 user nova-compute[82479]: DEBUG nova.compute.manager [req-9c89da4e-a275-40e3-a3c3-a732e1c36fe0 req-eeadb324-5757-4f92-b1e1-87ee96e577a0 service nova] [instance: 785033c7-e14b-418e-952a-248328b75d60] Refreshing instance network info cache due to event network-changed-29f1f1cc-0517-49a1-b8f1-61a7c3ee1002. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:21:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-9c89da4e-a275-40e3-a3c3-a732e1c36fe0 req-eeadb324-5757-4f92-b1e1-87ee96e577a0 service nova] Acquiring lock "refresh_cache-785033c7-e14b-418e-952a-248328b75d60" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:21:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-9c89da4e-a275-40e3-a3c3-a732e1c36fe0 req-eeadb324-5757-4f92-b1e1-87ee96e577a0 service nova] Acquired lock "refresh_cache-785033c7-e14b-418e-952a-248328b75d60" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:21:23 user nova-compute[82479]: DEBUG nova.network.neutron [req-9c89da4e-a275-40e3-a3c3-a732e1c36fe0 req-eeadb324-5757-4f92-b1e1-87ee96e577a0 service nova] [instance: 785033c7-e14b-418e-952a-248328b75d60] Refreshing network info cache for port 29f1f1cc-0517-49a1-b8f1-61a7c3ee1002 {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:21:24 user nova-compute[82479]: DEBUG nova.network.neutron [req-9c89da4e-a275-40e3-a3c3-a732e1c36fe0 req-eeadb324-5757-4f92-b1e1-87ee96e577a0 service nova] [instance: 785033c7-e14b-418e-952a-248328b75d60] Updated VIF entry in instance network info cache for port 29f1f1cc-0517-49a1-b8f1-61a7c3ee1002. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:21:24 user nova-compute[82479]: DEBUG nova.network.neutron [req-9c89da4e-a275-40e3-a3c3-a732e1c36fe0 req-eeadb324-5757-4f92-b1e1-87ee96e577a0 service nova] [instance: 785033c7-e14b-418e-952a-248328b75d60] Updating instance_info_cache with network_info: [{"id": "29f1f1cc-0517-49a1-b8f1-61a7c3ee1002", "address": "fa:16:3e:59:e0:37", "network": {"id": "cb8c9bb1-a885-486d-aa6a-de600bc01c2e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1676259779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8663ccad9047f4b11b9ae0646c287a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29f1f1cc-05", "ovs_interfaceid": "29f1f1cc-0517-49a1-b8f1-61a7c3ee1002", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:21:24 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-9c89da4e-a275-40e3-a3c3-a732e1c36fe0 req-eeadb324-5757-4f92-b1e1-87ee96e577a0 service nova] Releasing lock "refresh_cache-785033c7-e14b-418e-952a-248328b75d60" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:21:26 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:21:26 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:21:27 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:21:28 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "a1f2d364-908f-41c6-8e0c-df376a5d14f1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:21:28 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "a1f2d364-908f-41c6-8e0c-df376a5d14f1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:21:28 user nova-compute[82479]: DEBUG nova.compute.manager [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Starting instance... {{(pid=82479) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 00:21:28 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:21:28 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:21:28 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82479) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 00:21:28 user nova-compute[82479]: INFO nova.compute.claims [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Claim successful on node user
Apr 14 00:21:28 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:21:28 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:21:29 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.426s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:21:29 user nova-compute[82479]: DEBUG nova.compute.manager [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Start building networks asynchronously for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 00:21:29 user nova-compute[82479]: DEBUG nova.compute.manager [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Allocating IP information in the background. {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 00:21:29 user nova-compute[82479]: DEBUG nova.network.neutron [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] allocate_for_instance() {{(pid=82479) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 00:21:29 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 00:21:29 user nova-compute[82479]: DEBUG nova.compute.manager [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Start building block device mappings for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 00:21:29 user nova-compute[82479]: INFO nova.virt.block_device [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Booting with volume 7056196a-d087-4a9b-a3c8-350b13e6d2c3 at /dev/vda
Apr 14 00:21:29 user nova-compute[82479]: DEBUG nova.policy [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3d86662f2c7648daad87118b7e9f757c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf8663ccad9047f4b11b9ae0646c287a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82479) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 00:21:29 user nova-compute[82479]: DEBUG os_brick.utils [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:21:29 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:21:29 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:21:29 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9451f4c-1e44-41ac-b023-b076ab0b3fa7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fec92fcfdd3\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:21:29 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:21:29 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:21:29 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea237a9-cd07-4ceb-a437-95ebb074ffad]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:21:29 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:21:29 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:21:29 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f18afc5-d681-4a35-90ce-999283c3d4cb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:21:29 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b8ad3ff-e1cb-4587-8f50-6def70afd44b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:21:29 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Running cmd (subprocess): nvme version {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:21:29 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] 'nvme version' failed. Not Retrying. {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:21:29 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.nvmeof [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] nvme not present on system {{(pid=82479) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 00:21:29 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:21:29 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:21:29 user nova-compute[82479]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 00:21:29 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[77eaee1e-1251-4009-bc07-b79c138d1fe5]: (4, '') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:21:29 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82479) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 00:21:29 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 00:21:29 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] LIGHTOS: no hostnqn found. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 00:21:29 user nova-compute[82479]: DEBUG os_brick.utils [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fec92fcfdd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:21:29 user nova-compute[82479]: DEBUG nova.virt.block_device [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Updating existing volume attachment record: 979ee141-81ea-4ed1-85eb-7f12ebce14b6 {{(pid=82479) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 00:21:30 user nova-compute[82479]: DEBUG nova.network.neutron [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Successfully created port: db5a953b-fab8-4158-b9bb-95c4db32658e {{(pid=82479) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 00:21:30 user nova-compute[82479]: DEBUG nova.network.neutron [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Successfully updated port: db5a953b-fab8-4158-b9bb-95c4db32658e {{(pid=82479) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 00:21:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "refresh_cache-a1f2d364-908f-41c6-8e0c-df376a5d14f1" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:21:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquired lock "refresh_cache-a1f2d364-908f-41c6-8e0c-df376a5d14f1" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:21:30 user nova-compute[82479]: DEBUG nova.network.neutron [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 00:21:30 user nova-compute[82479]: DEBUG nova.compute.manager [req-75f104c8-fee4-48af-9c5e-10aab78f7adb req-52a02bf3-f3de-4b35-a18a-4d9a8039fc4a service nova] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Received event network-changed-db5a953b-fab8-4158-b9bb-95c4db32658e {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:21:30 user nova-compute[82479]: DEBUG nova.compute.manager [req-75f104c8-fee4-48af-9c5e-10aab78f7adb req-52a02bf3-f3de-4b35-a18a-4d9a8039fc4a service nova] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Refreshing instance network info cache due to event network-changed-db5a953b-fab8-4158-b9bb-95c4db32658e. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:21:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-75f104c8-fee4-48af-9c5e-10aab78f7adb req-52a02bf3-f3de-4b35-a18a-4d9a8039fc4a service nova] Acquiring lock "refresh_cache-a1f2d364-908f-41c6-8e0c-df376a5d14f1" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:21:30 user nova-compute[82479]: DEBUG nova.network.neutron [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Instance cache missing network info. {{(pid=82479) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 00:21:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:21:31 user nova-compute[82479]: DEBUG nova.network.neutron [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Updating instance_info_cache with network_info: [{"id": "db5a953b-fab8-4158-b9bb-95c4db32658e", "address": "fa:16:3e:16:63:e8", "network": {"id": "cb8c9bb1-a885-486d-aa6a-de600bc01c2e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1676259779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8663ccad9047f4b11b9ae0646c287a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb5a953b-fa", "ovs_interfaceid": "db5a953b-fab8-4158-b9bb-95c4db32658e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:21:31 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Releasing lock "refresh_cache-a1f2d364-908f-41c6-8e0c-df376a5d14f1" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:21:31 user nova-compute[82479]: DEBUG nova.compute.manager [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Instance network_info: |[{"id": "db5a953b-fab8-4158-b9bb-95c4db32658e", "address": "fa:16:3e:16:63:e8", "network": {"id": "cb8c9bb1-a885-486d-aa6a-de600bc01c2e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1676259779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8663ccad9047f4b11b9ae0646c287a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb5a953b-fa", "ovs_interfaceid": "db5a953b-fab8-4158-b9bb-95c4db32658e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 00:21:31 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-75f104c8-fee4-48af-9c5e-10aab78f7adb req-52a02bf3-f3de-4b35-a18a-4d9a8039fc4a service nova] Acquired lock "refresh_cache-a1f2d364-908f-41c6-8e0c-df376a5d14f1" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:21:31 user nova-compute[82479]: DEBUG nova.network.neutron [req-75f104c8-fee4-48af-9c5e-10aab78f7adb req-52a02bf3-f3de-4b35-a18a-4d9a8039fc4a service nova] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Refreshing network info cache for port db5a953b-fab8-4158-b9bb-95c4db32658e {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:21:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:21:31 user nova-compute[82479]: DEBUG nova.network.neutron [req-75f104c8-fee4-48af-9c5e-10aab78f7adb req-52a02bf3-f3de-4b35-a18a-4d9a8039fc4a service nova] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Updated VIF entry in instance network info cache for port db5a953b-fab8-4158-b9bb-95c4db32658e. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:21:31 user nova-compute[82479]: DEBUG nova.network.neutron [req-75f104c8-fee4-48af-9c5e-10aab78f7adb req-52a02bf3-f3de-4b35-a18a-4d9a8039fc4a service nova] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Updating instance_info_cache with network_info: [{"id": "db5a953b-fab8-4158-b9bb-95c4db32658e", "address": "fa:16:3e:16:63:e8", "network": {"id": "cb8c9bb1-a885-486d-aa6a-de600bc01c2e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1676259779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8663ccad9047f4b11b9ae0646c287a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb5a953b-fa", "ovs_interfaceid": "db5a953b-fab8-4158-b9bb-95c4db32658e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:21:31 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-75f104c8-fee4-48af-9c5e-10aab78f7adb req-52a02bf3-f3de-4b35-a18a-4d9a8039fc4a service nova] Releasing lock "refresh_cache-a1f2d364-908f-41c6-8e0c-df376a5d14f1" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:21:34 user nova-compute[82479]: DEBUG nova.compute.manager [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Start spawning the instance on the hypervisor. {{(pid=82479) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 00:21:34 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Creating instance directory {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 00:21:34 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Creating image(s)
Apr 14 00:21:34 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Did not create local disks {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 00:21:34 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Ensure instance console log exists: /opt/stack/data/nova/instances/a1f2d364-908f-41c6-8e0c-df376a5d14f1/console.log {{(pid=82479) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 00:21:34 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:21:34 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:21:34 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:21:34 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Start _get_guest_xml network_info=[{"id": "db5a953b-fab8-4158-b9bb-95c4db32658e", "address": "fa:16:3e:16:63:e8", "network": {"id": "cb8c9bb1-a885-486d-aa6a-de600bc01c2e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1676259779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8663ccad9047f4b11b9ae0646c287a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb5a953b-fa", "ovs_interfaceid": "db5a953b-fab8-4158-b9bb-95c4db32658e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': True, 'attachment_id': '979ee141-81ea-4ed1-85eb-7f12ebce14b6', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BcLTtdGe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a1f2d364-908f-41c6-8e0c-df376a5d14f1', 'attached_at': '', 'detached_at': '', 'volume_id': '7056196a-d087-4a9b-a3c8-350b13e6d2c3', 'serial': '7056196a-d087-4a9b-a3c8-350b13e6d2c3'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 00:21:34 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:21:34 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:21:34 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82479) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 00:21:34 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T00:02:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 00:21:34 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Flavor limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 00:21:34 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Image limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 00:21:34 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Flavor pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 00:21:34 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Image pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 00:21:34 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 00:21:34 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 00:21:34 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 00:21:34 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Got 1 possible topologies {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 00:21:34 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 00:21:34 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 00:21:34 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Calling os-brick to attach iSCSI Volume {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 00:21:34 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BcLTtdGe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:21:34 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:21:34 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:21:34 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:21:34 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:21:34 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:21:34 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:21:34 user nova-compute[82479]: INFO os_brick.initiator.connectors.iscsi [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 00:21:34 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 -p 172.16.0.220:3260 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:21:34 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:21:34 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[779be843-d9ff-40fa-aa49-5d9310db3831]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:21:34 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 00:21:34 user nova-compute[82479]:  {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:21:34 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 -p 172.16.0.220:3260 --interface default --op new {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:21:34 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:21:34 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf17088-5033-4a14-ab2f-4b30daa72d51]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3] added\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:21:34 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3] added
Apr 14 00:21:34 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:21:34 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:21:34 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:21:34 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb8181e-4822-4f82-bd46-995fa6af9e0c]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:21:34 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:21:34 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:21:34 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:21:34 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc1fd04-f6be-4700-b942-3e7dbd54fa27]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:21:34 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:21:34 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BcLTtdGe {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:21:34 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BcLTtdGe" returned: 0 in 0.025s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:21:34 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[024211cf-4b72-4197-9139-d30760e1977e]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:21:34 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BcLTtdGe'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:21:34 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:21:34 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:21:34 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddcdab49-a80f-4c02-be22-5735c4f6298a]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:21:34 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:21:34 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:21:34 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:21:34 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab02bdc-e2cb-41e6-9967-9dce0ddc095a]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:21:34 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:21:34 user nova-compute[82479]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 (non-flash)
Apr 14 00:21:34 user nova-compute[82479]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 (non-flash)
Apr 14 00:21:34 user nova-compute[82479]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 (non-flash)
Apr 14 00:21:34 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:21:34 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:21:34 user nova-compute[82479]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 (non-flash)
Apr 14 00:21:34 user nova-compute[82479]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 (non-flash)
Apr 14 00:21:34 user nova-compute[82479]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 (non-flash)
Apr 14 00:21:34 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:21:34 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 -p 172.16.0.220:3260 --login {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:21:34 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:21:34 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[afbfccbe-4061-43a5-8f8b-291024e17c6d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:21:34 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3, portal: 172.16.0.220,3260]
Apr 14 00:21:34 user nova-compute[82479]: Login to [iface: default, target: iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3, portal: 172.16.0.220,3260] successful.
Apr 14 00:21:34 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:21:34 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:21:34 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:21:34 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c49c91a-3453-40b3-a8e4-2bf1a00b0559]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:21:34 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:21:34 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:21:34 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:21:34 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d339c88-614e-4c09-a3b4-169edba717bf]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:21:34 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:21:34 user nova-compute[82479]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 (non-flash)
Apr 14 00:21:34 user nova-compute[82479]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 (non-flash)
Apr 14 00:21:34 user nova-compute[82479]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 (non-flash)
Apr 14 00:21:34 user nova-compute[82479]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 (non-flash)
Apr 14 00:21:34 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:21:34 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:21:34 user nova-compute[82479]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 (non-flash)
Apr 14 00:21:34 user nova-compute[82479]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 (non-flash)
Apr 14 00:21:34 user nova-compute[82479]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 (non-flash)
Apr 14 00:21:34 user nova-compute[82479]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 (non-flash)
Apr 14 00:21:34 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:21:34 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:21:34 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Connected to 172.16.0.220:3260 {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 00:21:34 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] HCTL ('36', '-', '-', 0) found on session 35 with lun 0 {{(pid=82479) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 00:21:34 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=82479) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 00:21:34 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:21:34 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:21:34 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f963059-cb67-4cf5-8590-4a7cbb7c9e08]: (4, ('- - 0', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:21:34 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Searching for a device in session 35 and hctl ['36', '*', '*', 0] yield: None {{(pid=82479) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 00:21:35 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Searching for a device in session 35 and hctl ['36', '*', '*', 0] yield: sde {{(pid=82479) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 00:21:35 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BcLTtdGe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 00:21:35 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:21:35 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '26436616533346535', 'path': '/dev/sde'} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:21:35 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26436616533346535', 'path': '/dev/sde'} {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 00:21:35 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:21:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1594608317',display_name='tempest-ServerActionsTestJSON-server-1594608317',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1594608317',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD8E1mkrqLo3jsCiJcIvha4CNzW2T6/HQ38hZ5dGaGtUghmrHejTJlAuKgmy6xusLbaAzGTrJCKVkdgQ5v0CqCqGeNMDA89aLJgLl5KHn3gvI39SkbPja84HarSvbQbbXg==',key_name='tempest-keypair-1040271550',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf8663ccad9047f4b11b9ae0646c287a',ramdisk_id='',reservation_id='r-w08m23lo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-948553482',owner_user_name='tempest-ServerActionsTestJSON-948553482-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:21:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d86662f2c7648daad87118b7e9f757c',uuid=a1f2d364-908f-41c6-8e0c-df376a5d14f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db5a953b-fab8-4158-b9bb-95c4db32658e", "address": "fa:16:3e:16:63:e8", "network": {"id": "cb8c9bb1-a885-486d-aa6a-de600bc01c2e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1676259779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8663ccad9047f4b11b9ae0646c287a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb5a953b-fa", "ovs_interfaceid": "db5a953b-fab8-4158-b9bb-95c4db32658e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82479) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 00:21:35 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Converting VIF {"id": "db5a953b-fab8-4158-b9bb-95c4db32658e", "address": "fa:16:3e:16:63:e8", "network": {"id": "cb8c9bb1-a885-486d-aa6a-de600bc01c2e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1676259779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8663ccad9047f4b11b9ae0646c287a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb5a953b-fa", "ovs_interfaceid": "db5a953b-fab8-4158-b9bb-95c4db32658e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:21:35 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:63:e8,bridge_name='br-int',has_traffic_filtering=True,id=db5a953b-fab8-4158-b9bb-95c4db32658e,network=Network(cb8c9bb1-a885-486d-aa6a-de600bc01c2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb5a953b-fa') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:21:35 user nova-compute[82479]: DEBUG nova.objects.instance [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lazy-loading 'pci_devices' on Instance uuid a1f2d364-908f-41c6-8e0c-df376a5d14f1 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:21:35 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] End _get_guest_xml xml=<domain type="kvm">
Apr 14 00:21:35 user nova-compute[82479]:   <uuid>a1f2d364-908f-41c6-8e0c-df376a5d14f1</uuid>
Apr 14 00:21:35 user nova-compute[82479]:   <name>instance-00000021</name>
Apr 14 00:21:35 user nova-compute[82479]:   <memory>131072</memory>
Apr 14 00:21:35 user nova-compute[82479]:   <vcpu>1</vcpu>
Apr 14 00:21:35 user nova-compute[82479]:   <metadata>
Apr 14 00:21:35 user nova-compute[82479]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 00:21:35 user nova-compute[82479]:       <nova:package version="0.0.0"/>
Apr 14 00:21:35 user nova-compute[82479]:       <nova:name>tempest-ServerActionsTestJSON-server-1594608317</nova:name>
Apr 14 00:21:35 user nova-compute[82479]:       <nova:creationTime>2023-04-14 00:21:34</nova:creationTime>
Apr 14 00:21:35 user nova-compute[82479]:       <nova:flavor name="m1.nano">
Apr 14 00:21:35 user nova-compute[82479]:         <nova:memory>128</nova:memory>
Apr 14 00:21:35 user nova-compute[82479]:         <nova:disk>1</nova:disk>
Apr 14 00:21:35 user nova-compute[82479]:         <nova:swap>0</nova:swap>
Apr 14 00:21:35 user nova-compute[82479]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 00:21:35 user nova-compute[82479]:         <nova:vcpus>1</nova:vcpus>
Apr 14 00:21:35 user nova-compute[82479]:       </nova:flavor>
Apr 14 00:21:35 user nova-compute[82479]:       <nova:owner>
Apr 14 00:21:35 user nova-compute[82479]:         <nova:user uuid="3d86662f2c7648daad87118b7e9f757c">tempest-ServerActionsTestJSON-948553482-project-member</nova:user>
Apr 14 00:21:35 user nova-compute[82479]:         <nova:project uuid="bf8663ccad9047f4b11b9ae0646c287a">tempest-ServerActionsTestJSON-948553482</nova:project>
Apr 14 00:21:35 user nova-compute[82479]:       </nova:owner>
Apr 14 00:21:35 user nova-compute[82479]:       <nova:ports>
Apr 14 00:21:35 user nova-compute[82479]:         <nova:port uuid="db5a953b-fab8-4158-b9bb-95c4db32658e">
Apr 14 00:21:35 user nova-compute[82479]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 14 00:21:35 user nova-compute[82479]:         </nova:port>
Apr 14 00:21:35 user nova-compute[82479]:       </nova:ports>
Apr 14 00:21:35 user nova-compute[82479]:     </nova:instance>
Apr 14 00:21:35 user nova-compute[82479]:   </metadata>
Apr 14 00:21:35 user nova-compute[82479]:   <sysinfo type="smbios">
Apr 14 00:21:35 user nova-compute[82479]:     <system>
Apr 14 00:21:35 user nova-compute[82479]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 00:21:35 user nova-compute[82479]:       <entry name="product">OpenStack Nova</entry>
Apr 14 00:21:35 user nova-compute[82479]:       <entry name="version">0.0.0</entry>
Apr 14 00:21:35 user nova-compute[82479]:       <entry name="serial">a1f2d364-908f-41c6-8e0c-df376a5d14f1</entry>
Apr 14 00:21:35 user nova-compute[82479]:       <entry name="uuid">a1f2d364-908f-41c6-8e0c-df376a5d14f1</entry>
Apr 14 00:21:35 user nova-compute[82479]:       <entry name="family">Virtual Machine</entry>
Apr 14 00:21:35 user nova-compute[82479]:     </system>
Apr 14 00:21:35 user nova-compute[82479]:   </sysinfo>
Apr 14 00:21:35 user nova-compute[82479]:   <os>
Apr 14 00:21:35 user nova-compute[82479]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 00:21:35 user nova-compute[82479]:     <boot dev="hd"/>
Apr 14 00:21:35 user nova-compute[82479]:     <smbios mode="sysinfo"/>
Apr 14 00:21:35 user nova-compute[82479]:   </os>
Apr 14 00:21:35 user nova-compute[82479]:   <features>
Apr 14 00:21:35 user nova-compute[82479]:     <acpi/>
Apr 14 00:21:35 user nova-compute[82479]:     <apic/>
Apr 14 00:21:35 user nova-compute[82479]:     <vmcoreinfo/>
Apr 14 00:21:35 user nova-compute[82479]:   </features>
Apr 14 00:21:35 user nova-compute[82479]:   <clock offset="utc">
Apr 14 00:21:35 user nova-compute[82479]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 00:21:35 user nova-compute[82479]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 00:21:35 user nova-compute[82479]:     <timer name="hpet" present="no"/>
Apr 14 00:21:35 user nova-compute[82479]:   </clock>
Apr 14 00:21:35 user nova-compute[82479]:   <cpu mode="custom" match="exact">
Apr 14 00:21:35 user nova-compute[82479]:     <model>Nehalem</model>
Apr 14 00:21:35 user nova-compute[82479]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 00:21:35 user nova-compute[82479]:   </cpu>
Apr 14 00:21:35 user nova-compute[82479]:   <devices>
Apr 14 00:21:35 user nova-compute[82479]:     <disk type="block" device="disk">
Apr 14 00:21:35 user nova-compute[82479]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:21:35 user nova-compute[82479]:       <source dev="/dev/sde"/>
Apr 14 00:21:35 user nova-compute[82479]:       <target dev="vda" bus="virtio"/>
Apr 14 00:21:35 user nova-compute[82479]:       <serial>7056196a-d087-4a9b-a3c8-350b13e6d2c3</serial>
Apr 14 00:21:35 user nova-compute[82479]:     </disk>
Apr 14 00:21:35 user nova-compute[82479]:     <interface type="ethernet">
Apr 14 00:21:35 user nova-compute[82479]:       <mac address="fa:16:3e:16:63:e8"/>
Apr 14 00:21:35 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:21:35 user nova-compute[82479]:       <mtu size="1442"/>
Apr 14 00:21:35 user nova-compute[82479]:       <target dev="tapdb5a953b-fa"/>
Apr 14 00:21:35 user nova-compute[82479]:     </interface>
Apr 14 00:21:35 user nova-compute[82479]:     <serial type="pty">
Apr 14 00:21:35 user nova-compute[82479]:       <log file="/opt/stack/data/nova/instances/a1f2d364-908f-41c6-8e0c-df376a5d14f1/console.log" append="off"/>
Apr 14 00:21:35 user nova-compute[82479]:     </serial>
Apr 14 00:21:35 user nova-compute[82479]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 00:21:35 user nova-compute[82479]:     <video>
Apr 14 00:21:35 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:21:35 user nova-compute[82479]:     </video>
Apr 14 00:21:35 user nova-compute[82479]:     <rng model="virtio">
Apr 14 00:21:35 user nova-compute[82479]:       <backend model="random">/dev/urandom</backend>
Apr 14 00:21:35 user nova-compute[82479]:     </rng>
Apr 14 00:21:35 user nova-compute[82479]:     <controller type="usb" index="0" model="none"/>
Apr 14 00:21:35 user nova-compute[82479]:     <memballoon model="virtio">
Apr 14 00:21:35 user nova-compute[82479]:       <stats period="10"/>
Apr 14 00:21:35 user nova-compute[82479]:     </memballoon>
Apr 14 00:21:35 user nova-compute[82479]:   </devices>
Apr 14 00:21:35 user nova-compute[82479]: </domain>
Apr 14 00:21:35 user nova-compute[82479]:  {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 00:21:35 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:21:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1594608317',display_name='tempest-ServerActionsTestJSON-server-1594608317',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1594608317',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD8E1mkrqLo3jsCiJcIvha4CNzW2T6/HQ38hZ5dGaGtUghmrHejTJlAuKgmy6xusLbaAzGTrJCKVkdgQ5v0CqCqGeNMDA89aLJgLl5KHn3gvI39SkbPja84HarSvbQbbXg==',key_name='tempest-keypair-1040271550',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf8663ccad9047f4b11b9ae0646c287a',ramdisk_id='',reservation_id='r-w08m23lo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-948553482',owner_user_name='tempest-ServerActionsTestJSON-948553482-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:21:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d86662f2c7648daad87118b7e9f757c',uuid=a1f2d364-908f-41c6-8e0c-df376a5d14f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db5a953b-fab8-4158-b9bb-95c4db32658e", "address": "fa:16:3e:16:63:e8", "network": {"id": "cb8c9bb1-a885-486d-aa6a-de600bc01c2e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1676259779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8663ccad9047f4b11b9ae0646c287a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb5a953b-fa", "ovs_interfaceid": "db5a953b-fab8-4158-b9bb-95c4db32658e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 00:21:35 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Converting VIF {"id": "db5a953b-fab8-4158-b9bb-95c4db32658e", "address": "fa:16:3e:16:63:e8", "network": {"id": "cb8c9bb1-a885-486d-aa6a-de600bc01c2e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1676259779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8663ccad9047f4b11b9ae0646c287a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb5a953b-fa", "ovs_interfaceid": "db5a953b-fab8-4158-b9bb-95c4db32658e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:21:35 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:63:e8,bridge_name='br-int',has_traffic_filtering=True,id=db5a953b-fab8-4158-b9bb-95c4db32658e,network=Network(cb8c9bb1-a885-486d-aa6a-de600bc01c2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb5a953b-fa') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:21:35 user nova-compute[82479]: DEBUG os_vif [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:63:e8,bridge_name='br-int',has_traffic_filtering=True,id=db5a953b-fab8-4158-b9bb-95c4db32658e,network=Network(cb8c9bb1-a885-486d-aa6a-de600bc01c2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb5a953b-fa') {{(pid=82479) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 00:21:35 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:21:35 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:21:35 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 00:21:35 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:21:35 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdb5a953b-fa, may_exist=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:21:35 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdb5a953b-fa, col_values=(('external_ids', {'iface-id': 'db5a953b-fab8-4158-b9bb-95c4db32658e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:63:e8', 'vm-uuid': 'a1f2d364-908f-41c6-8e0c-df376a5d14f1'}),)) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:21:35 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:21:35 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:21:35 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:21:35 user nova-compute[82479]: INFO os_vif [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:63:e8,bridge_name='br-int',has_traffic_filtering=True,id=db5a953b-fab8-4158-b9bb-95c4db32658e,network=Network(cb8c9bb1-a885-486d-aa6a-de600bc01c2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb5a953b-fa')
Apr 14 00:21:36 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:21:36 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] No VIF found with MAC fa:16:3e:16:63:e8, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:21:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:21:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:21:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:21:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:21:37 user nova-compute[82479]: DEBUG nova.compute.manager [req-c84ed565-52ce-43bf-adc8-9f31bf0722bb req-8219c302-8c5a-4540-894c-773ea2cabe6b service nova] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Received event network-vif-plugged-db5a953b-fab8-4158-b9bb-95c4db32658e {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:21:37 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-c84ed565-52ce-43bf-adc8-9f31bf0722bb req-8219c302-8c5a-4540-894c-773ea2cabe6b service nova] Acquiring lock "a1f2d364-908f-41c6-8e0c-df376a5d14f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:21:37 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-c84ed565-52ce-43bf-adc8-9f31bf0722bb req-8219c302-8c5a-4540-894c-773ea2cabe6b service nova] Lock "a1f2d364-908f-41c6-8e0c-df376a5d14f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:21:37 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-c84ed565-52ce-43bf-adc8-9f31bf0722bb req-8219c302-8c5a-4540-894c-773ea2cabe6b service nova] Lock "a1f2d364-908f-41c6-8e0c-df376a5d14f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:21:37 user nova-compute[82479]: DEBUG nova.compute.manager [req-c84ed565-52ce-43bf-adc8-9f31bf0722bb req-8219c302-8c5a-4540-894c-773ea2cabe6b service nova] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] No waiting events found dispatching network-vif-plugged-db5a953b-fab8-4158-b9bb-95c4db32658e {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:21:37 user nova-compute[82479]: WARNING nova.compute.manager [req-c84ed565-52ce-43bf-adc8-9f31bf0722bb req-8219c302-8c5a-4540-894c-773ea2cabe6b service nova] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Received unexpected event network-vif-plugged-db5a953b-fab8-4158-b9bb-95c4db32658e for instance with vm_state building and task_state spawning.
Apr 14 00:21:39 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681431699.499933, a1f2d364-908f-41c6-8e0c-df376a5d14f1 => Resumed> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:21:39 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] VM Resumed (Lifecycle Event)
Apr 14 00:21:39 user nova-compute[82479]: DEBUG nova.compute.manager [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Instance event wait completed in 0 seconds for  {{(pid=82479) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 00:21:39 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Guest created on hypervisor {{(pid=82479) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 00:21:39 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Instance spawned successfully.
Apr 14 00:21:39 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 00:21:39 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:21:39 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:21:39 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Found default for hw_cdrom_bus of ide {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:21:39 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Found default for hw_disk_bus of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:21:39 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Found default for hw_input_bus of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:21:39 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Found default for hw_pointer_model of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:21:39 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Found default for hw_video_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:21:39 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Found default for hw_vif_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:21:39 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:21:39 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681431699.5051792, a1f2d364-908f-41c6-8e0c-df376a5d14f1 => Started> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:21:39 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] VM Started (Lifecycle Event)
Apr 14 00:21:39 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:21:39 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:21:39 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:21:39 user nova-compute[82479]: INFO nova.compute.manager [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Took 5.19 seconds to spawn the instance on the hypervisor.
Apr 14 00:21:39 user nova-compute[82479]: DEBUG nova.compute.manager [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:21:39 user nova-compute[82479]: DEBUG nova.compute.manager [req-c46f9c5c-d778-4e24-9431-c1286ba5a8ca req-0e1c3622-adb9-41c6-96ba-e70b7c904f11 service nova] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Received event network-vif-plugged-db5a953b-fab8-4158-b9bb-95c4db32658e {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:21:39 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-c46f9c5c-d778-4e24-9431-c1286ba5a8ca req-0e1c3622-adb9-41c6-96ba-e70b7c904f11 service nova] Acquiring lock "a1f2d364-908f-41c6-8e0c-df376a5d14f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:21:39 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-c46f9c5c-d778-4e24-9431-c1286ba5a8ca req-0e1c3622-adb9-41c6-96ba-e70b7c904f11 service nova] Lock "a1f2d364-908f-41c6-8e0c-df376a5d14f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:21:39 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-c46f9c5c-d778-4e24-9431-c1286ba5a8ca req-0e1c3622-adb9-41c6-96ba-e70b7c904f11 service nova] Lock "a1f2d364-908f-41c6-8e0c-df376a5d14f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:21:39 user nova-compute[82479]: DEBUG nova.compute.manager [req-c46f9c5c-d778-4e24-9431-c1286ba5a8ca req-0e1c3622-adb9-41c6-96ba-e70b7c904f11 service nova] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] No waiting events found dispatching network-vif-plugged-db5a953b-fab8-4158-b9bb-95c4db32658e {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:21:39 user nova-compute[82479]: WARNING nova.compute.manager [req-c46f9c5c-d778-4e24-9431-c1286ba5a8ca req-0e1c3622-adb9-41c6-96ba-e70b7c904f11 service nova] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Received unexpected event network-vif-plugged-db5a953b-fab8-4158-b9bb-95c4db32658e for instance with vm_state building and task_state spawning.
Apr 14 00:21:39 user nova-compute[82479]: INFO nova.compute.manager [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Took 11.13 seconds to build instance.
Apr 14 00:21:39 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-91d4f270-4b18-4185-8f49-9e9ea57ae89f tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "a1f2d364-908f-41c6-8e0c-df376a5d14f1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.233s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:21:40 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:21:40 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:21:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:21:45 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:21:46 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:21:50 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:21:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:21:51 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:21:51 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Starting heal instance info cache {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 00:21:51 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "refresh_cache-d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:21:51 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquired lock "refresh_cache-d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:21:51 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Forcefully refreshing network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 00:21:52 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Updating instance_info_cache with network_info: [{"id": "caaa85dc-5a5f-4480-b6be-b2bc234cd455", "address": "fa:16:3e:73:2a:e3", "network": {"id": "08106daa-a35e-4376-8c46-2b4baa51c6ea", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321730350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524265958bd24a6cb94aa3115eb2b6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaaa85dc-5a", "ovs_interfaceid": "caaa85dc-5a5f-4480-b6be-b2bc234cd455", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:21:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Releasing lock "refresh_cache-d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:21:52 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Updated the network info_cache for instance {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 00:21:52 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:21:54 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:21:55 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._sync_power_states {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:21:55 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Triggering sync for uuid 23718fd0-58b8-47f9-b1ef-a26a90741ecc {{(pid=82479) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 00:21:55 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Triggering sync for uuid 17c6c147-fb62-4204-a416-792b94d3f7dd {{(pid=82479) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 00:21:55 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Triggering sync for uuid 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 {{(pid=82479) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 00:21:55 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Triggering sync for uuid d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c {{(pid=82479) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 00:21:55 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Triggering sync for uuid 2793d412-f405-4452-8e46-c192e3c92ccb {{(pid=82479) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 00:21:55 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Triggering sync for uuid 13a94e92-54cf-49b7-ae71-32b3c48df332 {{(pid=82479) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 00:21:55 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Triggering sync for uuid ade24ab6-1a93-4449-b5e9-ec3de357665b {{(pid=82479) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 00:21:55 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Triggering sync for uuid 785033c7-e14b-418e-952a-248328b75d60 {{(pid=82479) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 00:21:55 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Triggering sync for uuid a1f2d364-908f-41c6-8e0c-df376a5d14f1 {{(pid=82479) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 00:21:55 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Triggering sync for uuid c7e1f470-fe8a-455e-aa0b-0d2475957fc0 {{(pid=82479) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 00:21:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "23718fd0-58b8-47f9-b1ef-a26a90741ecc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:21:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "23718fd0-58b8-47f9-b1ef-a26a90741ecc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:21:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "17c6c147-fb62-4204-a416-792b94d3f7dd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:21:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "17c6c147-fb62-4204-a416-792b94d3f7dd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:21:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:21:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:21:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:21:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:21:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "2793d412-f405-4452-8e46-c192e3c92ccb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:21:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "2793d412-f405-4452-8e46-c192e3c92ccb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:21:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "13a94e92-54cf-49b7-ae71-32b3c48df332" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:21:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "13a94e92-54cf-49b7-ae71-32b3c48df332" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:21:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "ade24ab6-1a93-4449-b5e9-ec3de357665b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:21:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "ade24ab6-1a93-4449-b5e9-ec3de357665b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:21:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "785033c7-e14b-418e-952a-248328b75d60" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:21:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "785033c7-e14b-418e-952a-248328b75d60" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:21:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "a1f2d364-908f-41c6-8e0c-df376a5d14f1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:21:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "a1f2d364-908f-41c6-8e0c-df376a5d14f1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:21:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "c7e1f470-fe8a-455e-aa0b-0d2475957fc0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:21:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "c7e1f470-fe8a-455e-aa0b-0d2475957fc0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:21:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "23718fd0-58b8-47f9-b1ef-a26a90741ecc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:21:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:21:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "17c6c147-fb62-4204-a416-792b94d3f7dd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.051s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:21:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.058s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:21:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "2793d412-f405-4452-8e46-c192e3c92ccb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.058s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:21:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "13a94e92-54cf-49b7-ae71-32b3c48df332" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.058s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:21:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "ade24ab6-1a93-4449-b5e9-ec3de357665b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.063s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:21:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "785033c7-e14b-418e-952a-248328b75d60" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.069s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:21:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "a1f2d364-908f-41c6-8e0c-df376a5d14f1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.080s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:21:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "c7e1f470-fe8a-455e-aa0b-0d2475957fc0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.090s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:21:55 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:21:56 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:21:56 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:21:58 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:21:58 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:21:59 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:21:59 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:21:59 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:21:59 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:21:59 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Auditing locally available compute resources for user (node: user) {{(pid=82479) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 00:21:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:21:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:21:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:22:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:22:00 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:22:00 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:22:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785033c7-e14b-418e-952a-248328b75d60/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:22:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785033c7-e14b-418e-952a-248328b75d60/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:22:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785033c7-e14b-418e-952a-248328b75d60/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:22:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785033c7-e14b-418e-952a-248328b75d60/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:22:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2793d412-f405-4452-8e46-c192e3c92ccb/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:22:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2793d412-f405-4452-8e46-c192e3c92ccb/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:22:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2793d412-f405-4452-8e46-c192e3c92ccb/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:22:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2793d412-f405-4452-8e46-c192e3c92ccb/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:22:00 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:22:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk.rescue --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:22:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk.rescue --force-share --output=json" returned: 0 in 0.158s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:22:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk.rescue --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:22:00 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:22:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk.rescue --force-share --output=json" returned: 0 in 0.148s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:22:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:22:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:22:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:22:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:22:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:22:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:22:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:22:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:22:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:22:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ade24ab6-1a93-4449-b5e9-ec3de357665b/disk.rescue --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:22:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ade24ab6-1a93-4449-b5e9-ec3de357665b/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:22:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ade24ab6-1a93-4449-b5e9-ec3de357665b/disk.rescue --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:22:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ade24ab6-1a93-4449-b5e9-ec3de357665b/disk.rescue --force-share --output=json" returned: 0 in 0.149s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:22:01 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] skipping disk /opt/stack/data/nova/instances/ade24ab6-1a93-4449-b5e9-ec3de357665b/disk (vdb) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:22:01 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:22:02 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:22:02 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:22:02 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Hypervisor/Node resource view: name=user free_ram=7883MB free_disk=26.011234283447266GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82479) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 00:22:02 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:22:02 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:22:02 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 23718fd0-58b8-47f9-b1ef-a26a90741ecc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:22:02 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 17c6c147-fb62-4204-a416-792b94d3f7dd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:22:02 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:22:02 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:22:02 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 2793d412-f405-4452-8e46-c192e3c92ccb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:22:02 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 13a94e92-54cf-49b7-ae71-32b3c48df332 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:22:02 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance ade24ab6-1a93-4449-b5e9-ec3de357665b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:22:02 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 785033c7-e14b-418e-952a-248328b75d60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:22:02 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance c7e1f470-fe8a-455e-aa0b-0d2475957fc0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:22:02 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance a1f2d364-908f-41c6-8e0c-df376a5d14f1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:22:02 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 00:22:02 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 00:22:02 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:22:02 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:22:02 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Compute_service record updated for user:user {{(pid=82479) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 00:22:02 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.507s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:22:04 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:22:04 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:22:04 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82479) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 00:22:05 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:22:06 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:22:10 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:22:11 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:22:15 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:22:19 user nova-compute[82479]: INFO nova.compute.manager [None req-842b8ab3-42f2-495e-85ab-e2d9a4668586 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Unrescuing
Apr 14 00:22:19 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-842b8ab3-42f2-495e-85ab-e2d9a4668586 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "refresh_cache-ade24ab6-1a93-4449-b5e9-ec3de357665b" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:22:19 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-842b8ab3-42f2-495e-85ab-e2d9a4668586 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquired lock "refresh_cache-ade24ab6-1a93-4449-b5e9-ec3de357665b" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:22:19 user nova-compute[82479]: DEBUG nova.network.neutron [None req-842b8ab3-42f2-495e-85ab-e2d9a4668586 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 00:22:20 user nova-compute[82479]: DEBUG nova.network.neutron [None req-842b8ab3-42f2-495e-85ab-e2d9a4668586 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Updating instance_info_cache with network_info: [{"id": "11344eed-48f5-49c5-a770-c9c298f7185e", "address": "fa:16:3e:cd:dc:0b", "network": {"id": "08106daa-a35e-4376-8c46-2b4baa51c6ea", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321730350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524265958bd24a6cb94aa3115eb2b6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11344eed-48", "ovs_interfaceid": "11344eed-48f5-49c5-a770-c9c298f7185e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:22:20 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-842b8ab3-42f2-495e-85ab-e2d9a4668586 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Releasing lock "refresh_cache-ade24ab6-1a93-4449-b5e9-ec3de357665b" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:22:20 user nova-compute[82479]: DEBUG nova.objects.instance [None req-842b8ab3-42f2-495e-85ab-e2d9a4668586 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lazy-loading 'flavor' on Instance uuid ade24ab6-1a93-4449-b5e9-ec3de357665b {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:22:20 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:22:20 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:22:20 user nova-compute[82479]: DEBUG nova.compute.manager [req-95b7047e-8cf0-4d92-b67a-f60713aece66 req-73a3a97f-673e-4f00-8e4f-4cf4c5ea2fec service nova] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Received event network-vif-unplugged-11344eed-48f5-49c5-a770-c9c298f7185e {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:22:20 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-95b7047e-8cf0-4d92-b67a-f60713aece66 req-73a3a97f-673e-4f00-8e4f-4cf4c5ea2fec service nova] Acquiring lock "ade24ab6-1a93-4449-b5e9-ec3de357665b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:22:20 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-95b7047e-8cf0-4d92-b67a-f60713aece66 req-73a3a97f-673e-4f00-8e4f-4cf4c5ea2fec service nova] Lock "ade24ab6-1a93-4449-b5e9-ec3de357665b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:22:20 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-95b7047e-8cf0-4d92-b67a-f60713aece66 req-73a3a97f-673e-4f00-8e4f-4cf4c5ea2fec service nova] Lock "ade24ab6-1a93-4449-b5e9-ec3de357665b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:22:20 user nova-compute[82479]: DEBUG nova.compute.manager [req-95b7047e-8cf0-4d92-b67a-f60713aece66 req-73a3a97f-673e-4f00-8e4f-4cf4c5ea2fec service nova] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] No waiting events found dispatching network-vif-unplugged-11344eed-48f5-49c5-a770-c9c298f7185e {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:22:20 user nova-compute[82479]: WARNING nova.compute.manager [req-95b7047e-8cf0-4d92-b67a-f60713aece66 req-73a3a97f-673e-4f00-8e4f-4cf4c5ea2fec service nova] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Received unexpected event network-vif-unplugged-11344eed-48f5-49c5-a770-c9c298f7185e for instance with vm_state rescued and task_state unrescuing.
Apr 14 00:22:20 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:22:20 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:22:20 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Instance destroyed successfully.
Apr 14 00:22:20 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:22:21 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:22:21 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:22:21 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:22:22 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:22:22 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:22:22 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:22:22 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:22:22 user nova-compute[82479]: DEBUG nova.compute.manager [req-d9c2625b-cddd-413e-83ad-451dbcb6a78d req-4665e5dc-6bdb-4081-84cc-cc2b5f4f0439 service nova] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Received event network-vif-plugged-11344eed-48f5-49c5-a770-c9c298f7185e {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:22:22 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-d9c2625b-cddd-413e-83ad-451dbcb6a78d req-4665e5dc-6bdb-4081-84cc-cc2b5f4f0439 service nova] Acquiring lock "ade24ab6-1a93-4449-b5e9-ec3de357665b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:22:22 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-d9c2625b-cddd-413e-83ad-451dbcb6a78d req-4665e5dc-6bdb-4081-84cc-cc2b5f4f0439 service nova] Lock "ade24ab6-1a93-4449-b5e9-ec3de357665b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:22:22 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-d9c2625b-cddd-413e-83ad-451dbcb6a78d req-4665e5dc-6bdb-4081-84cc-cc2b5f4f0439 service nova] Lock "ade24ab6-1a93-4449-b5e9-ec3de357665b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:22:22 user nova-compute[82479]: DEBUG nova.compute.manager [req-d9c2625b-cddd-413e-83ad-451dbcb6a78d req-4665e5dc-6bdb-4081-84cc-cc2b5f4f0439 service nova] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] No waiting events found dispatching network-vif-plugged-11344eed-48f5-49c5-a770-c9c298f7185e {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:22:22 user nova-compute[82479]: WARNING nova.compute.manager [req-d9c2625b-cddd-413e-83ad-451dbcb6a78d req-4665e5dc-6bdb-4081-84cc-cc2b5f4f0439 service nova] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Received unexpected event network-vif-plugged-11344eed-48f5-49c5-a770-c9c298f7185e for instance with vm_state rescued and task_state unrescuing.
Apr 14 00:22:22 user nova-compute[82479]: DEBUG nova.compute.manager [req-d9c2625b-cddd-413e-83ad-451dbcb6a78d req-4665e5dc-6bdb-4081-84cc-cc2b5f4f0439 service nova] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Received event network-vif-plugged-11344eed-48f5-49c5-a770-c9c298f7185e {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:22:22 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-d9c2625b-cddd-413e-83ad-451dbcb6a78d req-4665e5dc-6bdb-4081-84cc-cc2b5f4f0439 service nova] Acquiring lock "ade24ab6-1a93-4449-b5e9-ec3de357665b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:22:22 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-d9c2625b-cddd-413e-83ad-451dbcb6a78d req-4665e5dc-6bdb-4081-84cc-cc2b5f4f0439 service nova] Lock "ade24ab6-1a93-4449-b5e9-ec3de357665b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:22:22 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-d9c2625b-cddd-413e-83ad-451dbcb6a78d req-4665e5dc-6bdb-4081-84cc-cc2b5f4f0439 service nova] Lock "ade24ab6-1a93-4449-b5e9-ec3de357665b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:22:22 user nova-compute[82479]: DEBUG nova.compute.manager [req-d9c2625b-cddd-413e-83ad-451dbcb6a78d req-4665e5dc-6bdb-4081-84cc-cc2b5f4f0439 service nova] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] No waiting events found dispatching network-vif-plugged-11344eed-48f5-49c5-a770-c9c298f7185e {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:22:22 user nova-compute[82479]: WARNING nova.compute.manager [req-d9c2625b-cddd-413e-83ad-451dbcb6a78d req-4665e5dc-6bdb-4081-84cc-cc2b5f4f0439 service nova] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Received unexpected event network-vif-plugged-11344eed-48f5-49c5-a770-c9c298f7185e for instance with vm_state rescued and task_state unrescuing.
Apr 14 00:22:22 user nova-compute[82479]: DEBUG nova.compute.manager [req-d9c2625b-cddd-413e-83ad-451dbcb6a78d req-4665e5dc-6bdb-4081-84cc-cc2b5f4f0439 service nova] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Received event network-vif-plugged-11344eed-48f5-49c5-a770-c9c298f7185e {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:22:22 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-d9c2625b-cddd-413e-83ad-451dbcb6a78d req-4665e5dc-6bdb-4081-84cc-cc2b5f4f0439 service nova] Acquiring lock "ade24ab6-1a93-4449-b5e9-ec3de357665b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:22:22 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-d9c2625b-cddd-413e-83ad-451dbcb6a78d req-4665e5dc-6bdb-4081-84cc-cc2b5f4f0439 service nova] Lock "ade24ab6-1a93-4449-b5e9-ec3de357665b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:22:22 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-d9c2625b-cddd-413e-83ad-451dbcb6a78d req-4665e5dc-6bdb-4081-84cc-cc2b5f4f0439 service nova] Lock "ade24ab6-1a93-4449-b5e9-ec3de357665b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:22:22 user nova-compute[82479]: DEBUG nova.compute.manager [req-d9c2625b-cddd-413e-83ad-451dbcb6a78d req-4665e5dc-6bdb-4081-84cc-cc2b5f4f0439 service nova] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] No waiting events found dispatching network-vif-plugged-11344eed-48f5-49c5-a770-c9c298f7185e {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:22:22 user nova-compute[82479]: WARNING nova.compute.manager [req-d9c2625b-cddd-413e-83ad-451dbcb6a78d req-4665e5dc-6bdb-4081-84cc-cc2b5f4f0439 service nova] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Received unexpected event network-vif-plugged-11344eed-48f5-49c5-a770-c9c298f7185e for instance with vm_state rescued and task_state unrescuing.
Apr 14 00:22:24 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Removed pending event for ade24ab6-1a93-4449-b5e9-ec3de357665b due to event {{(pid=82479) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 00:22:24 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681431744.1652265, ade24ab6-1a93-4449-b5e9-ec3de357665b => Resumed> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:22:24 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] VM Resumed (Lifecycle Event)
Apr 14 00:22:24 user nova-compute[82479]: DEBUG nova.compute.manager [None req-842b8ab3-42f2-495e-85ab-e2d9a4668586 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:22:24 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:22:24 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:22:24 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 14 00:22:24 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681431744.169993, ade24ab6-1a93-4449-b5e9-ec3de357665b => Started> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:22:24 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] VM Started (Lifecycle Event)
Apr 14 00:22:24 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:22:24 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:22:25 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:22:26 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:22:28 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:22:29 user nova-compute[82479]: DEBUG nova.compute.manager [req-876e5ab6-8ec1-417a-922c-979bba37481c req-1343cd01-0b3c-4aa2-bb36-9258a75aff30 service nova] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Received event network-changed-0f90a627-4dab-4a2a-a2c2-eaae2910b379 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:22:29 user nova-compute[82479]: DEBUG nova.compute.manager [req-876e5ab6-8ec1-417a-922c-979bba37481c req-1343cd01-0b3c-4aa2-bb36-9258a75aff30 service nova] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Refreshing instance network info cache due to event network-changed-0f90a627-4dab-4a2a-a2c2-eaae2910b379. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:22:29 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-876e5ab6-8ec1-417a-922c-979bba37481c req-1343cd01-0b3c-4aa2-bb36-9258a75aff30 service nova] Acquiring lock "refresh_cache-c7e1f470-fe8a-455e-aa0b-0d2475957fc0" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:22:29 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-876e5ab6-8ec1-417a-922c-979bba37481c req-1343cd01-0b3c-4aa2-bb36-9258a75aff30 service nova] Acquired lock "refresh_cache-c7e1f470-fe8a-455e-aa0b-0d2475957fc0" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:22:29 user nova-compute[82479]: DEBUG nova.network.neutron [req-876e5ab6-8ec1-417a-922c-979bba37481c req-1343cd01-0b3c-4aa2-bb36-9258a75aff30 service nova] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Refreshing network info cache for port 0f90a627-4dab-4a2a-a2c2-eaae2910b379 {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:22:29 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d0623ef6-c885-43cf-a123-984a940b758f tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Acquiring lock "c7e1f470-fe8a-455e-aa0b-0d2475957fc0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:22:29 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d0623ef6-c885-43cf-a123-984a940b758f tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "c7e1f470-fe8a-455e-aa0b-0d2475957fc0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:22:29 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d0623ef6-c885-43cf-a123-984a940b758f tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Acquiring lock "c7e1f470-fe8a-455e-aa0b-0d2475957fc0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:22:29 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d0623ef6-c885-43cf-a123-984a940b758f tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "c7e1f470-fe8a-455e-aa0b-0d2475957fc0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:22:29 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d0623ef6-c885-43cf-a123-984a940b758f tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "c7e1f470-fe8a-455e-aa0b-0d2475957fc0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:22:29 user nova-compute[82479]: INFO nova.compute.manager [None req-d0623ef6-c885-43cf-a123-984a940b758f tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Terminating instance
Apr 14 00:22:29 user nova-compute[82479]: DEBUG nova.compute.manager [None req-d0623ef6-c885-43cf-a123-984a940b758f tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Start destroying the instance on the hypervisor. {{(pid=82479) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 00:22:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:22:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:22:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:22:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:22:29 user nova-compute[82479]: DEBUG nova.compute.manager [req-6c71b483-8777-440e-8fed-de0735458ddf req-1e2f6ac3-e6d7-4ca5-a86e-60e63a67d6af service nova] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Received event network-vif-unplugged-0f90a627-4dab-4a2a-a2c2-eaae2910b379 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:22:29 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-6c71b483-8777-440e-8fed-de0735458ddf req-1e2f6ac3-e6d7-4ca5-a86e-60e63a67d6af service nova] Acquiring lock "c7e1f470-fe8a-455e-aa0b-0d2475957fc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:22:29 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-6c71b483-8777-440e-8fed-de0735458ddf req-1e2f6ac3-e6d7-4ca5-a86e-60e63a67d6af service nova] Lock "c7e1f470-fe8a-455e-aa0b-0d2475957fc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:22:29 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-6c71b483-8777-440e-8fed-de0735458ddf req-1e2f6ac3-e6d7-4ca5-a86e-60e63a67d6af service nova] Lock "c7e1f470-fe8a-455e-aa0b-0d2475957fc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:22:29 user nova-compute[82479]: DEBUG nova.compute.manager [req-6c71b483-8777-440e-8fed-de0735458ddf req-1e2f6ac3-e6d7-4ca5-a86e-60e63a67d6af service nova] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] No waiting events found dispatching network-vif-unplugged-0f90a627-4dab-4a2a-a2c2-eaae2910b379 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:22:29 user nova-compute[82479]: DEBUG nova.compute.manager [req-6c71b483-8777-440e-8fed-de0735458ddf req-1e2f6ac3-e6d7-4ca5-a86e-60e63a67d6af service nova] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Received event network-vif-unplugged-0f90a627-4dab-4a2a-a2c2-eaae2910b379 for instance with task_state deleting. {{(pid=82479) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 00:22:29 user nova-compute[82479]: DEBUG nova.network.neutron [req-876e5ab6-8ec1-417a-922c-979bba37481c req-1343cd01-0b3c-4aa2-bb36-9258a75aff30 service nova] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Updated VIF entry in instance network info cache for port 0f90a627-4dab-4a2a-a2c2-eaae2910b379. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:22:29 user nova-compute[82479]: DEBUG nova.network.neutron [req-876e5ab6-8ec1-417a-922c-979bba37481c req-1343cd01-0b3c-4aa2-bb36-9258a75aff30 service nova] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Updating instance_info_cache with network_info: [{"id": "0f90a627-4dab-4a2a-a2c2-eaae2910b379", "address": "fa:16:3e:e2:65:cb", "network": {"id": "9f0b7c66-0d95-4c5f-8c77-6f12228c20fc", "bridge": "br-int", "label": "tempest-TestShelveInstance-940455626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6be95e5c8d94269802ecf487ff73104", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f90a627-4d", "ovs_interfaceid": "0f90a627-4dab-4a2a-a2c2-eaae2910b379", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:22:29 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-876e5ab6-8ec1-417a-922c-979bba37481c req-1343cd01-0b3c-4aa2-bb36-9258a75aff30 service nova] Releasing lock "refresh_cache-c7e1f470-fe8a-455e-aa0b-0d2475957fc0" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:22:29 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Instance destroyed successfully.
Apr 14 00:22:29 user nova-compute[82479]: DEBUG nova.objects.instance [None req-d0623ef6-c885-43cf-a123-984a940b758f tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lazy-loading 'resources' on Instance uuid c7e1f470-fe8a-455e-aa0b-0d2475957fc0 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:22:29 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-d0623ef6-c885-43cf-a123-984a940b758f tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T00:16:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-454867915',display_name='tempest-TestShelveInstance-server-454867915',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-454867915',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC+PTdQ169W4Ik0XJKAX1vms0H6bKP2Yz2If5eK4IKeWDFl4zKDtIms+QmK6CN9t818K0haZCxWGM5VZYA/HUy2ewr54rCodMDtSTJaDzyD+lhV417bVgrES1KaG3eBq0w==',key_name='tempest-TestShelveInstance-266505447',keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:20:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e6be95e5c8d94269802ecf487ff73104',ramdisk_id='',reservation_id='r-el3udybd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-5222591',owner_user_name='tempest-TestShelveInstance-5222591-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T00:20:49Z,user_data=None,user_id='b81e5ce5d2414980a506d0f3b37d0d5c',uuid=c7e1f470-fe8a-455e-aa0b-0d2475957fc0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0f90a627-4dab-4a2a-a2c2-eaae2910b379", "address": "fa:16:3e:e2:65:cb", "network": {"id": "9f0b7c66-0d95-4c5f-8c77-6f12228c20fc", "bridge": "br-int", "label": "tempest-TestShelveInstance-940455626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6be95e5c8d94269802ecf487ff73104", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f90a627-4d", "ovs_interfaceid": "0f90a627-4dab-4a2a-a2c2-eaae2910b379", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 00:22:29 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-d0623ef6-c885-43cf-a123-984a940b758f tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Converting VIF {"id": "0f90a627-4dab-4a2a-a2c2-eaae2910b379", "address": "fa:16:3e:e2:65:cb", "network": {"id": "9f0b7c66-0d95-4c5f-8c77-6f12228c20fc", "bridge": "br-int", "label": "tempest-TestShelveInstance-940455626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6be95e5c8d94269802ecf487ff73104", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f90a627-4d", "ovs_interfaceid": "0f90a627-4dab-4a2a-a2c2-eaae2910b379", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:22:29 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-d0623ef6-c885-43cf-a123-984a940b758f tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:65:cb,bridge_name='br-int',has_traffic_filtering=True,id=0f90a627-4dab-4a2a-a2c2-eaae2910b379,network=Network(9f0b7c66-0d95-4c5f-8c77-6f12228c20fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f90a627-4d') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:22:29 user nova-compute[82479]: DEBUG os_vif [None req-d0623ef6-c885-43cf-a123-984a940b758f tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:65:cb,bridge_name='br-int',has_traffic_filtering=True,id=0f90a627-4dab-4a2a-a2c2-eaae2910b379,network=Network(9f0b7c66-0d95-4c5f-8c77-6f12228c20fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f90a627-4d') {{(pid=82479) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 00:22:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:22:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0f90a627-4d, bridge=br-int, if_exists=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:22:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:22:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:22:30 user nova-compute[82479]: INFO os_vif [None req-d0623ef6-c885-43cf-a123-984a940b758f tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:65:cb,bridge_name='br-int',has_traffic_filtering=True,id=0f90a627-4dab-4a2a-a2c2-eaae2910b379,network=Network(9f0b7c66-0d95-4c5f-8c77-6f12228c20fc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f90a627-4d')
Apr 14 00:22:30 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0623ef6-c885-43cf-a123-984a940b758f tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] calling os-brick to detach iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 00:22:30 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0623ef6-c885-43cf-a123-984a940b758f tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, {'target_iqn': 'iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FZCpIqMc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:22:30 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-d0623ef6-c885-43cf-a123-984a940b758f tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:22:30 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-d0623ef6-c885-43cf-a123-984a940b758f tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:22:30 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-d0623ef6-c885-43cf-a123-984a940b758f tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:22:30 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:22:30 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:22:30 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14b1c42-0ea4-4233-afdc-bc2916c97d5a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:22:30 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0623ef6-c885-43cf-a123-984a940b758f tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 00:22:30 user nova-compute[82479]: No targets found.
Apr 14 00:22:30 user nova-compute[82479]: iSNS:
Apr 14 00:22:30 user nova-compute[82479]: No targets found.
Apr 14 00:22:30 user nova-compute[82479]: STATIC:
Apr 14 00:22:30 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc
Apr 14 00:22:30 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:22:30 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:22:30 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3
Apr 14 00:22:30 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:22:30 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:22:30 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7
Apr 14 00:22:30 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:22:30 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:22:30 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9
Apr 14 00:22:30 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:22:30 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:22:30 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99
Apr 14 00:22:30 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:22:30 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:22:30 user nova-compute[82479]: FIRMWARE:
Apr 14 00:22:30 user nova-compute[82479]: No targets found.
Apr 14 00:22:30 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:22:30 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0623ef6-c885-43cf-a123-984a940b758f tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 00:22:30 user nova-compute[82479]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 00:22:30 user nova-compute[82479]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82479) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 00:22:30 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0623ef6-c885-43cf-a123-984a940b758f tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7', 0)] {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 00:22:30 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:22:30 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:22:30 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac4b092-0009-4115-be69-0c97e5ea7af6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:22:30 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:22:30 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:22:30 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b74c6ba-f77b-4079-86a4-17bc195ff31d]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:22:30 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0623ef6-c885-43cf-a123-984a940b758f tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:22:30 user nova-compute[82479]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 (non-flash)
Apr 14 00:22:30 user nova-compute[82479]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 (non-flash)
Apr 14 00:22:30 user nova-compute[82479]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 (non-flash)
Apr 14 00:22:30 user nova-compute[82479]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 (non-flash)
Apr 14 00:22:30 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:22:30 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0623ef6-c885-43cf-a123-984a940b758f tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:22:30 user nova-compute[82479]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 (non-flash)
Apr 14 00:22:30 user nova-compute[82479]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 (non-flash)
Apr 14 00:22:30 user nova-compute[82479]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 (non-flash)
Apr 14 00:22:30 user nova-compute[82479]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 (non-flash)
Apr 14 00:22:30 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:22:30 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0623ef6-c885-43cf-a123-984a940b758f tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f33385d1ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7'): ({'sdd'}, set())}) {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 00:22:30 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-d0623ef6-c885-43cf-a123-984a940b758f tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Removing single pathed devices sdd {{(pid=82479) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 00:22:30 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:22:30 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:22:30 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ef2626-e267-464f-9742-b79f49a7e026]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:22:30 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:22:30 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:22:30 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5eb2ee-d1b2-4738-adaf-67c74c145b1c]: (4, ('ok\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:22:30 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-d0623ef6-c885-43cf-a123-984a940b758f tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Flushing IO for device /dev/sdd {{(pid=82479) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 00:22:30 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:22:30 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:22:30 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[f888b949-d512-4e89-8c1c-59e9fbd88409]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:22:30 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-d0623ef6-c885-43cf-a123-984a940b758f tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=82479) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 00:22:30 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:22:30 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.061s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:22:30 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c277336-6a84-4921-afee-a1fa5f49f43e]: (4, ('1', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:22:30 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-d0623ef6-c885-43cf-a123-984a940b758f tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 00:22:30 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-d0623ef6-c885-43cf-a123-984a940b758f tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] SCSI volumes sdd have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 00:22:30 user nova-compute[82479]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26630376635613839', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_ef345ac1', '/dev/disk/by-id/scsi-1SCST_BIOef345ac1-f07f5a89696aa3f5') {{(pid=93289) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 14 00:22:30 user nova-compute[82479]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26630376635613839
Apr 14 00:22:30 user nova-compute[82479]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_ef345ac1
Apr 14 00:22:30 user nova-compute[82479]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOef345ac1-f07f5a89696aa3f5
Apr 14 00:22:30 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a632fb-3d33-496f-bbae-b2ce9ea43b6c]: (4, None) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:22:30 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0623ef6-c885-43cf-a123-984a940b758f tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7')] {{(pid=82479) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 00:22:30 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:22:30 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:22:30 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bdc168d-f4bb-432f-8bd8-aec16a3d1be9]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:22:30 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0623ef6-c885-43cf-a123-984a940b758f tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:22:30 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 -p 172.16.0.220:3260 --logout {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:22:30 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:22:30 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5550f3b-00c1-4071-8a50-d2513532fa00]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:22:30 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0623ef6-c885-43cf-a123-984a940b758f tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7, portal: 172.16.0.220,3260]
Apr 14 00:22:30 user nova-compute[82479]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7, portal: 172.16.0.220,3260] successful.
Apr 14 00:22:30 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:22:30 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 -p 172.16.0.220:3260 --op delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:22:30 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:22:30 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[6252cd8d-684a-461f-a179-bf8869ea3add]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:22:30 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0623ef6-c885-43cf-a123-984a940b758f tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:22:30 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-d0623ef6-c885-43cf-a123-984a940b758f tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:22:30 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0623ef6-c885-43cf-a123-984a940b758f tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] <== disconnect_volume: return (338ms) None {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:22:30 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0623ef6-c885-43cf-a123-984a940b758f tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Disconnected iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 00:22:30 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-d0623ef6-c885-43cf-a123-984a940b758f tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Deleting instance files /opt/stack/data/nova/instances/c7e1f470-fe8a-455e-aa0b-0d2475957fc0_del
Apr 14 00:22:30 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-d0623ef6-c885-43cf-a123-984a940b758f tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Deletion of /opt/stack/data/nova/instances/c7e1f470-fe8a-455e-aa0b-0d2475957fc0_del complete
Apr 14 00:22:30 user nova-compute[82479]: INFO nova.compute.manager [None req-d0623ef6-c885-43cf-a123-984a940b758f tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Took 1.20 seconds to destroy the instance on the hypervisor.
Apr 14 00:22:30 user nova-compute[82479]: DEBUG oslo.service.loopingcall [None req-d0623ef6-c885-43cf-a123-984a940b758f tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82479) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 00:22:30 user nova-compute[82479]: DEBUG nova.compute.manager [-] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Deallocating network for instance {{(pid=82479) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 00:22:30 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] deallocate_for_instance() {{(pid=82479) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 00:22:30 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Updating instance_info_cache with network_info: [] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:22:30 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Took 0.45 seconds to deallocate network for instance.
Apr 14 00:22:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:22:31 user nova-compute[82479]: INFO nova.compute.manager [None req-d0623ef6-c885-43cf-a123-984a940b758f tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Took 0.85 seconds to detach 1 volumes for instance.
Apr 14 00:22:31 user nova-compute[82479]: DEBUG nova.compute.manager [None req-d0623ef6-c885-43cf-a123-984a940b758f tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Deleting volume: 69599ada-93d4-425a-ae12-e52cafcc29f7 {{(pid=82479) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 14 00:22:31 user nova-compute[82479]: DEBUG nova.compute.manager [req-896e0307-b9b4-411f-b29e-9a50a279a831 req-f5d845d3-ffa7-4e1f-b057-d52d1617285a service nova] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Received event network-vif-plugged-0f90a627-4dab-4a2a-a2c2-eaae2910b379 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:22:31 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-896e0307-b9b4-411f-b29e-9a50a279a831 req-f5d845d3-ffa7-4e1f-b057-d52d1617285a service nova] Acquiring lock "c7e1f470-fe8a-455e-aa0b-0d2475957fc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:22:31 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-896e0307-b9b4-411f-b29e-9a50a279a831 req-f5d845d3-ffa7-4e1f-b057-d52d1617285a service nova] Lock "c7e1f470-fe8a-455e-aa0b-0d2475957fc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:22:31 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-896e0307-b9b4-411f-b29e-9a50a279a831 req-f5d845d3-ffa7-4e1f-b057-d52d1617285a service nova] Lock "c7e1f470-fe8a-455e-aa0b-0d2475957fc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:22:31 user nova-compute[82479]: DEBUG nova.compute.manager [req-896e0307-b9b4-411f-b29e-9a50a279a831 req-f5d845d3-ffa7-4e1f-b057-d52d1617285a service nova] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] No waiting events found dispatching network-vif-plugged-0f90a627-4dab-4a2a-a2c2-eaae2910b379 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:22:31 user nova-compute[82479]: WARNING nova.compute.manager [req-896e0307-b9b4-411f-b29e-9a50a279a831 req-f5d845d3-ffa7-4e1f-b057-d52d1617285a service nova] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Received unexpected event network-vif-plugged-0f90a627-4dab-4a2a-a2c2-eaae2910b379 for instance with vm_state active and task_state deleting.
Apr 14 00:22:31 user nova-compute[82479]: DEBUG nova.compute.manager [req-896e0307-b9b4-411f-b29e-9a50a279a831 req-f5d845d3-ffa7-4e1f-b057-d52d1617285a service nova] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Received event network-vif-deleted-0f90a627-4dab-4a2a-a2c2-eaae2910b379 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:22:31 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d0623ef6-c885-43cf-a123-984a940b758f tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:22:31 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d0623ef6-c885-43cf-a123-984a940b758f tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:22:32 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-d0623ef6-c885-43cf-a123-984a940b758f tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:22:32 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-d0623ef6-c885-43cf-a123-984a940b758f tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:22:32 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d0623ef6-c885-43cf-a123-984a940b758f tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.451s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:22:32 user nova-compute[82479]: INFO nova.scheduler.client.report [None req-d0623ef6-c885-43cf-a123-984a940b758f tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Deleted allocations for instance c7e1f470-fe8a-455e-aa0b-0d2475957fc0
Apr 14 00:22:32 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d0623ef6-c885-43cf-a123-984a940b758f tempest-TestShelveInstance-5222591 tempest-TestShelveInstance-5222591-project-member] Lock "c7e1f470-fe8a-455e-aa0b-0d2475957fc0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.294s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:22:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:22:36 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:22:39 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:22:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:22:44 user nova-compute[82479]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681431749.9576263, c7e1f470-fe8a-455e-aa0b-0d2475957fc0 => Stopped> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:22:44 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] VM Stopped (Lifecycle Event)
Apr 14 00:22:44 user nova-compute[82479]: DEBUG nova.compute.manager [None req-7006c430-7a92-499f-90fd-7cfab5823444 None None] [instance: c7e1f470-fe8a-455e-aa0b-0d2475957fc0] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:22:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:22:46 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:22:49 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8c31b509-bce4-47d1-b56e-bc99114376bc tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "13a94e92-54cf-49b7-ae71-32b3c48df332" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:22:49 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8c31b509-bce4-47d1-b56e-bc99114376bc tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "13a94e92-54cf-49b7-ae71-32b3c48df332" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:22:49 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8c31b509-bce4-47d1-b56e-bc99114376bc tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "13a94e92-54cf-49b7-ae71-32b3c48df332-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:22:49 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8c31b509-bce4-47d1-b56e-bc99114376bc tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "13a94e92-54cf-49b7-ae71-32b3c48df332-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:22:49 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8c31b509-bce4-47d1-b56e-bc99114376bc tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "13a94e92-54cf-49b7-ae71-32b3c48df332-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:22:49 user nova-compute[82479]: INFO nova.compute.manager [None req-8c31b509-bce4-47d1-b56e-bc99114376bc tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Terminating instance
Apr 14 00:22:49 user nova-compute[82479]: DEBUG nova.compute.manager [None req-8c31b509-bce4-47d1-b56e-bc99114376bc tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Start destroying the instance on the hypervisor. {{(pid=82479) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 00:22:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:22:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:22:49 user nova-compute[82479]: DEBUG nova.compute.manager [req-42634051-f9b9-49af-bc8a-8f075a05116a req-8240e863-8b0a-4edc-b97c-ff9f4f30aef1 service nova] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Received event network-vif-unplugged-4788878b-ac88-49ff-a42d-df57ef410442 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:22:49 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-42634051-f9b9-49af-bc8a-8f075a05116a req-8240e863-8b0a-4edc-b97c-ff9f4f30aef1 service nova] Acquiring lock "13a94e92-54cf-49b7-ae71-32b3c48df332-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:22:49 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-42634051-f9b9-49af-bc8a-8f075a05116a req-8240e863-8b0a-4edc-b97c-ff9f4f30aef1 service nova] Lock "13a94e92-54cf-49b7-ae71-32b3c48df332-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:22:49 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-42634051-f9b9-49af-bc8a-8f075a05116a req-8240e863-8b0a-4edc-b97c-ff9f4f30aef1 service nova] Lock "13a94e92-54cf-49b7-ae71-32b3c48df332-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:22:49 user nova-compute[82479]: DEBUG nova.compute.manager [req-42634051-f9b9-49af-bc8a-8f075a05116a req-8240e863-8b0a-4edc-b97c-ff9f4f30aef1 service nova] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] No waiting events found dispatching network-vif-unplugged-4788878b-ac88-49ff-a42d-df57ef410442 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:22:49 user nova-compute[82479]: DEBUG nova.compute.manager [req-42634051-f9b9-49af-bc8a-8f075a05116a req-8240e863-8b0a-4edc-b97c-ff9f4f30aef1 service nova] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Received event network-vif-unplugged-4788878b-ac88-49ff-a42d-df57ef410442 for instance with task_state deleting. {{(pid=82479) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 00:22:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:22:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:22:49 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Instance destroyed successfully.
Apr 14 00:22:49 user nova-compute[82479]: DEBUG nova.objects.instance [None req-8c31b509-bce4-47d1-b56e-bc99114376bc tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lazy-loading 'resources' on Instance uuid 13a94e92-54cf-49b7-ae71-32b3c48df332 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:22:49 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-8c31b509-bce4-47d1-b56e-bc99114376bc tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:17:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1831378742',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1831378742',id=29,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:19:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ba3f111e24414976beddba7ef90c4793',ramdisk_id='',reservation_id='r-ba0cm12p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1545234843',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T00:21:03Z,user_data=None,user_id='90bad96535c3453792982c5acab9dbc6',uuid=13a94e92-54cf-49b7-ae71-32b3c48df332,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4788878b-ac88-49ff-a42d-df57ef410442", "address": "fa:16:3e:97:9a:e9", "network": {"id": "491696ea-38ef-4c19-9d94-a61223c1fa00", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1323121698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3f111e24414976beddba7ef90c4793", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4788878b-ac", "ovs_interfaceid": "4788878b-ac88-49ff-a42d-df57ef410442", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 00:22:49 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-8c31b509-bce4-47d1-b56e-bc99114376bc tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Converting VIF {"id": "4788878b-ac88-49ff-a42d-df57ef410442", "address": "fa:16:3e:97:9a:e9", "network": {"id": "491696ea-38ef-4c19-9d94-a61223c1fa00", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1323121698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3f111e24414976beddba7ef90c4793", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4788878b-ac", "ovs_interfaceid": "4788878b-ac88-49ff-a42d-df57ef410442", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:22:49 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-8c31b509-bce4-47d1-b56e-bc99114376bc tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:97:9a:e9,bridge_name='br-int',has_traffic_filtering=True,id=4788878b-ac88-49ff-a42d-df57ef410442,network=Network(491696ea-38ef-4c19-9d94-a61223c1fa00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4788878b-ac') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:22:49 user nova-compute[82479]: DEBUG os_vif [None req-8c31b509-bce4-47d1-b56e-bc99114376bc tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:9a:e9,bridge_name='br-int',has_traffic_filtering=True,id=4788878b-ac88-49ff-a42d-df57ef410442,network=Network(491696ea-38ef-4c19-9d94-a61223c1fa00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4788878b-ac') {{(pid=82479) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 00:22:50 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:22:50 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4788878b-ac, bridge=br-int, if_exists=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:22:50 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:22:50 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:22:50 user nova-compute[82479]: INFO os_vif [None req-8c31b509-bce4-47d1-b56e-bc99114376bc tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:9a:e9,bridge_name='br-int',has_traffic_filtering=True,id=4788878b-ac88-49ff-a42d-df57ef410442,network=Network(491696ea-38ef-4c19-9d94-a61223c1fa00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4788878b-ac')
Apr 14 00:22:50 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c31b509-bce4-47d1-b56e-bc99114376bc tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] calling os-brick to detach iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 00:22:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c31b509-bce4-47d1-b56e-bc99114376bc tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, {'target_iqn': 'iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NhaiJkPC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:22:50 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-8c31b509-bce4-47d1-b56e-bc99114376bc tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:22:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-8c31b509-bce4-47d1-b56e-bc99114376bc tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:22:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-8c31b509-bce4-47d1-b56e-bc99114376bc tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:22:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:22:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:22:50 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[27fb11fa-36ef-4be5-92c8-75699170ad4f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:22:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c31b509-bce4-47d1-b56e-bc99114376bc tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 00:22:50 user nova-compute[82479]: No targets found.
Apr 14 00:22:50 user nova-compute[82479]: iSNS:
Apr 14 00:22:50 user nova-compute[82479]: No targets found.
Apr 14 00:22:50 user nova-compute[82479]: STATIC:
Apr 14 00:22:50 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc
Apr 14 00:22:50 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:22:50 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:22:50 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3
Apr 14 00:22:50 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:22:50 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:22:50 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9
Apr 14 00:22:50 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:22:50 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:22:50 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99
Apr 14 00:22:50 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:22:50 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:22:50 user nova-compute[82479]: FIRMWARE:
Apr 14 00:22:50 user nova-compute[82479]: No targets found.
Apr 14 00:22:50 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:22:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c31b509-bce4-47d1-b56e-bc99114376bc tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 00:22:50 user nova-compute[82479]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 00:22:50 user nova-compute[82479]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82479) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 00:22:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c31b509-bce4-47d1-b56e-bc99114376bc tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99', 0)] {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 00:22:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:22:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:22:50 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[f036bcb7-c235-4e82-9833-e525da567577]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:22:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:22:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:22:50 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[eebad65c-6411-478c-b95e-36578c8697cd]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:22:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c31b509-bce4-47d1-b56e-bc99114376bc tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:22:50 user nova-compute[82479]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 (non-flash)
Apr 14 00:22:50 user nova-compute[82479]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 (non-flash)
Apr 14 00:22:50 user nova-compute[82479]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 (non-flash)
Apr 14 00:22:50 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:22:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c31b509-bce4-47d1-b56e-bc99114376bc tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:22:50 user nova-compute[82479]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 (non-flash)
Apr 14 00:22:50 user nova-compute[82479]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 (non-flash)
Apr 14 00:22:50 user nova-compute[82479]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 (non-flash)
Apr 14 00:22:50 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:22:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c31b509-bce4-47d1-b56e-bc99114376bc tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3344b0eb90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99'): ({'sdf'}, set())}) {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 00:22:50 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-8c31b509-bce4-47d1-b56e-bc99114376bc tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Removing single pathed devices sdf {{(pid=82479) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 00:22:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:22:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:22:50 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9c9e50-df2f-47e0-90de-5c206b1c6e8c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:22:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:22:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:22:50 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[872f51f1-4e30-4226-bcea-72e9872e31b2]: (4, ('ok\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:22:50 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-8c31b509-bce4-47d1-b56e-bc99114376bc tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Flushing IO for device /dev/sdf {{(pid=82479) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 00:22:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:22:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:22:50 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f833f1-1a1e-49ef-8901-d872ab19438d]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:22:50 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-8c31b509-bce4-47d1-b56e-bc99114376bc tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=82479) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 00:22:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:22:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.048s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:22:50 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e01353-4866-4cda-a052-ee5a1a6af8c7]: (4, ('1', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:22:50 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-8c31b509-bce4-47d1-b56e-bc99114376bc tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 00:22:50 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-8c31b509-bce4-47d1-b56e-bc99114376bc tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] SCSI volumes sdf have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 00:22:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c31b509-bce4-47d1-b56e-bc99114376bc tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99')] {{(pid=82479) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 00:22:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:22:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:22:50 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[b16120d2-db6c-4fef-ae3b-8a62945f62f1]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:22:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c31b509-bce4-47d1-b56e-bc99114376bc tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:22:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 -p 172.16.0.220:3260 --logout {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:22:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:22:50 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee48de7-690b-4bf2-b4a9-937eb92393c9]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:22:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c31b509-bce4-47d1-b56e-bc99114376bc tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99, portal: 172.16.0.220,3260]
Apr 14 00:22:50 user nova-compute[82479]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99, portal: 172.16.0.220,3260] successful.
Apr 14 00:22:50 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:22:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 -p 172.16.0.220:3260 --op delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:22:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:22:50 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[3866246e-0339-461b-b671-0b0752fa7338]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:22:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c31b509-bce4-47d1-b56e-bc99114376bc tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:22:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-8c31b509-bce4-47d1-b56e-bc99114376bc tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:22:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c31b509-bce4-47d1-b56e-bc99114376bc tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] <== disconnect_volume: return (323ms) None {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:22:50 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c31b509-bce4-47d1-b56e-bc99114376bc tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Disconnected iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 00:22:50 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-8c31b509-bce4-47d1-b56e-bc99114376bc tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Deleting instance files /opt/stack/data/nova/instances/13a94e92-54cf-49b7-ae71-32b3c48df332_del
Apr 14 00:22:50 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-8c31b509-bce4-47d1-b56e-bc99114376bc tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Deletion of /opt/stack/data/nova/instances/13a94e92-54cf-49b7-ae71-32b3c48df332_del complete
Apr 14 00:22:50 user nova-compute[82479]: INFO nova.compute.manager [None req-8c31b509-bce4-47d1-b56e-bc99114376bc tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Took 1.16 seconds to destroy the instance on the hypervisor.
Apr 14 00:22:50 user nova-compute[82479]: DEBUG oslo.service.loopingcall [None req-8c31b509-bce4-47d1-b56e-bc99114376bc tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82479) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 00:22:50 user nova-compute[82479]: DEBUG nova.compute.manager [-] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Deallocating network for instance {{(pid=82479) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 00:22:50 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] deallocate_for_instance() {{(pid=82479) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 00:22:50 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Updating instance_info_cache with network_info: [] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:22:50 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Took 0.46 seconds to deallocate network for instance.
Apr 14 00:22:50 user nova-compute[82479]: DEBUG nova.compute.manager [req-ddee5e8e-4797-401c-a527-ca9cc3a981d5 req-21e863fd-3e82-41fc-92d7-2c550792af6f service nova] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Received event network-vif-deleted-4788878b-ac88-49ff-a42d-df57ef410442 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:22:50 user nova-compute[82479]: INFO nova.compute.manager [req-ddee5e8e-4797-401c-a527-ca9cc3a981d5 req-21e863fd-3e82-41fc-92d7-2c550792af6f service nova] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Neutron deleted interface 4788878b-ac88-49ff-a42d-df57ef410442; detaching it from the instance and deleting it from the info cache
Apr 14 00:22:50 user nova-compute[82479]: DEBUG nova.network.neutron [req-ddee5e8e-4797-401c-a527-ca9cc3a981d5 req-21e863fd-3e82-41fc-92d7-2c550792af6f service nova] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Updating instance_info_cache with network_info: [] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:22:50 user nova-compute[82479]: DEBUG nova.compute.manager [req-ddee5e8e-4797-401c-a527-ca9cc3a981d5 req-21e863fd-3e82-41fc-92d7-2c550792af6f service nova] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Detach interface failed, port_id=4788878b-ac88-49ff-a42d-df57ef410442, reason: Instance 13a94e92-54cf-49b7-ae71-32b3c48df332 could not be found. {{(pid=82479) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 00:22:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:22:51 user nova-compute[82479]: DEBUG nova.compute.manager [req-3c05b9d5-4c61-4504-9a1b-9b3d3784c148 req-f4fda724-dc10-4d23-91d0-c2ef838d14c2 service nova] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Received event network-vif-plugged-4788878b-ac88-49ff-a42d-df57ef410442 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:22:51 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-3c05b9d5-4c61-4504-9a1b-9b3d3784c148 req-f4fda724-dc10-4d23-91d0-c2ef838d14c2 service nova] Acquiring lock "13a94e92-54cf-49b7-ae71-32b3c48df332-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:22:51 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-3c05b9d5-4c61-4504-9a1b-9b3d3784c148 req-f4fda724-dc10-4d23-91d0-c2ef838d14c2 service nova] Lock "13a94e92-54cf-49b7-ae71-32b3c48df332-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:22:51 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-3c05b9d5-4c61-4504-9a1b-9b3d3784c148 req-f4fda724-dc10-4d23-91d0-c2ef838d14c2 service nova] Lock "13a94e92-54cf-49b7-ae71-32b3c48df332-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:22:51 user nova-compute[82479]: DEBUG nova.compute.manager [req-3c05b9d5-4c61-4504-9a1b-9b3d3784c148 req-f4fda724-dc10-4d23-91d0-c2ef838d14c2 service nova] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] No waiting events found dispatching network-vif-plugged-4788878b-ac88-49ff-a42d-df57ef410442 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:22:51 user nova-compute[82479]: WARNING nova.compute.manager [req-3c05b9d5-4c61-4504-9a1b-9b3d3784c148 req-f4fda724-dc10-4d23-91d0-c2ef838d14c2 service nova] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Received unexpected event network-vif-plugged-4788878b-ac88-49ff-a42d-df57ef410442 for instance with vm_state active and task_state deleting.
Apr 14 00:22:51 user nova-compute[82479]: INFO nova.compute.manager [None req-8c31b509-bce4-47d1-b56e-bc99114376bc tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Took 0.92 seconds to detach 1 volumes for instance.
Apr 14 00:22:51 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8c31b509-bce4-47d1-b56e-bc99114376bc tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:22:51 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8c31b509-bce4-47d1-b56e-bc99114376bc tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:22:52 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-8c31b509-bce4-47d1-b56e-bc99114376bc tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:22:52 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-8c31b509-bce4-47d1-b56e-bc99114376bc tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:22:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8c31b509-bce4-47d1-b56e-bc99114376bc tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.318s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:22:52 user nova-compute[82479]: INFO nova.scheduler.client.report [None req-8c31b509-bce4-47d1-b56e-bc99114376bc tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Deleted allocations for instance 13a94e92-54cf-49b7-ae71-32b3c48df332
Apr 14 00:22:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-8c31b509-bce4-47d1-b56e-bc99114376bc tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "13a94e92-54cf-49b7-ae71-32b3c48df332" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.049s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:22:53 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:22:53 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:22:53 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Starting heal instance info cache {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 00:22:53 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "refresh_cache-2793d412-f405-4452-8e46-c192e3c92ccb" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:22:53 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquired lock "refresh_cache-2793d412-f405-4452-8e46-c192e3c92ccb" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:22:53 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Forcefully refreshing network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 00:22:54 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Updating instance_info_cache with network_info: [{"id": "47e07f85-3946-4934-a2ec-c9c77ccc3761", "address": "fa:16:3e:7b:b8:78", "network": {"id": "491696ea-38ef-4c19-9d94-a61223c1fa00", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1323121698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3f111e24414976beddba7ef90c4793", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e07f85-39", "ovs_interfaceid": "47e07f85-3946-4934-a2ec-c9c77ccc3761", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:22:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Releasing lock "refresh_cache-2793d412-f405-4452-8e46-c192e3c92ccb" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:22:54 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Updated the network info_cache for instance {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 00:22:54 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:22:55 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:22:55 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:22:57 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:22:59 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:22:59 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:22:59 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:22:59 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:22:59 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:22:59 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:22:59 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Auditing locally available compute resources for user (node: user) {{(pid=82479) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 00:22:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:22:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:22:59 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:23:00 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:23:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:23:00 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:23:00 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:23:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785033c7-e14b-418e-952a-248328b75d60/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:23:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785033c7-e14b-418e-952a-248328b75d60/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:23:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785033c7-e14b-418e-952a-248328b75d60/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:23:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785033c7-e14b-418e-952a-248328b75d60/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:23:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2793d412-f405-4452-8e46-c192e3c92ccb/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:23:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2793d412-f405-4452-8e46-c192e3c92ccb/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:23:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2793d412-f405-4452-8e46-c192e3c92ccb/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:23:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2793d412-f405-4452-8e46-c192e3c92ccb/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:23:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk.rescue --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:23:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:23:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk.rescue --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:23:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:23:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:23:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:23:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:23:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:23:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:23:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:23:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:23:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:23:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ade24ab6-1a93-4449-b5e9-ec3de357665b/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:23:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ade24ab6-1a93-4449-b5e9-ec3de357665b/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:23:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ade24ab6-1a93-4449-b5e9-ec3de357665b/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:23:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ade24ab6-1a93-4449-b5e9-ec3de357665b/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:23:01 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:23:02 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:23:02 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:23:02 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Hypervisor/Node resource view: name=user free_ram=8128MB free_disk=26.027965545654297GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82479) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 00:23:02 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:23:02 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:23:02 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 23718fd0-58b8-47f9-b1ef-a26a90741ecc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:23:02 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 17c6c147-fb62-4204-a416-792b94d3f7dd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:23:02 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:23:02 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:23:02 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 2793d412-f405-4452-8e46-c192e3c92ccb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:23:02 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance ade24ab6-1a93-4449-b5e9-ec3de357665b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:23:02 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 785033c7-e14b-418e-952a-248328b75d60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:23:02 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance a1f2d364-908f-41c6-8e0c-df376a5d14f1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:23:02 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 00:23:02 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 00:23:02 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:23:02 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:23:02 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Compute_service record updated for user:user {{(pid=82479) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 00:23:02 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.409s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:23:04 user nova-compute[82479]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681431769.9729848, 13a94e92-54cf-49b7-ae71-32b3c48df332 => Stopped> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:23:04 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] VM Stopped (Lifecycle Event)
Apr 14 00:23:05 user nova-compute[82479]: DEBUG nova.compute.manager [None req-39972287-f80f-406f-8463-3a5b25017d3c None None] [instance: 13a94e92-54cf-49b7-ae71-32b3c48df332] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:23:05 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:23:05 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:23:05 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:23:05 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82479) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 00:23:10 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:23:11 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:23:15 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:23:19 user nova-compute[82479]: DEBUG nova.compute.manager [req-1dfd0c73-026f-491e-8ede-e0cf306266be req-d93a39ff-a16b-489c-b637-1b794d093277 service nova] [instance: 785033c7-e14b-418e-952a-248328b75d60] Received event network-changed-29f1f1cc-0517-49a1-b8f1-61a7c3ee1002 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:23:19 user nova-compute[82479]: DEBUG nova.compute.manager [req-1dfd0c73-026f-491e-8ede-e0cf306266be req-d93a39ff-a16b-489c-b637-1b794d093277 service nova] [instance: 785033c7-e14b-418e-952a-248328b75d60] Refreshing instance network info cache due to event network-changed-29f1f1cc-0517-49a1-b8f1-61a7c3ee1002. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:23:19 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-1dfd0c73-026f-491e-8ede-e0cf306266be req-d93a39ff-a16b-489c-b637-1b794d093277 service nova] Acquiring lock "refresh_cache-785033c7-e14b-418e-952a-248328b75d60" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:23:19 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-1dfd0c73-026f-491e-8ede-e0cf306266be req-d93a39ff-a16b-489c-b637-1b794d093277 service nova] Acquired lock "refresh_cache-785033c7-e14b-418e-952a-248328b75d60" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:23:19 user nova-compute[82479]: DEBUG nova.network.neutron [req-1dfd0c73-026f-491e-8ede-e0cf306266be req-d93a39ff-a16b-489c-b637-1b794d093277 service nova] [instance: 785033c7-e14b-418e-952a-248328b75d60] Refreshing network info cache for port 29f1f1cc-0517-49a1-b8f1-61a7c3ee1002 {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:23:19 user nova-compute[82479]: DEBUG nova.network.neutron [req-1dfd0c73-026f-491e-8ede-e0cf306266be req-d93a39ff-a16b-489c-b637-1b794d093277 service nova] [instance: 785033c7-e14b-418e-952a-248328b75d60] Updated VIF entry in instance network info cache for port 29f1f1cc-0517-49a1-b8f1-61a7c3ee1002. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:23:19 user nova-compute[82479]: DEBUG nova.network.neutron [req-1dfd0c73-026f-491e-8ede-e0cf306266be req-d93a39ff-a16b-489c-b637-1b794d093277 service nova] [instance: 785033c7-e14b-418e-952a-248328b75d60] Updating instance_info_cache with network_info: [{"id": "29f1f1cc-0517-49a1-b8f1-61a7c3ee1002", "address": "fa:16:3e:59:e0:37", "network": {"id": "cb8c9bb1-a885-486d-aa6a-de600bc01c2e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1676259779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8663ccad9047f4b11b9ae0646c287a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29f1f1cc-05", "ovs_interfaceid": "29f1f1cc-0517-49a1-b8f1-61a7c3ee1002", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:23:19 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-1dfd0c73-026f-491e-8ede-e0cf306266be req-d93a39ff-a16b-489c-b637-1b794d093277 service nova] Releasing lock "refresh_cache-785033c7-e14b-418e-952a-248328b75d60" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:23:20 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:23:20 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:23:20 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:23:20 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:23:20 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:23:20 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:23:20 user nova-compute[82479]: DEBUG nova.compute.manager [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Stashing vm_state: active {{(pid=82479) _prep_resize /opt/stack/nova/nova/compute/manager.py:5499}}
Apr 14 00:23:21 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:23:21 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:23:21 user nova-compute[82479]: DEBUG nova.objects.instance [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lazy-loading 'pci_requests' on Instance uuid a1f2d364-908f-41c6-8e0c-df376a5d14f1 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:23:21 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82479) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 00:23:21 user nova-compute[82479]: INFO nova.compute.claims [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Claim successful on node user
Apr 14 00:23:21 user nova-compute[82479]: DEBUG nova.objects.instance [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lazy-loading 'resources' on Instance uuid a1f2d364-908f-41c6-8e0c-df376a5d14f1 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:23:21 user nova-compute[82479]: DEBUG nova.objects.instance [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lazy-loading 'pci_devices' on Instance uuid a1f2d364-908f-41c6-8e0c-df376a5d14f1 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:23:21 user nova-compute[82479]: INFO nova.compute.resource_tracker [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Updating resource usage from migration f76243a8-0e97-4f4a-84ee-d485a13c4ed4
Apr 14 00:23:21 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:23:21 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:23:21 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.394s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:23:21 user nova-compute[82479]: INFO nova.compute.manager [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Migrating
Apr 14 00:23:21 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "refresh_cache-a1f2d364-908f-41c6-8e0c-df376a5d14f1" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:23:21 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquired lock "refresh_cache-a1f2d364-908f-41c6-8e0c-df376a5d14f1" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:23:21 user nova-compute[82479]: DEBUG nova.network.neutron [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 00:23:21 user nova-compute[82479]: DEBUG nova.compute.manager [req-44790a26-2f81-498c-9186-288305bd8d40 req-b8206ceb-082f-48e2-8921-3bd31fb23434 service nova] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Received event network-changed-db5a953b-fab8-4158-b9bb-95c4db32658e {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:23:21 user nova-compute[82479]: DEBUG nova.compute.manager [req-44790a26-2f81-498c-9186-288305bd8d40 req-b8206ceb-082f-48e2-8921-3bd31fb23434 service nova] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Refreshing instance network info cache due to event network-changed-db5a953b-fab8-4158-b9bb-95c4db32658e. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:23:21 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-44790a26-2f81-498c-9186-288305bd8d40 req-b8206ceb-082f-48e2-8921-3bd31fb23434 service nova] Acquiring lock "refresh_cache-a1f2d364-908f-41c6-8e0c-df376a5d14f1" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:23:21 user nova-compute[82479]: DEBUG nova.network.neutron [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Updating instance_info_cache with network_info: [{"id": "db5a953b-fab8-4158-b9bb-95c4db32658e", "address": "fa:16:3e:16:63:e8", "network": {"id": "cb8c9bb1-a885-486d-aa6a-de600bc01c2e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1676259779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8663ccad9047f4b11b9ae0646c287a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb5a953b-fa", "ovs_interfaceid": "db5a953b-fab8-4158-b9bb-95c4db32658e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:23:21 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Releasing lock "refresh_cache-a1f2d364-908f-41c6-8e0c-df376a5d14f1" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:23:21 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-44790a26-2f81-498c-9186-288305bd8d40 req-b8206ceb-082f-48e2-8921-3bd31fb23434 service nova] Acquired lock "refresh_cache-a1f2d364-908f-41c6-8e0c-df376a5d14f1" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:23:21 user nova-compute[82479]: DEBUG nova.network.neutron [req-44790a26-2f81-498c-9186-288305bd8d40 req-b8206ceb-082f-48e2-8921-3bd31fb23434 service nova] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Refreshing network info cache for port db5a953b-fab8-4158-b9bb-95c4db32658e {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:23:22 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Starting migrate_disk_and_power_off {{(pid=82479) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11460}}
Apr 14 00:23:22 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:23:22 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:23:22 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:23:22 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:23:22 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:23:22 user nova-compute[82479]: DEBUG nova.compute.manager [req-0ffe4c55-ac5f-4e21-8c43-724b167a146a req-f283e91b-c23d-4be6-9d7e-475ac4aa595b service nova] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Received event network-vif-unplugged-db5a953b-fab8-4158-b9bb-95c4db32658e {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:23:22 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0ffe4c55-ac5f-4e21-8c43-724b167a146a req-f283e91b-c23d-4be6-9d7e-475ac4aa595b service nova] Acquiring lock "a1f2d364-908f-41c6-8e0c-df376a5d14f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:23:22 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0ffe4c55-ac5f-4e21-8c43-724b167a146a req-f283e91b-c23d-4be6-9d7e-475ac4aa595b service nova] Lock "a1f2d364-908f-41c6-8e0c-df376a5d14f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:23:22 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0ffe4c55-ac5f-4e21-8c43-724b167a146a req-f283e91b-c23d-4be6-9d7e-475ac4aa595b service nova] Lock "a1f2d364-908f-41c6-8e0c-df376a5d14f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:23:22 user nova-compute[82479]: DEBUG nova.compute.manager [req-0ffe4c55-ac5f-4e21-8c43-724b167a146a req-f283e91b-c23d-4be6-9d7e-475ac4aa595b service nova] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] No waiting events found dispatching network-vif-unplugged-db5a953b-fab8-4158-b9bb-95c4db32658e {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:23:22 user nova-compute[82479]: WARNING nova.compute.manager [req-0ffe4c55-ac5f-4e21-8c43-724b167a146a req-f283e91b-c23d-4be6-9d7e-475ac4aa595b service nova] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Received unexpected event network-vif-unplugged-db5a953b-fab8-4158-b9bb-95c4db32658e for instance with vm_state active and task_state resize_migrating.
Apr 14 00:23:22 user nova-compute[82479]: DEBUG nova.network.neutron [req-44790a26-2f81-498c-9186-288305bd8d40 req-b8206ceb-082f-48e2-8921-3bd31fb23434 service nova] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Updated VIF entry in instance network info cache for port db5a953b-fab8-4158-b9bb-95c4db32658e. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:23:22 user nova-compute[82479]: DEBUG nova.network.neutron [req-44790a26-2f81-498c-9186-288305bd8d40 req-b8206ceb-082f-48e2-8921-3bd31fb23434 service nova] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Updating instance_info_cache with network_info: [{"id": "db5a953b-fab8-4158-b9bb-95c4db32658e", "address": "fa:16:3e:16:63:e8", "network": {"id": "cb8c9bb1-a885-486d-aa6a-de600bc01c2e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1676259779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8663ccad9047f4b11b9ae0646c287a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb5a953b-fa", "ovs_interfaceid": "db5a953b-fab8-4158-b9bb-95c4db32658e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:23:22 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-44790a26-2f81-498c-9186-288305bd8d40 req-b8206ceb-082f-48e2-8921-3bd31fb23434 service nova] Releasing lock "refresh_cache-a1f2d364-908f-41c6-8e0c-df376a5d14f1" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:23:22 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Instance destroyed successfully.
Apr 14 00:23:22 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:21:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1594608317',display_name='tempest-ServerActionsTestJSON-server-1594608317',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1594608317',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD8E1mkrqLo3jsCiJcIvha4CNzW2T6/HQ38hZ5dGaGtUghmrHejTJlAuKgmy6xusLbaAzGTrJCKVkdgQ5v0CqCqGeNMDA89aLJgLl5KHn3gvI39SkbPja84HarSvbQbbXg==',key_name='tempest-keypair-1040271550',keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:21:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='bf8663ccad9047f4b11b9ae0646c287a',ramdisk_id='',reservation_id='r-w08m23lo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-948553482',owner_user_name='tempest-ServerActionsTestJSON-948553482-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T00:23:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d86662f2c7648daad87118b7e9f757c',uuid=a1f2d364-908f-41c6-8e0c-df376a5d14f1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "db5a953b-fab8-4158-b9bb-95c4db32658e", "address": "fa:16:3e:16:63:e8", "network": {"id": "cb8c9bb1-a885-486d-aa6a-de600bc01c2e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1676259779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1676259779-network", "vif_mac": "fa:16:3e:16:63:e8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8663ccad9047f4b11b9ae0646c287a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb5a953b-fa", "ovs_interfaceid": "db5a953b-fab8-4158-b9bb-95c4db32658e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 00:23:22 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Converting VIF {"id": "db5a953b-fab8-4158-b9bb-95c4db32658e", "address": "fa:16:3e:16:63:e8", "network": {"id": "cb8c9bb1-a885-486d-aa6a-de600bc01c2e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1676259779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1676259779-network", "vif_mac": "fa:16:3e:16:63:e8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8663ccad9047f4b11b9ae0646c287a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb5a953b-fa", "ovs_interfaceid": "db5a953b-fab8-4158-b9bb-95c4db32658e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:23:22 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:16:63:e8,bridge_name='br-int',has_traffic_filtering=True,id=db5a953b-fab8-4158-b9bb-95c4db32658e,network=Network(cb8c9bb1-a885-486d-aa6a-de600bc01c2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb5a953b-fa') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:23:22 user nova-compute[82479]: DEBUG os_vif [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:63:e8,bridge_name='br-int',has_traffic_filtering=True,id=db5a953b-fab8-4158-b9bb-95c4db32658e,network=Network(cb8c9bb1-a885-486d-aa6a-de600bc01c2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb5a953b-fa') {{(pid=82479) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 00:23:22 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:23:22 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdb5a953b-fa, bridge=br-int, if_exists=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:23:22 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:23:22 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:23:22 user nova-compute[82479]: INFO os_vif [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:63:e8,bridge_name='br-int',has_traffic_filtering=True,id=db5a953b-fab8-4158-b9bb-95c4db32658e,network=Network(cb8c9bb1-a885-486d-aa6a-de600bc01c2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb5a953b-fa')
Apr 14 00:23:22 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] calling os-brick to detach iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 00:23:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, {'target_iqn': 'iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BcLTtdGe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:23:22 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:23:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:23:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:23:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:23:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:23:22 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[72574b03-64f1-43be-8b5a-fe351d42ab4f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:23:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 00:23:22 user nova-compute[82479]: No targets found.
Apr 14 00:23:22 user nova-compute[82479]: iSNS:
Apr 14 00:23:22 user nova-compute[82479]: No targets found.
Apr 14 00:23:22 user nova-compute[82479]: STATIC:
Apr 14 00:23:22 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc
Apr 14 00:23:22 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:23:22 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:23:22 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3
Apr 14 00:23:22 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:23:22 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:23:22 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9
Apr 14 00:23:22 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:23:22 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:23:22 user nova-compute[82479]: FIRMWARE:
Apr 14 00:23:22 user nova-compute[82479]: No targets found.
Apr 14 00:23:22 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:23:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 00:23:22 user nova-compute[82479]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 00:23:22 user nova-compute[82479]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82479) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 00:23:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3', 0)] {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 00:23:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:23:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:23:22 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d63d9d2-fd01-490e-8b63-7308d3e5ea4f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:23:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:23:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:23:22 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af8500b-fbb5-4ca6-994f-672903a15507]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:23:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:23:22 user nova-compute[82479]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 (non-flash)
Apr 14 00:23:22 user nova-compute[82479]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 (non-flash)
Apr 14 00:23:22 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:23:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:23:22 user nova-compute[82479]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 (non-flash)
Apr 14 00:23:22 user nova-compute[82479]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 (non-flash)
Apr 14 00:23:22 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:23:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f333821b250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3'): ({'sde'}, set())}) {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 00:23:22 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Removing single pathed devices sde {{(pid=82479) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 00:23:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:23:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:23:22 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f94e9b8-cb2c-49b0-b655-5abcc8d50bf2]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:23:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:23:23 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:23:23 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a22d811-3f9c-45a7-a9bf-4ba6f366e92b]: (4, ('ok\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:23:23 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Flushing IO for device /dev/sde {{(pid=82479) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 00:23:23 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:23:23 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:23:23 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b911acc-11cf-4e7a-9108-38e7ea3a2454]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:23:23 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=82479) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 00:23:23 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:23:23 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.037s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:23:23 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[12014292-aebf-4e84-b558-c80de2bfebba]: (4, ('1', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:23:23 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 00:23:23 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] SCSI volumes sde have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 00:23:23 user nova-compute[82479]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO4dc4f62-d6ae34e51c0cba65', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_4dc4f62', '/dev/disk/by-id/scsi-26436616533346535') {{(pid=93289) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 14 00:23:23 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[85fd9237-f138-4fab-a70b-5369232a1aca]: (4, None) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:23:23 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3')] {{(pid=82479) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 00:23:23 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:23:23 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:23:23 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[e414caa7-7198-44b1-83e3-ff2480728b29]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:23:23 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:23:23 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 -p 172.16.0.220:3260 --logout {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:23:23 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:23:23 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[48aa1428-4b81-4b97-924e-a14cba731509]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:23:23 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3, portal: 172.16.0.220,3260]
Apr 14 00:23:23 user nova-compute[82479]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3, portal: 172.16.0.220,3260] successful.
Apr 14 00:23:23 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:23:23 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 -p 172.16.0.220:3260 --op delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:23:23 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:23:23 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0576a08-519d-428a-af1e-39a6b23fd45f]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:23:23 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:23:23 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:23:23 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] <== disconnect_volume: return (333ms) None {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:23:23 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Disconnected iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 00:23:23 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] skipping disk /dev/sde (vda) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:23:24 user nova-compute[82479]: DEBUG nova.network.neutron [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Port db5a953b-fab8-4158-b9bb-95c4db32658e binding to destination host user is already ACTIVE {{(pid=82479) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 14 00:23:24 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "a1f2d364-908f-41c6-8e0c-df376a5d14f1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:23:24 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "a1f2d364-908f-41c6-8e0c-df376a5d14f1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:23:24 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "a1f2d364-908f-41c6-8e0c-df376a5d14f1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:23:24 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "refresh_cache-a1f2d364-908f-41c6-8e0c-df376a5d14f1" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:23:24 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquired lock "refresh_cache-a1f2d364-908f-41c6-8e0c-df376a5d14f1" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:23:24 user nova-compute[82479]: DEBUG nova.network.neutron [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 00:23:24 user nova-compute[82479]: DEBUG nova.compute.manager [req-b5e7e09b-4f54-43ee-a05c-6c4c0531f748 req-fe405700-c334-42c5-a42a-8ebd5b7ccd40 service nova] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Received event network-vif-plugged-db5a953b-fab8-4158-b9bb-95c4db32658e {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:23:24 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-b5e7e09b-4f54-43ee-a05c-6c4c0531f748 req-fe405700-c334-42c5-a42a-8ebd5b7ccd40 service nova] Acquiring lock "a1f2d364-908f-41c6-8e0c-df376a5d14f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:23:24 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-b5e7e09b-4f54-43ee-a05c-6c4c0531f748 req-fe405700-c334-42c5-a42a-8ebd5b7ccd40 service nova] Lock "a1f2d364-908f-41c6-8e0c-df376a5d14f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:23:24 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-b5e7e09b-4f54-43ee-a05c-6c4c0531f748 req-fe405700-c334-42c5-a42a-8ebd5b7ccd40 service nova] Lock "a1f2d364-908f-41c6-8e0c-df376a5d14f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:23:24 user nova-compute[82479]: DEBUG nova.compute.manager [req-b5e7e09b-4f54-43ee-a05c-6c4c0531f748 req-fe405700-c334-42c5-a42a-8ebd5b7ccd40 service nova] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] No waiting events found dispatching network-vif-plugged-db5a953b-fab8-4158-b9bb-95c4db32658e {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:23:24 user nova-compute[82479]: WARNING nova.compute.manager [req-b5e7e09b-4f54-43ee-a05c-6c4c0531f748 req-fe405700-c334-42c5-a42a-8ebd5b7ccd40 service nova] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Received unexpected event network-vif-plugged-db5a953b-fab8-4158-b9bb-95c4db32658e for instance with vm_state active and task_state resize_migrated.
Apr 14 00:23:24 user nova-compute[82479]: DEBUG nova.network.neutron [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Updating instance_info_cache with network_info: [{"id": "db5a953b-fab8-4158-b9bb-95c4db32658e", "address": "fa:16:3e:16:63:e8", "network": {"id": "cb8c9bb1-a885-486d-aa6a-de600bc01c2e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1676259779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8663ccad9047f4b11b9ae0646c287a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb5a953b-fa", "ovs_interfaceid": "db5a953b-fab8-4158-b9bb-95c4db32658e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:23:24 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Releasing lock "refresh_cache-a1f2d364-908f-41c6-8e0c-df376a5d14f1" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:23:24 user nova-compute[82479]: DEBUG os_brick.utils [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:23:24 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:23:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:23:25 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb07e42f-132c-4c27-b655-5597e6c006ce]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fec92fcfdd3\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:23:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:23:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:23:25 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[5260f249-dba8-4787-999b-14b71d725389]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:23:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:23:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:23:25 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d9aca4-d731-4d6b-b42c-11ee67eac828]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:23:25 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[30542d66-4918-4e56-aa73-b6858b577be8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:23:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Running cmd (subprocess): nvme version {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:23:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] 'nvme version' failed. Not Retrying. {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:23:25 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.nvmeof [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] nvme not present on system {{(pid=82479) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 00:23:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:23:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:23:25 user nova-compute[82479]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 00:23:25 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb348bb-7d03-4053-b684-2a733da68bf6]: (4, '') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:23:25 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82479) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 00:23:25 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 00:23:25 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] LIGHTOS: no hostnqn found. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 00:23:25 user nova-compute[82479]: DEBUG os_brick.utils [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fec92fcfdd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:23:25 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:23:27 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:23:29 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Starting finish_migration {{(pid=82479) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11647}}
Apr 14 00:23:29 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Instance directory exists: not creating {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 00:23:29 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Creating image(s)
Apr 14 00:23:29 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Did not create local disks {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 00:23:29 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Ensure instance console log exists: /opt/stack/data/nova/instances/a1f2d364-908f-41c6-8e0c-df376a5d14f1/console.log {{(pid=82479) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 00:23:29 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:23:29 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:23:29 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:23:29 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Start _get_guest_xml network_info=[{"id": "db5a953b-fab8-4158-b9bb-95c4db32658e", "address": "fa:16:3e:16:63:e8", "network": {"id": "cb8c9bb1-a885-486d-aa6a-de600bc01c2e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1676259779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1676259779-network", "vif_mac": "fa:16:3e:16:63:e8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8663ccad9047f4b11b9ae0646c287a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb5a953b-fa", "ovs_interfaceid": "db5a953b-fab8-4158-b9bb-95c4db32658e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': True, 'attachment_id': 'bdc31db9-2b5e-49a1-88c3-b26415140a22', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BcLTtdGe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'a1f2d364-908f-41c6-8e0c-df376a5d14f1', 'attached_at': '2023-04-14T00:23:30.000000', 'detached_at': '', 'volume_id': '7056196a-d087-4a9b-a3c8-350b13e6d2c3', 'serial': '7056196a-d087-4a9b-a3c8-350b13e6d2c3'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 00:23:29 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:23:29 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:23:29 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82479) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 00:23:29 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T00:02:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=192,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 00:23:29 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Flavor limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 00:23:29 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Image limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 00:23:29 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Flavor pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 00:23:29 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Image pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 00:23:29 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 00:23:29 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 00:23:29 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 00:23:29 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Got 1 possible topologies {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 00:23:29 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 00:23:29 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 00:23:29 user nova-compute[82479]: DEBUG nova.objects.instance [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lazy-loading 'vcpu_model' on Instance uuid a1f2d364-908f-41c6-8e0c-df376a5d14f1 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:23:29 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Calling os-brick to attach iSCSI Volume {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 00:23:29 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BcLTtdGe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:23:29 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:23:29 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:23:29 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:23:29 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:23:29 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:23:29 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:23:29 user nova-compute[82479]: INFO os_brick.initiator.connectors.iscsi [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 00:23:29 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 -p 172.16.0.220:3260 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:23:29 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:23:29 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[887c38a9-825d-4cea-93ef-3759f5011f86]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:23:29 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 00:23:29 user nova-compute[82479]:  {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:23:29 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 -p 172.16.0.220:3260 --interface default --op new {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:23:29 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:23:29 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa9b16a-d0d3-4c1e-a322-4281d348496b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3] added\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:23:29 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3] added
Apr 14 00:23:29 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:23:29 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:23:29 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:23:29 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[8069ed2e-bb55-4a93-a5ec-fc2093bc2e78]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:23:29 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:23:29 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:23:30 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:23:30 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b31133-3c19-4ae1-8901-ae6b2b0c4fc2]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:23:30 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:23:30 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BcLTtdGe {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:23:30 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BcLTtdGe" returned: 0 in 0.024s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:23:30 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbcbaa52-3a09-4805-bfae-6af88b674637]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:23:30 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BcLTtdGe'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:23:30 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:23:30 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:23:30 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e09220-4e2a-4114-a272-5c9fc6a2d38b]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:23:30 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:23:30 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:23:30 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:23:30 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a97f62-b8da-498a-8cb0-baca70c6cae9]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:23:30 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:23:30 user nova-compute[82479]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 (non-flash)
Apr 14 00:23:30 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:23:30 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:23:30 user nova-compute[82479]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 (non-flash)
Apr 14 00:23:30 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:23:30 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 -p 172.16.0.220:3260 --login {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:23:30 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:23:30 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[b424775b-2612-4eb0-b136-52c1894d0fa7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:23:30 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3, portal: 172.16.0.220,3260]
Apr 14 00:23:30 user nova-compute[82479]: Login to [iface: default, target: iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3, portal: 172.16.0.220,3260] successful.
Apr 14 00:23:30 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:23:30 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:23:30 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:23:30 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[73deba77-2fe9-4daf-9871-7b735892bf65]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:23:30 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:23:30 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:23:30 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:23:30 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[761e3d04-a36b-4e2e-9232-cef12f5c165f]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:23:30 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:23:30 user nova-compute[82479]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 (non-flash)
Apr 14 00:23:30 user nova-compute[82479]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 (non-flash)
Apr 14 00:23:30 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:23:30 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:23:30 user nova-compute[82479]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 (non-flash)
Apr 14 00:23:30 user nova-compute[82479]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 (non-flash)
Apr 14 00:23:30 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:23:30 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:23:30 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Connected to 172.16.0.220:3260 {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 00:23:30 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] HCTL ('35', '-', '-', 0) found on session 36 with lun 0 {{(pid=82479) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 00:23:30 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=82479) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 00:23:30 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:23:30 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:23:30 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[88727706-a8fa-405a-bc92-0b0d2befb6e9]: (4, ('- - 0', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:23:30 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Searching for a device in session 36 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=82479) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 00:23:30 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BcLTtdGe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 00:23:31 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:23:31 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '26436616533346535', 'path': '/dev/sdd'} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:23:31 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26436616533346535', 'path': '/dev/sdd'} {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 00:23:31 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:21:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1594608317',display_name='tempest-ServerActionsTestJSON-server-1594608317',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1594608317',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD8E1mkrqLo3jsCiJcIvha4CNzW2T6/HQ38hZ5dGaGtUghmrHejTJlAuKgmy6xusLbaAzGTrJCKVkdgQ5v0CqCqGeNMDA89aLJgLl5KHn3gvI39SkbPja84HarSvbQbbXg==',key_name='tempest-keypair-1040271550',keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:21:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='bf8663ccad9047f4b11b9ae0646c287a',ramdisk_id='',reservation_id='r-w08m23lo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-948553482',owner_user_name='tempest-ServerActionsTestJSON-948553482-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T00:23:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d86662f2c7648daad87118b7e9f757c',uuid=a1f2d364-908f-41c6-8e0c-df376a5d14f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "db5a953b-fab8-4158-b9bb-95c4db32658e", "address": "fa:16:3e:16:63:e8", "network": {"id": "cb8c9bb1-a885-486d-aa6a-de600bc01c2e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1676259779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1676259779-network", "vif_mac": "fa:16:3e:16:63:e8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8663ccad9047f4b11b9ae0646c287a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb5a953b-fa", "ovs_interfaceid": "db5a953b-fab8-4158-b9bb-95c4db32658e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82479) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 00:23:31 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Converting VIF {"id": "db5a953b-fab8-4158-b9bb-95c4db32658e", "address": "fa:16:3e:16:63:e8", "network": {"id": "cb8c9bb1-a885-486d-aa6a-de600bc01c2e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1676259779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1676259779-network", "vif_mac": "fa:16:3e:16:63:e8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8663ccad9047f4b11b9ae0646c287a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb5a953b-fa", "ovs_interfaceid": "db5a953b-fab8-4158-b9bb-95c4db32658e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:23:31 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:63:e8,bridge_name='br-int',has_traffic_filtering=True,id=db5a953b-fab8-4158-b9bb-95c4db32658e,network=Network(cb8c9bb1-a885-486d-aa6a-de600bc01c2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb5a953b-fa') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:23:31 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] End _get_guest_xml xml=<domain type="kvm">
Apr 14 00:23:31 user nova-compute[82479]:   <uuid>a1f2d364-908f-41c6-8e0c-df376a5d14f1</uuid>
Apr 14 00:23:31 user nova-compute[82479]:   <name>instance-00000021</name>
Apr 14 00:23:31 user nova-compute[82479]:   <memory>196608</memory>
Apr 14 00:23:31 user nova-compute[82479]:   <vcpu>1</vcpu>
Apr 14 00:23:31 user nova-compute[82479]:   <metadata>
Apr 14 00:23:31 user nova-compute[82479]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 00:23:31 user nova-compute[82479]:       <nova:package version="0.0.0"/>
Apr 14 00:23:31 user nova-compute[82479]:       <nova:name>tempest-ServerActionsTestJSON-server-1594608317</nova:name>
Apr 14 00:23:31 user nova-compute[82479]:       <nova:creationTime>2023-04-14 00:23:29</nova:creationTime>
Apr 14 00:23:31 user nova-compute[82479]:       <nova:flavor name="m1.micro">
Apr 14 00:23:31 user nova-compute[82479]:         <nova:memory>192</nova:memory>
Apr 14 00:23:31 user nova-compute[82479]:         <nova:disk>1</nova:disk>
Apr 14 00:23:31 user nova-compute[82479]:         <nova:swap>0</nova:swap>
Apr 14 00:23:31 user nova-compute[82479]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 00:23:31 user nova-compute[82479]:         <nova:vcpus>1</nova:vcpus>
Apr 14 00:23:31 user nova-compute[82479]:       </nova:flavor>
Apr 14 00:23:31 user nova-compute[82479]:       <nova:owner>
Apr 14 00:23:31 user nova-compute[82479]:         <nova:user uuid="3d86662f2c7648daad87118b7e9f757c">tempest-ServerActionsTestJSON-948553482-project-member</nova:user>
Apr 14 00:23:31 user nova-compute[82479]:         <nova:project uuid="bf8663ccad9047f4b11b9ae0646c287a">tempest-ServerActionsTestJSON-948553482</nova:project>
Apr 14 00:23:31 user nova-compute[82479]:       </nova:owner>
Apr 14 00:23:31 user nova-compute[82479]:       <nova:ports>
Apr 14 00:23:31 user nova-compute[82479]:         <nova:port uuid="db5a953b-fab8-4158-b9bb-95c4db32658e">
Apr 14 00:23:31 user nova-compute[82479]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 14 00:23:31 user nova-compute[82479]:         </nova:port>
Apr 14 00:23:31 user nova-compute[82479]:       </nova:ports>
Apr 14 00:23:31 user nova-compute[82479]:     </nova:instance>
Apr 14 00:23:31 user nova-compute[82479]:   </metadata>
Apr 14 00:23:31 user nova-compute[82479]:   <sysinfo type="smbios">
Apr 14 00:23:31 user nova-compute[82479]:     <system>
Apr 14 00:23:31 user nova-compute[82479]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 00:23:31 user nova-compute[82479]:       <entry name="product">OpenStack Nova</entry>
Apr 14 00:23:31 user nova-compute[82479]:       <entry name="version">0.0.0</entry>
Apr 14 00:23:31 user nova-compute[82479]:       <entry name="serial">a1f2d364-908f-41c6-8e0c-df376a5d14f1</entry>
Apr 14 00:23:31 user nova-compute[82479]:       <entry name="uuid">a1f2d364-908f-41c6-8e0c-df376a5d14f1</entry>
Apr 14 00:23:31 user nova-compute[82479]:       <entry name="family">Virtual Machine</entry>
Apr 14 00:23:31 user nova-compute[82479]:     </system>
Apr 14 00:23:31 user nova-compute[82479]:   </sysinfo>
Apr 14 00:23:31 user nova-compute[82479]:   <os>
Apr 14 00:23:31 user nova-compute[82479]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 00:23:31 user nova-compute[82479]:     <boot dev="hd"/>
Apr 14 00:23:31 user nova-compute[82479]:     <smbios mode="sysinfo"/>
Apr 14 00:23:31 user nova-compute[82479]:   </os>
Apr 14 00:23:31 user nova-compute[82479]:   <features>
Apr 14 00:23:31 user nova-compute[82479]:     <acpi/>
Apr 14 00:23:31 user nova-compute[82479]:     <apic/>
Apr 14 00:23:31 user nova-compute[82479]:     <vmcoreinfo/>
Apr 14 00:23:31 user nova-compute[82479]:   </features>
Apr 14 00:23:31 user nova-compute[82479]:   <clock offset="utc">
Apr 14 00:23:31 user nova-compute[82479]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 00:23:31 user nova-compute[82479]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 00:23:31 user nova-compute[82479]:     <timer name="hpet" present="no"/>
Apr 14 00:23:31 user nova-compute[82479]:   </clock>
Apr 14 00:23:31 user nova-compute[82479]:   <cpu mode="custom" match="exact">
Apr 14 00:23:31 user nova-compute[82479]:     <model>Nehalem</model>
Apr 14 00:23:31 user nova-compute[82479]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 00:23:31 user nova-compute[82479]:   </cpu>
Apr 14 00:23:31 user nova-compute[82479]:   <devices>
Apr 14 00:23:31 user nova-compute[82479]:     <disk type="block" device="disk">
Apr 14 00:23:31 user nova-compute[82479]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:23:31 user nova-compute[82479]:       <source dev="/dev/sdd"/>
Apr 14 00:23:31 user nova-compute[82479]:       <target dev="vda" bus="virtio"/>
Apr 14 00:23:31 user nova-compute[82479]:       <serial>7056196a-d087-4a9b-a3c8-350b13e6d2c3</serial>
Apr 14 00:23:31 user nova-compute[82479]:     </disk>
Apr 14 00:23:31 user nova-compute[82479]:     <interface type="ethernet">
Apr 14 00:23:31 user nova-compute[82479]:       <mac address="fa:16:3e:16:63:e8"/>
Apr 14 00:23:31 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:23:31 user nova-compute[82479]:       <mtu size="1442"/>
Apr 14 00:23:31 user nova-compute[82479]:       <target dev="tapdb5a953b-fa"/>
Apr 14 00:23:31 user nova-compute[82479]:     </interface>
Apr 14 00:23:31 user nova-compute[82479]:     <serial type="pty">
Apr 14 00:23:31 user nova-compute[82479]:       <log file="/opt/stack/data/nova/instances/a1f2d364-908f-41c6-8e0c-df376a5d14f1/console.log" append="off"/>
Apr 14 00:23:31 user nova-compute[82479]:     </serial>
Apr 14 00:23:31 user nova-compute[82479]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 00:23:31 user nova-compute[82479]:     <video>
Apr 14 00:23:31 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:23:31 user nova-compute[82479]:     </video>
Apr 14 00:23:31 user nova-compute[82479]:     <rng model="virtio">
Apr 14 00:23:31 user nova-compute[82479]:       <backend model="random">/dev/urandom</backend>
Apr 14 00:23:31 user nova-compute[82479]:     </rng>
Apr 14 00:23:31 user nova-compute[82479]:     <controller type="usb" index="0" model="none"/>
Apr 14 00:23:31 user nova-compute[82479]:     <memballoon model="virtio">
Apr 14 00:23:31 user nova-compute[82479]:       <stats period="10"/>
Apr 14 00:23:31 user nova-compute[82479]:     </memballoon>
Apr 14 00:23:31 user nova-compute[82479]:   </devices>
Apr 14 00:23:31 user nova-compute[82479]: </domain>
Apr 14 00:23:31 user nova-compute[82479]:  {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 00:23:31 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:21:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1594608317',display_name='tempest-ServerActionsTestJSON-server-1594608317',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1594608317',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD8E1mkrqLo3jsCiJcIvha4CNzW2T6/HQ38hZ5dGaGtUghmrHejTJlAuKgmy6xusLbaAzGTrJCKVkdgQ5v0CqCqGeNMDA89aLJgLl5KHn3gvI39SkbPja84HarSvbQbbXg==',key_name='tempest-keypair-1040271550',keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:21:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='bf8663ccad9047f4b11b9ae0646c287a',ramdisk_id='',reservation_id='r-w08m23lo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-948553482',owner_user_name='tempest-ServerActionsTestJSON-948553482-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T00:23:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d86662f2c7648daad87118b7e9f757c',uuid=a1f2d364-908f-41c6-8e0c-df376a5d14f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "db5a953b-fab8-4158-b9bb-95c4db32658e", "address": "fa:16:3e:16:63:e8", "network": {"id": "cb8c9bb1-a885-486d-aa6a-de600bc01c2e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1676259779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1676259779-network", "vif_mac": "fa:16:3e:16:63:e8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8663ccad9047f4b11b9ae0646c287a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb5a953b-fa", "ovs_interfaceid": "db5a953b-fab8-4158-b9bb-95c4db32658e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 00:23:31 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Converting VIF {"id": "db5a953b-fab8-4158-b9bb-95c4db32658e", "address": "fa:16:3e:16:63:e8", "network": {"id": "cb8c9bb1-a885-486d-aa6a-de600bc01c2e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1676259779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1676259779-network", "vif_mac": "fa:16:3e:16:63:e8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8663ccad9047f4b11b9ae0646c287a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb5a953b-fa", "ovs_interfaceid": "db5a953b-fab8-4158-b9bb-95c4db32658e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:23:31 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:63:e8,bridge_name='br-int',has_traffic_filtering=True,id=db5a953b-fab8-4158-b9bb-95c4db32658e,network=Network(cb8c9bb1-a885-486d-aa6a-de600bc01c2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb5a953b-fa') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:23:31 user nova-compute[82479]: DEBUG os_vif [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:63:e8,bridge_name='br-int',has_traffic_filtering=True,id=db5a953b-fab8-4158-b9bb-95c4db32658e,network=Network(cb8c9bb1-a885-486d-aa6a-de600bc01c2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb5a953b-fa') {{(pid=82479) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 00:23:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:23:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:23:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 00:23:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:23:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdb5a953b-fa, may_exist=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:23:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdb5a953b-fa, col_values=(('external_ids', {'iface-id': 'db5a953b-fab8-4158-b9bb-95c4db32658e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:63:e8', 'vm-uuid': 'a1f2d364-908f-41c6-8e0c-df376a5d14f1'}),)) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:23:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:23:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:23:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:23:31 user nova-compute[82479]: INFO os_vif [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:63:e8,bridge_name='br-int',has_traffic_filtering=True,id=db5a953b-fab8-4158-b9bb-95c4db32658e,network=Network(cb8c9bb1-a885-486d-aa6a-de600bc01c2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb5a953b-fa')
Apr 14 00:23:31 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:23:31 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] No VIF found with MAC fa:16:3e:16:63:e8, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:23:32 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:23:32 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:23:32 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:23:33 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:23:33 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:23:33 user nova-compute[82479]: DEBUG nova.compute.manager [req-b8b439ff-2b15-476e-8fb9-e02a1b773501 req-f3ae67b4-4aff-4aac-8de2-30dc44735443 service nova] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Received event network-vif-plugged-db5a953b-fab8-4158-b9bb-95c4db32658e {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:23:33 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-b8b439ff-2b15-476e-8fb9-e02a1b773501 req-f3ae67b4-4aff-4aac-8de2-30dc44735443 service nova] Acquiring lock "a1f2d364-908f-41c6-8e0c-df376a5d14f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:23:33 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-b8b439ff-2b15-476e-8fb9-e02a1b773501 req-f3ae67b4-4aff-4aac-8de2-30dc44735443 service nova] Lock "a1f2d364-908f-41c6-8e0c-df376a5d14f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:23:33 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-b8b439ff-2b15-476e-8fb9-e02a1b773501 req-f3ae67b4-4aff-4aac-8de2-30dc44735443 service nova] Lock "a1f2d364-908f-41c6-8e0c-df376a5d14f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:23:33 user nova-compute[82479]: DEBUG nova.compute.manager [req-b8b439ff-2b15-476e-8fb9-e02a1b773501 req-f3ae67b4-4aff-4aac-8de2-30dc44735443 service nova] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] No waiting events found dispatching network-vif-plugged-db5a953b-fab8-4158-b9bb-95c4db32658e {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:23:33 user nova-compute[82479]: WARNING nova.compute.manager [req-b8b439ff-2b15-476e-8fb9-e02a1b773501 req-f3ae67b4-4aff-4aac-8de2-30dc44735443 service nova] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Received unexpected event network-vif-plugged-db5a953b-fab8-4158-b9bb-95c4db32658e for instance with vm_state active and task_state resize_finish.
Apr 14 00:23:35 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Removed pending event for a1f2d364-908f-41c6-8e0c-df376a5d14f1 due to event {{(pid=82479) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 00:23:35 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681431815.1315746, a1f2d364-908f-41c6-8e0c-df376a5d14f1 => Resumed> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:23:35 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] VM Resumed (Lifecycle Event)
Apr 14 00:23:35 user nova-compute[82479]: DEBUG nova.compute.manager [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Instance event wait completed in 0 seconds for  {{(pid=82479) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 00:23:35 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Instance running successfully.
Apr 14 00:23:35 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Failed to set time: agent not configured {{(pid=82479) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Apr 14 00:23:35 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-764dea3d-0de2-484f-b44b-a3da1002de09 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] finish_migration finished successfully. {{(pid=82479) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11742}}
Apr 14 00:23:35 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:23:35 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:23:35 user nova-compute[82479]: DEBUG nova.compute.manager [req-8d87f768-6d74-4297-9ad4-0a2c644ac284 req-a518bf04-bbec-4854-bb47-5634d57e4a04 service nova] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Received event network-vif-plugged-db5a953b-fab8-4158-b9bb-95c4db32658e {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:23:35 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-8d87f768-6d74-4297-9ad4-0a2c644ac284 req-a518bf04-bbec-4854-bb47-5634d57e4a04 service nova] Acquiring lock "a1f2d364-908f-41c6-8e0c-df376a5d14f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:23:35 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-8d87f768-6d74-4297-9ad4-0a2c644ac284 req-a518bf04-bbec-4854-bb47-5634d57e4a04 service nova] Lock "a1f2d364-908f-41c6-8e0c-df376a5d14f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:23:35 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-8d87f768-6d74-4297-9ad4-0a2c644ac284 req-a518bf04-bbec-4854-bb47-5634d57e4a04 service nova] Lock "a1f2d364-908f-41c6-8e0c-df376a5d14f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:23:35 user nova-compute[82479]: DEBUG nova.compute.manager [req-8d87f768-6d74-4297-9ad4-0a2c644ac284 req-a518bf04-bbec-4854-bb47-5634d57e4a04 service nova] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] No waiting events found dispatching network-vif-plugged-db5a953b-fab8-4158-b9bb-95c4db32658e {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:23:35 user nova-compute[82479]: WARNING nova.compute.manager [req-8d87f768-6d74-4297-9ad4-0a2c644ac284 req-a518bf04-bbec-4854-bb47-5634d57e4a04 service nova] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Received unexpected event network-vif-plugged-db5a953b-fab8-4158-b9bb-95c4db32658e for instance with vm_state active and task_state resize_finish.
Apr 14 00:23:35 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 14 00:23:35 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681431815.134066, a1f2d364-908f-41c6-8e0c-df376a5d14f1 => Started> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:23:35 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] VM Started (Lifecycle Event)
Apr 14 00:23:35 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:23:35 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:23:35 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 14 00:23:36 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:23:36 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:23:39 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-cd79718c-79b1-4678-88b0-b90942b1731d tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "2793d412-f405-4452-8e46-c192e3c92ccb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:23:39 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-cd79718c-79b1-4678-88b0-b90942b1731d tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "2793d412-f405-4452-8e46-c192e3c92ccb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:23:39 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-cd79718c-79b1-4678-88b0-b90942b1731d tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "2793d412-f405-4452-8e46-c192e3c92ccb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:23:39 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-cd79718c-79b1-4678-88b0-b90942b1731d tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "2793d412-f405-4452-8e46-c192e3c92ccb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:23:39 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-cd79718c-79b1-4678-88b0-b90942b1731d tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "2793d412-f405-4452-8e46-c192e3c92ccb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:23:39 user nova-compute[82479]: INFO nova.compute.manager [None req-cd79718c-79b1-4678-88b0-b90942b1731d tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Terminating instance
Apr 14 00:23:39 user nova-compute[82479]: DEBUG nova.compute.manager [None req-cd79718c-79b1-4678-88b0-b90942b1731d tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Start destroying the instance on the hypervisor. {{(pid=82479) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 00:23:40 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:23:40 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:23:40 user nova-compute[82479]: DEBUG nova.compute.manager [req-82b5e03e-755e-4724-914d-2c3de867fd1f req-79c33825-46d9-4d7f-8dcb-c95d9c278e11 service nova] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Received event network-vif-unplugged-47e07f85-3946-4934-a2ec-c9c77ccc3761 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:23:40 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-82b5e03e-755e-4724-914d-2c3de867fd1f req-79c33825-46d9-4d7f-8dcb-c95d9c278e11 service nova] Acquiring lock "2793d412-f405-4452-8e46-c192e3c92ccb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:23:40 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-82b5e03e-755e-4724-914d-2c3de867fd1f req-79c33825-46d9-4d7f-8dcb-c95d9c278e11 service nova] Lock "2793d412-f405-4452-8e46-c192e3c92ccb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:23:40 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-82b5e03e-755e-4724-914d-2c3de867fd1f req-79c33825-46d9-4d7f-8dcb-c95d9c278e11 service nova] Lock "2793d412-f405-4452-8e46-c192e3c92ccb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:23:40 user nova-compute[82479]: DEBUG nova.compute.manager [req-82b5e03e-755e-4724-914d-2c3de867fd1f req-79c33825-46d9-4d7f-8dcb-c95d9c278e11 service nova] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] No waiting events found dispatching network-vif-unplugged-47e07f85-3946-4934-a2ec-c9c77ccc3761 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:23:40 user nova-compute[82479]: DEBUG nova.compute.manager [req-82b5e03e-755e-4724-914d-2c3de867fd1f req-79c33825-46d9-4d7f-8dcb-c95d9c278e11 service nova] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Received event network-vif-unplugged-47e07f85-3946-4934-a2ec-c9c77ccc3761 for instance with task_state deleting. {{(pid=82479) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 00:23:40 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:23:40 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:23:40 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:23:40 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Instance destroyed successfully.
Apr 14 00:23:40 user nova-compute[82479]: DEBUG nova.objects.instance [None req-cd79718c-79b1-4678-88b0-b90942b1731d tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lazy-loading 'resources' on Instance uuid 2793d412-f405-4452-8e46-c192e3c92ccb {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:23:40 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-cd79718c-79b1-4678-88b0-b90942b1731d tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:14:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1903424874',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1903424874',id=25,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:14:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ba3f111e24414976beddba7ef90c4793',ramdisk_id='',reservation_id='r-imvsl09i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1545234843',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T00:16:15Z,user_data=None,user_id='90bad96535c3453792982c5acab9dbc6',uuid=2793d412-f405-4452-8e46-c192e3c92ccb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "47e07f85-3946-4934-a2ec-c9c77ccc3761", "address": "fa:16:3e:7b:b8:78", "network": {"id": "491696ea-38ef-4c19-9d94-a61223c1fa00", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1323121698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3f111e24414976beddba7ef90c4793", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e07f85-39", "ovs_interfaceid": "47e07f85-3946-4934-a2ec-c9c77ccc3761", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 00:23:40 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-cd79718c-79b1-4678-88b0-b90942b1731d tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Converting VIF {"id": "47e07f85-3946-4934-a2ec-c9c77ccc3761", "address": "fa:16:3e:7b:b8:78", "network": {"id": "491696ea-38ef-4c19-9d94-a61223c1fa00", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1323121698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3f111e24414976beddba7ef90c4793", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e07f85-39", "ovs_interfaceid": "47e07f85-3946-4934-a2ec-c9c77ccc3761", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:23:40 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-cd79718c-79b1-4678-88b0-b90942b1731d tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:b8:78,bridge_name='br-int',has_traffic_filtering=True,id=47e07f85-3946-4934-a2ec-c9c77ccc3761,network=Network(491696ea-38ef-4c19-9d94-a61223c1fa00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47e07f85-39') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:23:40 user nova-compute[82479]: DEBUG os_vif [None req-cd79718c-79b1-4678-88b0-b90942b1731d tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:b8:78,bridge_name='br-int',has_traffic_filtering=True,id=47e07f85-3946-4934-a2ec-c9c77ccc3761,network=Network(491696ea-38ef-4c19-9d94-a61223c1fa00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47e07f85-39') {{(pid=82479) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 00:23:40 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:23:40 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap47e07f85-39, bridge=br-int, if_exists=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:23:40 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:23:40 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:23:40 user nova-compute[82479]: INFO os_vif [None req-cd79718c-79b1-4678-88b0-b90942b1731d tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:b8:78,bridge_name='br-int',has_traffic_filtering=True,id=47e07f85-3946-4934-a2ec-c9c77ccc3761,network=Network(491696ea-38ef-4c19-9d94-a61223c1fa00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47e07f85-39')
Apr 14 00:23:40 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-cd79718c-79b1-4678-88b0-b90942b1731d tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Deleting instance files /opt/stack/data/nova/instances/2793d412-f405-4452-8e46-c192e3c92ccb_del
Apr 14 00:23:40 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-cd79718c-79b1-4678-88b0-b90942b1731d tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Deletion of /opt/stack/data/nova/instances/2793d412-f405-4452-8e46-c192e3c92ccb_del complete
Apr 14 00:23:40 user nova-compute[82479]: INFO nova.compute.manager [None req-cd79718c-79b1-4678-88b0-b90942b1731d tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Took 0.72 seconds to destroy the instance on the hypervisor.
Apr 14 00:23:40 user nova-compute[82479]: DEBUG oslo.service.loopingcall [None req-cd79718c-79b1-4678-88b0-b90942b1731d tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82479) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 00:23:40 user nova-compute[82479]: DEBUG nova.compute.manager [-] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Deallocating network for instance {{(pid=82479) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 00:23:40 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] deallocate_for_instance() {{(pid=82479) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 00:23:41 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Updating instance_info_cache with network_info: [] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:23:41 user nova-compute[82479]: DEBUG nova.compute.manager [req-3c6cc3da-99d1-4e2b-a5d4-5a26538f952f req-3c843438-6d18-4432-953f-79e9cedc777f service nova] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Received event network-vif-deleted-47e07f85-3946-4934-a2ec-c9c77ccc3761 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:23:41 user nova-compute[82479]: INFO nova.compute.manager [req-3c6cc3da-99d1-4e2b-a5d4-5a26538f952f req-3c843438-6d18-4432-953f-79e9cedc777f service nova] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Neutron deleted interface 47e07f85-3946-4934-a2ec-c9c77ccc3761; detaching it from the instance and deleting it from the info cache
Apr 14 00:23:41 user nova-compute[82479]: DEBUG nova.network.neutron [req-3c6cc3da-99d1-4e2b-a5d4-5a26538f952f req-3c843438-6d18-4432-953f-79e9cedc777f service nova] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Updating instance_info_cache with network_info: [] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:23:41 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Took 0.60 seconds to deallocate network for instance.
Apr 14 00:23:41 user nova-compute[82479]: DEBUG nova.compute.manager [req-3c6cc3da-99d1-4e2b-a5d4-5a26538f952f req-3c843438-6d18-4432-953f-79e9cedc777f service nova] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Detach interface failed, port_id=47e07f85-3946-4934-a2ec-c9c77ccc3761, reason: Instance 2793d412-f405-4452-8e46-c192e3c92ccb could not be found. {{(pid=82479) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 00:23:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-cd79718c-79b1-4678-88b0-b90942b1731d tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:23:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-cd79718c-79b1-4678-88b0-b90942b1731d tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:23:41 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-cd79718c-79b1-4678-88b0-b90942b1731d tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:23:41 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-cd79718c-79b1-4678-88b0-b90942b1731d tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:23:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-cd79718c-79b1-4678-88b0-b90942b1731d tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.285s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:23:41 user nova-compute[82479]: INFO nova.scheduler.client.report [None req-cd79718c-79b1-4678-88b0-b90942b1731d tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Deleted allocations for instance 2793d412-f405-4452-8e46-c192e3c92ccb
Apr 14 00:23:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-cd79718c-79b1-4678-88b0-b90942b1731d tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "2793d412-f405-4452-8e46-c192e3c92ccb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.797s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:23:42 user nova-compute[82479]: DEBUG nova.compute.manager [req-60e2867a-9c49-430b-b182-f700f9590efa req-fa18c5fc-d210-464a-834d-e48b892e748c service nova] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Received event network-vif-plugged-47e07f85-3946-4934-a2ec-c9c77ccc3761 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:23:42 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-60e2867a-9c49-430b-b182-f700f9590efa req-fa18c5fc-d210-464a-834d-e48b892e748c service nova] Acquiring lock "2793d412-f405-4452-8e46-c192e3c92ccb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:23:42 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-60e2867a-9c49-430b-b182-f700f9590efa req-fa18c5fc-d210-464a-834d-e48b892e748c service nova] Lock "2793d412-f405-4452-8e46-c192e3c92ccb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:23:42 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-60e2867a-9c49-430b-b182-f700f9590efa req-fa18c5fc-d210-464a-834d-e48b892e748c service nova] Lock "2793d412-f405-4452-8e46-c192e3c92ccb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:23:42 user nova-compute[82479]: DEBUG nova.compute.manager [req-60e2867a-9c49-430b-b182-f700f9590efa req-fa18c5fc-d210-464a-834d-e48b892e748c service nova] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] No waiting events found dispatching network-vif-plugged-47e07f85-3946-4934-a2ec-c9c77ccc3761 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:23:42 user nova-compute[82479]: WARNING nova.compute.manager [req-60e2867a-9c49-430b-b182-f700f9590efa req-fa18c5fc-d210-464a-834d-e48b892e748c service nova] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Received unexpected event network-vif-plugged-47e07f85-3946-4934-a2ec-c9c77ccc3761 for instance with vm_state deleted and task_state None.
Apr 14 00:23:45 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:23:50 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:23:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:23:53 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:23:53 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Starting heal instance info cache {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 00:23:53 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "refresh_cache-ade24ab6-1a93-4449-b5e9-ec3de357665b" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:23:53 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquired lock "refresh_cache-ade24ab6-1a93-4449-b5e9-ec3de357665b" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:23:53 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Forcefully refreshing network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 00:23:54 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Updating instance_info_cache with network_info: [{"id": "11344eed-48f5-49c5-a770-c9c298f7185e", "address": "fa:16:3e:cd:dc:0b", "network": {"id": "08106daa-a35e-4376-8c46-2b4baa51c6ea", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321730350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524265958bd24a6cb94aa3115eb2b6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11344eed-48", "ovs_interfaceid": "11344eed-48f5-49c5-a770-c9c298f7185e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:23:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Releasing lock "refresh_cache-ade24ab6-1a93-4449-b5e9-ec3de357665b" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:23:54 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Updated the network info_cache for instance {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 00:23:54 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:23:55 user nova-compute[82479]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681431820.5601957, 2793d412-f405-4452-8e46-c192e3c92ccb => Stopped> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:23:55 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] VM Stopped (Lifecycle Event)
Apr 14 00:23:55 user nova-compute[82479]: DEBUG nova.compute.manager [None req-e337b9c9-dfc3-4b4a-84b7-d4f8bf4000e8 None None] [instance: 2793d412-f405-4452-8e46-c192e3c92ccb] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:23:55 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:23:56 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:23:56 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:23:59 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:24:00 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:24:00 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:24:00 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:24:01 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:24:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:24:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:24:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:24:01 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Auditing locally available compute resources for user (node: user) {{(pid=82479) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 00:24:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:24:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:24:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:24:02 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:24:02 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:24:02 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:24:02 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785033c7-e14b-418e-952a-248328b75d60/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:24:02 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785033c7-e14b-418e-952a-248328b75d60/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:24:02 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785033c7-e14b-418e-952a-248328b75d60/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:24:02 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785033c7-e14b-418e-952a-248328b75d60/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:24:02 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk.rescue --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:24:02 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:24:02 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk.rescue --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:24:02 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:24:02 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:24:02 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:24:02 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:24:02 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:24:02 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:24:03 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:24:03 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:24:03 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:24:03 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ade24ab6-1a93-4449-b5e9-ec3de357665b/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:24:03 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ade24ab6-1a93-4449-b5e9-ec3de357665b/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:24:03 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ade24ab6-1a93-4449-b5e9-ec3de357665b/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:24:03 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ade24ab6-1a93-4449-b5e9-ec3de357665b/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:24:03 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:24:04 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:24:04 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:24:04 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Hypervisor/Node resource view: name=user free_ram=8230MB free_disk=26.11600112915039GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82479) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 00:24:04 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:24:04 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:24:04 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Applying migration context for instance a1f2d364-908f-41c6-8e0c-df376a5d14f1 as it has an incoming, in-progress migration f76243a8-0e97-4f4a-84ee-d485a13c4ed4. Migration status is finished {{(pid=82479) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 14 00:24:04 user nova-compute[82479]: INFO nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Updating resource usage from migration f76243a8-0e97-4f4a-84ee-d485a13c4ed4
Apr 14 00:24:04 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 23718fd0-58b8-47f9-b1ef-a26a90741ecc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:24:04 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 17c6c147-fb62-4204-a416-792b94d3f7dd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:24:04 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:24:04 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:24:04 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance ade24ab6-1a93-4449-b5e9-ec3de357665b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:24:04 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 785033c7-e14b-418e-952a-248328b75d60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:24:04 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Migration f76243a8-0e97-4f4a-84ee-d485a13c4ed4 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 14 00:24:04 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance a1f2d364-908f-41c6-8e0c-df376a5d14f1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:24:04 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 00:24:04 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Final resource view: name=user phys_ram=16023MB used_ram=1600MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 00:24:04 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:24:04 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:24:04 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Compute_service record updated for user:user {{(pid=82479) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 00:24:04 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.414s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:24:05 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:24:06 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:24:06 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:24:06 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:24:06 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82479) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 00:24:10 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:24:10 user nova-compute[82479]: DEBUG nova.compute.manager [req-7196c8dd-1cb7-4be6-8745-2b332d1fb6d7 req-a1d9e24a-b94e-47dc-899f-1e85e42693aa service nova] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Received event network-changed-11344eed-48f5-49c5-a770-c9c298f7185e {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:24:10 user nova-compute[82479]: DEBUG nova.compute.manager [req-7196c8dd-1cb7-4be6-8745-2b332d1fb6d7 req-a1d9e24a-b94e-47dc-899f-1e85e42693aa service nova] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Refreshing instance network info cache due to event network-changed-11344eed-48f5-49c5-a770-c9c298f7185e. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:24:10 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-7196c8dd-1cb7-4be6-8745-2b332d1fb6d7 req-a1d9e24a-b94e-47dc-899f-1e85e42693aa service nova] Acquiring lock "refresh_cache-ade24ab6-1a93-4449-b5e9-ec3de357665b" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:24:10 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-7196c8dd-1cb7-4be6-8745-2b332d1fb6d7 req-a1d9e24a-b94e-47dc-899f-1e85e42693aa service nova] Acquired lock "refresh_cache-ade24ab6-1a93-4449-b5e9-ec3de357665b" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:24:10 user nova-compute[82479]: DEBUG nova.network.neutron [req-7196c8dd-1cb7-4be6-8745-2b332d1fb6d7 req-a1d9e24a-b94e-47dc-899f-1e85e42693aa service nova] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Refreshing network info cache for port 11344eed-48f5-49c5-a770-c9c298f7185e {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:24:11 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f15b1416-6cc9-4e60-b347-6b1e373d4137 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "ade24ab6-1a93-4449-b5e9-ec3de357665b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:24:11 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f15b1416-6cc9-4e60-b347-6b1e373d4137 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "ade24ab6-1a93-4449-b5e9-ec3de357665b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:24:11 user nova-compute[82479]: INFO nova.compute.manager [None req-f15b1416-6cc9-4e60-b347-6b1e373d4137 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Detaching volume 0c953a4d-d77b-4d17-bcad-ea49b45adbb9
Apr 14 00:24:11 user nova-compute[82479]: INFO nova.virt.block_device [None req-f15b1416-6cc9-4e60-b347-6b1e373d4137 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Attempting to driver detach volume 0c953a4d-d77b-4d17-bcad-ea49b45adbb9 from mountpoint /dev/vdb
Apr 14 00:24:11 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-f15b1416-6cc9-4e60-b347-6b1e373d4137 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Attempting to detach device vdb from instance ade24ab6-1a93-4449-b5e9-ec3de357665b from the persistent domain config. {{(pid=82479) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 00:24:11 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-f15b1416-6cc9-4e60-b347-6b1e373d4137 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 00:24:11 user nova-compute[82479]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:24:11 user nova-compute[82479]:   <source dev="/dev/sdb"/>
Apr 14 00:24:11 user nova-compute[82479]:   <target dev="vdb" bus="virtio"/>
Apr 14 00:24:11 user nova-compute[82479]:   <serial>0c953a4d-d77b-4d17-bcad-ea49b45adbb9</serial>
Apr 14 00:24:11 user nova-compute[82479]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 00:24:11 user nova-compute[82479]: </disk>
Apr 14 00:24:11 user nova-compute[82479]:  {{(pid=82479) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 00:24:11 user nova-compute[82479]: DEBUG nova.network.neutron [req-7196c8dd-1cb7-4be6-8745-2b332d1fb6d7 req-a1d9e24a-b94e-47dc-899f-1e85e42693aa service nova] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Updated VIF entry in instance network info cache for port 11344eed-48f5-49c5-a770-c9c298f7185e. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:24:11 user nova-compute[82479]: DEBUG nova.network.neutron [req-7196c8dd-1cb7-4be6-8745-2b332d1fb6d7 req-a1d9e24a-b94e-47dc-899f-1e85e42693aa service nova] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Updating instance_info_cache with network_info: [{"id": "11344eed-48f5-49c5-a770-c9c298f7185e", "address": "fa:16:3e:cd:dc:0b", "network": {"id": "08106daa-a35e-4376-8c46-2b4baa51c6ea", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321730350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524265958bd24a6cb94aa3115eb2b6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11344eed-48", "ovs_interfaceid": "11344eed-48f5-49c5-a770-c9c298f7185e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:24:11 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-f15b1416-6cc9-4e60-b347-6b1e373d4137 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Successfully detached device vdb from instance ade24ab6-1a93-4449-b5e9-ec3de357665b from the persistent domain config.
Apr 14 00:24:11 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-f15b1416-6cc9-4e60-b347-6b1e373d4137 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ade24ab6-1a93-4449-b5e9-ec3de357665b from the live domain config. {{(pid=82479) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 00:24:11 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-f15b1416-6cc9-4e60-b347-6b1e373d4137 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 00:24:11 user nova-compute[82479]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:24:11 user nova-compute[82479]:   <source dev="/dev/sdb"/>
Apr 14 00:24:11 user nova-compute[82479]:   <target dev="vdb" bus="virtio"/>
Apr 14 00:24:11 user nova-compute[82479]:   <serial>0c953a4d-d77b-4d17-bcad-ea49b45adbb9</serial>
Apr 14 00:24:11 user nova-compute[82479]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 00:24:11 user nova-compute[82479]: </disk>
Apr 14 00:24:11 user nova-compute[82479]:  {{(pid=82479) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 00:24:11 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-7196c8dd-1cb7-4be6-8745-2b332d1fb6d7 req-a1d9e24a-b94e-47dc-899f-1e85e42693aa service nova] Releasing lock "refresh_cache-ade24ab6-1a93-4449-b5e9-ec3de357665b" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:24:11 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:24:11 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Received event <DeviceRemovedEvent: 1681431851.6760087, ade24ab6-1a93-4449-b5e9-ec3de357665b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82479) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 00:24:11 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-f15b1416-6cc9-4e60-b347-6b1e373d4137 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ade24ab6-1a93-4449-b5e9-ec3de357665b {{(pid=82479) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 00:24:11 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-f15b1416-6cc9-4e60-b347-6b1e373d4137 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Successfully detached device vdb from instance ade24ab6-1a93-4449-b5e9-ec3de357665b from the live domain config.
Apr 14 00:24:11 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f15b1416-6cc9-4e60-b347-6b1e373d4137 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] calling os-brick to detach iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 00:24:11 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-f15b1416-6cc9-4e60-b347-6b1e373d4137 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, {'target_iqn': 'iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RxsEKbZB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:24:11 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-f15b1416-6cc9-4e60-b347-6b1e373d4137 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:24:11 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-f15b1416-6cc9-4e60-b347-6b1e373d4137 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:24:11 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-f15b1416-6cc9-4e60-b347-6b1e373d4137 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:24:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:24:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:24:11 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4a6ff2-6c23-46ce-82cc-6be43d848730]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:24:11 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-f15b1416-6cc9-4e60-b347-6b1e373d4137 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 00:24:11 user nova-compute[82479]: No targets found.
Apr 14 00:24:11 user nova-compute[82479]: iSNS:
Apr 14 00:24:11 user nova-compute[82479]: No targets found.
Apr 14 00:24:11 user nova-compute[82479]: STATIC:
Apr 14 00:24:11 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc
Apr 14 00:24:11 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:24:11 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:24:11 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3
Apr 14 00:24:11 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:24:11 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:24:11 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9
Apr 14 00:24:11 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:24:11 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:24:11 user nova-compute[82479]: FIRMWARE:
Apr 14 00:24:11 user nova-compute[82479]: No targets found.
Apr 14 00:24:11 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:24:11 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-f15b1416-6cc9-4e60-b347-6b1e373d4137 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 00:24:11 user nova-compute[82479]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 00:24:11 user nova-compute[82479]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82479) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 00:24:11 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-f15b1416-6cc9-4e60-b347-6b1e373d4137 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9', 0)] {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 00:24:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:24:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:24:11 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe4c9fe-30f2-493b-81c5-c9deef49e734]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:24:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:24:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:24:11 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a75d489-6293-42c1-96d2-964ffa3ea363]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:24:11 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-f15b1416-6cc9-4e60-b347-6b1e373d4137 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:24:11 user nova-compute[82479]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 (non-flash)
Apr 14 00:24:11 user nova-compute[82479]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 (non-flash)
Apr 14 00:24:11 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:24:11 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-f15b1416-6cc9-4e60-b347-6b1e373d4137 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:24:11 user nova-compute[82479]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 (non-flash)
Apr 14 00:24:11 user nova-compute[82479]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 (non-flash)
Apr 14 00:24:11 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:24:11 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-f15b1416-6cc9-4e60-b347-6b1e373d4137 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f33302cd2d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9'): ({'sdb'}, set())}) {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 00:24:11 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-f15b1416-6cc9-4e60-b347-6b1e373d4137 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Removing single pathed devices sdb {{(pid=82479) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 00:24:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:24:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:24:11 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fdd12ac-250b-4aa0-bd2c-341504f10a11]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:24:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:24:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:24:11 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f12c0e7-02e4-4aac-871c-97dd0091755d]: (4, ('ok\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:24:11 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-f15b1416-6cc9-4e60-b347-6b1e373d4137 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Flushing IO for device /dev/sdb {{(pid=82479) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 00:24:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:24:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:24:11 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[43857683-b67c-4984-a262-faecb6ab6702]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:24:11 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-f15b1416-6cc9-4e60-b347-6b1e373d4137 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82479) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 00:24:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:24:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:24:11 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[192a2daa-1ee6-4043-a4d6-14dbddae148c]: (4, ('1', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:24:11 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-f15b1416-6cc9-4e60-b347-6b1e373d4137 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 00:24:11 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-f15b1416-6cc9-4e60-b347-6b1e373d4137 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] SCSI volumes sdb have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 00:24:11 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-f15b1416-6cc9-4e60-b347-6b1e373d4137 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9')] {{(pid=82479) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 00:24:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:24:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:24:11 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a370d08-0812-4eb2-bf92-3fd93df4c485]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:24:11 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-f15b1416-6cc9-4e60-b347-6b1e373d4137 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:24:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 -p 172.16.0.220:3260 --logout {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:24:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:24:11 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4d7962-0332-4b4c-be59-1282674adffd]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:24:11 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-f15b1416-6cc9-4e60-b347-6b1e373d4137 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9, portal: 172.16.0.220,3260]
Apr 14 00:24:11 user nova-compute[82479]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9, portal: 172.16.0.220,3260] successful.
Apr 14 00:24:11 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:24:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 -p 172.16.0.220:3260 --op delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:24:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:24:11 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[63866b03-e517-4d22-83b7-9a568ee87865]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:24:11 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-f15b1416-6cc9-4e60-b347-6b1e373d4137 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:24:11 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-f15b1416-6cc9-4e60-b347-6b1e373d4137 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:24:11 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-f15b1416-6cc9-4e60-b347-6b1e373d4137 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] <== disconnect_volume: return (294ms) None {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:24:11 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f15b1416-6cc9-4e60-b347-6b1e373d4137 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Disconnected iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 00:24:12 user nova-compute[82479]: DEBUG nova.objects.instance [None req-f15b1416-6cc9-4e60-b347-6b1e373d4137 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lazy-loading 'flavor' on Instance uuid ade24ab6-1a93-4449-b5e9-ec3de357665b {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:24:12 user nova-compute[82479]: DEBUG nova.compute.manager [req-04b1cbef-6c5c-4a2b-92c1-4d62392d8b7a req-4202566d-d9d7-41c2-ba86-f65b5659b609 service nova] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Received event network-changed-11344eed-48f5-49c5-a770-c9c298f7185e {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:24:12 user nova-compute[82479]: DEBUG nova.compute.manager [req-04b1cbef-6c5c-4a2b-92c1-4d62392d8b7a req-4202566d-d9d7-41c2-ba86-f65b5659b609 service nova] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Refreshing instance network info cache due to event network-changed-11344eed-48f5-49c5-a770-c9c298f7185e. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:24:12 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-04b1cbef-6c5c-4a2b-92c1-4d62392d8b7a req-4202566d-d9d7-41c2-ba86-f65b5659b609 service nova] Acquiring lock "refresh_cache-ade24ab6-1a93-4449-b5e9-ec3de357665b" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:24:12 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-04b1cbef-6c5c-4a2b-92c1-4d62392d8b7a req-4202566d-d9d7-41c2-ba86-f65b5659b609 service nova] Acquired lock "refresh_cache-ade24ab6-1a93-4449-b5e9-ec3de357665b" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:24:12 user nova-compute[82479]: DEBUG nova.network.neutron [req-04b1cbef-6c5c-4a2b-92c1-4d62392d8b7a req-4202566d-d9d7-41c2-ba86-f65b5659b609 service nova] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Refreshing network info cache for port 11344eed-48f5-49c5-a770-c9c298f7185e {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:24:12 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f15b1416-6cc9-4e60-b347-6b1e373d4137 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "ade24ab6-1a93-4449-b5e9-ec3de357665b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.653s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:24:13 user nova-compute[82479]: DEBUG nova.network.neutron [req-04b1cbef-6c5c-4a2b-92c1-4d62392d8b7a req-4202566d-d9d7-41c2-ba86-f65b5659b609 service nova] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Updated VIF entry in instance network info cache for port 11344eed-48f5-49c5-a770-c9c298f7185e. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:24:13 user nova-compute[82479]: DEBUG nova.network.neutron [req-04b1cbef-6c5c-4a2b-92c1-4d62392d8b7a req-4202566d-d9d7-41c2-ba86-f65b5659b609 service nova] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Updating instance_info_cache with network_info: [{"id": "11344eed-48f5-49c5-a770-c9c298f7185e", "address": "fa:16:3e:cd:dc:0b", "network": {"id": "08106daa-a35e-4376-8c46-2b4baa51c6ea", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321730350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524265958bd24a6cb94aa3115eb2b6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11344eed-48", "ovs_interfaceid": "11344eed-48f5-49c5-a770-c9c298f7185e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:24:13 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-04b1cbef-6c5c-4a2b-92c1-4d62392d8b7a req-4202566d-d9d7-41c2-ba86-f65b5659b609 service nova] Releasing lock "refresh_cache-ade24ab6-1a93-4449-b5e9-ec3de357665b" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:24:15 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:24:16 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:24:20 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:24:21 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:24:25 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:24:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a86cae49-5b83-475f-ae05-0473b8ef93fd tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "17c6c147-fb62-4204-a416-792b94d3f7dd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:24:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a86cae49-5b83-475f-ae05-0473b8ef93fd tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "17c6c147-fb62-4204-a416-792b94d3f7dd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:24:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a86cae49-5b83-475f-ae05-0473b8ef93fd tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "17c6c147-fb62-4204-a416-792b94d3f7dd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:24:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a86cae49-5b83-475f-ae05-0473b8ef93fd tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "17c6c147-fb62-4204-a416-792b94d3f7dd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:24:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a86cae49-5b83-475f-ae05-0473b8ef93fd tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "17c6c147-fb62-4204-a416-792b94d3f7dd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:24:30 user nova-compute[82479]: INFO nova.compute.manager [None req-a86cae49-5b83-475f-ae05-0473b8ef93fd tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Terminating instance
Apr 14 00:24:30 user nova-compute[82479]: DEBUG nova.compute.manager [None req-a86cae49-5b83-475f-ae05-0473b8ef93fd tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Start destroying the instance on the hypervisor. {{(pid=82479) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 00:24:30 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:24:30 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:24:30 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:24:30 user nova-compute[82479]: DEBUG nova.compute.manager [req-c5ea3ee9-b93a-456d-b32a-a02ed462b270 req-963597d5-e596-4b68-97fd-3e7cafe8761e service nova] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Received event network-vif-unplugged-102987de-d5e4-4ccd-b4fd-7ca7c131e379 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:24:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-c5ea3ee9-b93a-456d-b32a-a02ed462b270 req-963597d5-e596-4b68-97fd-3e7cafe8761e service nova] Acquiring lock "17c6c147-fb62-4204-a416-792b94d3f7dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:24:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-c5ea3ee9-b93a-456d-b32a-a02ed462b270 req-963597d5-e596-4b68-97fd-3e7cafe8761e service nova] Lock "17c6c147-fb62-4204-a416-792b94d3f7dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:24:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-c5ea3ee9-b93a-456d-b32a-a02ed462b270 req-963597d5-e596-4b68-97fd-3e7cafe8761e service nova] Lock "17c6c147-fb62-4204-a416-792b94d3f7dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:24:30 user nova-compute[82479]: DEBUG nova.compute.manager [req-c5ea3ee9-b93a-456d-b32a-a02ed462b270 req-963597d5-e596-4b68-97fd-3e7cafe8761e service nova] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] No waiting events found dispatching network-vif-unplugged-102987de-d5e4-4ccd-b4fd-7ca7c131e379 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:24:30 user nova-compute[82479]: DEBUG nova.compute.manager [req-c5ea3ee9-b93a-456d-b32a-a02ed462b270 req-963597d5-e596-4b68-97fd-3e7cafe8761e service nova] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Received event network-vif-unplugged-102987de-d5e4-4ccd-b4fd-7ca7c131e379 for instance with task_state deleting. {{(pid=82479) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 00:24:30 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:24:30 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:24:31 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Instance destroyed successfully.
Apr 14 00:24:31 user nova-compute[82479]: DEBUG nova.objects.instance [None req-a86cae49-5b83-475f-ae05-0473b8ef93fd tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lazy-loading 'resources' on Instance uuid 17c6c147-fb62-4204-a416-792b94d3f7dd {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:24:31 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-a86cae49-5b83-475f-ae05-0473b8ef93fd tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:08:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1240439258',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1240439258',id=13,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:10:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ba3f111e24414976beddba7ef90c4793',ramdisk_id='',reservation_id='r-uxopaibn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1545234843',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T00:12:31Z,user_data=None,user_id='90bad96535c3453792982c5acab9dbc6',uuid=17c6c147-fb62-4204-a416-792b94d3f7dd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "102987de-d5e4-4ccd-b4fd-7ca7c131e379", "address": "fa:16:3e:23:dd:a5", "network": {"id": "491696ea-38ef-4c19-9d94-a61223c1fa00", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1323121698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3f111e24414976beddba7ef90c4793", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap102987de-d5", "ovs_interfaceid": "102987de-d5e4-4ccd-b4fd-7ca7c131e379", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 00:24:31 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-a86cae49-5b83-475f-ae05-0473b8ef93fd tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Converting VIF {"id": "102987de-d5e4-4ccd-b4fd-7ca7c131e379", "address": "fa:16:3e:23:dd:a5", "network": {"id": "491696ea-38ef-4c19-9d94-a61223c1fa00", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1323121698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3f111e24414976beddba7ef90c4793", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap102987de-d5", "ovs_interfaceid": "102987de-d5e4-4ccd-b4fd-7ca7c131e379", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:24:31 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-a86cae49-5b83-475f-ae05-0473b8ef93fd tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:dd:a5,bridge_name='br-int',has_traffic_filtering=True,id=102987de-d5e4-4ccd-b4fd-7ca7c131e379,network=Network(491696ea-38ef-4c19-9d94-a61223c1fa00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap102987de-d5') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:24:31 user nova-compute[82479]: DEBUG os_vif [None req-a86cae49-5b83-475f-ae05-0473b8ef93fd tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:dd:a5,bridge_name='br-int',has_traffic_filtering=True,id=102987de-d5e4-4ccd-b4fd-7ca7c131e379,network=Network(491696ea-38ef-4c19-9d94-a61223c1fa00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap102987de-d5') {{(pid=82479) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 00:24:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:24:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap102987de-d5, bridge=br-int, if_exists=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:24:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:24:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:24:31 user nova-compute[82479]: INFO os_vif [None req-a86cae49-5b83-475f-ae05-0473b8ef93fd tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:dd:a5,bridge_name='br-int',has_traffic_filtering=True,id=102987de-d5e4-4ccd-b4fd-7ca7c131e379,network=Network(491696ea-38ef-4c19-9d94-a61223c1fa00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap102987de-d5')
Apr 14 00:24:31 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a86cae49-5b83-475f-ae05-0473b8ef93fd tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] calling os-brick to detach iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 00:24:31 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a86cae49-5b83-475f-ae05-0473b8ef93fd tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, {'target_iqn': 'iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DXAVYghe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:24:31 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-a86cae49-5b83-475f-ae05-0473b8ef93fd tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:24:31 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-a86cae49-5b83-475f-ae05-0473b8ef93fd tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:24:31 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-a86cae49-5b83-475f-ae05-0473b8ef93fd tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:24:31 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:24:31 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:24:31 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff19aeb-a199-4362-97f0-88823a58dd66]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:24:31 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a86cae49-5b83-475f-ae05-0473b8ef93fd tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 00:24:31 user nova-compute[82479]: No targets found.
Apr 14 00:24:31 user nova-compute[82479]: iSNS:
Apr 14 00:24:31 user nova-compute[82479]: No targets found.
Apr 14 00:24:31 user nova-compute[82479]: STATIC:
Apr 14 00:24:31 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc
Apr 14 00:24:31 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:24:31 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:24:31 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3
Apr 14 00:24:31 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:24:31 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:24:31 user nova-compute[82479]: FIRMWARE:
Apr 14 00:24:31 user nova-compute[82479]: No targets found.
Apr 14 00:24:31 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:24:31 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a86cae49-5b83-475f-ae05-0473b8ef93fd tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 00:24:31 user nova-compute[82479]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 00:24:31 user nova-compute[82479]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82479) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 00:24:31 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a86cae49-5b83-475f-ae05-0473b8ef93fd tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc', 0)] {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 00:24:31 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:24:31 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:24:31 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b6a655c-5bed-41ab-94b5-ab8dcb5d1284]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:24:31 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:24:31 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:24:31 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb40fa9-50fa-424b-9feb-c31f3a124548]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:24:31 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a86cae49-5b83-475f-ae05-0473b8ef93fd tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:24:31 user nova-compute[82479]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 (non-flash)
Apr 14 00:24:31 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:24:31 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a86cae49-5b83-475f-ae05-0473b8ef93fd tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)
Apr 14 00:24:31 user nova-compute[82479]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 (non-flash)
Apr 14 00:24:31 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:24:31 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a86cae49-5b83-475f-ae05-0473b8ef93fd tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f33385f6560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc'): ({'sdc'}, set())}) {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 00:24:31 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-a86cae49-5b83-475f-ae05-0473b8ef93fd tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Removing single pathed devices sdc {{(pid=82479) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 00:24:31 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:24:31 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:24:31 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba1b6dd-9a31-4410-8906-00c7c30a579e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:24:31 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:24:31 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.112s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:24:31 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[09dcf7c8-aadf-42d9-a892-768b87fa4309]: (4, ('ok\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:24:31 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-a86cae49-5b83-475f-ae05-0473b8ef93fd tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Flushing IO for device /dev/sdc {{(pid=82479) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 00:24:31 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:24:31 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.025s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:24:31 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[441635eb-f61a-434a-92d1-fe9e58a9c073]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:24:31 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-a86cae49-5b83-475f-ae05-0473b8ef93fd tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=82479) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 00:24:31 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:24:31 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.066s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:24:31 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f9d0402-40f8-46f2-ac2b-25607339dabb]: (4, ('1', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:24:31 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-a86cae49-5b83-475f-ae05-0473b8ef93fd tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 00:24:31 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-a86cae49-5b83-475f-ae05-0473b8ef93fd tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] SCSI volumes sdc have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 00:24:31 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a86cae49-5b83-475f-ae05-0473b8ef93fd tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc')] {{(pid=82479) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 00:24:31 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:24:31 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:24:31 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4d2af6-6b65-4860-975a-59e71a03c07a]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:24:31 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a86cae49-5b83-475f-ae05-0473b8ef93fd tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:24:31 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc -p 172.16.0.220:3260 --logout {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:24:31 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:24:31 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e8d6f6-9571-42c9-9cdb-45f80e9b0fa5]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:24:31 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a86cae49-5b83-475f-ae05-0473b8ef93fd tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc, portal: 172.16.0.220,3260]
Apr 14 00:24:31 user nova-compute[82479]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc, portal: 172.16.0.220,3260] successful.
Apr 14 00:24:31 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:24:31 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc -p 172.16.0.220:3260 --op delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:24:31 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:24:31 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e381691-4e51-4246-9fad-f4303558edf0]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:24:31 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a86cae49-5b83-475f-ae05-0473b8ef93fd tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:24:31 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-a86cae49-5b83-475f-ae05-0473b8ef93fd tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.432s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:24:31 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a86cae49-5b83-475f-ae05-0473b8ef93fd tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] <== disconnect_volume: return (433ms) None {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:24:31 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a86cae49-5b83-475f-ae05-0473b8ef93fd tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Disconnected iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 00:24:31 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-a86cae49-5b83-475f-ae05-0473b8ef93fd tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Deleting instance files /opt/stack/data/nova/instances/17c6c147-fb62-4204-a416-792b94d3f7dd_del
Apr 14 00:24:31 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-a86cae49-5b83-475f-ae05-0473b8ef93fd tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Deletion of /opt/stack/data/nova/instances/17c6c147-fb62-4204-a416-792b94d3f7dd_del complete
Apr 14 00:24:31 user nova-compute[82479]: INFO nova.compute.manager [None req-a86cae49-5b83-475f-ae05-0473b8ef93fd tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Took 1.28 seconds to destroy the instance on the hypervisor.
Apr 14 00:24:31 user nova-compute[82479]: DEBUG oslo.service.loopingcall [None req-a86cae49-5b83-475f-ae05-0473b8ef93fd tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82479) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 00:24:31 user nova-compute[82479]: DEBUG nova.compute.manager [-] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Deallocating network for instance {{(pid=82479) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 00:24:31 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] deallocate_for_instance() {{(pid=82479) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 00:24:32 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:24:32 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Updating instance_info_cache with network_info: [] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:24:32 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Took 0.67 seconds to deallocate network for instance.
Apr 14 00:24:32 user nova-compute[82479]: DEBUG nova.compute.manager [req-45a02142-749f-4db4-bd4e-f20503710de7 req-fea85813-a71c-4f23-8e63-cbc18a6f55f3 service nova] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Received event network-vif-deleted-102987de-d5e4-4ccd-b4fd-7ca7c131e379 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:24:32 user nova-compute[82479]: DEBUG nova.compute.manager [req-763cac84-072b-4b77-8f09-0dbf42e16435 req-56a113b9-9adf-4b08-aead-f2a3ecf4859d service nova] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Received event network-vif-plugged-102987de-d5e4-4ccd-b4fd-7ca7c131e379 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:24:32 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-763cac84-072b-4b77-8f09-0dbf42e16435 req-56a113b9-9adf-4b08-aead-f2a3ecf4859d service nova] Acquiring lock "17c6c147-fb62-4204-a416-792b94d3f7dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:24:32 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-763cac84-072b-4b77-8f09-0dbf42e16435 req-56a113b9-9adf-4b08-aead-f2a3ecf4859d service nova] Lock "17c6c147-fb62-4204-a416-792b94d3f7dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:24:32 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-763cac84-072b-4b77-8f09-0dbf42e16435 req-56a113b9-9adf-4b08-aead-f2a3ecf4859d service nova] Lock "17c6c147-fb62-4204-a416-792b94d3f7dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:24:32 user nova-compute[82479]: DEBUG nova.compute.manager [req-763cac84-072b-4b77-8f09-0dbf42e16435 req-56a113b9-9adf-4b08-aead-f2a3ecf4859d service nova] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] No waiting events found dispatching network-vif-plugged-102987de-d5e4-4ccd-b4fd-7ca7c131e379 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:24:32 user nova-compute[82479]: WARNING nova.compute.manager [req-763cac84-072b-4b77-8f09-0dbf42e16435 req-56a113b9-9adf-4b08-aead-f2a3ecf4859d service nova] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Received unexpected event network-vif-plugged-102987de-d5e4-4ccd-b4fd-7ca7c131e379 for instance with vm_state active and task_state deleting.
Apr 14 00:24:33 user nova-compute[82479]: INFO nova.compute.manager [None req-a86cae49-5b83-475f-ae05-0473b8ef93fd tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Took 0.92 seconds to detach 1 volumes for instance.
Apr 14 00:24:33 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a86cae49-5b83-475f-ae05-0473b8ef93fd tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:24:33 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a86cae49-5b83-475f-ae05-0473b8ef93fd tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:24:33 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-a86cae49-5b83-475f-ae05-0473b8ef93fd tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:24:33 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-a86cae49-5b83-475f-ae05-0473b8ef93fd tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:24:33 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a86cae49-5b83-475f-ae05-0473b8ef93fd tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.338s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:24:33 user nova-compute[82479]: INFO nova.scheduler.client.report [None req-a86cae49-5b83-475f-ae05-0473b8ef93fd tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Deleted allocations for instance 17c6c147-fb62-4204-a416-792b94d3f7dd
Apr 14 00:24:33 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a86cae49-5b83-475f-ae05-0473b8ef93fd tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "17c6c147-fb62-4204-a416-792b94d3f7dd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.461s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:24:36 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:24:36 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:24:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:24:46 user nova-compute[82479]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681431871.1341188, 17c6c147-fb62-4204-a416-792b94d3f7dd => Stopped> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:24:46 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] VM Stopped (Lifecycle Event)
Apr 14 00:24:46 user nova-compute[82479]: DEBUG nova.compute.manager [None req-3aaed7d6-f042-4e73-a98d-4a7d97fe3b39 None None] [instance: 17c6c147-fb62-4204-a416-792b94d3f7dd] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:24:46 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:24:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:24:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:24:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:24:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:24:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:24:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:24:53 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:24:53 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Starting heal instance info cache {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 00:24:53 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Didn't find any instances for network info cache update. {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 00:24:54 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:24:54 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:24:56 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:24:58 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:25:00 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:25:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:25:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:25:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-79102a9c-b86e-4546-816a-ca404399fbb7 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "ade24ab6-1a93-4449-b5e9-ec3de357665b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:25:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-79102a9c-b86e-4546-816a-ca404399fbb7 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "ade24ab6-1a93-4449-b5e9-ec3de357665b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:25:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-79102a9c-b86e-4546-816a-ca404399fbb7 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "ade24ab6-1a93-4449-b5e9-ec3de357665b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:25:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-79102a9c-b86e-4546-816a-ca404399fbb7 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "ade24ab6-1a93-4449-b5e9-ec3de357665b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:25:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-79102a9c-b86e-4546-816a-ca404399fbb7 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "ade24ab6-1a93-4449-b5e9-ec3de357665b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:25:01 user nova-compute[82479]: INFO nova.compute.manager [None req-79102a9c-b86e-4546-816a-ca404399fbb7 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Terminating instance
Apr 14 00:25:01 user nova-compute[82479]: DEBUG nova.compute.manager [None req-79102a9c-b86e-4546-816a-ca404399fbb7 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Start destroying the instance on the hypervisor. {{(pid=82479) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 00:25:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:25:01 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:25:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:25:01 user nova-compute[82479]: DEBUG nova.compute.manager [req-2c847a41-71a4-411d-8bcd-288e26577f47 req-10f3a5fe-ce1c-4a12-b25f-9bc78e1aac49 service nova] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Received event network-vif-unplugged-11344eed-48f5-49c5-a770-c9c298f7185e {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:25:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-2c847a41-71a4-411d-8bcd-288e26577f47 req-10f3a5fe-ce1c-4a12-b25f-9bc78e1aac49 service nova] Acquiring lock "ade24ab6-1a93-4449-b5e9-ec3de357665b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:25:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-2c847a41-71a4-411d-8bcd-288e26577f47 req-10f3a5fe-ce1c-4a12-b25f-9bc78e1aac49 service nova] Lock "ade24ab6-1a93-4449-b5e9-ec3de357665b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:25:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-2c847a41-71a4-411d-8bcd-288e26577f47 req-10f3a5fe-ce1c-4a12-b25f-9bc78e1aac49 service nova] Lock "ade24ab6-1a93-4449-b5e9-ec3de357665b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:25:01 user nova-compute[82479]: DEBUG nova.compute.manager [req-2c847a41-71a4-411d-8bcd-288e26577f47 req-10f3a5fe-ce1c-4a12-b25f-9bc78e1aac49 service nova] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] No waiting events found dispatching network-vif-unplugged-11344eed-48f5-49c5-a770-c9c298f7185e {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:25:01 user nova-compute[82479]: DEBUG nova.compute.manager [req-2c847a41-71a4-411d-8bcd-288e26577f47 req-10f3a5fe-ce1c-4a12-b25f-9bc78e1aac49 service nova] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Received event network-vif-unplugged-11344eed-48f5-49c5-a770-c9c298f7185e for instance with task_state deleting. {{(pid=82479) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 00:25:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:25:02 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Instance destroyed successfully.
Apr 14 00:25:02 user nova-compute[82479]: DEBUG nova.objects.instance [None req-79102a9c-b86e-4546-816a-ca404399fbb7 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lazy-loading 'resources' on Instance uuid ade24ab6-1a93-4449-b5e9-ec3de357665b {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:25:02 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-79102a9c-b86e-4546-816a-ca404399fbb7 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:18:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-576521395',display_name='tempest-ServerRescueNegativeTestJSON-server-576521395',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-576521395',id=31,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLPJl6SDPfCFQp4baCPxy+GI6LhLuQU3NPsG3291XLwXmLvJxDSbMZPnAUG2FnoP7gWRMoPh0RxuN0i+Igwez3QU2DJmViyuFIRLYjK8+Jg8nIMy2dRZs6Aqrth2wJ7mNQ==',key_name='tempest-keypair-2020248029',keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:20:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='524265958bd24a6cb94aa3115eb2b6c7',ramdisk_id='',reservation_id='r-a4yceyqy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1055458768',owner_user_name='tempest-ServerRescueNegativeTestJSON-1055458768-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T00:22:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f43f3171ccad4167ac783bbdfe2df478',uuid=ade24ab6-1a93-4449-b5e9-ec3de357665b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "11344eed-48f5-49c5-a770-c9c298f7185e", "address": "fa:16:3e:cd:dc:0b", "network": {"id": "08106daa-a35e-4376-8c46-2b4baa51c6ea", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321730350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524265958bd24a6cb94aa3115eb2b6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11344eed-48", "ovs_interfaceid": "11344eed-48f5-49c5-a770-c9c298f7185e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 00:25:02 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-79102a9c-b86e-4546-816a-ca404399fbb7 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Converting VIF {"id": "11344eed-48f5-49c5-a770-c9c298f7185e", "address": "fa:16:3e:cd:dc:0b", "network": {"id": "08106daa-a35e-4376-8c46-2b4baa51c6ea", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321730350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524265958bd24a6cb94aa3115eb2b6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11344eed-48", "ovs_interfaceid": "11344eed-48f5-49c5-a770-c9c298f7185e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:25:02 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-79102a9c-b86e-4546-816a-ca404399fbb7 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:dc:0b,bridge_name='br-int',has_traffic_filtering=True,id=11344eed-48f5-49c5-a770-c9c298f7185e,network=Network(08106daa-a35e-4376-8c46-2b4baa51c6ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11344eed-48') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:25:02 user nova-compute[82479]: DEBUG os_vif [None req-79102a9c-b86e-4546-816a-ca404399fbb7 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:dc:0b,bridge_name='br-int',has_traffic_filtering=True,id=11344eed-48f5-49c5-a770-c9c298f7185e,network=Network(08106daa-a35e-4376-8c46-2b4baa51c6ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11344eed-48') {{(pid=82479) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 00:25:02 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:25:02 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap11344eed-48, bridge=br-int, if_exists=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:25:02 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:25:02 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:25:02 user nova-compute[82479]: INFO os_vif [None req-79102a9c-b86e-4546-816a-ca404399fbb7 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:dc:0b,bridge_name='br-int',has_traffic_filtering=True,id=11344eed-48f5-49c5-a770-c9c298f7185e,network=Network(08106daa-a35e-4376-8c46-2b4baa51c6ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11344eed-48')
Apr 14 00:25:02 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-79102a9c-b86e-4546-816a-ca404399fbb7 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Deleting instance files /opt/stack/data/nova/instances/ade24ab6-1a93-4449-b5e9-ec3de357665b_del
Apr 14 00:25:02 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-79102a9c-b86e-4546-816a-ca404399fbb7 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Deletion of /opt/stack/data/nova/instances/ade24ab6-1a93-4449-b5e9-ec3de357665b_del complete
Apr 14 00:25:02 user nova-compute[82479]: INFO nova.compute.manager [None req-79102a9c-b86e-4546-816a-ca404399fbb7 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Took 0.85 seconds to destroy the instance on the hypervisor.
Apr 14 00:25:02 user nova-compute[82479]: DEBUG oslo.service.loopingcall [None req-79102a9c-b86e-4546-816a-ca404399fbb7 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82479) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 00:25:02 user nova-compute[82479]: DEBUG nova.compute.manager [-] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Deallocating network for instance {{(pid=82479) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 00:25:02 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] deallocate_for_instance() {{(pid=82479) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 00:25:02 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:25:03 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Updating instance_info_cache with network_info: [] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:25:03 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Took 0.87 seconds to deallocate network for instance.
Apr 14 00:25:03 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-79102a9c-b86e-4546-816a-ca404399fbb7 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:25:03 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-79102a9c-b86e-4546-816a-ca404399fbb7 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:25:03 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-79102a9c-b86e-4546-816a-ca404399fbb7 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:25:03 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-79102a9c-b86e-4546-816a-ca404399fbb7 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:25:03 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-79102a9c-b86e-4546-816a-ca404399fbb7 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.232s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:25:03 user nova-compute[82479]: INFO nova.scheduler.client.report [None req-79102a9c-b86e-4546-816a-ca404399fbb7 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Deleted allocations for instance ade24ab6-1a93-4449-b5e9-ec3de357665b
Apr 14 00:25:03 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:25:03 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:25:03 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:25:03 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:25:03 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Auditing locally available compute resources for user (node: user) {{(pid=82479) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 00:25:03 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-79102a9c-b86e-4546-816a-ca404399fbb7 tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "ade24ab6-1a93-4449-b5e9-ec3de357665b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.131s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:25:03 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:25:03 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:25:03 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:25:03 user nova-compute[82479]: DEBUG nova.compute.manager [req-c9ca970c-fc08-4de3-a934-45ce15376c96 req-46168f89-0ef9-4af1-b155-bbe231a696fc service nova] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Received event network-vif-plugged-11344eed-48f5-49c5-a770-c9c298f7185e {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:25:03 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-c9ca970c-fc08-4de3-a934-45ce15376c96 req-46168f89-0ef9-4af1-b155-bbe231a696fc service nova] Acquiring lock "ade24ab6-1a93-4449-b5e9-ec3de357665b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:25:03 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-c9ca970c-fc08-4de3-a934-45ce15376c96 req-46168f89-0ef9-4af1-b155-bbe231a696fc service nova] Lock "ade24ab6-1a93-4449-b5e9-ec3de357665b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:25:03 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-c9ca970c-fc08-4de3-a934-45ce15376c96 req-46168f89-0ef9-4af1-b155-bbe231a696fc service nova] Lock "ade24ab6-1a93-4449-b5e9-ec3de357665b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:25:03 user nova-compute[82479]: DEBUG nova.compute.manager [req-c9ca970c-fc08-4de3-a934-45ce15376c96 req-46168f89-0ef9-4af1-b155-bbe231a696fc service nova] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] No waiting events found dispatching network-vif-plugged-11344eed-48f5-49c5-a770-c9c298f7185e {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:25:03 user nova-compute[82479]: WARNING nova.compute.manager [req-c9ca970c-fc08-4de3-a934-45ce15376c96 req-46168f89-0ef9-4af1-b155-bbe231a696fc service nova] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Received unexpected event network-vif-plugged-11344eed-48f5-49c5-a770-c9c298f7185e for instance with vm_state deleted and task_state None.
Apr 14 00:25:03 user nova-compute[82479]: DEBUG nova.compute.manager [req-c9ca970c-fc08-4de3-a934-45ce15376c96 req-46168f89-0ef9-4af1-b155-bbe231a696fc service nova] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Received event network-vif-deleted-11344eed-48f5-49c5-a770-c9c298f7185e {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:25:04 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:25:04 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:25:04 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785033c7-e14b-418e-952a-248328b75d60/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:25:04 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785033c7-e14b-418e-952a-248328b75d60/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:25:04 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785033c7-e14b-418e-952a-248328b75d60/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:25:04 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785033c7-e14b-418e-952a-248328b75d60/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:25:04 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk.rescue --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:25:04 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:25:04 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk.rescue --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:25:04 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:25:04 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:25:04 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:25:04 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:25:04 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:25:04 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:25:05 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:25:05 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:25:05 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:25:05 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:25:05 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:25:05 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Hypervisor/Node resource view: name=user free_ram=8457MB free_disk=26.11892318725586GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82479) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 00:25:05 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:25:05 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:25:05 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Applying migration context for instance a1f2d364-908f-41c6-8e0c-df376a5d14f1 as it has an incoming, in-progress migration f76243a8-0e97-4f4a-84ee-d485a13c4ed4. Migration status is finished {{(pid=82479) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 14 00:25:05 user nova-compute[82479]: INFO nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Updating resource usage from migration f76243a8-0e97-4f4a-84ee-d485a13c4ed4
Apr 14 00:25:05 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 23718fd0-58b8-47f9-b1ef-a26a90741ecc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:25:05 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:25:05 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:25:05 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 785033c7-e14b-418e-952a-248328b75d60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:25:05 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Migration f76243a8-0e97-4f4a-84ee-d485a13c4ed4 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 14 00:25:05 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance a1f2d364-908f-41c6-8e0c-df376a5d14f1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:25:05 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 00:25:05 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Final resource view: name=user phys_ram=16023MB used_ram=1344MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 00:25:05 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:25:05 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:25:05 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Compute_service record updated for user:user {{(pid=82479) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 00:25:05 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.317s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:25:07 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:25:07 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:25:07 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:25:07 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82479) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 00:25:10 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-da8c9e92-5514-48ea-a076-08d53e893bb1 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "a1f2d364-908f-41c6-8e0c-df376a5d14f1" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:25:10 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-da8c9e92-5514-48ea-a076-08d53e893bb1 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "a1f2d364-908f-41c6-8e0c-df376a5d14f1" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:25:10 user nova-compute[82479]: DEBUG nova.compute.manager [None req-da8c9e92-5514-48ea-a076-08d53e893bb1 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Going to confirm migration 2 {{(pid=82479) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4663}}
Apr 14 00:25:10 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-da8c9e92-5514-48ea-a076-08d53e893bb1 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "refresh_cache-a1f2d364-908f-41c6-8e0c-df376a5d14f1" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:25:10 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-da8c9e92-5514-48ea-a076-08d53e893bb1 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquired lock "refresh_cache-a1f2d364-908f-41c6-8e0c-df376a5d14f1" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:25:10 user nova-compute[82479]: DEBUG nova.network.neutron [None req-da8c9e92-5514-48ea-a076-08d53e893bb1 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 00:25:10 user nova-compute[82479]: DEBUG nova.objects.instance [None req-da8c9e92-5514-48ea-a076-08d53e893bb1 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lazy-loading 'info_cache' on Instance uuid a1f2d364-908f-41c6-8e0c-df376a5d14f1 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:25:11 user nova-compute[82479]: DEBUG nova.network.neutron [None req-da8c9e92-5514-48ea-a076-08d53e893bb1 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Updating instance_info_cache with network_info: [{"id": "db5a953b-fab8-4158-b9bb-95c4db32658e", "address": "fa:16:3e:16:63:e8", "network": {"id": "cb8c9bb1-a885-486d-aa6a-de600bc01c2e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1676259779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8663ccad9047f4b11b9ae0646c287a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb5a953b-fa", "ovs_interfaceid": "db5a953b-fab8-4158-b9bb-95c4db32658e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:25:11 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-da8c9e92-5514-48ea-a076-08d53e893bb1 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Releasing lock "refresh_cache-a1f2d364-908f-41c6-8e0c-df376a5d14f1" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:25:11 user nova-compute[82479]: DEBUG nova.objects.instance [None req-da8c9e92-5514-48ea-a076-08d53e893bb1 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lazy-loading 'migration_context' on Instance uuid a1f2d364-908f-41c6-8e0c-df376a5d14f1 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:25:11 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-da8c9e92-5514-48ea-a076-08d53e893bb1 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:25:11 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-da8c9e92-5514-48ea-a076-08d53e893bb1 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:25:11 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-da8c9e92-5514-48ea-a076-08d53e893bb1 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:25:11 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-da8c9e92-5514-48ea-a076-08d53e893bb1 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:25:11 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-da8c9e92-5514-48ea-a076-08d53e893bb1 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.328s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:25:11 user nova-compute[82479]: INFO nova.scheduler.client.report [None req-da8c9e92-5514-48ea-a076-08d53e893bb1 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Deleted allocation for migration f76243a8-0e97-4f4a-84ee-d485a13c4ed4
Apr 14 00:25:11 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-da8c9e92-5514-48ea-a076-08d53e893bb1 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "a1f2d364-908f-41c6-8e0c-df376a5d14f1" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.271s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:25:12 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:25:17 user nova-compute[82479]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681431902.2589145, ade24ab6-1a93-4449-b5e9-ec3de357665b => Stopped> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:25:17 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] VM Stopped (Lifecycle Event)
Apr 14 00:25:17 user nova-compute[82479]: DEBUG nova.compute.manager [None req-701d1d83-0046-4b09-ae78-26a1b91994de None None] [instance: ade24ab6-1a93-4449-b5e9-ec3de357665b] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:25:17 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:25:21 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1e40d06b-169d-4663-ae76-211b6501f7da tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "23718fd0-58b8-47f9-b1ef-a26a90741ecc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:25:21 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1e40d06b-169d-4663-ae76-211b6501f7da tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "23718fd0-58b8-47f9-b1ef-a26a90741ecc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:25:21 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1e40d06b-169d-4663-ae76-211b6501f7da tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "23718fd0-58b8-47f9-b1ef-a26a90741ecc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:25:21 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1e40d06b-169d-4663-ae76-211b6501f7da tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "23718fd0-58b8-47f9-b1ef-a26a90741ecc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:25:21 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1e40d06b-169d-4663-ae76-211b6501f7da tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "23718fd0-58b8-47f9-b1ef-a26a90741ecc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:25:21 user nova-compute[82479]: INFO nova.compute.manager [None req-1e40d06b-169d-4663-ae76-211b6501f7da tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Terminating instance
Apr 14 00:25:21 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1e40d06b-169d-4663-ae76-211b6501f7da tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Start destroying the instance on the hypervisor. {{(pid=82479) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 00:25:21 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:25:21 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:25:21 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:25:21 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Instance destroyed successfully.
Apr 14 00:25:21 user nova-compute[82479]: DEBUG nova.objects.instance [None req-1e40d06b-169d-4663-ae76-211b6501f7da tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lazy-loading 'resources' on Instance uuid 23718fd0-58b8-47f9-b1ef-a26a90741ecc {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:25:21 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-1e40d06b-169d-4663-ae76-211b6501f7da tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:04:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-762920045',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-762920045',id=2,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:05:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ba3f111e24414976beddba7ef90c4793',ramdisk_id='',reservation_id='r-8yse6wut',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1545234843',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T00:06:51Z,user_data=None,user_id='90bad96535c3453792982c5acab9dbc6',uuid=23718fd0-58b8-47f9-b1ef-a26a90741ecc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "db4fcb1f-e93d-4eee-851d-0c47f24dcdb3", "address": "fa:16:3e:28:8a:3c", "network": {"id": "491696ea-38ef-4c19-9d94-a61223c1fa00", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1323121698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3f111e24414976beddba7ef90c4793", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb4fcb1f-e9", "ovs_interfaceid": "db4fcb1f-e93d-4eee-851d-0c47f24dcdb3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 00:25:21 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-1e40d06b-169d-4663-ae76-211b6501f7da tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Converting VIF {"id": "db4fcb1f-e93d-4eee-851d-0c47f24dcdb3", "address": "fa:16:3e:28:8a:3c", "network": {"id": "491696ea-38ef-4c19-9d94-a61223c1fa00", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1323121698-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba3f111e24414976beddba7ef90c4793", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb4fcb1f-e9", "ovs_interfaceid": "db4fcb1f-e93d-4eee-851d-0c47f24dcdb3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:25:21 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-1e40d06b-169d-4663-ae76-211b6501f7da tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:8a:3c,bridge_name='br-int',has_traffic_filtering=True,id=db4fcb1f-e93d-4eee-851d-0c47f24dcdb3,network=Network(491696ea-38ef-4c19-9d94-a61223c1fa00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb4fcb1f-e9') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:25:21 user nova-compute[82479]: DEBUG os_vif [None req-1e40d06b-169d-4663-ae76-211b6501f7da tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:8a:3c,bridge_name='br-int',has_traffic_filtering=True,id=db4fcb1f-e93d-4eee-851d-0c47f24dcdb3,network=Network(491696ea-38ef-4c19-9d94-a61223c1fa00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb4fcb1f-e9') {{(pid=82479) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 00:25:21 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:25:21 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdb4fcb1f-e9, bridge=br-int, if_exists=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:25:21 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:25:21 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:25:21 user nova-compute[82479]: INFO os_vif [None req-1e40d06b-169d-4663-ae76-211b6501f7da tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:8a:3c,bridge_name='br-int',has_traffic_filtering=True,id=db4fcb1f-e93d-4eee-851d-0c47f24dcdb3,network=Network(491696ea-38ef-4c19-9d94-a61223c1fa00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb4fcb1f-e9')
Apr 14 00:25:21 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-1e40d06b-169d-4663-ae76-211b6501f7da tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Deleting instance files /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc_del
Apr 14 00:25:21 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-1e40d06b-169d-4663-ae76-211b6501f7da tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Deletion of /opt/stack/data/nova/instances/23718fd0-58b8-47f9-b1ef-a26a90741ecc_del complete
Apr 14 00:25:21 user nova-compute[82479]: INFO nova.compute.manager [None req-1e40d06b-169d-4663-ae76-211b6501f7da tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Took 0.71 seconds to destroy the instance on the hypervisor.
Apr 14 00:25:21 user nova-compute[82479]: DEBUG oslo.service.loopingcall [None req-1e40d06b-169d-4663-ae76-211b6501f7da tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82479) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 00:25:21 user nova-compute[82479]: DEBUG nova.compute.manager [-] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Deallocating network for instance {{(pid=82479) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 00:25:21 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] deallocate_for_instance() {{(pid=82479) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 00:25:21 user nova-compute[82479]: DEBUG nova.compute.manager [req-3aab1b96-7540-428d-958a-90850cba58cb req-cf2973e0-fabd-4f9a-a1a0-789ca7100567 service nova] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Received event network-vif-unplugged-db4fcb1f-e93d-4eee-851d-0c47f24dcdb3 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:25:21 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-3aab1b96-7540-428d-958a-90850cba58cb req-cf2973e0-fabd-4f9a-a1a0-789ca7100567 service nova] Acquiring lock "23718fd0-58b8-47f9-b1ef-a26a90741ecc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:25:21 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-3aab1b96-7540-428d-958a-90850cba58cb req-cf2973e0-fabd-4f9a-a1a0-789ca7100567 service nova] Lock "23718fd0-58b8-47f9-b1ef-a26a90741ecc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:25:21 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-3aab1b96-7540-428d-958a-90850cba58cb req-cf2973e0-fabd-4f9a-a1a0-789ca7100567 service nova] Lock "23718fd0-58b8-47f9-b1ef-a26a90741ecc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:25:21 user nova-compute[82479]: DEBUG nova.compute.manager [req-3aab1b96-7540-428d-958a-90850cba58cb req-cf2973e0-fabd-4f9a-a1a0-789ca7100567 service nova] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] No waiting events found dispatching network-vif-unplugged-db4fcb1f-e93d-4eee-851d-0c47f24dcdb3 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:25:21 user nova-compute[82479]: DEBUG nova.compute.manager [req-3aab1b96-7540-428d-958a-90850cba58cb req-cf2973e0-fabd-4f9a-a1a0-789ca7100567 service nova] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Received event network-vif-unplugged-db4fcb1f-e93d-4eee-851d-0c47f24dcdb3 for instance with task_state deleting. {{(pid=82479) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 00:25:22 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Updating instance_info_cache with network_info: [] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:25:22 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Took 0.70 seconds to deallocate network for instance.
Apr 14 00:25:22 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1e40d06b-169d-4663-ae76-211b6501f7da tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:25:22 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1e40d06b-169d-4663-ae76-211b6501f7da tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:25:22 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1e40d06b-169d-4663-ae76-211b6501f7da tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:25:22 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1e40d06b-169d-4663-ae76-211b6501f7da tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:25:22 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1e40d06b-169d-4663-ae76-211b6501f7da tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.202s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:25:22 user nova-compute[82479]: INFO nova.scheduler.client.report [None req-1e40d06b-169d-4663-ae76-211b6501f7da tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Deleted allocations for instance 23718fd0-58b8-47f9-b1ef-a26a90741ecc
Apr 14 00:25:22 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1e40d06b-169d-4663-ae76-211b6501f7da tempest-ServerBootFromVolumeStableRescueTest-1545234843 tempest-ServerBootFromVolumeStableRescueTest-1545234843-project-member] Lock "23718fd0-58b8-47f9-b1ef-a26a90741ecc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.782s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:25:23 user nova-compute[82479]: DEBUG nova.compute.manager [req-8040cdca-3e72-4505-9be5-779b6fa130bc req-4f1765fb-c4db-482d-a3b7-b1cf0e091ca8 service nova] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Received event network-vif-plugged-db4fcb1f-e93d-4eee-851d-0c47f24dcdb3 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:25:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-8040cdca-3e72-4505-9be5-779b6fa130bc req-4f1765fb-c4db-482d-a3b7-b1cf0e091ca8 service nova] Acquiring lock "23718fd0-58b8-47f9-b1ef-a26a90741ecc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:25:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-8040cdca-3e72-4505-9be5-779b6fa130bc req-4f1765fb-c4db-482d-a3b7-b1cf0e091ca8 service nova] Lock "23718fd0-58b8-47f9-b1ef-a26a90741ecc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:25:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-8040cdca-3e72-4505-9be5-779b6fa130bc req-4f1765fb-c4db-482d-a3b7-b1cf0e091ca8 service nova] Lock "23718fd0-58b8-47f9-b1ef-a26a90741ecc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:25:23 user nova-compute[82479]: DEBUG nova.compute.manager [req-8040cdca-3e72-4505-9be5-779b6fa130bc req-4f1765fb-c4db-482d-a3b7-b1cf0e091ca8 service nova] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] No waiting events found dispatching network-vif-plugged-db4fcb1f-e93d-4eee-851d-0c47f24dcdb3 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:25:23 user nova-compute[82479]: WARNING nova.compute.manager [req-8040cdca-3e72-4505-9be5-779b6fa130bc req-4f1765fb-c4db-482d-a3b7-b1cf0e091ca8 service nova] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Received unexpected event network-vif-plugged-db4fcb1f-e93d-4eee-851d-0c47f24dcdb3 for instance with vm_state deleted and task_state None.
Apr 14 00:25:23 user nova-compute[82479]: DEBUG nova.compute.manager [req-8040cdca-3e72-4505-9be5-779b6fa130bc req-4f1765fb-c4db-482d-a3b7-b1cf0e091ca8 service nova] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Received event network-vif-deleted-db4fcb1f-e93d-4eee-851d-0c47f24dcdb3 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:25:26 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:25:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:25:36 user nova-compute[82479]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681431921.6466212, 23718fd0-58b8-47f9-b1ef-a26a90741ecc => Stopped> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:25:36 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] VM Stopped (Lifecycle Event)
Apr 14 00:25:36 user nova-compute[82479]: DEBUG nova.compute.manager [None req-e93effac-0285-42bc-bc94-0feef0ca3a4a None None] [instance: 23718fd0-58b8-47f9-b1ef-a26a90741ecc] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:25:36 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:25:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:25:46 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:25:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:25:52 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:25:53 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:25:53 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Starting heal instance info cache {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 00:25:53 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Rebuilding the list of instances to heal {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 00:25:53 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "refresh_cache-6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:25:53 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquired lock "refresh_cache-6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:25:53 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Forcefully refreshing network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 00:25:53 user nova-compute[82479]: DEBUG nova.objects.instance [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lazy-loading 'info_cache' on Instance uuid 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:25:54 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Updating instance_info_cache with network_info: [{"id": "10a32c68-570b-4ba1-ba36-6ecaf135c9bb", "address": "fa:16:3e:a4:44:5a", "network": {"id": "08106daa-a35e-4376-8c46-2b4baa51c6ea", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321730350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524265958bd24a6cb94aa3115eb2b6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10a32c68-57", "ovs_interfaceid": "10a32c68-570b-4ba1-ba36-6ecaf135c9bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:25:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Releasing lock "refresh_cache-6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:25:54 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Updated the network info_cache for instance {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 00:25:56 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:25:56 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:25:59 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-955b437d-a4a3-4761-b270-b06b87ecd2be tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:25:59 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-955b437d-a4a3-4761-b270-b06b87ecd2be tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:25:59 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-955b437d-a4a3-4761-b270-b06b87ecd2be tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:25:59 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-955b437d-a4a3-4761-b270-b06b87ecd2be tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:25:59 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-955b437d-a4a3-4761-b270-b06b87ecd2be tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:25:59 user nova-compute[82479]: INFO nova.compute.manager [None req-955b437d-a4a3-4761-b270-b06b87ecd2be tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Terminating instance
Apr 14 00:25:59 user nova-compute[82479]: DEBUG nova.compute.manager [None req-955b437d-a4a3-4761-b270-b06b87ecd2be tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Start destroying the instance on the hypervisor. {{(pid=82479) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 00:25:59 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:25:59 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:25:59 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:25:59 user nova-compute[82479]: DEBUG nova.compute.manager [req-b1aae788-250d-4f20-8e00-7996d5b823ee req-c93c7734-6ce6-499d-9fb8-8d9d396dd51d service nova] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Received event network-vif-unplugged-caaa85dc-5a5f-4480-b6be-b2bc234cd455 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:25:59 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-b1aae788-250d-4f20-8e00-7996d5b823ee req-c93c7734-6ce6-499d-9fb8-8d9d396dd51d service nova] Acquiring lock "d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:25:59 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-b1aae788-250d-4f20-8e00-7996d5b823ee req-c93c7734-6ce6-499d-9fb8-8d9d396dd51d service nova] Lock "d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:25:59 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-b1aae788-250d-4f20-8e00-7996d5b823ee req-c93c7734-6ce6-499d-9fb8-8d9d396dd51d service nova] Lock "d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:25:59 user nova-compute[82479]: DEBUG nova.compute.manager [req-b1aae788-250d-4f20-8e00-7996d5b823ee req-c93c7734-6ce6-499d-9fb8-8d9d396dd51d service nova] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] No waiting events found dispatching network-vif-unplugged-caaa85dc-5a5f-4480-b6be-b2bc234cd455 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:25:59 user nova-compute[82479]: DEBUG nova.compute.manager [req-b1aae788-250d-4f20-8e00-7996d5b823ee req-c93c7734-6ce6-499d-9fb8-8d9d396dd51d service nova] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Received event network-vif-unplugged-caaa85dc-5a5f-4480-b6be-b2bc234cd455 for instance with task_state deleting. {{(pid=82479) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 00:25:59 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:25:59 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Instance destroyed successfully.
Apr 14 00:25:59 user nova-compute[82479]: DEBUG nova.objects.instance [None req-955b437d-a4a3-4761-b270-b06b87ecd2be tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lazy-loading 'resources' on Instance uuid d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:26:00 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-955b437d-a4a3-4761-b270-b06b87ecd2be tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:09:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-969325789',display_name='tempest-ServerRescueNegativeTestJSON-server-969325789',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-969325789',id=18,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:11:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='524265958bd24a6cb94aa3115eb2b6c7',ramdisk_id='',reservation_id='r-vvqygcuz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1055458768',owner_user_name='tempest-ServerRescueNegativeTestJSON-1055458768-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T00:11:55Z,user_data=None,user_id='f43f3171ccad4167ac783bbdfe2df478',uuid=d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "caaa85dc-5a5f-4480-b6be-b2bc234cd455", "address": "fa:16:3e:73:2a:e3", "network": {"id": "08106daa-a35e-4376-8c46-2b4baa51c6ea", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321730350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524265958bd24a6cb94aa3115eb2b6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaaa85dc-5a", "ovs_interfaceid": "caaa85dc-5a5f-4480-b6be-b2bc234cd455", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 00:26:00 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-955b437d-a4a3-4761-b270-b06b87ecd2be tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Converting VIF {"id": "caaa85dc-5a5f-4480-b6be-b2bc234cd455", "address": "fa:16:3e:73:2a:e3", "network": {"id": "08106daa-a35e-4376-8c46-2b4baa51c6ea", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321730350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524265958bd24a6cb94aa3115eb2b6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaaa85dc-5a", "ovs_interfaceid": "caaa85dc-5a5f-4480-b6be-b2bc234cd455", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:26:00 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-955b437d-a4a3-4761-b270-b06b87ecd2be tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:73:2a:e3,bridge_name='br-int',has_traffic_filtering=True,id=caaa85dc-5a5f-4480-b6be-b2bc234cd455,network=Network(08106daa-a35e-4376-8c46-2b4baa51c6ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcaaa85dc-5a') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:26:00 user nova-compute[82479]: DEBUG os_vif [None req-955b437d-a4a3-4761-b270-b06b87ecd2be tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:2a:e3,bridge_name='br-int',has_traffic_filtering=True,id=caaa85dc-5a5f-4480-b6be-b2bc234cd455,network=Network(08106daa-a35e-4376-8c46-2b4baa51c6ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcaaa85dc-5a') {{(pid=82479) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 00:26:00 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:26:00 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcaaa85dc-5a, bridge=br-int, if_exists=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:26:00 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:26:00 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:26:00 user nova-compute[82479]: INFO os_vif [None req-955b437d-a4a3-4761-b270-b06b87ecd2be tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:2a:e3,bridge_name='br-int',has_traffic_filtering=True,id=caaa85dc-5a5f-4480-b6be-b2bc234cd455,network=Network(08106daa-a35e-4376-8c46-2b4baa51c6ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcaaa85dc-5a')
Apr 14 00:26:00 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-955b437d-a4a3-4761-b270-b06b87ecd2be tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Deleting instance files /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c_del
Apr 14 00:26:00 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-955b437d-a4a3-4761-b270-b06b87ecd2be tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Deletion of /opt/stack/data/nova/instances/d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c_del complete
Apr 14 00:26:00 user nova-compute[82479]: INFO nova.compute.manager [None req-955b437d-a4a3-4761-b270-b06b87ecd2be tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Took 0.86 seconds to destroy the instance on the hypervisor.
Apr 14 00:26:00 user nova-compute[82479]: DEBUG oslo.service.loopingcall [None req-955b437d-a4a3-4761-b270-b06b87ecd2be tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82479) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 00:26:00 user nova-compute[82479]: DEBUG nova.compute.manager [-] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Deallocating network for instance {{(pid=82479) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 00:26:00 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] deallocate_for_instance() {{(pid=82479) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 00:26:00 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:26:00 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:26:00 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:26:00 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Cleaning up deleted instances {{(pid=82479) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 00:26:00 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] There are 0 instances to clean {{(pid=82479) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 00:26:00 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Updating instance_info_cache with network_info: [] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:26:00 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Took 0.55 seconds to deallocate network for instance.
Apr 14 00:26:00 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-955b437d-a4a3-4761-b270-b06b87ecd2be tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:26:00 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-955b437d-a4a3-4761-b270-b06b87ecd2be tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:26:00 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-955b437d-a4a3-4761-b270-b06b87ecd2be tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:26:00 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-955b437d-a4a3-4761-b270-b06b87ecd2be tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:26:00 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-955b437d-a4a3-4761-b270-b06b87ecd2be tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.172s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:26:00 user nova-compute[82479]: INFO nova.scheduler.client.report [None req-955b437d-a4a3-4761-b270-b06b87ecd2be tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Deleted allocations for instance d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c
Apr 14 00:26:00 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-955b437d-a4a3-4761-b270-b06b87ecd2be tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.762s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:26:01 user nova-compute[82479]: DEBUG nova.compute.manager [req-7ee25e90-c4bc-405a-9e37-69ee5faaa8ee req-159b6847-b873-4e0b-a970-1b8383fa2d4d service nova] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Received event network-vif-plugged-caaa85dc-5a5f-4480-b6be-b2bc234cd455 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:26:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-7ee25e90-c4bc-405a-9e37-69ee5faaa8ee req-159b6847-b873-4e0b-a970-1b8383fa2d4d service nova] Acquiring lock "d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:26:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-7ee25e90-c4bc-405a-9e37-69ee5faaa8ee req-159b6847-b873-4e0b-a970-1b8383fa2d4d service nova] Lock "d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:26:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-7ee25e90-c4bc-405a-9e37-69ee5faaa8ee req-159b6847-b873-4e0b-a970-1b8383fa2d4d service nova] Lock "d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:26:01 user nova-compute[82479]: DEBUG nova.compute.manager [req-7ee25e90-c4bc-405a-9e37-69ee5faaa8ee req-159b6847-b873-4e0b-a970-1b8383fa2d4d service nova] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] No waiting events found dispatching network-vif-plugged-caaa85dc-5a5f-4480-b6be-b2bc234cd455 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:26:01 user nova-compute[82479]: WARNING nova.compute.manager [req-7ee25e90-c4bc-405a-9e37-69ee5faaa8ee req-159b6847-b873-4e0b-a970-1b8383fa2d4d service nova] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Received unexpected event network-vif-plugged-caaa85dc-5a5f-4480-b6be-b2bc234cd455 for instance with vm_state deleted and task_state None.
Apr 14 00:26:01 user nova-compute[82479]: DEBUG nova.compute.manager [req-7ee25e90-c4bc-405a-9e37-69ee5faaa8ee req-159b6847-b873-4e0b-a970-1b8383fa2d4d service nova] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Received event network-vif-deleted-caaa85dc-5a5f-4480-b6be-b2bc234cd455 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:26:02 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:26:04 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:26:05 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:26:05 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:26:05 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:26:05 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:26:05 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:26:05 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Auditing locally available compute resources for user (node: user) {{(pid=82479) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 00:26:05 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785033c7-e14b-418e-952a-248328b75d60/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:26:05 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785033c7-e14b-418e-952a-248328b75d60/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:26:05 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785033c7-e14b-418e-952a-248328b75d60/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:26:05 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785033c7-e14b-418e-952a-248328b75d60/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:26:06 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:26:06 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:26:06 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:26:06 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:26:06 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:26:06 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:26:06 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:26:06 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Hypervisor/Node resource view: name=user free_ram=8587MB free_disk=26.248008728027344GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82479) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 00:26:06 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:26:06 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:26:06 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:26:06 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 785033c7-e14b-418e-952a-248328b75d60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:26:06 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance a1f2d364-908f-41c6-8e0c-df376a5d14f1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:26:06 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 00:26:06 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Final resource view: name=user phys_ram=16023MB used_ram=960MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 00:26:06 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Refreshing inventories for resource provider 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 00:26:06 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Updating ProviderTree inventory for provider 3847975a-19aa-4b27-9180-14b5cc49044a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 00:26:06 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Updating inventory in ProviderTree for provider 3847975a-19aa-4b27-9180-14b5cc49044a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 00:26:06 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Refreshing aggregate associations for resource provider 3847975a-19aa-4b27-9180-14b5cc49044a, aggregates: None {{(pid=82479) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 00:26:07 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Refreshing trait associations for resource provider 3847975a-19aa-4b27-9180-14b5cc49044a, traits: COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,HW_CPU_X86_SSE42,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO {{(pid=82479) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 00:26:07 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:26:07 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:26:07 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Compute_service record updated for user:user {{(pid=82479) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 00:26:07 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.558s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:26:07 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:26:07 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Cleaning up deleted instances with incomplete migration  {{(pid=82479) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 00:26:09 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:26:09 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:26:09 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82479) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 00:26:10 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:26:10 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:26:10 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:26:10 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:26:10 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:26:10 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:26:11 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:26:13 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:26:14 user nova-compute[82479]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681431959.9861925, d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c => Stopped> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:26:14 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] VM Stopped (Lifecycle Event)
Apr 14 00:26:15 user nova-compute[82479]: DEBUG nova.compute.manager [None req-40038d16-e631-45b2-9944-ebe6be83d108 None None] [instance: d1cd9bc9-289f-4830-8c0f-ec5f13bd7f5c] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:26:15 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:26:17 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:26:20 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:26:25 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:26:25 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:26:25 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:26:25 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:26:25 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:26:25 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:26:26 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:26:30 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:26:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Acquiring lock "a4235d23-9b0d-4da3-870c-778c6c9b7ae1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:26:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "a4235d23-9b0d-4da3-870c-778c6c9b7ae1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:26:30 user nova-compute[82479]: DEBUG nova.compute.manager [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Starting instance... {{(pid=82479) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 00:26:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:26:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:26:30 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82479) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 00:26:30 user nova-compute[82479]: INFO nova.compute.claims [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Claim successful on node user
Apr 14 00:26:30 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:26:31 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:26:31 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.308s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:26:31 user nova-compute[82479]: DEBUG nova.compute.manager [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Start building networks asynchronously for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 00:26:31 user nova-compute[82479]: DEBUG nova.compute.manager [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Allocating IP information in the background. {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 00:26:31 user nova-compute[82479]: DEBUG nova.network.neutron [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] allocate_for_instance() {{(pid=82479) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 00:26:31 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 00:26:31 user nova-compute[82479]: DEBUG nova.compute.manager [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Start building block device mappings for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 00:26:31 user nova-compute[82479]: DEBUG nova.policy [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f922c56244e442028d3265b23a8fffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851640ccdac240bcb6b9b0a89dd250d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82479) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 00:26:31 user nova-compute[82479]: DEBUG nova.compute.manager [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Start spawning the instance on the hypervisor. {{(pid=82479) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 00:26:31 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Creating instance directory {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 00:26:31 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Creating image(s)
Apr 14 00:26:31 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Acquiring lock "/opt/stack/data/nova/instances/a4235d23-9b0d-4da3-870c-778c6c9b7ae1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:26:31 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "/opt/stack/data/nova/instances/a4235d23-9b0d-4da3-870c-778c6c9b7ae1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:26:31 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "/opt/stack/data/nova/instances/a4235d23-9b0d-4da3-870c-778c6c9b7ae1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:26:31 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:26:31 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.137s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:26:31 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Acquiring lock "3e200e101633f2016e569ae4c0a352380507d1e4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:26:31 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "3e200e101633f2016e569ae4c0a352380507d1e4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:26:31 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:26:31 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.137s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:26:31 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/a4235d23-9b0d-4da3-870c-778c6c9b7ae1/disk 1073741824 {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:26:31 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/a4235d23-9b0d-4da3-870c-778c6c9b7ae1/disk 1073741824" returned: 0 in 0.047s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:26:31 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "3e200e101633f2016e569ae4c0a352380507d1e4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.190s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:26:31 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:26:31 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.130s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:26:31 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a4235d23-9b0d-4da3-870c-778c6c9b7ae1/disk. size=1073741824 {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 00:26:31 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4235d23-9b0d-4da3-870c-778c6c9b7ae1/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:26:31 user nova-compute[82479]: DEBUG nova.network.neutron [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Successfully created port: 417e91ad-d81e-4837-ad20-0a9b57e85496 {{(pid=82479) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 00:26:31 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4235d23-9b0d-4da3-870c-778c6c9b7ae1/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:26:31 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Cannot resize image /opt/stack/data/nova/instances/a4235d23-9b0d-4da3-870c-778c6c9b7ae1/disk to a smaller size. {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 00:26:31 user nova-compute[82479]: DEBUG nova.objects.instance [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lazy-loading 'migration_context' on Instance uuid a4235d23-9b0d-4da3-870c-778c6c9b7ae1 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:26:31 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Created local disks {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 00:26:31 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Ensure instance console log exists: /opt/stack/data/nova/instances/a4235d23-9b0d-4da3-870c-778c6c9b7ae1/console.log {{(pid=82479) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 00:26:31 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:26:31 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:26:31 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:26:32 user nova-compute[82479]: DEBUG nova.network.neutron [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Successfully updated port: 417e91ad-d81e-4837-ad20-0a9b57e85496 {{(pid=82479) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 00:26:32 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Acquiring lock "refresh_cache-a4235d23-9b0d-4da3-870c-778c6c9b7ae1" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:26:32 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Acquired lock "refresh_cache-a4235d23-9b0d-4da3-870c-778c6c9b7ae1" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:26:32 user nova-compute[82479]: DEBUG nova.network.neutron [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 00:26:33 user nova-compute[82479]: DEBUG nova.compute.manager [req-d2b78069-f806-4148-a417-73cf74cf4c7e req-060bdb4f-f9ed-4a04-8639-b83c82403dfd service nova] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Received event network-changed-417e91ad-d81e-4837-ad20-0a9b57e85496 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:26:33 user nova-compute[82479]: DEBUG nova.compute.manager [req-d2b78069-f806-4148-a417-73cf74cf4c7e req-060bdb4f-f9ed-4a04-8639-b83c82403dfd service nova] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Refreshing instance network info cache due to event network-changed-417e91ad-d81e-4837-ad20-0a9b57e85496. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:26:33 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-d2b78069-f806-4148-a417-73cf74cf4c7e req-060bdb4f-f9ed-4a04-8639-b83c82403dfd service nova] Acquiring lock "refresh_cache-a4235d23-9b0d-4da3-870c-778c6c9b7ae1" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:26:33 user nova-compute[82479]: DEBUG nova.network.neutron [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Instance cache missing network info. {{(pid=82479) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 00:26:33 user nova-compute[82479]: DEBUG nova.network.neutron [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Updating instance_info_cache with network_info: [{"id": "417e91ad-d81e-4837-ad20-0a9b57e85496", "address": "fa:16:3e:57:ed:7a", "network": {"id": "83abe289-89d1-4c43-bfc5-19bcfdcc8309", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2050684181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "851640ccdac240bcb6b9b0a89dd250d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap417e91ad-d8", "ovs_interfaceid": "417e91ad-d81e-4837-ad20-0a9b57e85496", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:26:33 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Releasing lock "refresh_cache-a4235d23-9b0d-4da3-870c-778c6c9b7ae1" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:26:33 user nova-compute[82479]: DEBUG nova.compute.manager [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Instance network_info: |[{"id": "417e91ad-d81e-4837-ad20-0a9b57e85496", "address": "fa:16:3e:57:ed:7a", "network": {"id": "83abe289-89d1-4c43-bfc5-19bcfdcc8309", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2050684181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "851640ccdac240bcb6b9b0a89dd250d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap417e91ad-d8", "ovs_interfaceid": "417e91ad-d81e-4837-ad20-0a9b57e85496", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 00:26:33 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-d2b78069-f806-4148-a417-73cf74cf4c7e req-060bdb4f-f9ed-4a04-8639-b83c82403dfd service nova] Acquired lock "refresh_cache-a4235d23-9b0d-4da3-870c-778c6c9b7ae1" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:26:33 user nova-compute[82479]: DEBUG nova.network.neutron [req-d2b78069-f806-4148-a417-73cf74cf4c7e req-060bdb4f-f9ed-4a04-8639-b83c82403dfd service nova] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Refreshing network info cache for port 417e91ad-d81e-4837-ad20-0a9b57e85496 {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:26:33 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Start _get_guest_xml network_info=[{"id": "417e91ad-d81e-4837-ad20-0a9b57e85496", "address": "fa:16:3e:57:ed:7a", "network": {"id": "83abe289-89d1-4c43-bfc5-19bcfdcc8309", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2050684181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "851640ccdac240bcb6b9b0a89dd250d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap417e91ad-d8", "ovs_interfaceid": "417e91ad-d81e-4837-ad20-0a9b57e85496", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 00:26:33 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:26:33 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:26:33 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82479) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 00:26:33 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T00:02:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 00:26:33 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Flavor limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 00:26:33 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Image limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 00:26:33 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Flavor pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 00:26:33 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Image pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 00:26:33 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 00:26:33 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 00:26:33 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 00:26:33 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Got 1 possible topologies {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 00:26:33 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 00:26:33 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 00:26:33 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:26:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-770201332',display_name='tempest-VolumesSnapshotTestJSON-instance-770201332',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-770201332',id=34,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='851640ccdac240bcb6b9b0a89dd250d8',ramdisk_id='',reservation_id='r-4v5r5p4q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-655184435',owner_user_name='tempest-VolumesSnapshotTestJSON-655184435-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:26:31Z,user_data=None,user_id='f922c56244e442028d3265b23a8fffd5',uuid=a4235d23-9b0d-4da3-870c-778c6c9b7ae1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "417e91ad-d81e-4837-ad20-0a9b57e85496", "address": "fa:16:3e:57:ed:7a", "network": {"id": "83abe289-89d1-4c43-bfc5-19bcfdcc8309", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2050684181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "851640ccdac240bcb6b9b0a89dd250d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap417e91ad-d8", "ovs_interfaceid": "417e91ad-d81e-4837-ad20-0a9b57e85496", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82479) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 00:26:33 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Converting VIF {"id": "417e91ad-d81e-4837-ad20-0a9b57e85496", "address": "fa:16:3e:57:ed:7a", "network": {"id": "83abe289-89d1-4c43-bfc5-19bcfdcc8309", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2050684181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "851640ccdac240bcb6b9b0a89dd250d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap417e91ad-d8", "ovs_interfaceid": "417e91ad-d81e-4837-ad20-0a9b57e85496", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:26:33 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:ed:7a,bridge_name='br-int',has_traffic_filtering=True,id=417e91ad-d81e-4837-ad20-0a9b57e85496,network=Network(83abe289-89d1-4c43-bfc5-19bcfdcc8309),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap417e91ad-d8') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:26:33 user nova-compute[82479]: DEBUG nova.objects.instance [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lazy-loading 'pci_devices' on Instance uuid a4235d23-9b0d-4da3-870c-778c6c9b7ae1 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:26:33 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] End _get_guest_xml xml=<domain type="kvm">
Apr 14 00:26:33 user nova-compute[82479]:   <uuid>a4235d23-9b0d-4da3-870c-778c6c9b7ae1</uuid>
Apr 14 00:26:33 user nova-compute[82479]:   <name>instance-00000022</name>
Apr 14 00:26:33 user nova-compute[82479]:   <memory>131072</memory>
Apr 14 00:26:33 user nova-compute[82479]:   <vcpu>1</vcpu>
Apr 14 00:26:33 user nova-compute[82479]:   <metadata>
Apr 14 00:26:33 user nova-compute[82479]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 00:26:33 user nova-compute[82479]:       <nova:package version="0.0.0"/>
Apr 14 00:26:33 user nova-compute[82479]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-770201332</nova:name>
Apr 14 00:26:33 user nova-compute[82479]:       <nova:creationTime>2023-04-14 00:26:33</nova:creationTime>
Apr 14 00:26:33 user nova-compute[82479]:       <nova:flavor name="m1.nano">
Apr 14 00:26:33 user nova-compute[82479]:         <nova:memory>128</nova:memory>
Apr 14 00:26:33 user nova-compute[82479]:         <nova:disk>1</nova:disk>
Apr 14 00:26:33 user nova-compute[82479]:         <nova:swap>0</nova:swap>
Apr 14 00:26:33 user nova-compute[82479]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 00:26:33 user nova-compute[82479]:         <nova:vcpus>1</nova:vcpus>
Apr 14 00:26:33 user nova-compute[82479]:       </nova:flavor>
Apr 14 00:26:33 user nova-compute[82479]:       <nova:owner>
Apr 14 00:26:33 user nova-compute[82479]:         <nova:user uuid="f922c56244e442028d3265b23a8fffd5">tempest-VolumesSnapshotTestJSON-655184435-project-member</nova:user>
Apr 14 00:26:33 user nova-compute[82479]:         <nova:project uuid="851640ccdac240bcb6b9b0a89dd250d8">tempest-VolumesSnapshotTestJSON-655184435</nova:project>
Apr 14 00:26:33 user nova-compute[82479]:       </nova:owner>
Apr 14 00:26:33 user nova-compute[82479]:       <nova:root type="image" uuid="6db62068-7278-4cd8-b41f-d0140d89e199"/>
Apr 14 00:26:33 user nova-compute[82479]:       <nova:ports>
Apr 14 00:26:33 user nova-compute[82479]:         <nova:port uuid="417e91ad-d81e-4837-ad20-0a9b57e85496">
Apr 14 00:26:33 user nova-compute[82479]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 14 00:26:33 user nova-compute[82479]:         </nova:port>
Apr 14 00:26:33 user nova-compute[82479]:       </nova:ports>
Apr 14 00:26:33 user nova-compute[82479]:     </nova:instance>
Apr 14 00:26:33 user nova-compute[82479]:   </metadata>
Apr 14 00:26:33 user nova-compute[82479]:   <sysinfo type="smbios">
Apr 14 00:26:33 user nova-compute[82479]:     <system>
Apr 14 00:26:33 user nova-compute[82479]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 00:26:33 user nova-compute[82479]:       <entry name="product">OpenStack Nova</entry>
Apr 14 00:26:33 user nova-compute[82479]:       <entry name="version">0.0.0</entry>
Apr 14 00:26:33 user nova-compute[82479]:       <entry name="serial">a4235d23-9b0d-4da3-870c-778c6c9b7ae1</entry>
Apr 14 00:26:33 user nova-compute[82479]:       <entry name="uuid">a4235d23-9b0d-4da3-870c-778c6c9b7ae1</entry>
Apr 14 00:26:33 user nova-compute[82479]:       <entry name="family">Virtual Machine</entry>
Apr 14 00:26:33 user nova-compute[82479]:     </system>
Apr 14 00:26:33 user nova-compute[82479]:   </sysinfo>
Apr 14 00:26:33 user nova-compute[82479]:   <os>
Apr 14 00:26:33 user nova-compute[82479]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 00:26:33 user nova-compute[82479]:     <boot dev="hd"/>
Apr 14 00:26:33 user nova-compute[82479]:     <smbios mode="sysinfo"/>
Apr 14 00:26:33 user nova-compute[82479]:   </os>
Apr 14 00:26:33 user nova-compute[82479]:   <features>
Apr 14 00:26:33 user nova-compute[82479]:     <acpi/>
Apr 14 00:26:33 user nova-compute[82479]:     <apic/>
Apr 14 00:26:33 user nova-compute[82479]:     <vmcoreinfo/>
Apr 14 00:26:33 user nova-compute[82479]:   </features>
Apr 14 00:26:33 user nova-compute[82479]:   <clock offset="utc">
Apr 14 00:26:33 user nova-compute[82479]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 00:26:33 user nova-compute[82479]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 00:26:33 user nova-compute[82479]:     <timer name="hpet" present="no"/>
Apr 14 00:26:33 user nova-compute[82479]:   </clock>
Apr 14 00:26:33 user nova-compute[82479]:   <cpu mode="custom" match="exact">
Apr 14 00:26:33 user nova-compute[82479]:     <model>Nehalem</model>
Apr 14 00:26:33 user nova-compute[82479]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 00:26:33 user nova-compute[82479]:   </cpu>
Apr 14 00:26:33 user nova-compute[82479]:   <devices>
Apr 14 00:26:33 user nova-compute[82479]:     <disk type="file" device="disk">
Apr 14 00:26:33 user nova-compute[82479]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 00:26:33 user nova-compute[82479]:       <source file="/opt/stack/data/nova/instances/a4235d23-9b0d-4da3-870c-778c6c9b7ae1/disk"/>
Apr 14 00:26:33 user nova-compute[82479]:       <target dev="vda" bus="virtio"/>
Apr 14 00:26:33 user nova-compute[82479]:     </disk>
Apr 14 00:26:33 user nova-compute[82479]:     <interface type="ethernet">
Apr 14 00:26:33 user nova-compute[82479]:       <mac address="fa:16:3e:57:ed:7a"/>
Apr 14 00:26:33 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:26:33 user nova-compute[82479]:       <mtu size="1442"/>
Apr 14 00:26:33 user nova-compute[82479]:       <target dev="tap417e91ad-d8"/>
Apr 14 00:26:33 user nova-compute[82479]:     </interface>
Apr 14 00:26:33 user nova-compute[82479]:     <serial type="pty">
Apr 14 00:26:33 user nova-compute[82479]:       <log file="/opt/stack/data/nova/instances/a4235d23-9b0d-4da3-870c-778c6c9b7ae1/console.log" append="off"/>
Apr 14 00:26:33 user nova-compute[82479]:     </serial>
Apr 14 00:26:33 user nova-compute[82479]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 00:26:33 user nova-compute[82479]:     <video>
Apr 14 00:26:33 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:26:33 user nova-compute[82479]:     </video>
Apr 14 00:26:33 user nova-compute[82479]:     <rng model="virtio">
Apr 14 00:26:33 user nova-compute[82479]:       <backend model="random">/dev/urandom</backend>
Apr 14 00:26:33 user nova-compute[82479]:     </rng>
Apr 14 00:26:33 user nova-compute[82479]:     <controller type="usb" index="0" model="none"/>
Apr 14 00:26:33 user nova-compute[82479]:     <memballoon model="virtio">
Apr 14 00:26:33 user nova-compute[82479]:       <stats period="10"/>
Apr 14 00:26:33 user nova-compute[82479]:     </memballoon>
Apr 14 00:26:33 user nova-compute[82479]:   </devices>
Apr 14 00:26:33 user nova-compute[82479]: </domain>
Apr 14 00:26:33 user nova-compute[82479]:  {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 00:26:33 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:26:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-770201332',display_name='tempest-VolumesSnapshotTestJSON-instance-770201332',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-770201332',id=34,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='851640ccdac240bcb6b9b0a89dd250d8',ramdisk_id='',reservation_id='r-4v5r5p4q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-655184435',owner_user_name='tempest-VolumesSnapshotTestJSON-655184435-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:26:31Z,user_data=None,user_id='f922c56244e442028d3265b23a8fffd5',uuid=a4235d23-9b0d-4da3-870c-778c6c9b7ae1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "417e91ad-d81e-4837-ad20-0a9b57e85496", "address": "fa:16:3e:57:ed:7a", "network": {"id": "83abe289-89d1-4c43-bfc5-19bcfdcc8309", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2050684181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "851640ccdac240bcb6b9b0a89dd250d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap417e91ad-d8", "ovs_interfaceid": "417e91ad-d81e-4837-ad20-0a9b57e85496", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 00:26:33 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Converting VIF {"id": "417e91ad-d81e-4837-ad20-0a9b57e85496", "address": "fa:16:3e:57:ed:7a", "network": {"id": "83abe289-89d1-4c43-bfc5-19bcfdcc8309", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2050684181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "851640ccdac240bcb6b9b0a89dd250d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap417e91ad-d8", "ovs_interfaceid": "417e91ad-d81e-4837-ad20-0a9b57e85496", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:26:33 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:ed:7a,bridge_name='br-int',has_traffic_filtering=True,id=417e91ad-d81e-4837-ad20-0a9b57e85496,network=Network(83abe289-89d1-4c43-bfc5-19bcfdcc8309),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap417e91ad-d8') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:26:33 user nova-compute[82479]: DEBUG os_vif [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:ed:7a,bridge_name='br-int',has_traffic_filtering=True,id=417e91ad-d81e-4837-ad20-0a9b57e85496,network=Network(83abe289-89d1-4c43-bfc5-19bcfdcc8309),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap417e91ad-d8') {{(pid=82479) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 00:26:33 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:26:33 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:26:33 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 00:26:33 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:26:33 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap417e91ad-d8, may_exist=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:26:33 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap417e91ad-d8, col_values=(('external_ids', {'iface-id': '417e91ad-d81e-4837-ad20-0a9b57e85496', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:ed:7a', 'vm-uuid': 'a4235d23-9b0d-4da3-870c-778c6c9b7ae1'}),)) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:26:33 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:26:33 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:26:33 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:26:33 user nova-compute[82479]: INFO os_vif [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:ed:7a,bridge_name='br-int',has_traffic_filtering=True,id=417e91ad-d81e-4837-ad20-0a9b57e85496,network=Network(83abe289-89d1-4c43-bfc5-19bcfdcc8309),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap417e91ad-d8')
Apr 14 00:26:33 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:26:33 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] No VIF found with MAC fa:16:3e:57:ed:7a, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:26:34 user nova-compute[82479]: DEBUG nova.network.neutron [req-d2b78069-f806-4148-a417-73cf74cf4c7e req-060bdb4f-f9ed-4a04-8639-b83c82403dfd service nova] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Updated VIF entry in instance network info cache for port 417e91ad-d81e-4837-ad20-0a9b57e85496. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:26:34 user nova-compute[82479]: DEBUG nova.network.neutron [req-d2b78069-f806-4148-a417-73cf74cf4c7e req-060bdb4f-f9ed-4a04-8639-b83c82403dfd service nova] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Updating instance_info_cache with network_info: [{"id": "417e91ad-d81e-4837-ad20-0a9b57e85496", "address": "fa:16:3e:57:ed:7a", "network": {"id": "83abe289-89d1-4c43-bfc5-19bcfdcc8309", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2050684181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "851640ccdac240bcb6b9b0a89dd250d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap417e91ad-d8", "ovs_interfaceid": "417e91ad-d81e-4837-ad20-0a9b57e85496", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:26:34 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-d2b78069-f806-4148-a417-73cf74cf4c7e req-060bdb4f-f9ed-4a04-8639-b83c82403dfd service nova] Releasing lock "refresh_cache-a4235d23-9b0d-4da3-870c-778c6c9b7ae1" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:26:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:26:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:26:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:26:35 user nova-compute[82479]: DEBUG nova.compute.manager [req-1de33e40-9065-4379-86b6-ede0680992bb req-d2c8bd2b-c149-4f96-bba4-a2bcfb41134f service nova] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Received event network-vif-plugged-417e91ad-d81e-4837-ad20-0a9b57e85496 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:26:35 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-1de33e40-9065-4379-86b6-ede0680992bb req-d2c8bd2b-c149-4f96-bba4-a2bcfb41134f service nova] Acquiring lock "a4235d23-9b0d-4da3-870c-778c6c9b7ae1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:26:35 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-1de33e40-9065-4379-86b6-ede0680992bb req-d2c8bd2b-c149-4f96-bba4-a2bcfb41134f service nova] Lock "a4235d23-9b0d-4da3-870c-778c6c9b7ae1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:26:35 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-1de33e40-9065-4379-86b6-ede0680992bb req-d2c8bd2b-c149-4f96-bba4-a2bcfb41134f service nova] Lock "a4235d23-9b0d-4da3-870c-778c6c9b7ae1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:26:35 user nova-compute[82479]: DEBUG nova.compute.manager [req-1de33e40-9065-4379-86b6-ede0680992bb req-d2c8bd2b-c149-4f96-bba4-a2bcfb41134f service nova] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] No waiting events found dispatching network-vif-plugged-417e91ad-d81e-4837-ad20-0a9b57e85496 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:26:35 user nova-compute[82479]: WARNING nova.compute.manager [req-1de33e40-9065-4379-86b6-ede0680992bb req-d2c8bd2b-c149-4f96-bba4-a2bcfb41134f service nova] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Received unexpected event network-vif-plugged-417e91ad-d81e-4837-ad20-0a9b57e85496 for instance with vm_state building and task_state spawning.
Apr 14 00:26:36 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:26:37 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681431997.0648468, a4235d23-9b0d-4da3-870c-778c6c9b7ae1 => Resumed> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:26:37 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] VM Resumed (Lifecycle Event)
Apr 14 00:26:37 user nova-compute[82479]: DEBUG nova.compute.manager [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Instance event wait completed in 0 seconds for  {{(pid=82479) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 00:26:37 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Guest created on hypervisor {{(pid=82479) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 00:26:37 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Instance spawned successfully.
Apr 14 00:26:37 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 00:26:37 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:26:37 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Found default for hw_cdrom_bus of ide {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:26:37 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Found default for hw_disk_bus of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:26:37 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Found default for hw_input_bus of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:26:37 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Found default for hw_pointer_model of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:26:37 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Found default for hw_video_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:26:37 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Found default for hw_vif_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:26:37 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:26:37 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:26:37 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681431997.0685213, a4235d23-9b0d-4da3-870c-778c6c9b7ae1 => Started> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:26:37 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] VM Started (Lifecycle Event)
Apr 14 00:26:37 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:26:37 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:26:37 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:26:37 user nova-compute[82479]: DEBUG nova.compute.manager [req-fb5c0f79-c17b-422c-b025-469addd5122e req-6a602b16-c6cc-4df0-84fc-edd514ba69ee service nova] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Received event network-vif-plugged-417e91ad-d81e-4837-ad20-0a9b57e85496 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:26:37 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-fb5c0f79-c17b-422c-b025-469addd5122e req-6a602b16-c6cc-4df0-84fc-edd514ba69ee service nova] Acquiring lock "a4235d23-9b0d-4da3-870c-778c6c9b7ae1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:26:37 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-fb5c0f79-c17b-422c-b025-469addd5122e req-6a602b16-c6cc-4df0-84fc-edd514ba69ee service nova] Lock "a4235d23-9b0d-4da3-870c-778c6c9b7ae1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:26:37 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-fb5c0f79-c17b-422c-b025-469addd5122e req-6a602b16-c6cc-4df0-84fc-edd514ba69ee service nova] Lock "a4235d23-9b0d-4da3-870c-778c6c9b7ae1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:26:37 user nova-compute[82479]: DEBUG nova.compute.manager [req-fb5c0f79-c17b-422c-b025-469addd5122e req-6a602b16-c6cc-4df0-84fc-edd514ba69ee service nova] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] No waiting events found dispatching network-vif-plugged-417e91ad-d81e-4837-ad20-0a9b57e85496 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:26:37 user nova-compute[82479]: WARNING nova.compute.manager [req-fb5c0f79-c17b-422c-b025-469addd5122e req-6a602b16-c6cc-4df0-84fc-edd514ba69ee service nova] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Received unexpected event network-vif-plugged-417e91ad-d81e-4837-ad20-0a9b57e85496 for instance with vm_state building and task_state spawning.
Apr 14 00:26:37 user nova-compute[82479]: INFO nova.compute.manager [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Took 5.95 seconds to spawn the instance on the hypervisor.
Apr 14 00:26:37 user nova-compute[82479]: DEBUG nova.compute.manager [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:26:37 user nova-compute[82479]: INFO nova.compute.manager [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Took 6.56 seconds to build instance.
Apr 14 00:26:37 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-0829e582-f452-4c36-a754-6063f9fa2d77 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "a4235d23-9b0d-4da3-870c-778c6c9b7ae1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.656s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:26:38 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:26:43 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:26:48 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:26:48 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:26:48 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:26:48 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:26:48 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:26:48 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:26:49 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-93e3facc-12ff-498b-8402-d1b1270e3e8a tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:26:49 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-93e3facc-12ff-498b-8402-d1b1270e3e8a tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:26:49 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-93e3facc-12ff-498b-8402-d1b1270e3e8a tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:26:49 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-93e3facc-12ff-498b-8402-d1b1270e3e8a tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:26:49 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-93e3facc-12ff-498b-8402-d1b1270e3e8a tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:26:49 user nova-compute[82479]: INFO nova.compute.manager [None req-93e3facc-12ff-498b-8402-d1b1270e3e8a tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Terminating instance
Apr 14 00:26:49 user nova-compute[82479]: DEBUG nova.compute.manager [None req-93e3facc-12ff-498b-8402-d1b1270e3e8a tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Start destroying the instance on the hypervisor. {{(pid=82479) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 00:26:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:26:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:26:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:26:50 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:26:50 user nova-compute[82479]: DEBUG nova.compute.manager [req-b4a6d3ce-12f6-4aea-ac18-f8006b527193 req-ac453a8f-5518-405e-911e-b9ef2022138f service nova] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Received event network-vif-unplugged-10a32c68-570b-4ba1-ba36-6ecaf135c9bb {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:26:50 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-b4a6d3ce-12f6-4aea-ac18-f8006b527193 req-ac453a8f-5518-405e-911e-b9ef2022138f service nova] Acquiring lock "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:26:50 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-b4a6d3ce-12f6-4aea-ac18-f8006b527193 req-ac453a8f-5518-405e-911e-b9ef2022138f service nova] Lock "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:26:50 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-b4a6d3ce-12f6-4aea-ac18-f8006b527193 req-ac453a8f-5518-405e-911e-b9ef2022138f service nova] Lock "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:26:50 user nova-compute[82479]: DEBUG nova.compute.manager [req-b4a6d3ce-12f6-4aea-ac18-f8006b527193 req-ac453a8f-5518-405e-911e-b9ef2022138f service nova] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] No waiting events found dispatching network-vif-unplugged-10a32c68-570b-4ba1-ba36-6ecaf135c9bb {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:26:50 user nova-compute[82479]: DEBUG nova.compute.manager [req-b4a6d3ce-12f6-4aea-ac18-f8006b527193 req-ac453a8f-5518-405e-911e-b9ef2022138f service nova] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Received event network-vif-unplugged-10a32c68-570b-4ba1-ba36-6ecaf135c9bb for instance with task_state deleting. {{(pid=82479) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 00:26:50 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:26:50 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:26:50 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Instance destroyed successfully.
Apr 14 00:26:50 user nova-compute[82479]: DEBUG nova.objects.instance [None req-93e3facc-12ff-498b-8402-d1b1270e3e8a tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lazy-loading 'resources' on Instance uuid 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:26:50 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-93e3facc-12ff-498b-8402-d1b1270e3e8a tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:09:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1929968798',display_name='tempest-ServerRescueNegativeTestJSON-server-1929968798',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1929968798',id=17,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:14:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='524265958bd24a6cb94aa3115eb2b6c7',ramdisk_id='',reservation_id='r-r5gflibu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1055458768',owner_user_name='tempest-ServerRescueNegativeTestJSON-1055458768-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T00:16:39Z,user_data=None,user_id='f43f3171ccad4167ac783bbdfe2df478',uuid=6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "10a32c68-570b-4ba1-ba36-6ecaf135c9bb", "address": "fa:16:3e:a4:44:5a", "network": {"id": "08106daa-a35e-4376-8c46-2b4baa51c6ea", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321730350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524265958bd24a6cb94aa3115eb2b6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10a32c68-57", "ovs_interfaceid": "10a32c68-570b-4ba1-ba36-6ecaf135c9bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 00:26:50 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-93e3facc-12ff-498b-8402-d1b1270e3e8a tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Converting VIF {"id": "10a32c68-570b-4ba1-ba36-6ecaf135c9bb", "address": "fa:16:3e:a4:44:5a", "network": {"id": "08106daa-a35e-4376-8c46-2b4baa51c6ea", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1321730350-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "524265958bd24a6cb94aa3115eb2b6c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10a32c68-57", "ovs_interfaceid": "10a32c68-570b-4ba1-ba36-6ecaf135c9bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:26:50 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-93e3facc-12ff-498b-8402-d1b1270e3e8a tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a4:44:5a,bridge_name='br-int',has_traffic_filtering=True,id=10a32c68-570b-4ba1-ba36-6ecaf135c9bb,network=Network(08106daa-a35e-4376-8c46-2b4baa51c6ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10a32c68-57') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:26:50 user nova-compute[82479]: DEBUG os_vif [None req-93e3facc-12ff-498b-8402-d1b1270e3e8a tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:44:5a,bridge_name='br-int',has_traffic_filtering=True,id=10a32c68-570b-4ba1-ba36-6ecaf135c9bb,network=Network(08106daa-a35e-4376-8c46-2b4baa51c6ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10a32c68-57') {{(pid=82479) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 00:26:50 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:26:50 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap10a32c68-57, bridge=br-int, if_exists=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:26:50 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:26:50 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:26:50 user nova-compute[82479]: INFO os_vif [None req-93e3facc-12ff-498b-8402-d1b1270e3e8a tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:44:5a,bridge_name='br-int',has_traffic_filtering=True,id=10a32c68-570b-4ba1-ba36-6ecaf135c9bb,network=Network(08106daa-a35e-4376-8c46-2b4baa51c6ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10a32c68-57')
Apr 14 00:26:50 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-93e3facc-12ff-498b-8402-d1b1270e3e8a tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Deleting instance files /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9_del
Apr 14 00:26:50 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-93e3facc-12ff-498b-8402-d1b1270e3e8a tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Deletion of /opt/stack/data/nova/instances/6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9_del complete
Apr 14 00:26:50 user nova-compute[82479]: INFO nova.compute.manager [None req-93e3facc-12ff-498b-8402-d1b1270e3e8a tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Took 0.64 seconds to destroy the instance on the hypervisor.
Apr 14 00:26:50 user nova-compute[82479]: DEBUG oslo.service.loopingcall [None req-93e3facc-12ff-498b-8402-d1b1270e3e8a tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82479) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 00:26:50 user nova-compute[82479]: DEBUG nova.compute.manager [-] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Deallocating network for instance {{(pid=82479) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 00:26:50 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] deallocate_for_instance() {{(pid=82479) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 00:26:50 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Updating instance_info_cache with network_info: [] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:26:50 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Took 0.42 seconds to deallocate network for instance.
Apr 14 00:26:50 user nova-compute[82479]: DEBUG nova.compute.manager [req-a5effd27-cd3f-4a41-a991-80b8399d2b0d req-abeebd5d-fb3f-40fe-bece-58b798ef5b29 service nova] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Received event network-vif-deleted-10a32c68-570b-4ba1-ba36-6ecaf135c9bb {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:26:51 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-93e3facc-12ff-498b-8402-d1b1270e3e8a tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:26:51 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-93e3facc-12ff-498b-8402-d1b1270e3e8a tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:26:51 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-93e3facc-12ff-498b-8402-d1b1270e3e8a tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:26:51 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-93e3facc-12ff-498b-8402-d1b1270e3e8a tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:26:51 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-93e3facc-12ff-498b-8402-d1b1270e3e8a tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.176s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:26:51 user nova-compute[82479]: INFO nova.scheduler.client.report [None req-93e3facc-12ff-498b-8402-d1b1270e3e8a tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Deleted allocations for instance 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9
Apr 14 00:26:51 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-93e3facc-12ff-498b-8402-d1b1270e3e8a tempest-ServerRescueNegativeTestJSON-1055458768 tempest-ServerRescueNegativeTestJSON-1055458768-project-member] Lock "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.419s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:26:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:26:52 user nova-compute[82479]: DEBUG nova.compute.manager [req-3ea0eadc-aa0b-4ef8-ba17-0e7745aef617 req-a18509ed-969a-4fb3-b1f8-31289d19734f service nova] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Received event network-vif-plugged-10a32c68-570b-4ba1-ba36-6ecaf135c9bb {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:26:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-3ea0eadc-aa0b-4ef8-ba17-0e7745aef617 req-a18509ed-969a-4fb3-b1f8-31289d19734f service nova] Acquiring lock "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:26:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-3ea0eadc-aa0b-4ef8-ba17-0e7745aef617 req-a18509ed-969a-4fb3-b1f8-31289d19734f service nova] Lock "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:26:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-3ea0eadc-aa0b-4ef8-ba17-0e7745aef617 req-a18509ed-969a-4fb3-b1f8-31289d19734f service nova] Lock "6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:26:52 user nova-compute[82479]: DEBUG nova.compute.manager [req-3ea0eadc-aa0b-4ef8-ba17-0e7745aef617 req-a18509ed-969a-4fb3-b1f8-31289d19734f service nova] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] No waiting events found dispatching network-vif-plugged-10a32c68-570b-4ba1-ba36-6ecaf135c9bb {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:26:52 user nova-compute[82479]: WARNING nova.compute.manager [req-3ea0eadc-aa0b-4ef8-ba17-0e7745aef617 req-a18509ed-969a-4fb3-b1f8-31289d19734f service nova] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Received unexpected event network-vif-plugged-10a32c68-570b-4ba1-ba36-6ecaf135c9bb for instance with vm_state deleted and task_state None.
Apr 14 00:26:55 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:26:55 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:26:55 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Starting heal instance info cache {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 00:26:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "refresh_cache-785033c7-e14b-418e-952a-248328b75d60" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:26:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquired lock "refresh_cache-785033c7-e14b-418e-952a-248328b75d60" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:26:55 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 785033c7-e14b-418e-952a-248328b75d60] Forcefully refreshing network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 00:26:56 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 785033c7-e14b-418e-952a-248328b75d60] Updating instance_info_cache with network_info: [{"id": "29f1f1cc-0517-49a1-b8f1-61a7c3ee1002", "address": "fa:16:3e:59:e0:37", "network": {"id": "cb8c9bb1-a885-486d-aa6a-de600bc01c2e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1676259779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8663ccad9047f4b11b9ae0646c287a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29f1f1cc-05", "ovs_interfaceid": "29f1f1cc-0517-49a1-b8f1-61a7c3ee1002", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:26:56 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Releasing lock "refresh_cache-785033c7-e14b-418e-952a-248328b75d60" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:26:56 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 785033c7-e14b-418e-952a-248328b75d60] Updated the network info_cache for instance {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 00:26:56 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:26:58 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:26:58 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:27:00 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:27:00 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:27:01 user nova-compute[82479]: INFO nova.compute.manager [None req-87aa8b38-3771-4e68-9349-711d3b63f992 tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Get console output
Apr 14 00:27:01 user nova-compute[82479]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Apr 14 00:27:02 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:27:04 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:27:04 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:27:05 user nova-compute[82479]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681432010.4402537, 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9 => Stopped> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:27:05 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] VM Stopped (Lifecycle Event)
Apr 14 00:27:05 user nova-compute[82479]: DEBUG nova.compute.manager [None req-d601bcb0-cd08-456b-875f-4b49635ef998 None None] [instance: 6df5031d-3e5b-4a6a-85a5-1c3e1eb582d9] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:27:05 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:27:06 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:27:06 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:27:06 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:27:06 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:27:06 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:27:06 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Auditing locally available compute resources for user (node: user) {{(pid=82479) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 00:27:06 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785033c7-e14b-418e-952a-248328b75d60/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:27:06 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785033c7-e14b-418e-952a-248328b75d60/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:27:06 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785033c7-e14b-418e-952a-248328b75d60/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:27:06 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785033c7-e14b-418e-952a-248328b75d60/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:27:07 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:27:07 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4235d23-9b0d-4da3-870c-778c6c9b7ae1/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:27:07 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4235d23-9b0d-4da3-870c-778c6c9b7ae1/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:27:07 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4235d23-9b0d-4da3-870c-778c6c9b7ae1/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:27:07 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4235d23-9b0d-4da3-870c-778c6c9b7ae1/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:27:07 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:27:07 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:27:07 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Hypervisor/Node resource view: name=user free_ram=8562MB free_disk=26.238658905029297GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82479) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 00:27:07 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:27:07 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:27:07 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 785033c7-e14b-418e-952a-248328b75d60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:27:07 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance a1f2d364-908f-41c6-8e0c-df376a5d14f1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:27:07 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance a4235d23-9b0d-4da3-870c-778c6c9b7ae1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:27:07 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 00:27:07 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Final resource view: name=user phys_ram=16023MB used_ram=960MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 00:27:07 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:27:07 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:27:07 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Compute_service record updated for user:user {{(pid=82479) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 00:27:07 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.291s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:27:08 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:27:08 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:27:08 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82479) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 00:27:10 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:27:15 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:27:15 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:27:15 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:27:15 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:27:15 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:27:15 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:27:20 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:27:21 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:27:25 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:27:30 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:27:35 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:27:40 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:27:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:27:42 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:27:45 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:27:48 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:27:50 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:27:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:27:52 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:27:53 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Acquiring lock "2d04f694-0eba-46c3-a617-97d3de666de8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:27:53 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "2d04f694-0eba-46c3-a617-97d3de666de8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:27:53 user nova-compute[82479]: DEBUG nova.compute.manager [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Starting instance... {{(pid=82479) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 00:27:53 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:27:53 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:27:53 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82479) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 00:27:53 user nova-compute[82479]: INFO nova.compute.claims [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Claim successful on node user
Apr 14 00:27:53 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:27:53 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:27:53 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.300s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:27:53 user nova-compute[82479]: DEBUG nova.compute.manager [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Start building networks asynchronously for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 00:27:53 user nova-compute[82479]: DEBUG nova.compute.manager [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Allocating IP information in the background. {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 00:27:53 user nova-compute[82479]: DEBUG nova.network.neutron [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] allocate_for_instance() {{(pid=82479) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 00:27:53 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 00:27:53 user nova-compute[82479]: DEBUG nova.compute.manager [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Start building block device mappings for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 00:27:54 user nova-compute[82479]: DEBUG nova.policy [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '67248d6b437547918b0cc2b0cdf29536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46ba54fdcdb45368f457001f26a281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82479) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 00:27:54 user nova-compute[82479]: DEBUG nova.compute.manager [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Start spawning the instance on the hypervisor. {{(pid=82479) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 00:27:54 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Creating instance directory {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 00:27:54 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Creating image(s)
Apr 14 00:27:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Acquiring lock "/opt/stack/data/nova/instances/2d04f694-0eba-46c3-a617-97d3de666de8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:27:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "/opt/stack/data/nova/instances/2d04f694-0eba-46c3-a617-97d3de666de8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:27:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "/opt/stack/data/nova/instances/2d04f694-0eba-46c3-a617-97d3de666de8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:27:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:27:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.142s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:27:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Acquiring lock "3e200e101633f2016e569ae4c0a352380507d1e4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:27:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "3e200e101633f2016e569ae4c0a352380507d1e4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:27:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:27:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.131s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:27:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/2d04f694-0eba-46c3-a617-97d3de666de8/disk 1073741824 {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:27:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/2d04f694-0eba-46c3-a617-97d3de666de8/disk 1073741824" returned: 0 in 0.051s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:27:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "3e200e101633f2016e569ae4c0a352380507d1e4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.189s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:27:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:27:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.138s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:27:54 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2d04f694-0eba-46c3-a617-97d3de666de8/disk. size=1073741824 {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 00:27:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d04f694-0eba-46c3-a617-97d3de666de8/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:27:54 user nova-compute[82479]: DEBUG nova.network.neutron [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Successfully created port: e7556e77-8734-4ef9-b260-2503b06b73bc {{(pid=82479) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 00:27:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d04f694-0eba-46c3-a617-97d3de666de8/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:27:54 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Cannot resize image /opt/stack/data/nova/instances/2d04f694-0eba-46c3-a617-97d3de666de8/disk to a smaller size. {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 00:27:54 user nova-compute[82479]: DEBUG nova.objects.instance [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lazy-loading 'migration_context' on Instance uuid 2d04f694-0eba-46c3-a617-97d3de666de8 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:27:54 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Created local disks {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 00:27:54 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Ensure instance console log exists: /opt/stack/data/nova/instances/2d04f694-0eba-46c3-a617-97d3de666de8/console.log {{(pid=82479) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 00:27:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:27:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:27:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:27:55 user nova-compute[82479]: DEBUG nova.network.neutron [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Successfully updated port: e7556e77-8734-4ef9-b260-2503b06b73bc {{(pid=82479) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 00:27:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Acquiring lock "refresh_cache-2d04f694-0eba-46c3-a617-97d3de666de8" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:27:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Acquired lock "refresh_cache-2d04f694-0eba-46c3-a617-97d3de666de8" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:27:55 user nova-compute[82479]: DEBUG nova.network.neutron [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 00:27:55 user nova-compute[82479]: DEBUG nova.compute.manager [req-0d0ae863-c1eb-49d6-b0e2-6579fcd81aa9 req-780466fb-002a-48d5-9693-d1a1c8ddb08b service nova] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Received event network-changed-e7556e77-8734-4ef9-b260-2503b06b73bc {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:27:55 user nova-compute[82479]: DEBUG nova.compute.manager [req-0d0ae863-c1eb-49d6-b0e2-6579fcd81aa9 req-780466fb-002a-48d5-9693-d1a1c8ddb08b service nova] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Refreshing instance network info cache due to event network-changed-e7556e77-8734-4ef9-b260-2503b06b73bc. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:27:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0d0ae863-c1eb-49d6-b0e2-6579fcd81aa9 req-780466fb-002a-48d5-9693-d1a1c8ddb08b service nova] Acquiring lock "refresh_cache-2d04f694-0eba-46c3-a617-97d3de666de8" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:27:55 user nova-compute[82479]: DEBUG nova.network.neutron [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Instance cache missing network info. {{(pid=82479) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 00:27:55 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:27:55 user nova-compute[82479]: DEBUG nova.network.neutron [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Updating instance_info_cache with network_info: [{"id": "e7556e77-8734-4ef9-b260-2503b06b73bc", "address": "fa:16:3e:5a:d1:62", "network": {"id": "8b306bb0-c969-4918-a696-dd539eaa3a21", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1341077591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e46ba54fdcdb45368f457001f26a281b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7556e77-87", "ovs_interfaceid": "e7556e77-8734-4ef9-b260-2503b06b73bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:27:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Releasing lock "refresh_cache-2d04f694-0eba-46c3-a617-97d3de666de8" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:27:55 user nova-compute[82479]: DEBUG nova.compute.manager [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Instance network_info: |[{"id": "e7556e77-8734-4ef9-b260-2503b06b73bc", "address": "fa:16:3e:5a:d1:62", "network": {"id": "8b306bb0-c969-4918-a696-dd539eaa3a21", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1341077591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e46ba54fdcdb45368f457001f26a281b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7556e77-87", "ovs_interfaceid": "e7556e77-8734-4ef9-b260-2503b06b73bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 00:27:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0d0ae863-c1eb-49d6-b0e2-6579fcd81aa9 req-780466fb-002a-48d5-9693-d1a1c8ddb08b service nova] Acquired lock "refresh_cache-2d04f694-0eba-46c3-a617-97d3de666de8" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:27:55 user nova-compute[82479]: DEBUG nova.network.neutron [req-0d0ae863-c1eb-49d6-b0e2-6579fcd81aa9 req-780466fb-002a-48d5-9693-d1a1c8ddb08b service nova] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Refreshing network info cache for port e7556e77-8734-4ef9-b260-2503b06b73bc {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:27:55 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Start _get_guest_xml network_info=[{"id": "e7556e77-8734-4ef9-b260-2503b06b73bc", "address": "fa:16:3e:5a:d1:62", "network": {"id": "8b306bb0-c969-4918-a696-dd539eaa3a21", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1341077591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e46ba54fdcdb45368f457001f26a281b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7556e77-87", "ovs_interfaceid": "e7556e77-8734-4ef9-b260-2503b06b73bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 00:27:55 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:27:55 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:27:55 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82479) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 00:27:55 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T00:02:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 00:27:55 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Flavor limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 00:27:55 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Image limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 00:27:55 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Flavor pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 00:27:55 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Image pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 00:27:55 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 00:27:55 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 00:27:55 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 00:27:55 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Got 1 possible topologies {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 00:27:55 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 00:27:55 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 00:27:55 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:27:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1146244002',display_name='tempest-ServersNegativeTestJSON-server-1146244002',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1146244002',id=35,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e46ba54fdcdb45368f457001f26a281b',ramdisk_id='',reservation_id='r-9vy07ao1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-495782531',owner_user_name='tempest-ServersNegativeTestJSON-495782531-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:27:54Z,user_data=None,user_id='67248d6b437547918b0cc2b0cdf29536',uuid=2d04f694-0eba-46c3-a617-97d3de666de8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7556e77-8734-4ef9-b260-2503b06b73bc", "address": "fa:16:3e:5a:d1:62", "network": {"id": "8b306bb0-c969-4918-a696-dd539eaa3a21", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1341077591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e46ba54fdcdb45368f457001f26a281b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7556e77-87", "ovs_interfaceid": "e7556e77-8734-4ef9-b260-2503b06b73bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82479) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 00:27:55 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Converting VIF {"id": "e7556e77-8734-4ef9-b260-2503b06b73bc", "address": "fa:16:3e:5a:d1:62", "network": {"id": "8b306bb0-c969-4918-a696-dd539eaa3a21", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1341077591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e46ba54fdcdb45368f457001f26a281b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7556e77-87", "ovs_interfaceid": "e7556e77-8734-4ef9-b260-2503b06b73bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:27:55 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:d1:62,bridge_name='br-int',has_traffic_filtering=True,id=e7556e77-8734-4ef9-b260-2503b06b73bc,network=Network(8b306bb0-c969-4918-a696-dd539eaa3a21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7556e77-87') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:27:55 user nova-compute[82479]: DEBUG nova.objects.instance [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lazy-loading 'pci_devices' on Instance uuid 2d04f694-0eba-46c3-a617-97d3de666de8 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:27:55 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] End _get_guest_xml xml=<domain type="kvm">
Apr 14 00:27:55 user nova-compute[82479]:   <uuid>2d04f694-0eba-46c3-a617-97d3de666de8</uuid>
Apr 14 00:27:55 user nova-compute[82479]:   <name>instance-00000023</name>
Apr 14 00:27:55 user nova-compute[82479]:   <memory>131072</memory>
Apr 14 00:27:55 user nova-compute[82479]:   <vcpu>1</vcpu>
Apr 14 00:27:55 user nova-compute[82479]:   <metadata>
Apr 14 00:27:55 user nova-compute[82479]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 00:27:55 user nova-compute[82479]:       <nova:package version="0.0.0"/>
Apr 14 00:27:55 user nova-compute[82479]:       <nova:name>tempest-ServersNegativeTestJSON-server-1146244002</nova:name>
Apr 14 00:27:55 user nova-compute[82479]:       <nova:creationTime>2023-04-14 00:27:55</nova:creationTime>
Apr 14 00:27:55 user nova-compute[82479]:       <nova:flavor name="m1.nano">
Apr 14 00:27:55 user nova-compute[82479]:         <nova:memory>128</nova:memory>
Apr 14 00:27:55 user nova-compute[82479]:         <nova:disk>1</nova:disk>
Apr 14 00:27:55 user nova-compute[82479]:         <nova:swap>0</nova:swap>
Apr 14 00:27:55 user nova-compute[82479]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 00:27:55 user nova-compute[82479]:         <nova:vcpus>1</nova:vcpus>
Apr 14 00:27:55 user nova-compute[82479]:       </nova:flavor>
Apr 14 00:27:55 user nova-compute[82479]:       <nova:owner>
Apr 14 00:27:55 user nova-compute[82479]:         <nova:user uuid="67248d6b437547918b0cc2b0cdf29536">tempest-ServersNegativeTestJSON-495782531-project-member</nova:user>
Apr 14 00:27:55 user nova-compute[82479]:         <nova:project uuid="e46ba54fdcdb45368f457001f26a281b">tempest-ServersNegativeTestJSON-495782531</nova:project>
Apr 14 00:27:55 user nova-compute[82479]:       </nova:owner>
Apr 14 00:27:55 user nova-compute[82479]:       <nova:root type="image" uuid="6db62068-7278-4cd8-b41f-d0140d89e199"/>
Apr 14 00:27:55 user nova-compute[82479]:       <nova:ports>
Apr 14 00:27:55 user nova-compute[82479]:         <nova:port uuid="e7556e77-8734-4ef9-b260-2503b06b73bc">
Apr 14 00:27:55 user nova-compute[82479]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 14 00:27:55 user nova-compute[82479]:         </nova:port>
Apr 14 00:27:55 user nova-compute[82479]:       </nova:ports>
Apr 14 00:27:55 user nova-compute[82479]:     </nova:instance>
Apr 14 00:27:55 user nova-compute[82479]:   </metadata>
Apr 14 00:27:55 user nova-compute[82479]:   <sysinfo type="smbios">
Apr 14 00:27:55 user nova-compute[82479]:     <system>
Apr 14 00:27:55 user nova-compute[82479]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 00:27:55 user nova-compute[82479]:       <entry name="product">OpenStack Nova</entry>
Apr 14 00:27:55 user nova-compute[82479]:       <entry name="version">0.0.0</entry>
Apr 14 00:27:55 user nova-compute[82479]:       <entry name="serial">2d04f694-0eba-46c3-a617-97d3de666de8</entry>
Apr 14 00:27:55 user nova-compute[82479]:       <entry name="uuid">2d04f694-0eba-46c3-a617-97d3de666de8</entry>
Apr 14 00:27:55 user nova-compute[82479]:       <entry name="family">Virtual Machine</entry>
Apr 14 00:27:55 user nova-compute[82479]:     </system>
Apr 14 00:27:55 user nova-compute[82479]:   </sysinfo>
Apr 14 00:27:55 user nova-compute[82479]:   <os>
Apr 14 00:27:55 user nova-compute[82479]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 00:27:55 user nova-compute[82479]:     <boot dev="hd"/>
Apr 14 00:27:55 user nova-compute[82479]:     <smbios mode="sysinfo"/>
Apr 14 00:27:55 user nova-compute[82479]:   </os>
Apr 14 00:27:55 user nova-compute[82479]:   <features>
Apr 14 00:27:55 user nova-compute[82479]:     <acpi/>
Apr 14 00:27:55 user nova-compute[82479]:     <apic/>
Apr 14 00:27:55 user nova-compute[82479]:     <vmcoreinfo/>
Apr 14 00:27:55 user nova-compute[82479]:   </features>
Apr 14 00:27:55 user nova-compute[82479]:   <clock offset="utc">
Apr 14 00:27:55 user nova-compute[82479]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 00:27:55 user nova-compute[82479]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 00:27:55 user nova-compute[82479]:     <timer name="hpet" present="no"/>
Apr 14 00:27:55 user nova-compute[82479]:   </clock>
Apr 14 00:27:55 user nova-compute[82479]:   <cpu mode="custom" match="exact">
Apr 14 00:27:55 user nova-compute[82479]:     <model>Nehalem</model>
Apr 14 00:27:55 user nova-compute[82479]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 00:27:55 user nova-compute[82479]:   </cpu>
Apr 14 00:27:55 user nova-compute[82479]:   <devices>
Apr 14 00:27:55 user nova-compute[82479]:     <disk type="file" device="disk">
Apr 14 00:27:55 user nova-compute[82479]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 00:27:55 user nova-compute[82479]:       <source file="/opt/stack/data/nova/instances/2d04f694-0eba-46c3-a617-97d3de666de8/disk"/>
Apr 14 00:27:55 user nova-compute[82479]:       <target dev="vda" bus="virtio"/>
Apr 14 00:27:55 user nova-compute[82479]:     </disk>
Apr 14 00:27:55 user nova-compute[82479]:     <interface type="ethernet">
Apr 14 00:27:55 user nova-compute[82479]:       <mac address="fa:16:3e:5a:d1:62"/>
Apr 14 00:27:55 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:27:55 user nova-compute[82479]:       <mtu size="1442"/>
Apr 14 00:27:55 user nova-compute[82479]:       <target dev="tape7556e77-87"/>
Apr 14 00:27:55 user nova-compute[82479]:     </interface>
Apr 14 00:27:55 user nova-compute[82479]:     <serial type="pty">
Apr 14 00:27:55 user nova-compute[82479]:       <log file="/opt/stack/data/nova/instances/2d04f694-0eba-46c3-a617-97d3de666de8/console.log" append="off"/>
Apr 14 00:27:55 user nova-compute[82479]:     </serial>
Apr 14 00:27:55 user nova-compute[82479]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 00:27:55 user nova-compute[82479]:     <video>
Apr 14 00:27:55 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:27:55 user nova-compute[82479]:     </video>
Apr 14 00:27:55 user nova-compute[82479]:     <rng model="virtio">
Apr 14 00:27:55 user nova-compute[82479]:       <backend model="random">/dev/urandom</backend>
Apr 14 00:27:55 user nova-compute[82479]:     </rng>
Apr 14 00:27:55 user nova-compute[82479]:     <controller type="usb" index="0" model="none"/>
Apr 14 00:27:55 user nova-compute[82479]:     <memballoon model="virtio">
Apr 14 00:27:55 user nova-compute[82479]:       <stats period="10"/>
Apr 14 00:27:55 user nova-compute[82479]:     </memballoon>
Apr 14 00:27:55 user nova-compute[82479]:   </devices>
Apr 14 00:27:55 user nova-compute[82479]: </domain>
Apr 14 00:27:55 user nova-compute[82479]:  {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 00:27:55 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:27:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1146244002',display_name='tempest-ServersNegativeTestJSON-server-1146244002',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1146244002',id=35,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e46ba54fdcdb45368f457001f26a281b',ramdisk_id='',reservation_id='r-9vy07ao1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-495782531',owner_user_name='tempest-ServersNegativeTestJSON-495782531-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:27:54Z,user_data=None,user_id='67248d6b437547918b0cc2b0cdf29536',uuid=2d04f694-0eba-46c3-a617-97d3de666de8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7556e77-8734-4ef9-b260-2503b06b73bc", "address": "fa:16:3e:5a:d1:62", "network": {"id": "8b306bb0-c969-4918-a696-dd539eaa3a21", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1341077591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e46ba54fdcdb45368f457001f26a281b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7556e77-87", "ovs_interfaceid": "e7556e77-8734-4ef9-b260-2503b06b73bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 00:27:55 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Converting VIF {"id": "e7556e77-8734-4ef9-b260-2503b06b73bc", "address": "fa:16:3e:5a:d1:62", "network": {"id": "8b306bb0-c969-4918-a696-dd539eaa3a21", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1341077591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e46ba54fdcdb45368f457001f26a281b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7556e77-87", "ovs_interfaceid": "e7556e77-8734-4ef9-b260-2503b06b73bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:27:55 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:d1:62,bridge_name='br-int',has_traffic_filtering=True,id=e7556e77-8734-4ef9-b260-2503b06b73bc,network=Network(8b306bb0-c969-4918-a696-dd539eaa3a21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7556e77-87') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:27:55 user nova-compute[82479]: DEBUG os_vif [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:d1:62,bridge_name='br-int',has_traffic_filtering=True,id=e7556e77-8734-4ef9-b260-2503b06b73bc,network=Network(8b306bb0-c969-4918-a696-dd539eaa3a21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7556e77-87') {{(pid=82479) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 00:27:55 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:27:55 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:27:55 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 00:27:55 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:27:55 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape7556e77-87, may_exist=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:27:55 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape7556e77-87, col_values=(('external_ids', {'iface-id': 'e7556e77-8734-4ef9-b260-2503b06b73bc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:d1:62', 'vm-uuid': '2d04f694-0eba-46c3-a617-97d3de666de8'}),)) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:27:55 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:27:55 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:27:55 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:27:55 user nova-compute[82479]: INFO os_vif [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:d1:62,bridge_name='br-int',has_traffic_filtering=True,id=e7556e77-8734-4ef9-b260-2503b06b73bc,network=Network(8b306bb0-c969-4918-a696-dd539eaa3a21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7556e77-87')
Apr 14 00:27:55 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:27:55 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] No VIF found with MAC fa:16:3e:5a:d1:62, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:27:56 user nova-compute[82479]: DEBUG nova.network.neutron [req-0d0ae863-c1eb-49d6-b0e2-6579fcd81aa9 req-780466fb-002a-48d5-9693-d1a1c8ddb08b service nova] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Updated VIF entry in instance network info cache for port e7556e77-8734-4ef9-b260-2503b06b73bc. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:27:56 user nova-compute[82479]: DEBUG nova.network.neutron [req-0d0ae863-c1eb-49d6-b0e2-6579fcd81aa9 req-780466fb-002a-48d5-9693-d1a1c8ddb08b service nova] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Updating instance_info_cache with network_info: [{"id": "e7556e77-8734-4ef9-b260-2503b06b73bc", "address": "fa:16:3e:5a:d1:62", "network": {"id": "8b306bb0-c969-4918-a696-dd539eaa3a21", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1341077591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e46ba54fdcdb45368f457001f26a281b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7556e77-87", "ovs_interfaceid": "e7556e77-8734-4ef9-b260-2503b06b73bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:27:56 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0d0ae863-c1eb-49d6-b0e2-6579fcd81aa9 req-780466fb-002a-48d5-9693-d1a1c8ddb08b service nova] Releasing lock "refresh_cache-2d04f694-0eba-46c3-a617-97d3de666de8" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:27:56 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:27:56 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:27:56 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Starting heal instance info cache {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 00:27:56 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "refresh_cache-a1f2d364-908f-41c6-8e0c-df376a5d14f1" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:27:56 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquired lock "refresh_cache-a1f2d364-908f-41c6-8e0c-df376a5d14f1" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:27:56 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Forcefully refreshing network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 00:27:57 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:27:57 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:27:57 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:27:57 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Updating instance_info_cache with network_info: [{"id": "db5a953b-fab8-4158-b9bb-95c4db32658e", "address": "fa:16:3e:16:63:e8", "network": {"id": "cb8c9bb1-a885-486d-aa6a-de600bc01c2e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1676259779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8663ccad9047f4b11b9ae0646c287a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb5a953b-fa", "ovs_interfaceid": "db5a953b-fab8-4158-b9bb-95c4db32658e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:27:57 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Releasing lock "refresh_cache-a1f2d364-908f-41c6-8e0c-df376a5d14f1" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:27:57 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Updated the network info_cache for instance {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 00:27:57 user nova-compute[82479]: DEBUG nova.compute.manager [req-f899982f-069f-4763-af9e-3bdfa0bc03a0 req-05eac7e5-8ca2-44ab-934d-7e400a7b8640 service nova] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Received event network-vif-plugged-e7556e77-8734-4ef9-b260-2503b06b73bc {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:27:57 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-f899982f-069f-4763-af9e-3bdfa0bc03a0 req-05eac7e5-8ca2-44ab-934d-7e400a7b8640 service nova] Acquiring lock "2d04f694-0eba-46c3-a617-97d3de666de8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:27:57 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-f899982f-069f-4763-af9e-3bdfa0bc03a0 req-05eac7e5-8ca2-44ab-934d-7e400a7b8640 service nova] Lock "2d04f694-0eba-46c3-a617-97d3de666de8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:27:57 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-f899982f-069f-4763-af9e-3bdfa0bc03a0 req-05eac7e5-8ca2-44ab-934d-7e400a7b8640 service nova] Lock "2d04f694-0eba-46c3-a617-97d3de666de8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:27:57 user nova-compute[82479]: DEBUG nova.compute.manager [req-f899982f-069f-4763-af9e-3bdfa0bc03a0 req-05eac7e5-8ca2-44ab-934d-7e400a7b8640 service nova] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] No waiting events found dispatching network-vif-plugged-e7556e77-8734-4ef9-b260-2503b06b73bc {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:27:57 user nova-compute[82479]: WARNING nova.compute.manager [req-f899982f-069f-4763-af9e-3bdfa0bc03a0 req-05eac7e5-8ca2-44ab-934d-7e400a7b8640 service nova] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Received unexpected event network-vif-plugged-e7556e77-8734-4ef9-b260-2503b06b73bc for instance with vm_state building and task_state spawning.
Apr 14 00:27:57 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:27:57 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:27:57 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:27:58 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:27:59 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681432079.2377813, 2d04f694-0eba-46c3-a617-97d3de666de8 => Resumed> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:27:59 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] VM Resumed (Lifecycle Event)
Apr 14 00:27:59 user nova-compute[82479]: DEBUG nova.compute.manager [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Instance event wait completed in 0 seconds for  {{(pid=82479) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 00:27:59 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Guest created on hypervisor {{(pid=82479) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 00:27:59 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Instance spawned successfully.
Apr 14 00:27:59 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 00:27:59 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:27:59 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:27:59 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Found default for hw_cdrom_bus of ide {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:27:59 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Found default for hw_disk_bus of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:27:59 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Found default for hw_input_bus of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:27:59 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Found default for hw_pointer_model of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:27:59 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Found default for hw_video_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:27:59 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Found default for hw_vif_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:27:59 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:27:59 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681432079.238956, 2d04f694-0eba-46c3-a617-97d3de666de8 => Started> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:27:59 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] VM Started (Lifecycle Event)
Apr 14 00:27:59 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:27:59 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:27:59 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:27:59 user nova-compute[82479]: INFO nova.compute.manager [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Took 5.30 seconds to spawn the instance on the hypervisor.
Apr 14 00:27:59 user nova-compute[82479]: DEBUG nova.compute.manager [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:27:59 user nova-compute[82479]: DEBUG nova.compute.manager [req-c18b741c-9303-4137-8731-24f33c2e0693 req-6cef15c6-47df-4109-8b01-0e1affe7519c service nova] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Received event network-vif-plugged-e7556e77-8734-4ef9-b260-2503b06b73bc {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:27:59 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-c18b741c-9303-4137-8731-24f33c2e0693 req-6cef15c6-47df-4109-8b01-0e1affe7519c service nova] Acquiring lock "2d04f694-0eba-46c3-a617-97d3de666de8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:27:59 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-c18b741c-9303-4137-8731-24f33c2e0693 req-6cef15c6-47df-4109-8b01-0e1affe7519c service nova] Lock "2d04f694-0eba-46c3-a617-97d3de666de8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:27:59 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-c18b741c-9303-4137-8731-24f33c2e0693 req-6cef15c6-47df-4109-8b01-0e1affe7519c service nova] Lock "2d04f694-0eba-46c3-a617-97d3de666de8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:27:59 user nova-compute[82479]: DEBUG nova.compute.manager [req-c18b741c-9303-4137-8731-24f33c2e0693 req-6cef15c6-47df-4109-8b01-0e1affe7519c service nova] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] No waiting events found dispatching network-vif-plugged-e7556e77-8734-4ef9-b260-2503b06b73bc {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:27:59 user nova-compute[82479]: WARNING nova.compute.manager [req-c18b741c-9303-4137-8731-24f33c2e0693 req-6cef15c6-47df-4109-8b01-0e1affe7519c service nova] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Received unexpected event network-vif-plugged-e7556e77-8734-4ef9-b260-2503b06b73bc for instance with vm_state building and task_state spawning.
Apr 14 00:27:59 user nova-compute[82479]: INFO nova.compute.manager [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Took 5.93 seconds to build instance.
Apr 14 00:27:59 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-78a000c8-3651-4246-9136-35307c32cf1e tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "2d04f694-0eba-46c3-a617-97d3de666de8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.031s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:28:00 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:28:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:28:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-601710f8-4449-4ec5-af12-e92a871fb83c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "a1f2d364-908f-41c6-8e0c-df376a5d14f1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:28:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-601710f8-4449-4ec5-af12-e92a871fb83c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "a1f2d364-908f-41c6-8e0c-df376a5d14f1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:28:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-601710f8-4449-4ec5-af12-e92a871fb83c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "a1f2d364-908f-41c6-8e0c-df376a5d14f1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:28:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-601710f8-4449-4ec5-af12-e92a871fb83c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "a1f2d364-908f-41c6-8e0c-df376a5d14f1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:28:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-601710f8-4449-4ec5-af12-e92a871fb83c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "a1f2d364-908f-41c6-8e0c-df376a5d14f1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:28:01 user nova-compute[82479]: INFO nova.compute.manager [None req-601710f8-4449-4ec5-af12-e92a871fb83c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Terminating instance
Apr 14 00:28:01 user nova-compute[82479]: DEBUG nova.compute.manager [None req-601710f8-4449-4ec5-af12-e92a871fb83c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Start destroying the instance on the hypervisor. {{(pid=82479) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 00:28:02 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:28:02 user nova-compute[82479]: DEBUG nova.compute.manager [req-2eaacc76-a85e-42d2-b742-1942122bf6f8 req-f4899136-265a-427d-847b-0f28fdbbb6e5 service nova] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Received event network-vif-unplugged-db5a953b-fab8-4158-b9bb-95c4db32658e {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:28:02 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-2eaacc76-a85e-42d2-b742-1942122bf6f8 req-f4899136-265a-427d-847b-0f28fdbbb6e5 service nova] Acquiring lock "a1f2d364-908f-41c6-8e0c-df376a5d14f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:28:02 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-2eaacc76-a85e-42d2-b742-1942122bf6f8 req-f4899136-265a-427d-847b-0f28fdbbb6e5 service nova] Lock "a1f2d364-908f-41c6-8e0c-df376a5d14f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:28:02 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-2eaacc76-a85e-42d2-b742-1942122bf6f8 req-f4899136-265a-427d-847b-0f28fdbbb6e5 service nova] Lock "a1f2d364-908f-41c6-8e0c-df376a5d14f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:28:02 user nova-compute[82479]: DEBUG nova.compute.manager [req-2eaacc76-a85e-42d2-b742-1942122bf6f8 req-f4899136-265a-427d-847b-0f28fdbbb6e5 service nova] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] No waiting events found dispatching network-vif-unplugged-db5a953b-fab8-4158-b9bb-95c4db32658e {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:28:02 user nova-compute[82479]: DEBUG nova.compute.manager [req-2eaacc76-a85e-42d2-b742-1942122bf6f8 req-f4899136-265a-427d-847b-0f28fdbbb6e5 service nova] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Received event network-vif-unplugged-db5a953b-fab8-4158-b9bb-95c4db32658e for instance with task_state deleting. {{(pid=82479) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 00:28:02 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:28:02 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:28:02 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:28:02 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Instance destroyed successfully.
Apr 14 00:28:02 user nova-compute[82479]: DEBUG nova.objects.instance [None req-601710f8-4449-4ec5-af12-e92a871fb83c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lazy-loading 'resources' on Instance uuid a1f2d364-908f-41c6-8e0c-df376a5d14f1 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:28:02 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-601710f8-4449-4ec5-af12-e92a871fb83c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:21:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1594608317',display_name='tempest-ServerActionsTestJSON-server-1594608317',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1594608317',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD8E1mkrqLo3jsCiJcIvha4CNzW2T6/HQ38hZ5dGaGtUghmrHejTJlAuKgmy6xusLbaAzGTrJCKVkdgQ5v0CqCqGeNMDA89aLJgLl5KHn3gvI39SkbPja84HarSvbQbbXg==',key_name='tempest-keypair-1040271550',keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:23:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bf8663ccad9047f4b11b9ae0646c287a',ramdisk_id='',reservation_id='r-w08m23lo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-948553482',owner_user_name='tempest-ServerActionsTestJSON-948553482-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T00:25:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d86662f2c7648daad87118b7e9f757c',uuid=a1f2d364-908f-41c6-8e0c-df376a5d14f1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "db5a953b-fab8-4158-b9bb-95c4db32658e", "address": "fa:16:3e:16:63:e8", "network": {"id": "cb8c9bb1-a885-486d-aa6a-de600bc01c2e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1676259779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8663ccad9047f4b11b9ae0646c287a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb5a953b-fa", "ovs_interfaceid": "db5a953b-fab8-4158-b9bb-95c4db32658e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 00:28:02 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-601710f8-4449-4ec5-af12-e92a871fb83c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Converting VIF {"id": "db5a953b-fab8-4158-b9bb-95c4db32658e", "address": "fa:16:3e:16:63:e8", "network": {"id": "cb8c9bb1-a885-486d-aa6a-de600bc01c2e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1676259779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8663ccad9047f4b11b9ae0646c287a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb5a953b-fa", "ovs_interfaceid": "db5a953b-fab8-4158-b9bb-95c4db32658e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:28:02 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-601710f8-4449-4ec5-af12-e92a871fb83c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:16:63:e8,bridge_name='br-int',has_traffic_filtering=True,id=db5a953b-fab8-4158-b9bb-95c4db32658e,network=Network(cb8c9bb1-a885-486d-aa6a-de600bc01c2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb5a953b-fa') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:28:02 user nova-compute[82479]: DEBUG os_vif [None req-601710f8-4449-4ec5-af12-e92a871fb83c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:63:e8,bridge_name='br-int',has_traffic_filtering=True,id=db5a953b-fab8-4158-b9bb-95c4db32658e,network=Network(cb8c9bb1-a885-486d-aa6a-de600bc01c2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb5a953b-fa') {{(pid=82479) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 00:28:02 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:28:02 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdb5a953b-fa, bridge=br-int, if_exists=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:28:02 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:28:02 user nova-compute[82479]: INFO os_vif [None req-601710f8-4449-4ec5-af12-e92a871fb83c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:63:e8,bridge_name='br-int',has_traffic_filtering=True,id=db5a953b-fab8-4158-b9bb-95c4db32658e,network=Network(cb8c9bb1-a885-486d-aa6a-de600bc01c2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb5a953b-fa')
Apr 14 00:28:02 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-601710f8-4449-4ec5-af12-e92a871fb83c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] calling os-brick to detach iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 00:28:02 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-601710f8-4449-4ec5-af12-e92a871fb83c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, {'target_iqn': 'iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BcLTtdGe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:28:02 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-601710f8-4449-4ec5-af12-e92a871fb83c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:28:02 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-601710f8-4449-4ec5-af12-e92a871fb83c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:28:02 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-601710f8-4449-4ec5-af12-e92a871fb83c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:28:02 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:28:02 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:28:02 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[762b9b47-7afc-41fe-b13e-1c6c1b30f53d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:28:02 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-601710f8-4449-4ec5-af12-e92a871fb83c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 00:28:02 user nova-compute[82479]: No targets found.
Apr 14 00:28:02 user nova-compute[82479]: iSNS:
Apr 14 00:28:02 user nova-compute[82479]: No targets found.
Apr 14 00:28:02 user nova-compute[82479]: STATIC:
Apr 14 00:28:02 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3
Apr 14 00:28:02 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:28:02 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:28:02 user nova-compute[82479]: FIRMWARE:
Apr 14 00:28:02 user nova-compute[82479]: No targets found.
Apr 14 00:28:02 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:28:02 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-601710f8-4449-4ec5-af12-e92a871fb83c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 00:28:02 user nova-compute[82479]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 00:28:02 user nova-compute[82479]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82479) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 00:28:02 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-601710f8-4449-4ec5-af12-e92a871fb83c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3', 0)] {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 00:28:02 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:28:02 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:28:02 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[268215ab-bf2a-47ef-92a2-3a0083a9e227]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:28:02 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:28:02 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:28:02 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11270be-715c-47a3-8db6-7957ca244953]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:28:02 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-601710f8-4449-4ec5-af12-e92a871fb83c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 (non-flash)
Apr 14 00:28:02 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:28:02 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-601710f8-4449-4ec5-af12-e92a871fb83c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 (non-flash)
Apr 14 00:28:02 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:28:02 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-601710f8-4449-4ec5-af12-e92a871fb83c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f33302cea70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3'): ({'sdd'}, set())}) {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 00:28:02 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-601710f8-4449-4ec5-af12-e92a871fb83c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Removing single pathed devices sdd {{(pid=82479) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 00:28:02 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:28:02 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:28:02 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8c60e5-b55c-47f6-8d53-e9ee720d519f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:28:02 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:28:03 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:28:03 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[001902b3-d4fa-45a8-a49c-28e63f721508]: (4, ('ok\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:28:03 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-601710f8-4449-4ec5-af12-e92a871fb83c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Flushing IO for device /dev/sdd {{(pid=82479) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 00:28:03 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:28:03 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:28:03 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ae2abc-502f-438e-a26b-381295a093dc]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:28:03 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-601710f8-4449-4ec5-af12-e92a871fb83c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=82479) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 00:28:03 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:28:03 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:28:03 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8712241-45db-44d4-abed-a21b3650a49e]: (4, ('1', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:28:03 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-601710f8-4449-4ec5-af12-e92a871fb83c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 00:28:03 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-601710f8-4449-4ec5-af12-e92a871fb83c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] SCSI volumes sdd have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 00:28:03 user nova-compute[82479]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO4dc4f62-d6ae34e51c0cba65', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_4dc4f62', '/dev/disk/by-id/scsi-26436616533346535') {{(pid=93289) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 14 00:28:03 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8d90f1-5200-4c97-8d7e-63846c939bcd]: (4, None) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:28:03 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-601710f8-4449-4ec5-af12-e92a871fb83c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3')] {{(pid=82479) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 00:28:03 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:28:03 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:28:03 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc26638c-bd21-419b-8f89-7919597e5826]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:28:03 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-601710f8-4449-4ec5-af12-e92a871fb83c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:28:03 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 -p 172.16.0.220:3260 --logout {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:28:03 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:28:03 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[e00d5256-1a06-45f2-9a18-cabfdb568e6f]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:28:03 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-601710f8-4449-4ec5-af12-e92a871fb83c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3, portal: 172.16.0.220,3260]
Apr 14 00:28:03 user nova-compute[82479]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3, portal: 172.16.0.220,3260] successful.
Apr 14 00:28:03 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:28:03 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 -p 172.16.0.220:3260 --op delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:28:03 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:28:03 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[8acb6fba-adf5-4255-97a9-7e4398146391]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:28:03 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-601710f8-4449-4ec5-af12-e92a871fb83c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:28:03 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-601710f8-4449-4ec5-af12-e92a871fb83c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:28:03 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-601710f8-4449-4ec5-af12-e92a871fb83c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] <== disconnect_volume: return (302ms) None {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:28:03 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-601710f8-4449-4ec5-af12-e92a871fb83c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Disconnected iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 00:28:03 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-601710f8-4449-4ec5-af12-e92a871fb83c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Deleting instance files /opt/stack/data/nova/instances/a1f2d364-908f-41c6-8e0c-df376a5d14f1_del
Apr 14 00:28:03 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-601710f8-4449-4ec5-af12-e92a871fb83c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Deletion of /opt/stack/data/nova/instances/a1f2d364-908f-41c6-8e0c-df376a5d14f1_del complete
Apr 14 00:28:03 user nova-compute[82479]: INFO nova.compute.manager [None req-601710f8-4449-4ec5-af12-e92a871fb83c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Took 1.29 seconds to destroy the instance on the hypervisor.
Apr 14 00:28:03 user nova-compute[82479]: DEBUG oslo.service.loopingcall [None req-601710f8-4449-4ec5-af12-e92a871fb83c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82479) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 00:28:03 user nova-compute[82479]: DEBUG nova.compute.manager [-] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Deallocating network for instance {{(pid=82479) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 00:28:03 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] deallocate_for_instance() {{(pid=82479) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 00:28:03 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:28:03 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Updating instance_info_cache with network_info: [] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:28:04 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Took 0.74 seconds to deallocate network for instance.
Apr 14 00:28:04 user nova-compute[82479]: DEBUG nova.compute.manager [req-919b3414-d0c9-4731-8ed9-54f58c49da5b req-e9105013-05c2-44c7-8046-98ec3d69eb58 service nova] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Received event network-vif-deleted-db5a953b-fab8-4158-b9bb-95c4db32658e {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:28:04 user nova-compute[82479]: DEBUG nova.compute.manager [req-2af130d6-ee7d-4252-9f7c-9a82fdb80778 req-1f0bd1ba-dae7-4c1a-b832-42831c068c34 service nova] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Received event network-vif-plugged-db5a953b-fab8-4158-b9bb-95c4db32658e {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:28:04 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-2af130d6-ee7d-4252-9f7c-9a82fdb80778 req-1f0bd1ba-dae7-4c1a-b832-42831c068c34 service nova] Acquiring lock "a1f2d364-908f-41c6-8e0c-df376a5d14f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:28:04 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-2af130d6-ee7d-4252-9f7c-9a82fdb80778 req-1f0bd1ba-dae7-4c1a-b832-42831c068c34 service nova] Lock "a1f2d364-908f-41c6-8e0c-df376a5d14f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:28:04 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-2af130d6-ee7d-4252-9f7c-9a82fdb80778 req-1f0bd1ba-dae7-4c1a-b832-42831c068c34 service nova] Lock "a1f2d364-908f-41c6-8e0c-df376a5d14f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:28:04 user nova-compute[82479]: DEBUG nova.compute.manager [req-2af130d6-ee7d-4252-9f7c-9a82fdb80778 req-1f0bd1ba-dae7-4c1a-b832-42831c068c34 service nova] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] No waiting events found dispatching network-vif-plugged-db5a953b-fab8-4158-b9bb-95c4db32658e {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:28:04 user nova-compute[82479]: WARNING nova.compute.manager [req-2af130d6-ee7d-4252-9f7c-9a82fdb80778 req-1f0bd1ba-dae7-4c1a-b832-42831c068c34 service nova] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Received unexpected event network-vif-plugged-db5a953b-fab8-4158-b9bb-95c4db32658e for instance with vm_state active and task_state deleting.
Apr 14 00:28:04 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:28:04 user nova-compute[82479]: INFO nova.compute.manager [None req-601710f8-4449-4ec5-af12-e92a871fb83c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Took 0.80 seconds to detach 1 volumes for instance.
Apr 14 00:28:04 user nova-compute[82479]: DEBUG nova.compute.manager [None req-601710f8-4449-4ec5-af12-e92a871fb83c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Deleting volume: 7056196a-d087-4a9b-a3c8-350b13e6d2c3 {{(pid=82479) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 14 00:28:04 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-601710f8-4449-4ec5-af12-e92a871fb83c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:28:04 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-601710f8-4449-4ec5-af12-e92a871fb83c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:28:05 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-601710f8-4449-4ec5-af12-e92a871fb83c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:28:05 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-601710f8-4449-4ec5-af12-e92a871fb83c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:28:05 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-601710f8-4449-4ec5-af12-e92a871fb83c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.184s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:28:05 user nova-compute[82479]: INFO nova.scheduler.client.report [None req-601710f8-4449-4ec5-af12-e92a871fb83c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Deleted allocations for instance a1f2d364-908f-41c6-8e0c-df376a5d14f1
Apr 14 00:28:05 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-601710f8-4449-4ec5-af12-e92a871fb83c tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "a1f2d364-908f-41c6-8e0c-df376a5d14f1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.275s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:28:05 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:28:06 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:28:07 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:28:08 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:28:08 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:28:08 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:28:08 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:28:08 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Auditing locally available compute resources for user (node: user) {{(pid=82479) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 00:28:08 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d04f694-0eba-46c3-a617-97d3de666de8/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:28:08 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d04f694-0eba-46c3-a617-97d3de666de8/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:28:08 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d04f694-0eba-46c3-a617-97d3de666de8/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:28:09 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d04f694-0eba-46c3-a617-97d3de666de8/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:28:09 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785033c7-e14b-418e-952a-248328b75d60/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:28:09 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785033c7-e14b-418e-952a-248328b75d60/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:28:09 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785033c7-e14b-418e-952a-248328b75d60/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:28:09 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785033c7-e14b-418e-952a-248328b75d60/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:28:09 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4235d23-9b0d-4da3-870c-778c6c9b7ae1/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:28:09 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4235d23-9b0d-4da3-870c-778c6c9b7ae1/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:28:09 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4235d23-9b0d-4da3-870c-778c6c9b7ae1/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:28:09 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4235d23-9b0d-4da3-870c-778c6c9b7ae1/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:28:09 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:28:09 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:28:09 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Hypervisor/Node resource view: name=user free_ram=8530MB free_disk=26.236038208007812GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82479) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 00:28:09 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:28:09 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:28:10 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 785033c7-e14b-418e-952a-248328b75d60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:28:10 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance a4235d23-9b0d-4da3-870c-778c6c9b7ae1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:28:10 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 2d04f694-0eba-46c3-a617-97d3de666de8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:28:10 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 00:28:10 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 00:28:10 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:28:10 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:28:10 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Compute_service record updated for user:user {{(pid=82479) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 00:28:10 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.250s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:28:11 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:28:11 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:28:11 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82479) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 00:28:11 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:28:12 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:28:16 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:28:17 user nova-compute[82479]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681432082.8416646, a1f2d364-908f-41c6-8e0c-df376a5d14f1 => Stopped> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:28:17 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] VM Stopped (Lifecycle Event)
Apr 14 00:28:17 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1105d5e8-9234-4735-9972-d9b078d562c2 None None] [instance: a1f2d364-908f-41c6-8e0c-df376a5d14f1] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:28:17 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:28:20 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Acquiring lock "a4235d23-9b0d-4da3-870c-778c6c9b7ae1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:28:20 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "a4235d23-9b0d-4da3-870c-778c6c9b7ae1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:28:20 user nova-compute[82479]: DEBUG nova.objects.instance [None req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lazy-loading 'flavor' on Instance uuid a4235d23-9b0d-4da3-870c-778c6c9b7ae1 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:28:20 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Ignoring supplied device name: /dev/vdb
Apr 14 00:28:20 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "a4235d23-9b0d-4da3-870c-778c6c9b7ae1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:28:20 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Acquiring lock "a4235d23-9b0d-4da3-870c-778c6c9b7ae1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:28:20 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "a4235d23-9b0d-4da3-870c-778c6c9b7ae1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:28:20 user nova-compute[82479]: INFO nova.compute.manager [None req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Attaching volume 62c40b52-a5d3-47d1-8a30-d50aa4514387 to /dev/vdb
Apr 14 00:28:20 user nova-compute[82479]: DEBUG os_brick.utils [None req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:28:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:28:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:28:20 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b88a88-a918-4ccf-b7b2-b726b2634278]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fec92fcfdd3\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:28:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:28:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:28:20 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[5755b88e-4794-4fea-abf8-c9442ec325c3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:28:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:28:21 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:28:21 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6227198-a0ca-49cb-a4d3-f43472499edd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:28:21 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[f42f5696-10d6-485a-82c4-480065f8003a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:28:21 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Running cmd (subprocess): nvme version {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:28:21 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] 'nvme version' failed. Not Retrying. {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:28:21 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.nvmeof [None req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] nvme not present on system {{(pid=82479) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 00:28:21 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:28:21 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:28:21 user nova-compute[82479]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 00:28:21 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c2c05f-b93f-4c4c-8fac-6f8b33aebc15]: (4, '') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:28:21 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82479) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 00:28:21 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 00:28:21 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] LIGHTOS: no hostnqn found. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 00:28:21 user nova-compute[82479]: DEBUG os_brick.utils [None req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fec92fcfdd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:28:21 user nova-compute[82479]: DEBUG nova.virt.block_device [None req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Updating existing volume attachment record: a5f482b2-b1bf-4452-83be-204a058ad5c3 {{(pid=82479) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 00:28:21 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:28:22 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:28:25 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Calling os-brick to attach iSCSI Volume {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 00:28:25 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zOgGiwXu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:28:25 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:28:25 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:28:25 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:28:25 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:28:25 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:28:25 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:28:25 user nova-compute[82479]: INFO os_brick.initiator.connectors.iscsi [None req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 00:28:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387 -p 172.16.0.220:3260 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:28:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:28:25 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[209924fd-bd4e-4a67-8624-634ff63525ea]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:28:25 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 00:28:25 user nova-compute[82479]:  {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:28:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387 -p 172.16.0.220:3260 --interface default --op new {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:28:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:28:25 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[04deb351-b8c9-4e9e-a244-17071b925de0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387] added\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:28:25 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387] added
Apr 14 00:28:25 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:28:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:28:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:28:25 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[fabe8c51-0c30-477a-acd8-417ae7a2c6b0]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:28:25 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:28:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:28:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:28:25 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[5baee3d0-94d8-4aeb-b80e-6f1b6ce4e218]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:28:25 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:28:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zOgGiwXu {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:28:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zOgGiwXu" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:28:25 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf34c01-871a-4a5a-907c-56a2000a2ac2]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:28:25 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zOgGiwXu'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:28:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:28:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:28:25 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f94d481-a597-4e67-a145-22b421dbd38c]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:28:25 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:28:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:28:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:28:25 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea9ffd2-eba3-4b45-ae2a-92d155e23279]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:28:25 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 00:28:25 user nova-compute[82479]:  {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:28:25 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 00:28:25 user nova-compute[82479]:  {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:28:25 user nova-compute[82479]: WARNING os_brick.initiator.connectors.iscsi [None req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 00:28:25 user nova-compute[82479]: 
Apr 14 00:28:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387 -p 172.16.0.220:3260 --login {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:28:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:28:25 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8e62c2-0a01-468f-91b1-260f6331ee7e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:28:25 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387, portal: 172.16.0.220,3260]
Apr 14 00:28:25 user nova-compute[82479]: Login to [iface: default, target: iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387, portal: 172.16.0.220,3260] successful.
Apr 14 00:28:25 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:28:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:28:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:28:25 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[848916a2-6f47-426a-8e04-59079c00cefc]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:28:25 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:28:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:28:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:28:25 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[73423e52-5714-4178-89ce-1f6c0c36cfef]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:28:25 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387 (non-flash)
Apr 14 00:28:25 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:28:25 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387 (non-flash)
Apr 14 00:28:25 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:28:25 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:28:25 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Connected to 172.16.0.220:3260 {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 00:28:25 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] HCTL ('33', '-', '-', 0) found on session 37 with lun 0 {{(pid=82479) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 00:28:25 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82479) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 00:28:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:28:25 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:28:25 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[579be0ce-8f34-41e5-803d-04ede6c8cf19]: (4, ('- - 0', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:28:25 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Searching for a device in session 37 and hctl ['33', '*', '*', 0] yield: None {{(pid=82479) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 00:28:26 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:28:26 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Searching for a device in session 37 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82479) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 00:28:26 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zOgGiwXu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 00:28:26 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:28:26 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '26563656637343361', 'path': '/dev/sdb'} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:28:26 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26563656637343361', 'path': '/dev/sdb'} {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 00:28:26 user nova-compute[82479]: DEBUG nova.objects.instance [None req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lazy-loading 'flavor' on Instance uuid a4235d23-9b0d-4da3-870c-778c6c9b7ae1 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:28:26 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 00:28:26 user nova-compute[82479]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:28:26 user nova-compute[82479]:   <source dev="/dev/sdb"/>
Apr 14 00:28:26 user nova-compute[82479]:   <target dev="vdb" bus="virtio"/>
Apr 14 00:28:26 user nova-compute[82479]:   <serial>62c40b52-a5d3-47d1-8a30-d50aa4514387</serial>
Apr 14 00:28:26 user nova-compute[82479]: </disk>
Apr 14 00:28:26 user nova-compute[82479]:  {{(pid=82479) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 00:28:27 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:28:27 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:28:27 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] No VIF found with MAC fa:16:3e:57:ed:7a, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:28:27 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "a4235d23-9b0d-4da3-870c-778c6c9b7ae1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.339s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:28:27 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:28:32 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:28:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:28:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:28:42 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-022d811c-442a-4d54-a74d-01cd4881745d tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Acquiring lock "a4235d23-9b0d-4da3-870c-778c6c9b7ae1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:28:42 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-022d811c-442a-4d54-a74d-01cd4881745d tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "a4235d23-9b0d-4da3-870c-778c6c9b7ae1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:28:42 user nova-compute[82479]: INFO nova.compute.manager [None req-022d811c-442a-4d54-a74d-01cd4881745d tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Detaching volume 62c40b52-a5d3-47d1-8a30-d50aa4514387
Apr 14 00:28:42 user nova-compute[82479]: INFO nova.virt.block_device [None req-022d811c-442a-4d54-a74d-01cd4881745d tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Attempting to driver detach volume 62c40b52-a5d3-47d1-8a30-d50aa4514387 from mountpoint /dev/vdb
Apr 14 00:28:42 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-022d811c-442a-4d54-a74d-01cd4881745d tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Attempting to detach device vdb from instance a4235d23-9b0d-4da3-870c-778c6c9b7ae1 from the persistent domain config. {{(pid=82479) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 00:28:42 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-022d811c-442a-4d54-a74d-01cd4881745d tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 00:28:42 user nova-compute[82479]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:28:42 user nova-compute[82479]:   <source dev="/dev/sdb"/>
Apr 14 00:28:42 user nova-compute[82479]:   <target dev="vdb" bus="virtio"/>
Apr 14 00:28:42 user nova-compute[82479]:   <serial>62c40b52-a5d3-47d1-8a30-d50aa4514387</serial>
Apr 14 00:28:42 user nova-compute[82479]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 00:28:42 user nova-compute[82479]: </disk>
Apr 14 00:28:42 user nova-compute[82479]:  {{(pid=82479) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 00:28:42 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-7d1972aa-3c05-418f-8f08-7c344b5b2d38 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Acquiring lock "a4235d23-9b0d-4da3-870c-778c6c9b7ae1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:28:42 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-022d811c-442a-4d54-a74d-01cd4881745d tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Successfully detached device vdb from instance a4235d23-9b0d-4da3-870c-778c6c9b7ae1 from the persistent domain config.
Apr 14 00:28:42 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-022d811c-442a-4d54-a74d-01cd4881745d tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a4235d23-9b0d-4da3-870c-778c6c9b7ae1 from the live domain config. {{(pid=82479) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 00:28:42 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-022d811c-442a-4d54-a74d-01cd4881745d tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 00:28:42 user nova-compute[82479]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:28:42 user nova-compute[82479]:   <source dev="/dev/sdb"/>
Apr 14 00:28:42 user nova-compute[82479]:   <target dev="vdb" bus="virtio"/>
Apr 14 00:28:42 user nova-compute[82479]:   <serial>62c40b52-a5d3-47d1-8a30-d50aa4514387</serial>
Apr 14 00:28:42 user nova-compute[82479]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 00:28:42 user nova-compute[82479]: </disk>
Apr 14 00:28:42 user nova-compute[82479]:  {{(pid=82479) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 00:28:42 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:28:42 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Received event <DeviceRemovedEvent: 1681432122.934357, a4235d23-9b0d-4da3-870c-778c6c9b7ae1 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82479) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 00:28:42 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-022d811c-442a-4d54-a74d-01cd4881745d tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a4235d23-9b0d-4da3-870c-778c6c9b7ae1 {{(pid=82479) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 00:28:42 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-022d811c-442a-4d54-a74d-01cd4881745d tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Successfully detached device vdb from instance a4235d23-9b0d-4da3-870c-778c6c9b7ae1 from the live domain config.
Apr 14 00:28:42 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-022d811c-442a-4d54-a74d-01cd4881745d tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] calling os-brick to detach iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 00:28:42 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-022d811c-442a-4d54-a74d-01cd4881745d tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, {'target_iqn': 'iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zOgGiwXu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:28:42 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-022d811c-442a-4d54-a74d-01cd4881745d tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:28:42 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-022d811c-442a-4d54-a74d-01cd4881745d tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:28:42 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-022d811c-442a-4d54-a74d-01cd4881745d tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:28:42 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:28:42 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:28:42 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[77809dd4-cb33-46fc-a6df-2aeb4c6aafa7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:28:42 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-022d811c-442a-4d54-a74d-01cd4881745d tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 00:28:42 user nova-compute[82479]: No targets found.
Apr 14 00:28:42 user nova-compute[82479]: iSNS:
Apr 14 00:28:42 user nova-compute[82479]: No targets found.
Apr 14 00:28:42 user nova-compute[82479]: STATIC:
Apr 14 00:28:42 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387
Apr 14 00:28:42 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:28:42 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:28:42 user nova-compute[82479]: FIRMWARE:
Apr 14 00:28:42 user nova-compute[82479]: No targets found.
Apr 14 00:28:42 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:28:42 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-022d811c-442a-4d54-a74d-01cd4881745d tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 00:28:42 user nova-compute[82479]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 00:28:42 user nova-compute[82479]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82479) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 00:28:42 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-022d811c-442a-4d54-a74d-01cd4881745d tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387', 0)] {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 00:28:42 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:28:42 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:28:42 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b0d1b2-2dc7-4668-a279-3318d06566fa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:28:42 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:28:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:28:43 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f7d2de2-9455-4a45-b527-6306fd9e5e03]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:28:43 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-022d811c-442a-4d54-a74d-01cd4881745d tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387 (non-flash)
Apr 14 00:28:43 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:28:43 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-022d811c-442a-4d54-a74d-01cd4881745d tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387 (non-flash)
Apr 14 00:28:43 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:28:43 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-022d811c-442a-4d54-a74d-01cd4881745d tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f33385cc0d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387'): ({'sdb'}, set())}) {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 00:28:43 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-022d811c-442a-4d54-a74d-01cd4881745d tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Removing single pathed devices sdb {{(pid=82479) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 00:28:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:28:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:28:43 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[4410a3ea-6642-4bee-88bb-4fe910cf1f42]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:28:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:28:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:28:43 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e12fd61-3ecc-4c82-8b75-c7eef1c7b52f]: (4, ('ok\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:28:43 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-022d811c-442a-4d54-a74d-01cd4881745d tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Flushing IO for device /dev/sdb {{(pid=82479) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 00:28:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:28:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:28:43 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[7299d943-a0fa-4997-92d0-5c5607d1dbc6]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:28:43 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-022d811c-442a-4d54-a74d-01cd4881745d tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82479) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 00:28:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:28:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:28:43 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3445df-f854-4b3f-9319-8a5195a7a356]: (4, ('1', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:28:43 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-022d811c-442a-4d54-a74d-01cd4881745d tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 00:28:43 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-022d811c-442a-4d54-a74d-01cd4881745d tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] SCSI volumes sdb have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 00:28:43 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-022d811c-442a-4d54-a74d-01cd4881745d tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387')] {{(pid=82479) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 00:28:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:28:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:28:43 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[b116763b-cb86-48b7-88b3-858c4df56260]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:28:43 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-022d811c-442a-4d54-a74d-01cd4881745d tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:28:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387 -p 172.16.0.220:3260 --logout {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:28:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:28:43 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a4b2ab7-e530-4485-afa4-59595cf6c64a]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:28:43 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-022d811c-442a-4d54-a74d-01cd4881745d tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387, portal: 172.16.0.220,3260]
Apr 14 00:28:43 user nova-compute[82479]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387, portal: 172.16.0.220,3260] successful.
Apr 14 00:28:43 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:28:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387 -p 172.16.0.220:3260 --op delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:28:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:28:43 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dfa949b-f400-42db-9358-31ac45f415d7]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:28:43 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-022d811c-442a-4d54-a74d-01cd4881745d tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:28:43 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-022d811c-442a-4d54-a74d-01cd4881745d tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:28:43 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-022d811c-442a-4d54-a74d-01cd4881745d tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] <== disconnect_volume: return (300ms) None {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:28:43 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-022d811c-442a-4d54-a74d-01cd4881745d tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Disconnected iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 00:28:43 user nova-compute[82479]: DEBUG nova.objects.instance [None req-022d811c-442a-4d54-a74d-01cd4881745d tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lazy-loading 'flavor' on Instance uuid a4235d23-9b0d-4da3-870c-778c6c9b7ae1 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:28:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-022d811c-442a-4d54-a74d-01cd4881745d tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "a4235d23-9b0d-4da3-870c-778c6c9b7ae1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.659s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:28:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-7d1972aa-3c05-418f-8f08-7c344b5b2d38 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "a4235d23-9b0d-4da3-870c-778c6c9b7ae1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.547s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:28:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-7d1972aa-3c05-418f-8f08-7c344b5b2d38 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Acquiring lock "a4235d23-9b0d-4da3-870c-778c6c9b7ae1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:28:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-7d1972aa-3c05-418f-8f08-7c344b5b2d38 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "a4235d23-9b0d-4da3-870c-778c6c9b7ae1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:28:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-7d1972aa-3c05-418f-8f08-7c344b5b2d38 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "a4235d23-9b0d-4da3-870c-778c6c9b7ae1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:28:44 user nova-compute[82479]: INFO nova.compute.manager [None req-7d1972aa-3c05-418f-8f08-7c344b5b2d38 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Terminating instance
Apr 14 00:28:44 user nova-compute[82479]: DEBUG nova.compute.manager [None req-7d1972aa-3c05-418f-8f08-7c344b5b2d38 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Start destroying the instance on the hypervisor. {{(pid=82479) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 00:28:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:28:44 user nova-compute[82479]: DEBUG nova.compute.manager [req-d51f7460-0630-450b-a5e6-74f8a292f5f2 req-a3dd0ab2-4a64-4e1b-a665-35d27000d596 service nova] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Received event network-vif-unplugged-417e91ad-d81e-4837-ad20-0a9b57e85496 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:28:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-d51f7460-0630-450b-a5e6-74f8a292f5f2 req-a3dd0ab2-4a64-4e1b-a665-35d27000d596 service nova] Acquiring lock "a4235d23-9b0d-4da3-870c-778c6c9b7ae1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:28:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-d51f7460-0630-450b-a5e6-74f8a292f5f2 req-a3dd0ab2-4a64-4e1b-a665-35d27000d596 service nova] Lock "a4235d23-9b0d-4da3-870c-778c6c9b7ae1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:28:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-d51f7460-0630-450b-a5e6-74f8a292f5f2 req-a3dd0ab2-4a64-4e1b-a665-35d27000d596 service nova] Lock "a4235d23-9b0d-4da3-870c-778c6c9b7ae1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:28:44 user nova-compute[82479]: DEBUG nova.compute.manager [req-d51f7460-0630-450b-a5e6-74f8a292f5f2 req-a3dd0ab2-4a64-4e1b-a665-35d27000d596 service nova] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] No waiting events found dispatching network-vif-unplugged-417e91ad-d81e-4837-ad20-0a9b57e85496 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:28:44 user nova-compute[82479]: DEBUG nova.compute.manager [req-d51f7460-0630-450b-a5e6-74f8a292f5f2 req-a3dd0ab2-4a64-4e1b-a665-35d27000d596 service nova] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Received event network-vif-unplugged-417e91ad-d81e-4837-ad20-0a9b57e85496 for instance with task_state deleting. {{(pid=82479) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 00:28:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:28:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:28:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:28:44 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Instance destroyed successfully.
Apr 14 00:28:44 user nova-compute[82479]: DEBUG nova.objects.instance [None req-7d1972aa-3c05-418f-8f08-7c344b5b2d38 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lazy-loading 'resources' on Instance uuid a4235d23-9b0d-4da3-870c-778c6c9b7ae1 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:28:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-7d1972aa-3c05-418f-8f08-7c344b5b2d38 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:26:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-770201332',display_name='tempest-VolumesSnapshotTestJSON-instance-770201332',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-770201332',id=34,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:26:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='851640ccdac240bcb6b9b0a89dd250d8',ramdisk_id='',reservation_id='r-4v5r5p4q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-655184435',owner_user_name='tempest-VolumesSnapshotTestJSON-655184435-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T00:26:37Z,user_data=None,user_id='f922c56244e442028d3265b23a8fffd5',uuid=a4235d23-9b0d-4da3-870c-778c6c9b7ae1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "417e91ad-d81e-4837-ad20-0a9b57e85496", "address": "fa:16:3e:57:ed:7a", "network": {"id": "83abe289-89d1-4c43-bfc5-19bcfdcc8309", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2050684181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "851640ccdac240bcb6b9b0a89dd250d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap417e91ad-d8", "ovs_interfaceid": "417e91ad-d81e-4837-ad20-0a9b57e85496", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 00:28:44 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-7d1972aa-3c05-418f-8f08-7c344b5b2d38 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Converting VIF {"id": "417e91ad-d81e-4837-ad20-0a9b57e85496", "address": "fa:16:3e:57:ed:7a", "network": {"id": "83abe289-89d1-4c43-bfc5-19bcfdcc8309", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2050684181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "851640ccdac240bcb6b9b0a89dd250d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap417e91ad-d8", "ovs_interfaceid": "417e91ad-d81e-4837-ad20-0a9b57e85496", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:28:44 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-7d1972aa-3c05-418f-8f08-7c344b5b2d38 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:ed:7a,bridge_name='br-int',has_traffic_filtering=True,id=417e91ad-d81e-4837-ad20-0a9b57e85496,network=Network(83abe289-89d1-4c43-bfc5-19bcfdcc8309),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap417e91ad-d8') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:28:44 user nova-compute[82479]: DEBUG os_vif [None req-7d1972aa-3c05-418f-8f08-7c344b5b2d38 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:ed:7a,bridge_name='br-int',has_traffic_filtering=True,id=417e91ad-d81e-4837-ad20-0a9b57e85496,network=Network(83abe289-89d1-4c43-bfc5-19bcfdcc8309),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap417e91ad-d8') {{(pid=82479) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 00:28:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:28:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap417e91ad-d8, bridge=br-int, if_exists=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:28:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:28:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:28:44 user nova-compute[82479]: INFO os_vif [None req-7d1972aa-3c05-418f-8f08-7c344b5b2d38 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:ed:7a,bridge_name='br-int',has_traffic_filtering=True,id=417e91ad-d81e-4837-ad20-0a9b57e85496,network=Network(83abe289-89d1-4c43-bfc5-19bcfdcc8309),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap417e91ad-d8')
Apr 14 00:28:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d1972aa-3c05-418f-8f08-7c344b5b2d38 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] calling os-brick to detach iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 00:28:44 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d1972aa-3c05-418f-8f08-7c344b5b2d38 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, {'target_iqn': 'iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zOgGiwXu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:28:44 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-7d1972aa-3c05-418f-8f08-7c344b5b2d38 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:28:44 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-7d1972aa-3c05-418f-8f08-7c344b5b2d38 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:28:44 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-7d1972aa-3c05-418f-8f08-7c344b5b2d38 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:28:44 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:28:44 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.017s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:28:44 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:28:44 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[bf720e91-7ebf-416a-a213-72d1ba44946a]: Unexpected error while running command.
Apr 14 00:28:44 user nova-compute[82479]: Command: iscsiadm -m discoverydb -o show -P 1
Apr 14 00:28:44 user nova-compute[82479]: Exit code: 21
Apr 14 00:28:44 user nova-compute[82479]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 14 00:28:44 user nova-compute[82479]: Stderr: '' {{(pid=93289) _process_cmd /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:479}}
Apr 14 00:28:44 user nova-compute[82479]: Traceback (most recent call last):
Apr 14 00:28:44 user nova-compute[82479]:   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py", line 476, in _process_cmd
Apr 14 00:28:44 user nova-compute[82479]:     ret = func(*f_args, **f_kwargs)
Apr 14 00:28:44 user nova-compute[82479]:   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Apr 14 00:28:44 user nova-compute[82479]:     return func(*args, **kwargs)
Apr 14 00:28:44 user nova-compute[82479]:   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Apr 14 00:28:44 user nova-compute[82479]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Apr 14 00:28:44 user nova-compute[82479]:   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Apr 14 00:28:44 user nova-compute[82479]:     return putils.execute(on_execute=on_execute,
Apr 14 00:28:44 user nova-compute[82479]:   File "/usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py", line 438, in execute
Apr 14 00:28:44 user nova-compute[82479]:     raise ProcessExecutionError(exit_code=_returncode,
Apr 14 00:28:44 user nova-compute[82479]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 14 00:28:44 user nova-compute[82479]: Command: iscsiadm -m discoverydb -o show -P 1
Apr 14 00:28:44 user nova-compute[82479]: Exit code: 21
Apr 14 00:28:44 user nova-compute[82479]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 14 00:28:44 user nova-compute[82479]: Stderr: ''
Apr 14 00:28:44 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf720e91-7ebf-416a-a213-72d1ba44946a]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:28:44 user nova-compute[82479]: ERROR os_brick.initiator.connectors.iscsi [None req-7d1972aa-3c05-418f-8f08-7c344b5b2d38 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 14 00:28:44 user nova-compute[82479]: Command: iscsiadm -m discoverydb -o show -P 1
Apr 14 00:28:44 user nova-compute[82479]: Exit code: 21
Apr 14 00:28:44 user nova-compute[82479]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 14 00:28:44 user nova-compute[82479]: Stderr: ''
Apr 14 00:28:44 user nova-compute[82479]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Apr 14 00:28:44 user nova-compute[82479]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 206, in _get_ips_iqns_luns
Apr 14 00:28:44 user nova-compute[82479]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Apr 14 00:28:44 user nova-compute[82479]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 365, in _get_discoverydb_portals
Apr 14 00:28:44 user nova-compute[82479]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Apr 14 00:28:44 user nova-compute[82479]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 1177, in _run_iscsiadm_bare
Apr 14 00:28:44 user nova-compute[82479]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Apr 14 00:28:44 user nova-compute[82479]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/executor.py", line 55, in _execute
Apr 14 00:28:44 user nova-compute[82479]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Apr 14 00:28:44 user nova-compute[82479]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Apr 14 00:28:44 user nova-compute[82479]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Apr 14 00:28:44 user nova-compute[82479]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Apr 14 00:28:44 user nova-compute[82479]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Apr 14 00:28:44 user nova-compute[82479]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py", line 215, in remote_call
Apr 14 00:28:44 user nova-compute[82479]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Apr 14 00:28:44 user nova-compute[82479]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 14 00:28:44 user nova-compute[82479]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Apr 14 00:28:44 user nova-compute[82479]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Apr 14 00:28:44 user nova-compute[82479]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 14 00:28:44 user nova-compute[82479]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Apr 14 00:28:44 user nova-compute[82479]: ERROR os_brick.initiator.connectors.iscsi 
Apr 14 00:28:44 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d1972aa-3c05-418f-8f08-7c344b5b2d38 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=82479) _cleanup_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:923}}
Apr 14 00:28:44 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-7d1972aa-3c05-418f-8f08-7c344b5b2d38 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.085s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:28:44 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d1972aa-3c05-418f-8f08-7c344b5b2d38 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] <== disconnect_volume: return (86ms) None {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:28:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d1972aa-3c05-418f-8f08-7c344b5b2d38 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Disconnected iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 00:28:44 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-7d1972aa-3c05-418f-8f08-7c344b5b2d38 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Deleting instance files /opt/stack/data/nova/instances/a4235d23-9b0d-4da3-870c-778c6c9b7ae1_del
Apr 14 00:28:44 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-7d1972aa-3c05-418f-8f08-7c344b5b2d38 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Deletion of /opt/stack/data/nova/instances/a4235d23-9b0d-4da3-870c-778c6c9b7ae1_del complete
Apr 14 00:28:45 user nova-compute[82479]: INFO nova.compute.manager [None req-7d1972aa-3c05-418f-8f08-7c344b5b2d38 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Took 0.96 seconds to destroy the instance on the hypervisor.
Apr 14 00:28:45 user nova-compute[82479]: DEBUG oslo.service.loopingcall [None req-7d1972aa-3c05-418f-8f08-7c344b5b2d38 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82479) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 00:28:45 user nova-compute[82479]: DEBUG nova.compute.manager [-] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Deallocating network for instance {{(pid=82479) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 00:28:45 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] deallocate_for_instance() {{(pid=82479) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 00:28:45 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:28:45 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Updating instance_info_cache with network_info: [] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:28:45 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Took 0.89 seconds to deallocate network for instance.
Apr 14 00:28:45 user nova-compute[82479]: WARNING nova.volume.cinder [None req-7d1972aa-3c05-418f-8f08-7c344b5b2d38 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Attachment a5f482b2-b1bf-4452-83be-204a058ad5c3 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = a5f482b2-b1bf-4452-83be-204a058ad5c3. (HTTP 404) (Request-ID: req-96b89a52-1817-4bec-a0da-483e9b27199a)
Apr 14 00:28:45 user nova-compute[82479]: INFO nova.compute.manager [None req-7d1972aa-3c05-418f-8f08-7c344b5b2d38 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Took 0.02 seconds to detach 1 volumes for instance.
Apr 14 00:28:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-7d1972aa-3c05-418f-8f08-7c344b5b2d38 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:28:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-7d1972aa-3c05-418f-8f08-7c344b5b2d38 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:28:46 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-7d1972aa-3c05-418f-8f08-7c344b5b2d38 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:28:46 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-7d1972aa-3c05-418f-8f08-7c344b5b2d38 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:28:46 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-7d1972aa-3c05-418f-8f08-7c344b5b2d38 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.161s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:28:46 user nova-compute[82479]: INFO nova.scheduler.client.report [None req-7d1972aa-3c05-418f-8f08-7c344b5b2d38 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Deleted allocations for instance a4235d23-9b0d-4da3-870c-778c6c9b7ae1
Apr 14 00:28:46 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-7d1972aa-3c05-418f-8f08-7c344b5b2d38 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "a4235d23-9b0d-4da3-870c-778c6c9b7ae1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.224s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:28:46 user nova-compute[82479]: DEBUG nova.compute.manager [req-224e950a-f786-4669-b46d-fdbdd1bb698f req-e59f1c35-da09-456b-be35-bd7bb7bd1b5a service nova] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Received event network-vif-plugged-417e91ad-d81e-4837-ad20-0a9b57e85496 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:28:46 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-224e950a-f786-4669-b46d-fdbdd1bb698f req-e59f1c35-da09-456b-be35-bd7bb7bd1b5a service nova] Acquiring lock "a4235d23-9b0d-4da3-870c-778c6c9b7ae1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:28:46 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-224e950a-f786-4669-b46d-fdbdd1bb698f req-e59f1c35-da09-456b-be35-bd7bb7bd1b5a service nova] Lock "a4235d23-9b0d-4da3-870c-778c6c9b7ae1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:28:46 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-224e950a-f786-4669-b46d-fdbdd1bb698f req-e59f1c35-da09-456b-be35-bd7bb7bd1b5a service nova] Lock "a4235d23-9b0d-4da3-870c-778c6c9b7ae1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:28:46 user nova-compute[82479]: DEBUG nova.compute.manager [req-224e950a-f786-4669-b46d-fdbdd1bb698f req-e59f1c35-da09-456b-be35-bd7bb7bd1b5a service nova] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] No waiting events found dispatching network-vif-plugged-417e91ad-d81e-4837-ad20-0a9b57e85496 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:28:46 user nova-compute[82479]: WARNING nova.compute.manager [req-224e950a-f786-4669-b46d-fdbdd1bb698f req-e59f1c35-da09-456b-be35-bd7bb7bd1b5a service nova] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Received unexpected event network-vif-plugged-417e91ad-d81e-4837-ad20-0a9b57e85496 for instance with vm_state deleted and task_state None.
Apr 14 00:28:46 user nova-compute[82479]: DEBUG nova.compute.manager [req-224e950a-f786-4669-b46d-fdbdd1bb698f req-e59f1c35-da09-456b-be35-bd7bb7bd1b5a service nova] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Received event network-vif-plugged-417e91ad-d81e-4837-ad20-0a9b57e85496 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:28:46 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-224e950a-f786-4669-b46d-fdbdd1bb698f req-e59f1c35-da09-456b-be35-bd7bb7bd1b5a service nova] Acquiring lock "a4235d23-9b0d-4da3-870c-778c6c9b7ae1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:28:46 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-224e950a-f786-4669-b46d-fdbdd1bb698f req-e59f1c35-da09-456b-be35-bd7bb7bd1b5a service nova] Lock "a4235d23-9b0d-4da3-870c-778c6c9b7ae1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:28:46 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-224e950a-f786-4669-b46d-fdbdd1bb698f req-e59f1c35-da09-456b-be35-bd7bb7bd1b5a service nova] Lock "a4235d23-9b0d-4da3-870c-778c6c9b7ae1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:28:46 user nova-compute[82479]: DEBUG nova.compute.manager [req-224e950a-f786-4669-b46d-fdbdd1bb698f req-e59f1c35-da09-456b-be35-bd7bb7bd1b5a service nova] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] No waiting events found dispatching network-vif-plugged-417e91ad-d81e-4837-ad20-0a9b57e85496 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:28:46 user nova-compute[82479]: WARNING nova.compute.manager [req-224e950a-f786-4669-b46d-fdbdd1bb698f req-e59f1c35-da09-456b-be35-bd7bb7bd1b5a service nova] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Received unexpected event network-vif-plugged-417e91ad-d81e-4837-ad20-0a9b57e85496 for instance with vm_state deleted and task_state None.
Apr 14 00:28:46 user nova-compute[82479]: DEBUG nova.compute.manager [req-224e950a-f786-4669-b46d-fdbdd1bb698f req-e59f1c35-da09-456b-be35-bd7bb7bd1b5a service nova] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Received event network-vif-plugged-417e91ad-d81e-4837-ad20-0a9b57e85496 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:28:46 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-224e950a-f786-4669-b46d-fdbdd1bb698f req-e59f1c35-da09-456b-be35-bd7bb7bd1b5a service nova] Acquiring lock "a4235d23-9b0d-4da3-870c-778c6c9b7ae1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:28:46 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-224e950a-f786-4669-b46d-fdbdd1bb698f req-e59f1c35-da09-456b-be35-bd7bb7bd1b5a service nova] Lock "a4235d23-9b0d-4da3-870c-778c6c9b7ae1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:28:46 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-224e950a-f786-4669-b46d-fdbdd1bb698f req-e59f1c35-da09-456b-be35-bd7bb7bd1b5a service nova] Lock "a4235d23-9b0d-4da3-870c-778c6c9b7ae1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:28:46 user nova-compute[82479]: DEBUG nova.compute.manager [req-224e950a-f786-4669-b46d-fdbdd1bb698f req-e59f1c35-da09-456b-be35-bd7bb7bd1b5a service nova] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] No waiting events found dispatching network-vif-plugged-417e91ad-d81e-4837-ad20-0a9b57e85496 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:28:46 user nova-compute[82479]: WARNING nova.compute.manager [req-224e950a-f786-4669-b46d-fdbdd1bb698f req-e59f1c35-da09-456b-be35-bd7bb7bd1b5a service nova] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Received unexpected event network-vif-plugged-417e91ad-d81e-4837-ad20-0a9b57e85496 for instance with vm_state deleted and task_state None.
Apr 14 00:28:46 user nova-compute[82479]: DEBUG nova.compute.manager [req-224e950a-f786-4669-b46d-fdbdd1bb698f req-e59f1c35-da09-456b-be35-bd7bb7bd1b5a service nova] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Received event network-vif-deleted-417e91ad-d81e-4837-ad20-0a9b57e85496 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:28:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:28:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-b3b89d0b-0446-4dc9-8fc9-67e4e52f3baa tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "785033c7-e14b-418e-952a-248328b75d60" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:28:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-b3b89d0b-0446-4dc9-8fc9-67e4e52f3baa tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "785033c7-e14b-418e-952a-248328b75d60" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:28:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-b3b89d0b-0446-4dc9-8fc9-67e4e52f3baa tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "785033c7-e14b-418e-952a-248328b75d60-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:28:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-b3b89d0b-0446-4dc9-8fc9-67e4e52f3baa tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "785033c7-e14b-418e-952a-248328b75d60-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:28:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-b3b89d0b-0446-4dc9-8fc9-67e4e52f3baa tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "785033c7-e14b-418e-952a-248328b75d60-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:28:52 user nova-compute[82479]: INFO nova.compute.manager [None req-b3b89d0b-0446-4dc9-8fc9-67e4e52f3baa tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: 785033c7-e14b-418e-952a-248328b75d60] Terminating instance
Apr 14 00:28:52 user nova-compute[82479]: DEBUG nova.compute.manager [None req-b3b89d0b-0446-4dc9-8fc9-67e4e52f3baa tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: 785033c7-e14b-418e-952a-248328b75d60] Start destroying the instance on the hypervisor. {{(pid=82479) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 00:28:52 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:28:52 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:28:52 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:28:52 user nova-compute[82479]: DEBUG nova.compute.manager [req-a910331d-0b37-47c3-92d5-fc806b2a9714 req-7ea81906-4058-4c1f-8aa7-107290e6491a service nova] [instance: 785033c7-e14b-418e-952a-248328b75d60] Received event network-vif-unplugged-29f1f1cc-0517-49a1-b8f1-61a7c3ee1002 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:28:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-a910331d-0b37-47c3-92d5-fc806b2a9714 req-7ea81906-4058-4c1f-8aa7-107290e6491a service nova] Acquiring lock "785033c7-e14b-418e-952a-248328b75d60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:28:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-a910331d-0b37-47c3-92d5-fc806b2a9714 req-7ea81906-4058-4c1f-8aa7-107290e6491a service nova] Lock "785033c7-e14b-418e-952a-248328b75d60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:28:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-a910331d-0b37-47c3-92d5-fc806b2a9714 req-7ea81906-4058-4c1f-8aa7-107290e6491a service nova] Lock "785033c7-e14b-418e-952a-248328b75d60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:28:52 user nova-compute[82479]: DEBUG nova.compute.manager [req-a910331d-0b37-47c3-92d5-fc806b2a9714 req-7ea81906-4058-4c1f-8aa7-107290e6491a service nova] [instance: 785033c7-e14b-418e-952a-248328b75d60] No waiting events found dispatching network-vif-unplugged-29f1f1cc-0517-49a1-b8f1-61a7c3ee1002 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:28:52 user nova-compute[82479]: DEBUG nova.compute.manager [req-a910331d-0b37-47c3-92d5-fc806b2a9714 req-7ea81906-4058-4c1f-8aa7-107290e6491a service nova] [instance: 785033c7-e14b-418e-952a-248328b75d60] Received event network-vif-unplugged-29f1f1cc-0517-49a1-b8f1-61a7c3ee1002 for instance with task_state deleting. {{(pid=82479) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 00:28:53 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 785033c7-e14b-418e-952a-248328b75d60] Instance destroyed successfully.
Apr 14 00:28:53 user nova-compute[82479]: DEBUG nova.objects.instance [None req-b3b89d0b-0446-4dc9-8fc9-67e4e52f3baa tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lazy-loading 'resources' on Instance uuid 785033c7-e14b-418e-952a-248328b75d60 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:28:53 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-b3b89d0b-0446-4dc9-8fc9-67e4e52f3baa tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:19:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1841222453',display_name='tempest-ServerActionsTestJSON-server-1841222453',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1841222453',id=32,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD8E1mkrqLo3jsCiJcIvha4CNzW2T6/HQ38hZ5dGaGtUghmrHejTJlAuKgmy6xusLbaAzGTrJCKVkdgQ5v0CqCqGeNMDA89aLJgLl5KHn3gvI39SkbPja84HarSvbQbbXg==',key_name='tempest-keypair-1040271550',keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:19:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bf8663ccad9047f4b11b9ae0646c287a',ramdisk_id='',reservation_id='r-vno1kjy0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-948553482',owner_user_name='tempest-ServerActionsTestJSON-948553482-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T00:19:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d86662f2c7648daad87118b7e9f757c',uuid=785033c7-e14b-418e-952a-248328b75d60,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "29f1f1cc-0517-49a1-b8f1-61a7c3ee1002", "address": "fa:16:3e:59:e0:37", "network": {"id": "cb8c9bb1-a885-486d-aa6a-de600bc01c2e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1676259779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8663ccad9047f4b11b9ae0646c287a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29f1f1cc-05", "ovs_interfaceid": "29f1f1cc-0517-49a1-b8f1-61a7c3ee1002", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 00:28:53 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-b3b89d0b-0446-4dc9-8fc9-67e4e52f3baa tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Converting VIF {"id": "29f1f1cc-0517-49a1-b8f1-61a7c3ee1002", "address": "fa:16:3e:59:e0:37", "network": {"id": "cb8c9bb1-a885-486d-aa6a-de600bc01c2e", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1676259779-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf8663ccad9047f4b11b9ae0646c287a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29f1f1cc-05", "ovs_interfaceid": "29f1f1cc-0517-49a1-b8f1-61a7c3ee1002", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:28:53 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-b3b89d0b-0446-4dc9-8fc9-67e4e52f3baa tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:e0:37,bridge_name='br-int',has_traffic_filtering=True,id=29f1f1cc-0517-49a1-b8f1-61a7c3ee1002,network=Network(cb8c9bb1-a885-486d-aa6a-de600bc01c2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29f1f1cc-05') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:28:53 user nova-compute[82479]: DEBUG os_vif [None req-b3b89d0b-0446-4dc9-8fc9-67e4e52f3baa tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:e0:37,bridge_name='br-int',has_traffic_filtering=True,id=29f1f1cc-0517-49a1-b8f1-61a7c3ee1002,network=Network(cb8c9bb1-a885-486d-aa6a-de600bc01c2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29f1f1cc-05') {{(pid=82479) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 00:28:53 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:28:53 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap29f1f1cc-05, bridge=br-int, if_exists=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:28:53 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:28:53 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:28:53 user nova-compute[82479]: INFO os_vif [None req-b3b89d0b-0446-4dc9-8fc9-67e4e52f3baa tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:e0:37,bridge_name='br-int',has_traffic_filtering=True,id=29f1f1cc-0517-49a1-b8f1-61a7c3ee1002,network=Network(cb8c9bb1-a885-486d-aa6a-de600bc01c2e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29f1f1cc-05')
Apr 14 00:28:53 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-b3b89d0b-0446-4dc9-8fc9-67e4e52f3baa tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: 785033c7-e14b-418e-952a-248328b75d60] Deleting instance files /opt/stack/data/nova/instances/785033c7-e14b-418e-952a-248328b75d60_del
Apr 14 00:28:53 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-b3b89d0b-0446-4dc9-8fc9-67e4e52f3baa tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: 785033c7-e14b-418e-952a-248328b75d60] Deletion of /opt/stack/data/nova/instances/785033c7-e14b-418e-952a-248328b75d60_del complete
Apr 14 00:28:53 user nova-compute[82479]: INFO nova.compute.manager [None req-b3b89d0b-0446-4dc9-8fc9-67e4e52f3baa tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] [instance: 785033c7-e14b-418e-952a-248328b75d60] Took 0.66 seconds to destroy the instance on the hypervisor.
Apr 14 00:28:53 user nova-compute[82479]: DEBUG oslo.service.loopingcall [None req-b3b89d0b-0446-4dc9-8fc9-67e4e52f3baa tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82479) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 00:28:53 user nova-compute[82479]: DEBUG nova.compute.manager [-] [instance: 785033c7-e14b-418e-952a-248328b75d60] Deallocating network for instance {{(pid=82479) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 00:28:53 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: 785033c7-e14b-418e-952a-248328b75d60] deallocate_for_instance() {{(pid=82479) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 00:28:53 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: 785033c7-e14b-418e-952a-248328b75d60] Updating instance_info_cache with network_info: [] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:28:53 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: 785033c7-e14b-418e-952a-248328b75d60] Took 0.46 seconds to deallocate network for instance.
Apr 14 00:28:53 user nova-compute[82479]: DEBUG nova.compute.manager [req-4531be72-8974-4c50-93ee-a9b6f7c69496 req-4db1602e-21b0-4301-9d2d-e8554cdedb15 service nova] [instance: 785033c7-e14b-418e-952a-248328b75d60] Received event network-vif-deleted-29f1f1cc-0517-49a1-b8f1-61a7c3ee1002 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:28:53 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-b3b89d0b-0446-4dc9-8fc9-67e4e52f3baa tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:28:53 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-b3b89d0b-0446-4dc9-8fc9-67e4e52f3baa tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:28:53 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-b3b89d0b-0446-4dc9-8fc9-67e4e52f3baa tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:28:53 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-b3b89d0b-0446-4dc9-8fc9-67e4e52f3baa tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:28:53 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-b3b89d0b-0446-4dc9-8fc9-67e4e52f3baa tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.129s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:28:53 user nova-compute[82479]: INFO nova.scheduler.client.report [None req-b3b89d0b-0446-4dc9-8fc9-67e4e52f3baa tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Deleted allocations for instance 785033c7-e14b-418e-952a-248328b75d60
Apr 14 00:28:53 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-b3b89d0b-0446-4dc9-8fc9-67e4e52f3baa tempest-ServerActionsTestJSON-948553482 tempest-ServerActionsTestJSON-948553482-project-member] Lock "785033c7-e14b-418e-952a-248328b75d60" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.424s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:28:54 user nova-compute[82479]: DEBUG nova.compute.manager [req-b0550894-ddfa-4c88-89b3-51d2090b1aae req-708e5569-ed2a-4bde-aeb8-c6e14d51e7af service nova] [instance: 785033c7-e14b-418e-952a-248328b75d60] Received event network-vif-plugged-29f1f1cc-0517-49a1-b8f1-61a7c3ee1002 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:28:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-b0550894-ddfa-4c88-89b3-51d2090b1aae req-708e5569-ed2a-4bde-aeb8-c6e14d51e7af service nova] Acquiring lock "785033c7-e14b-418e-952a-248328b75d60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:28:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-b0550894-ddfa-4c88-89b3-51d2090b1aae req-708e5569-ed2a-4bde-aeb8-c6e14d51e7af service nova] Lock "785033c7-e14b-418e-952a-248328b75d60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:28:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-b0550894-ddfa-4c88-89b3-51d2090b1aae req-708e5569-ed2a-4bde-aeb8-c6e14d51e7af service nova] Lock "785033c7-e14b-418e-952a-248328b75d60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:28:54 user nova-compute[82479]: DEBUG nova.compute.manager [req-b0550894-ddfa-4c88-89b3-51d2090b1aae req-708e5569-ed2a-4bde-aeb8-c6e14d51e7af service nova] [instance: 785033c7-e14b-418e-952a-248328b75d60] No waiting events found dispatching network-vif-plugged-29f1f1cc-0517-49a1-b8f1-61a7c3ee1002 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:28:54 user nova-compute[82479]: WARNING nova.compute.manager [req-b0550894-ddfa-4c88-89b3-51d2090b1aae req-708e5569-ed2a-4bde-aeb8-c6e14d51e7af service nova] [instance: 785033c7-e14b-418e-952a-248328b75d60] Received unexpected event network-vif-plugged-29f1f1cc-0517-49a1-b8f1-61a7c3ee1002 for instance with vm_state deleted and task_state None.
Apr 14 00:28:56 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:28:56 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Starting heal instance info cache {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 00:28:56 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Rebuilding the list of instances to heal {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 00:28:56 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "refresh_cache-2d04f694-0eba-46c3-a617-97d3de666de8" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:28:56 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquired lock "refresh_cache-2d04f694-0eba-46c3-a617-97d3de666de8" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:28:56 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Forcefully refreshing network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 00:28:56 user nova-compute[82479]: DEBUG nova.objects.instance [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lazy-loading 'info_cache' on Instance uuid 2d04f694-0eba-46c3-a617-97d3de666de8 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:28:57 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Updating instance_info_cache with network_info: [{"id": "e7556e77-8734-4ef9-b260-2503b06b73bc", "address": "fa:16:3e:5a:d1:62", "network": {"id": "8b306bb0-c969-4918-a696-dd539eaa3a21", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1341077591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e46ba54fdcdb45368f457001f26a281b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7556e77-87", "ovs_interfaceid": "e7556e77-8734-4ef9-b260-2503b06b73bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:28:57 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Releasing lock "refresh_cache-2d04f694-0eba-46c3-a617-97d3de666de8" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:28:57 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Updated the network info_cache for instance {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 00:28:58 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:28:58 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:28:59 user nova-compute[82479]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681432124.8131776, a4235d23-9b0d-4da3-870c-778c6c9b7ae1 => Stopped> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:28:59 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] VM Stopped (Lifecycle Event)
Apr 14 00:28:59 user nova-compute[82479]: DEBUG nova.compute.manager [None req-364d9248-ff11-45c5-ab31-3fc3c7c4d3a7 None None] [instance: a4235d23-9b0d-4da3-870c-778c6c9b7ae1] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:29:00 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:29:03 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:29:03 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:29:04 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:29:05 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:29:06 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:29:08 user nova-compute[82479]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681432133.0928063, 785033c7-e14b-418e-952a-248328b75d60 => Stopped> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:29:08 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: 785033c7-e14b-418e-952a-248328b75d60] VM Stopped (Lifecycle Event)
Apr 14 00:29:08 user nova-compute[82479]: DEBUG nova.compute.manager [None req-d4f7117d-8058-4ae7-a0e7-679f4e738863 None None] [instance: 785033c7-e14b-418e-952a-248328b75d60] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:29:08 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:29:09 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:29:09 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:29:09 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:29:09 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:29:09 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Auditing locally available compute resources for user (node: user) {{(pid=82479) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 00:29:09 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d04f694-0eba-46c3-a617-97d3de666de8/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:29:09 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d04f694-0eba-46c3-a617-97d3de666de8/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:29:09 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d04f694-0eba-46c3-a617-97d3de666de8/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:29:09 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d04f694-0eba-46c3-a617-97d3de666de8/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:29:10 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:29:10 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:29:10 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Hypervisor/Node resource view: name=user free_ram=8731MB free_disk=26.253063201904297GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82479) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 00:29:10 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:29:10 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:29:10 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 2d04f694-0eba-46c3-a617-97d3de666de8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:29:10 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 00:29:10 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 00:29:10 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:29:10 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:29:10 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Compute_service record updated for user:user {{(pid=82479) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 00:29:10 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.199s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:29:11 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:29:11 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:29:11 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:29:11 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82479) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 00:29:13 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:29:18 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:29:18 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:29:18 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:29:18 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:29:18 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:29:18 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:29:23 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:29:28 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:29:33 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:29:38 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:29:43 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:29:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Acquiring lock "5bd24977-c1b5-4bc5-b651-d6061483e781" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:29:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "5bd24977-c1b5-4bc5-b651-d6061483e781" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:29:44 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Starting instance... {{(pid=82479) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 00:29:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:29:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:29:44 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82479) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 00:29:44 user nova-compute[82479]: INFO nova.compute.claims [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Claim successful on node user
Apr 14 00:29:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Acquiring lock "c04d101a-2c7f-4c9d-81c8-0f2d866e1534" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:29:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "c04d101a-2c7f-4c9d-81c8-0f2d866e1534" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:29:44 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] Starting instance... {{(pid=82479) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 00:29:44 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:29:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:29:44 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:29:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.244s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:29:44 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Start building networks asynchronously for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 00:29:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.042s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:29:44 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82479) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 00:29:44 user nova-compute[82479]: INFO nova.compute.claims [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] Claim successful on node user
Apr 14 00:29:44 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Allocating IP information in the background. {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 00:29:44 user nova-compute[82479]: DEBUG nova.network.neutron [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] allocate_for_instance() {{(pid=82479) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 00:29:44 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 00:29:44 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Start building block device mappings for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 00:29:44 user nova-compute[82479]: DEBUG nova.policy [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f922c56244e442028d3265b23a8fffd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '851640ccdac240bcb6b9b0a89dd250d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82479) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 00:29:44 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:29:44 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:29:44 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Start spawning the instance on the hypervisor. {{(pid=82479) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 00:29:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Creating instance directory {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 00:29:44 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Creating image(s)
Apr 14 00:29:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Acquiring lock "/opt/stack/data/nova/instances/5bd24977-c1b5-4bc5-b651-d6061483e781/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:29:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "/opt/stack/data/nova/instances/5bd24977-c1b5-4bc5-b651-d6061483e781/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:29:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "/opt/stack/data/nova/instances/5bd24977-c1b5-4bc5-b651-d6061483e781/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:29:44 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:29:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.299s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:29:44 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] Start building networks asynchronously for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 00:29:44 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] Allocating IP information in the background. {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 00:29:44 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] allocate_for_instance() {{(pid=82479) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 00:29:44 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 00:29:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.144s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:29:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Acquiring lock "3e200e101633f2016e569ae4c0a352380507d1e4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:29:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "3e200e101633f2016e569ae4c0a352380507d1e4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:29:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:29:45 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] Start building block device mappings for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 00:29:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.136s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:29:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/5bd24977-c1b5-4bc5-b651-d6061483e781/disk 1073741824 {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:29:45 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] Start spawning the instance on the hypervisor. {{(pid=82479) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 00:29:45 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] Creating instance directory {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 00:29:45 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] Creating image(s)
Apr 14 00:29:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Acquiring lock "/opt/stack/data/nova/instances/c04d101a-2c7f-4c9d-81c8-0f2d866e1534/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:29:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "/opt/stack/data/nova/instances/c04d101a-2c7f-4c9d-81c8-0f2d866e1534/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:29:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "/opt/stack/data/nova/instances/c04d101a-2c7f-4c9d-81c8-0f2d866e1534/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:29:45 user nova-compute[82479]: DEBUG nova.policy [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '67248d6b437547918b0cc2b0cdf29536', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e46ba54fdcdb45368f457001f26a281b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82479) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 00:29:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/5bd24977-c1b5-4bc5-b651-d6061483e781/disk 1073741824" returned: 0 in 0.071s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:29:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:29:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "3e200e101633f2016e569ae4c0a352380507d1e4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:29:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:29:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.174s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:29:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Acquiring lock "3e200e101633f2016e569ae4c0a352380507d1e4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:29:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "3e200e101633f2016e569ae4c0a352380507d1e4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:29:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:29:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.186s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:29:45 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5bd24977-c1b5-4bc5-b651-d6061483e781/disk. size=1073741824 {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 00:29:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bd24977-c1b5-4bc5-b651-d6061483e781/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:29:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.201s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:29:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/c04d101a-2c7f-4c9d-81c8-0f2d866e1534/disk 1073741824 {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:29:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bd24977-c1b5-4bc5-b651-d6061483e781/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:29:45 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Cannot resize image /opt/stack/data/nova/instances/5bd24977-c1b5-4bc5-b651-d6061483e781/disk to a smaller size. {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 00:29:45 user nova-compute[82479]: DEBUG nova.objects.instance [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lazy-loading 'migration_context' on Instance uuid 5bd24977-c1b5-4bc5-b651-d6061483e781 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:29:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/c04d101a-2c7f-4c9d-81c8-0f2d866e1534/disk 1073741824" returned: 0 in 0.060s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:29:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "3e200e101633f2016e569ae4c0a352380507d1e4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:29:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:29:45 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:29:45 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Created local disks {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 00:29:45 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Ensure instance console log exists: /opt/stack/data/nova/instances/5bd24977-c1b5-4bc5-b651-d6061483e781/console.log {{(pid=82479) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 00:29:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:29:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:29:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:29:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.140s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:29:45 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c04d101a-2c7f-4c9d-81c8-0f2d866e1534/disk. size=1073741824 {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 00:29:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c04d101a-2c7f-4c9d-81c8-0f2d866e1534/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:29:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c04d101a-2c7f-4c9d-81c8-0f2d866e1534/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:29:45 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Cannot resize image /opt/stack/data/nova/instances/c04d101a-2c7f-4c9d-81c8-0f2d866e1534/disk to a smaller size. {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 00:29:45 user nova-compute[82479]: DEBUG nova.objects.instance [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lazy-loading 'migration_context' on Instance uuid c04d101a-2c7f-4c9d-81c8-0f2d866e1534 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:29:45 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] Created local disks {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 00:29:45 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] Ensure instance console log exists: /opt/stack/data/nova/instances/c04d101a-2c7f-4c9d-81c8-0f2d866e1534/console.log {{(pid=82479) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 00:29:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:29:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:29:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:29:45 user nova-compute[82479]: DEBUG nova.network.neutron [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Successfully created port: 05d7b2dd-9ebb-4ab6-a720-ea22509e855e {{(pid=82479) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 00:29:46 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] Successfully created port: b1ca4eb0-7c25-407d-9baf-1d37f309e9e5 {{(pid=82479) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 00:29:47 user nova-compute[82479]: DEBUG nova.network.neutron [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Successfully updated port: 05d7b2dd-9ebb-4ab6-a720-ea22509e855e {{(pid=82479) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 00:29:47 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Acquiring lock "refresh_cache-5bd24977-c1b5-4bc5-b651-d6061483e781" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:29:47 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Acquired lock "refresh_cache-5bd24977-c1b5-4bc5-b651-d6061483e781" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:29:47 user nova-compute[82479]: DEBUG nova.network.neutron [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 00:29:47 user nova-compute[82479]: DEBUG nova.compute.manager [req-e1bedaae-2f8f-462d-9c31-b2083c6ffd78 req-6930d359-46cc-4989-99ea-d2f81c798c46 service nova] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Received event network-changed-05d7b2dd-9ebb-4ab6-a720-ea22509e855e {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:29:47 user nova-compute[82479]: DEBUG nova.compute.manager [req-e1bedaae-2f8f-462d-9c31-b2083c6ffd78 req-6930d359-46cc-4989-99ea-d2f81c798c46 service nova] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Refreshing instance network info cache due to event network-changed-05d7b2dd-9ebb-4ab6-a720-ea22509e855e. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:29:47 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-e1bedaae-2f8f-462d-9c31-b2083c6ffd78 req-6930d359-46cc-4989-99ea-d2f81c798c46 service nova] Acquiring lock "refresh_cache-5bd24977-c1b5-4bc5-b651-d6061483e781" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:29:48 user nova-compute[82479]: DEBUG nova.network.neutron [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Instance cache missing network info. {{(pid=82479) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 00:29:48 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:29:48 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] Successfully updated port: b1ca4eb0-7c25-407d-9baf-1d37f309e9e5 {{(pid=82479) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 00:29:48 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Acquiring lock "refresh_cache-c04d101a-2c7f-4c9d-81c8-0f2d866e1534" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:29:48 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Acquired lock "refresh_cache-c04d101a-2c7f-4c9d-81c8-0f2d866e1534" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:29:48 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 00:29:48 user nova-compute[82479]: DEBUG nova.network.neutron [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Updating instance_info_cache with network_info: [{"id": "05d7b2dd-9ebb-4ab6-a720-ea22509e855e", "address": "fa:16:3e:73:07:f8", "network": {"id": "83abe289-89d1-4c43-bfc5-19bcfdcc8309", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2050684181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "851640ccdac240bcb6b9b0a89dd250d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05d7b2dd-9e", "ovs_interfaceid": "05d7b2dd-9ebb-4ab6-a720-ea22509e855e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:29:48 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Releasing lock "refresh_cache-5bd24977-c1b5-4bc5-b651-d6061483e781" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:29:48 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Instance network_info: |[{"id": "05d7b2dd-9ebb-4ab6-a720-ea22509e855e", "address": "fa:16:3e:73:07:f8", "network": {"id": "83abe289-89d1-4c43-bfc5-19bcfdcc8309", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2050684181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "851640ccdac240bcb6b9b0a89dd250d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05d7b2dd-9e", "ovs_interfaceid": "05d7b2dd-9ebb-4ab6-a720-ea22509e855e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 00:29:48 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-e1bedaae-2f8f-462d-9c31-b2083c6ffd78 req-6930d359-46cc-4989-99ea-d2f81c798c46 service nova] Acquired lock "refresh_cache-5bd24977-c1b5-4bc5-b651-d6061483e781" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:29:48 user nova-compute[82479]: DEBUG nova.network.neutron [req-e1bedaae-2f8f-462d-9c31-b2083c6ffd78 req-6930d359-46cc-4989-99ea-d2f81c798c46 service nova] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Refreshing network info cache for port 05d7b2dd-9ebb-4ab6-a720-ea22509e855e {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:29:48 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Start _get_guest_xml network_info=[{"id": "05d7b2dd-9ebb-4ab6-a720-ea22509e855e", "address": "fa:16:3e:73:07:f8", "network": {"id": "83abe289-89d1-4c43-bfc5-19bcfdcc8309", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2050684181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "851640ccdac240bcb6b9b0a89dd250d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05d7b2dd-9e", "ovs_interfaceid": "05d7b2dd-9ebb-4ab6-a720-ea22509e855e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 00:29:48 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] Instance cache missing network info. {{(pid=82479) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 00:29:48 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:29:48 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:29:48 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82479) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 00:29:48 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T00:02:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 00:29:48 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Flavor limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 00:29:48 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Image limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 00:29:48 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Flavor pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 00:29:48 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Image pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 00:29:48 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 00:29:48 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 00:29:48 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 00:29:48 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Got 1 possible topologies {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 00:29:48 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 00:29:48 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 00:29:48 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:29:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-869198220',display_name='tempest-VolumesSnapshotTestJSON-instance-869198220',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-869198220',id=36,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='851640ccdac240bcb6b9b0a89dd250d8',ramdisk_id='',reservation_id='r-jabdxbqo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-655184435',owner_user_name='tempest-VolumesSnapshotTestJSON-655184435-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:29:45Z,user_data=None,user_id='f922c56244e442028d3265b23a8fffd5',uuid=5bd24977-c1b5-4bc5-b651-d6061483e781,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05d7b2dd-9ebb-4ab6-a720-ea22509e855e", "address": "fa:16:3e:73:07:f8", "network": {"id": "83abe289-89d1-4c43-bfc5-19bcfdcc8309", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2050684181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "851640ccdac240bcb6b9b0a89dd250d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05d7b2dd-9e", "ovs_interfaceid": "05d7b2dd-9ebb-4ab6-a720-ea22509e855e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82479) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 00:29:48 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Converting VIF {"id": "05d7b2dd-9ebb-4ab6-a720-ea22509e855e", "address": "fa:16:3e:73:07:f8", "network": {"id": "83abe289-89d1-4c43-bfc5-19bcfdcc8309", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2050684181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "851640ccdac240bcb6b9b0a89dd250d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05d7b2dd-9e", "ovs_interfaceid": "05d7b2dd-9ebb-4ab6-a720-ea22509e855e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:29:48 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:07:f8,bridge_name='br-int',has_traffic_filtering=True,id=05d7b2dd-9ebb-4ab6-a720-ea22509e855e,network=Network(83abe289-89d1-4c43-bfc5-19bcfdcc8309),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05d7b2dd-9e') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:29:48 user nova-compute[82479]: DEBUG nova.objects.instance [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lazy-loading 'pci_devices' on Instance uuid 5bd24977-c1b5-4bc5-b651-d6061483e781 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:29:48 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] End _get_guest_xml xml=<domain type="kvm">
Apr 14 00:29:48 user nova-compute[82479]:   <uuid>5bd24977-c1b5-4bc5-b651-d6061483e781</uuid>
Apr 14 00:29:48 user nova-compute[82479]:   <name>instance-00000024</name>
Apr 14 00:29:48 user nova-compute[82479]:   <memory>131072</memory>
Apr 14 00:29:48 user nova-compute[82479]:   <vcpu>1</vcpu>
Apr 14 00:29:48 user nova-compute[82479]:   <metadata>
Apr 14 00:29:48 user nova-compute[82479]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 00:29:48 user nova-compute[82479]:       <nova:package version="0.0.0"/>
Apr 14 00:29:48 user nova-compute[82479]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-869198220</nova:name>
Apr 14 00:29:48 user nova-compute[82479]:       <nova:creationTime>2023-04-14 00:29:48</nova:creationTime>
Apr 14 00:29:48 user nova-compute[82479]:       <nova:flavor name="m1.nano">
Apr 14 00:29:48 user nova-compute[82479]:         <nova:memory>128</nova:memory>
Apr 14 00:29:48 user nova-compute[82479]:         <nova:disk>1</nova:disk>
Apr 14 00:29:48 user nova-compute[82479]:         <nova:swap>0</nova:swap>
Apr 14 00:29:48 user nova-compute[82479]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 00:29:48 user nova-compute[82479]:         <nova:vcpus>1</nova:vcpus>
Apr 14 00:29:48 user nova-compute[82479]:       </nova:flavor>
Apr 14 00:29:48 user nova-compute[82479]:       <nova:owner>
Apr 14 00:29:48 user nova-compute[82479]:         <nova:user uuid="f922c56244e442028d3265b23a8fffd5">tempest-VolumesSnapshotTestJSON-655184435-project-member</nova:user>
Apr 14 00:29:48 user nova-compute[82479]:         <nova:project uuid="851640ccdac240bcb6b9b0a89dd250d8">tempest-VolumesSnapshotTestJSON-655184435</nova:project>
Apr 14 00:29:48 user nova-compute[82479]:       </nova:owner>
Apr 14 00:29:48 user nova-compute[82479]:       <nova:root type="image" uuid="6db62068-7278-4cd8-b41f-d0140d89e199"/>
Apr 14 00:29:48 user nova-compute[82479]:       <nova:ports>
Apr 14 00:29:48 user nova-compute[82479]:         <nova:port uuid="05d7b2dd-9ebb-4ab6-a720-ea22509e855e">
Apr 14 00:29:48 user nova-compute[82479]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 14 00:29:48 user nova-compute[82479]:         </nova:port>
Apr 14 00:29:48 user nova-compute[82479]:       </nova:ports>
Apr 14 00:29:48 user nova-compute[82479]:     </nova:instance>
Apr 14 00:29:48 user nova-compute[82479]:   </metadata>
Apr 14 00:29:48 user nova-compute[82479]:   <sysinfo type="smbios">
Apr 14 00:29:48 user nova-compute[82479]:     <system>
Apr 14 00:29:48 user nova-compute[82479]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 00:29:48 user nova-compute[82479]:       <entry name="product">OpenStack Nova</entry>
Apr 14 00:29:48 user nova-compute[82479]:       <entry name="version">0.0.0</entry>
Apr 14 00:29:48 user nova-compute[82479]:       <entry name="serial">5bd24977-c1b5-4bc5-b651-d6061483e781</entry>
Apr 14 00:29:48 user nova-compute[82479]:       <entry name="uuid">5bd24977-c1b5-4bc5-b651-d6061483e781</entry>
Apr 14 00:29:48 user nova-compute[82479]:       <entry name="family">Virtual Machine</entry>
Apr 14 00:29:48 user nova-compute[82479]:     </system>
Apr 14 00:29:48 user nova-compute[82479]:   </sysinfo>
Apr 14 00:29:48 user nova-compute[82479]:   <os>
Apr 14 00:29:48 user nova-compute[82479]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 00:29:48 user nova-compute[82479]:     <boot dev="hd"/>
Apr 14 00:29:48 user nova-compute[82479]:     <smbios mode="sysinfo"/>
Apr 14 00:29:48 user nova-compute[82479]:   </os>
Apr 14 00:29:48 user nova-compute[82479]:   <features>
Apr 14 00:29:48 user nova-compute[82479]:     <acpi/>
Apr 14 00:29:48 user nova-compute[82479]:     <apic/>
Apr 14 00:29:48 user nova-compute[82479]:     <vmcoreinfo/>
Apr 14 00:29:48 user nova-compute[82479]:   </features>
Apr 14 00:29:48 user nova-compute[82479]:   <clock offset="utc">
Apr 14 00:29:48 user nova-compute[82479]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 00:29:48 user nova-compute[82479]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 00:29:48 user nova-compute[82479]:     <timer name="hpet" present="no"/>
Apr 14 00:29:48 user nova-compute[82479]:   </clock>
Apr 14 00:29:48 user nova-compute[82479]:   <cpu mode="custom" match="exact">
Apr 14 00:29:48 user nova-compute[82479]:     <model>Nehalem</model>
Apr 14 00:29:48 user nova-compute[82479]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 00:29:48 user nova-compute[82479]:   </cpu>
Apr 14 00:29:48 user nova-compute[82479]:   <devices>
Apr 14 00:29:48 user nova-compute[82479]:     <disk type="file" device="disk">
Apr 14 00:29:48 user nova-compute[82479]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 00:29:48 user nova-compute[82479]:       <source file="/opt/stack/data/nova/instances/5bd24977-c1b5-4bc5-b651-d6061483e781/disk"/>
Apr 14 00:29:48 user nova-compute[82479]:       <target dev="vda" bus="virtio"/>
Apr 14 00:29:48 user nova-compute[82479]:     </disk>
Apr 14 00:29:48 user nova-compute[82479]:     <interface type="ethernet">
Apr 14 00:29:48 user nova-compute[82479]:       <mac address="fa:16:3e:73:07:f8"/>
Apr 14 00:29:48 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:29:48 user nova-compute[82479]:       <mtu size="1442"/>
Apr 14 00:29:48 user nova-compute[82479]:       <target dev="tap05d7b2dd-9e"/>
Apr 14 00:29:48 user nova-compute[82479]:     </interface>
Apr 14 00:29:48 user nova-compute[82479]:     <serial type="pty">
Apr 14 00:29:48 user nova-compute[82479]:       <log file="/opt/stack/data/nova/instances/5bd24977-c1b5-4bc5-b651-d6061483e781/console.log" append="off"/>
Apr 14 00:29:48 user nova-compute[82479]:     </serial>
Apr 14 00:29:48 user nova-compute[82479]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 00:29:48 user nova-compute[82479]:     <video>
Apr 14 00:29:48 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:29:48 user nova-compute[82479]:     </video>
Apr 14 00:29:48 user nova-compute[82479]:     <rng model="virtio">
Apr 14 00:29:48 user nova-compute[82479]:       <backend model="random">/dev/urandom</backend>
Apr 14 00:29:48 user nova-compute[82479]:     </rng>
Apr 14 00:29:48 user nova-compute[82479]:     <controller type="usb" index="0" model="none"/>
Apr 14 00:29:48 user nova-compute[82479]:     <memballoon model="virtio">
Apr 14 00:29:48 user nova-compute[82479]:       <stats period="10"/>
Apr 14 00:29:48 user nova-compute[82479]:     </memballoon>
Apr 14 00:29:48 user nova-compute[82479]:   </devices>
Apr 14 00:29:48 user nova-compute[82479]: </domain>
Apr 14 00:29:48 user nova-compute[82479]:  {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 00:29:48 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:29:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-869198220',display_name='tempest-VolumesSnapshotTestJSON-instance-869198220',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-869198220',id=36,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='851640ccdac240bcb6b9b0a89dd250d8',ramdisk_id='',reservation_id='r-jabdxbqo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-655184435',owner_user_name='tempest-VolumesSnapshotTestJSON-655184435-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:29:45Z,user_data=None,user_id='f922c56244e442028d3265b23a8fffd5',uuid=5bd24977-c1b5-4bc5-b651-d6061483e781,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05d7b2dd-9ebb-4ab6-a720-ea22509e855e", "address": "fa:16:3e:73:07:f8", "network": {"id": "83abe289-89d1-4c43-bfc5-19bcfdcc8309", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2050684181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "851640ccdac240bcb6b9b0a89dd250d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05d7b2dd-9e", "ovs_interfaceid": "05d7b2dd-9ebb-4ab6-a720-ea22509e855e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 00:29:48 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Converting VIF {"id": "05d7b2dd-9ebb-4ab6-a720-ea22509e855e", "address": "fa:16:3e:73:07:f8", "network": {"id": "83abe289-89d1-4c43-bfc5-19bcfdcc8309", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2050684181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "851640ccdac240bcb6b9b0a89dd250d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05d7b2dd-9e", "ovs_interfaceid": "05d7b2dd-9ebb-4ab6-a720-ea22509e855e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:29:48 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:07:f8,bridge_name='br-int',has_traffic_filtering=True,id=05d7b2dd-9ebb-4ab6-a720-ea22509e855e,network=Network(83abe289-89d1-4c43-bfc5-19bcfdcc8309),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05d7b2dd-9e') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:29:48 user nova-compute[82479]: DEBUG os_vif [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:07:f8,bridge_name='br-int',has_traffic_filtering=True,id=05d7b2dd-9ebb-4ab6-a720-ea22509e855e,network=Network(83abe289-89d1-4c43-bfc5-19bcfdcc8309),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05d7b2dd-9e') {{(pid=82479) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 00:29:48 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:29:48 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:29:48 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 00:29:48 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:29:48 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap05d7b2dd-9e, may_exist=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:29:48 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap05d7b2dd-9e, col_values=(('external_ids', {'iface-id': '05d7b2dd-9ebb-4ab6-a720-ea22509e855e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:07:f8', 'vm-uuid': '5bd24977-c1b5-4bc5-b651-d6061483e781'}),)) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:29:48 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:29:48 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:29:48 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:29:48 user nova-compute[82479]: INFO os_vif [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:07:f8,bridge_name='br-int',has_traffic_filtering=True,id=05d7b2dd-9ebb-4ab6-a720-ea22509e855e,network=Network(83abe289-89d1-4c43-bfc5-19bcfdcc8309),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05d7b2dd-9e')
Apr 14 00:29:48 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:29:48 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] No VIF found with MAC fa:16:3e:73:07:f8, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:29:49 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] Updating instance_info_cache with network_info: [{"id": "b1ca4eb0-7c25-407d-9baf-1d37f309e9e5", "address": "fa:16:3e:50:69:97", "network": {"id": "8b306bb0-c969-4918-a696-dd539eaa3a21", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1341077591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e46ba54fdcdb45368f457001f26a281b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1ca4eb0-7c", "ovs_interfaceid": "b1ca4eb0-7c25-407d-9baf-1d37f309e9e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:29:49 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Releasing lock "refresh_cache-c04d101a-2c7f-4c9d-81c8-0f2d866e1534" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:29:49 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] Instance network_info: |[{"id": "b1ca4eb0-7c25-407d-9baf-1d37f309e9e5", "address": "fa:16:3e:50:69:97", "network": {"id": "8b306bb0-c969-4918-a696-dd539eaa3a21", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1341077591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e46ba54fdcdb45368f457001f26a281b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1ca4eb0-7c", "ovs_interfaceid": "b1ca4eb0-7c25-407d-9baf-1d37f309e9e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 00:29:49 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] Start _get_guest_xml network_info=[{"id": "b1ca4eb0-7c25-407d-9baf-1d37f309e9e5", "address": "fa:16:3e:50:69:97", "network": {"id": "8b306bb0-c969-4918-a696-dd539eaa3a21", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1341077591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e46ba54fdcdb45368f457001f26a281b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1ca4eb0-7c", "ovs_interfaceid": "b1ca4eb0-7c25-407d-9baf-1d37f309e9e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 00:29:49 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:29:49 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:29:49 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82479) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 00:29:49 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T00:02:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 00:29:49 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Flavor limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 00:29:49 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Image limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 00:29:49 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Flavor pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 00:29:49 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Image pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 00:29:49 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 00:29:49 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 00:29:49 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 00:29:49 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Got 1 possible topologies {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 00:29:49 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 00:29:49 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 00:29:49 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:29:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-983427950',display_name='tempest-ServersNegativeTestJSON-server-983427950',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-983427950',id=37,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e46ba54fdcdb45368f457001f26a281b',ramdisk_id='',reservation_id='r-8vmhuy3y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-495782531',owner_user_name='tempest-ServersNegativeTestJSON-495782531-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:29:45Z,user_data=None,user_id='67248d6b437547918b0cc2b0cdf29536',uuid=c04d101a-2c7f-4c9d-81c8-0f2d866e1534,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1ca4eb0-7c25-407d-9baf-1d37f309e9e5", "address": "fa:16:3e:50:69:97", "network": {"id": "8b306bb0-c969-4918-a696-dd539eaa3a21", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1341077591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e46ba54fdcdb45368f457001f26a281b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1ca4eb0-7c", "ovs_interfaceid": "b1ca4eb0-7c25-407d-9baf-1d37f309e9e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82479) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 00:29:49 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Converting VIF {"id": "b1ca4eb0-7c25-407d-9baf-1d37f309e9e5", "address": "fa:16:3e:50:69:97", "network": {"id": "8b306bb0-c969-4918-a696-dd539eaa3a21", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1341077591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e46ba54fdcdb45368f457001f26a281b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1ca4eb0-7c", "ovs_interfaceid": "b1ca4eb0-7c25-407d-9baf-1d37f309e9e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:29:49 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:69:97,bridge_name='br-int',has_traffic_filtering=True,id=b1ca4eb0-7c25-407d-9baf-1d37f309e9e5,network=Network(8b306bb0-c969-4918-a696-dd539eaa3a21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1ca4eb0-7c') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:29:49 user nova-compute[82479]: DEBUG nova.objects.instance [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lazy-loading 'pci_devices' on Instance uuid c04d101a-2c7f-4c9d-81c8-0f2d866e1534 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:29:49 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] End _get_guest_xml xml=<domain type="kvm">
Apr 14 00:29:49 user nova-compute[82479]:   <uuid>c04d101a-2c7f-4c9d-81c8-0f2d866e1534</uuid>
Apr 14 00:29:49 user nova-compute[82479]:   <name>instance-00000025</name>
Apr 14 00:29:49 user nova-compute[82479]:   <memory>131072</memory>
Apr 14 00:29:49 user nova-compute[82479]:   <vcpu>1</vcpu>
Apr 14 00:29:49 user nova-compute[82479]:   <metadata>
Apr 14 00:29:49 user nova-compute[82479]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 00:29:49 user nova-compute[82479]:       <nova:package version="0.0.0"/>
Apr 14 00:29:49 user nova-compute[82479]:       <nova:name>tempest-ServersNegativeTestJSON-server-983427950</nova:name>
Apr 14 00:29:49 user nova-compute[82479]:       <nova:creationTime>2023-04-14 00:29:49</nova:creationTime>
Apr 14 00:29:49 user nova-compute[82479]:       <nova:flavor name="m1.nano">
Apr 14 00:29:49 user nova-compute[82479]:         <nova:memory>128</nova:memory>
Apr 14 00:29:49 user nova-compute[82479]:         <nova:disk>1</nova:disk>
Apr 14 00:29:49 user nova-compute[82479]:         <nova:swap>0</nova:swap>
Apr 14 00:29:49 user nova-compute[82479]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 00:29:49 user nova-compute[82479]:         <nova:vcpus>1</nova:vcpus>
Apr 14 00:29:49 user nova-compute[82479]:       </nova:flavor>
Apr 14 00:29:49 user nova-compute[82479]:       <nova:owner>
Apr 14 00:29:49 user nova-compute[82479]:         <nova:user uuid="67248d6b437547918b0cc2b0cdf29536">tempest-ServersNegativeTestJSON-495782531-project-member</nova:user>
Apr 14 00:29:49 user nova-compute[82479]:         <nova:project uuid="e46ba54fdcdb45368f457001f26a281b">tempest-ServersNegativeTestJSON-495782531</nova:project>
Apr 14 00:29:49 user nova-compute[82479]:       </nova:owner>
Apr 14 00:29:49 user nova-compute[82479]:       <nova:root type="image" uuid="6db62068-7278-4cd8-b41f-d0140d89e199"/>
Apr 14 00:29:49 user nova-compute[82479]:       <nova:ports>
Apr 14 00:29:49 user nova-compute[82479]:         <nova:port uuid="b1ca4eb0-7c25-407d-9baf-1d37f309e9e5">
Apr 14 00:29:49 user nova-compute[82479]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 00:29:49 user nova-compute[82479]:         </nova:port>
Apr 14 00:29:49 user nova-compute[82479]:       </nova:ports>
Apr 14 00:29:49 user nova-compute[82479]:     </nova:instance>
Apr 14 00:29:49 user nova-compute[82479]:   </metadata>
Apr 14 00:29:49 user nova-compute[82479]:   <sysinfo type="smbios">
Apr 14 00:29:49 user nova-compute[82479]:     <system>
Apr 14 00:29:49 user nova-compute[82479]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 00:29:49 user nova-compute[82479]:       <entry name="product">OpenStack Nova</entry>
Apr 14 00:29:49 user nova-compute[82479]:       <entry name="version">0.0.0</entry>
Apr 14 00:29:49 user nova-compute[82479]:       <entry name="serial">c04d101a-2c7f-4c9d-81c8-0f2d866e1534</entry>
Apr 14 00:29:49 user nova-compute[82479]:       <entry name="uuid">c04d101a-2c7f-4c9d-81c8-0f2d866e1534</entry>
Apr 14 00:29:49 user nova-compute[82479]:       <entry name="family">Virtual Machine</entry>
Apr 14 00:29:49 user nova-compute[82479]:     </system>
Apr 14 00:29:49 user nova-compute[82479]:   </sysinfo>
Apr 14 00:29:49 user nova-compute[82479]:   <os>
Apr 14 00:29:49 user nova-compute[82479]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 00:29:49 user nova-compute[82479]:     <boot dev="hd"/>
Apr 14 00:29:49 user nova-compute[82479]:     <smbios mode="sysinfo"/>
Apr 14 00:29:49 user nova-compute[82479]:   </os>
Apr 14 00:29:49 user nova-compute[82479]:   <features>
Apr 14 00:29:49 user nova-compute[82479]:     <acpi/>
Apr 14 00:29:49 user nova-compute[82479]:     <apic/>
Apr 14 00:29:49 user nova-compute[82479]:     <vmcoreinfo/>
Apr 14 00:29:49 user nova-compute[82479]:   </features>
Apr 14 00:29:49 user nova-compute[82479]:   <clock offset="utc">
Apr 14 00:29:49 user nova-compute[82479]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 00:29:49 user nova-compute[82479]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 00:29:49 user nova-compute[82479]:     <timer name="hpet" present="no"/>
Apr 14 00:29:49 user nova-compute[82479]:   </clock>
Apr 14 00:29:49 user nova-compute[82479]:   <cpu mode="custom" match="exact">
Apr 14 00:29:49 user nova-compute[82479]:     <model>Nehalem</model>
Apr 14 00:29:49 user nova-compute[82479]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 00:29:49 user nova-compute[82479]:   </cpu>
Apr 14 00:29:49 user nova-compute[82479]:   <devices>
Apr 14 00:29:49 user nova-compute[82479]:     <disk type="file" device="disk">
Apr 14 00:29:49 user nova-compute[82479]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 00:29:49 user nova-compute[82479]:       <source file="/opt/stack/data/nova/instances/c04d101a-2c7f-4c9d-81c8-0f2d866e1534/disk"/>
Apr 14 00:29:49 user nova-compute[82479]:       <target dev="vda" bus="virtio"/>
Apr 14 00:29:49 user nova-compute[82479]:     </disk>
Apr 14 00:29:49 user nova-compute[82479]:     <interface type="ethernet">
Apr 14 00:29:49 user nova-compute[82479]:       <mac address="fa:16:3e:50:69:97"/>
Apr 14 00:29:49 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:29:49 user nova-compute[82479]:       <mtu size="1442"/>
Apr 14 00:29:49 user nova-compute[82479]:       <target dev="tapb1ca4eb0-7c"/>
Apr 14 00:29:49 user nova-compute[82479]:     </interface>
Apr 14 00:29:49 user nova-compute[82479]:     <serial type="pty">
Apr 14 00:29:49 user nova-compute[82479]:       <log file="/opt/stack/data/nova/instances/c04d101a-2c7f-4c9d-81c8-0f2d866e1534/console.log" append="off"/>
Apr 14 00:29:49 user nova-compute[82479]:     </serial>
Apr 14 00:29:49 user nova-compute[82479]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 00:29:49 user nova-compute[82479]:     <video>
Apr 14 00:29:49 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:29:49 user nova-compute[82479]:     </video>
Apr 14 00:29:49 user nova-compute[82479]:     <rng model="virtio">
Apr 14 00:29:49 user nova-compute[82479]:       <backend model="random">/dev/urandom</backend>
Apr 14 00:29:49 user nova-compute[82479]:     </rng>
Apr 14 00:29:49 user nova-compute[82479]:     <controller type="usb" index="0" model="none"/>
Apr 14 00:29:49 user nova-compute[82479]:     <memballoon model="virtio">
Apr 14 00:29:49 user nova-compute[82479]:       <stats period="10"/>
Apr 14 00:29:49 user nova-compute[82479]:     </memballoon>
Apr 14 00:29:49 user nova-compute[82479]:   </devices>
Apr 14 00:29:49 user nova-compute[82479]: </domain>
Apr 14 00:29:49 user nova-compute[82479]:  {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 00:29:49 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:29:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-983427950',display_name='tempest-ServersNegativeTestJSON-server-983427950',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-983427950',id=37,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e46ba54fdcdb45368f457001f26a281b',ramdisk_id='',reservation_id='r-8vmhuy3y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-495782531',owner_user_name='tempest-ServersNegativeTestJSON-495782531-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:29:45Z,user_data=None,user_id='67248d6b437547918b0cc2b0cdf29536',uuid=c04d101a-2c7f-4c9d-81c8-0f2d866e1534,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1ca4eb0-7c25-407d-9baf-1d37f309e9e5", "address": "fa:16:3e:50:69:97", "network": {"id": "8b306bb0-c969-4918-a696-dd539eaa3a21", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1341077591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e46ba54fdcdb45368f457001f26a281b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1ca4eb0-7c", "ovs_interfaceid": "b1ca4eb0-7c25-407d-9baf-1d37f309e9e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 00:29:49 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Converting VIF {"id": "b1ca4eb0-7c25-407d-9baf-1d37f309e9e5", "address": "fa:16:3e:50:69:97", "network": {"id": "8b306bb0-c969-4918-a696-dd539eaa3a21", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1341077591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e46ba54fdcdb45368f457001f26a281b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1ca4eb0-7c", "ovs_interfaceid": "b1ca4eb0-7c25-407d-9baf-1d37f309e9e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:29:49 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:69:97,bridge_name='br-int',has_traffic_filtering=True,id=b1ca4eb0-7c25-407d-9baf-1d37f309e9e5,network=Network(8b306bb0-c969-4918-a696-dd539eaa3a21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1ca4eb0-7c') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:29:49 user nova-compute[82479]: DEBUG os_vif [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:69:97,bridge_name='br-int',has_traffic_filtering=True,id=b1ca4eb0-7c25-407d-9baf-1d37f309e9e5,network=Network(8b306bb0-c969-4918-a696-dd539eaa3a21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1ca4eb0-7c') {{(pid=82479) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 00:29:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:29:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:29:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 00:29:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:29:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb1ca4eb0-7c, may_exist=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:29:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb1ca4eb0-7c, col_values=(('external_ids', {'iface-id': 'b1ca4eb0-7c25-407d-9baf-1d37f309e9e5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:50:69:97', 'vm-uuid': 'c04d101a-2c7f-4c9d-81c8-0f2d866e1534'}),)) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:29:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:29:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:29:49 user nova-compute[82479]: DEBUG nova.network.neutron [req-e1bedaae-2f8f-462d-9c31-b2083c6ffd78 req-6930d359-46cc-4989-99ea-d2f81c798c46 service nova] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Updated VIF entry in instance network info cache for port 05d7b2dd-9ebb-4ab6-a720-ea22509e855e. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:29:49 user nova-compute[82479]: DEBUG nova.network.neutron [req-e1bedaae-2f8f-462d-9c31-b2083c6ffd78 req-6930d359-46cc-4989-99ea-d2f81c798c46 service nova] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Updating instance_info_cache with network_info: [{"id": "05d7b2dd-9ebb-4ab6-a720-ea22509e855e", "address": "fa:16:3e:73:07:f8", "network": {"id": "83abe289-89d1-4c43-bfc5-19bcfdcc8309", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2050684181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "851640ccdac240bcb6b9b0a89dd250d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05d7b2dd-9e", "ovs_interfaceid": "05d7b2dd-9ebb-4ab6-a720-ea22509e855e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:29:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:29:49 user nova-compute[82479]: INFO os_vif [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:69:97,bridge_name='br-int',has_traffic_filtering=True,id=b1ca4eb0-7c25-407d-9baf-1d37f309e9e5,network=Network(8b306bb0-c969-4918-a696-dd539eaa3a21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1ca4eb0-7c')
Apr 14 00:29:49 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-e1bedaae-2f8f-462d-9c31-b2083c6ffd78 req-6930d359-46cc-4989-99ea-d2f81c798c46 service nova] Releasing lock "refresh_cache-5bd24977-c1b5-4bc5-b651-d6061483e781" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:29:49 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:29:49 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] No VIF found with MAC fa:16:3e:50:69:97, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:29:50 user nova-compute[82479]: DEBUG nova.compute.manager [req-c384fe30-7821-4d59-b7ae-62156c46c3a3 req-ebf77b41-2431-4879-83e0-bdb0b444fa4e service nova] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] Received event network-changed-b1ca4eb0-7c25-407d-9baf-1d37f309e9e5 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:29:50 user nova-compute[82479]: DEBUG nova.compute.manager [req-c384fe30-7821-4d59-b7ae-62156c46c3a3 req-ebf77b41-2431-4879-83e0-bdb0b444fa4e service nova] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] Refreshing instance network info cache due to event network-changed-b1ca4eb0-7c25-407d-9baf-1d37f309e9e5. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:29:50 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-c384fe30-7821-4d59-b7ae-62156c46c3a3 req-ebf77b41-2431-4879-83e0-bdb0b444fa4e service nova] Acquiring lock "refresh_cache-c04d101a-2c7f-4c9d-81c8-0f2d866e1534" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:29:50 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-c384fe30-7821-4d59-b7ae-62156c46c3a3 req-ebf77b41-2431-4879-83e0-bdb0b444fa4e service nova] Acquired lock "refresh_cache-c04d101a-2c7f-4c9d-81c8-0f2d866e1534" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:29:50 user nova-compute[82479]: DEBUG nova.network.neutron [req-c384fe30-7821-4d59-b7ae-62156c46c3a3 req-ebf77b41-2431-4879-83e0-bdb0b444fa4e service nova] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] Refreshing network info cache for port b1ca4eb0-7c25-407d-9baf-1d37f309e9e5 {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:29:50 user nova-compute[82479]: DEBUG nova.network.neutron [req-c384fe30-7821-4d59-b7ae-62156c46c3a3 req-ebf77b41-2431-4879-83e0-bdb0b444fa4e service nova] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] Updated VIF entry in instance network info cache for port b1ca4eb0-7c25-407d-9baf-1d37f309e9e5. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:29:50 user nova-compute[82479]: DEBUG nova.network.neutron [req-c384fe30-7821-4d59-b7ae-62156c46c3a3 req-ebf77b41-2431-4879-83e0-bdb0b444fa4e service nova] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] Updating instance_info_cache with network_info: [{"id": "b1ca4eb0-7c25-407d-9baf-1d37f309e9e5", "address": "fa:16:3e:50:69:97", "network": {"id": "8b306bb0-c969-4918-a696-dd539eaa3a21", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1341077591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e46ba54fdcdb45368f457001f26a281b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1ca4eb0-7c", "ovs_interfaceid": "b1ca4eb0-7c25-407d-9baf-1d37f309e9e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:29:50 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-c384fe30-7821-4d59-b7ae-62156c46c3a3 req-ebf77b41-2431-4879-83e0-bdb0b444fa4e service nova] Releasing lock "refresh_cache-c04d101a-2c7f-4c9d-81c8-0f2d866e1534" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:29:50 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:29:50 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:29:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:29:51 user nova-compute[82479]: DEBUG nova.compute.manager [req-b6e74d7a-f4b6-40fc-af12-110c9d3d394f req-b9abb586-0ad1-44e6-9e35-0b3113cca435 service nova] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Received event network-vif-plugged-05d7b2dd-9ebb-4ab6-a720-ea22509e855e {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:29:51 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-b6e74d7a-f4b6-40fc-af12-110c9d3d394f req-b9abb586-0ad1-44e6-9e35-0b3113cca435 service nova] Acquiring lock "5bd24977-c1b5-4bc5-b651-d6061483e781-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:29:51 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-b6e74d7a-f4b6-40fc-af12-110c9d3d394f req-b9abb586-0ad1-44e6-9e35-0b3113cca435 service nova] Lock "5bd24977-c1b5-4bc5-b651-d6061483e781-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:29:51 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-b6e74d7a-f4b6-40fc-af12-110c9d3d394f req-b9abb586-0ad1-44e6-9e35-0b3113cca435 service nova] Lock "5bd24977-c1b5-4bc5-b651-d6061483e781-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:29:51 user nova-compute[82479]: DEBUG nova.compute.manager [req-b6e74d7a-f4b6-40fc-af12-110c9d3d394f req-b9abb586-0ad1-44e6-9e35-0b3113cca435 service nova] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] No waiting events found dispatching network-vif-plugged-05d7b2dd-9ebb-4ab6-a720-ea22509e855e {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:29:51 user nova-compute[82479]: WARNING nova.compute.manager [req-b6e74d7a-f4b6-40fc-af12-110c9d3d394f req-b9abb586-0ad1-44e6-9e35-0b3113cca435 service nova] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Received unexpected event network-vif-plugged-05d7b2dd-9ebb-4ab6-a720-ea22509e855e for instance with vm_state building and task_state spawning.
Apr 14 00:29:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:29:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:29:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:29:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:29:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:29:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:29:53 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:29:53 user nova-compute[82479]: DEBUG nova.compute.manager [req-6d86a954-d5c1-439c-a464-6cfa5dc46585 req-02a6e1d3-9816-475e-8063-2b63363d1104 service nova] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Received event network-vif-plugged-05d7b2dd-9ebb-4ab6-a720-ea22509e855e {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:29:53 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-6d86a954-d5c1-439c-a464-6cfa5dc46585 req-02a6e1d3-9816-475e-8063-2b63363d1104 service nova] Acquiring lock "5bd24977-c1b5-4bc5-b651-d6061483e781-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:29:53 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-6d86a954-d5c1-439c-a464-6cfa5dc46585 req-02a6e1d3-9816-475e-8063-2b63363d1104 service nova] Lock "5bd24977-c1b5-4bc5-b651-d6061483e781-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:29:53 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-6d86a954-d5c1-439c-a464-6cfa5dc46585 req-02a6e1d3-9816-475e-8063-2b63363d1104 service nova] Lock "5bd24977-c1b5-4bc5-b651-d6061483e781-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:29:53 user nova-compute[82479]: DEBUG nova.compute.manager [req-6d86a954-d5c1-439c-a464-6cfa5dc46585 req-02a6e1d3-9816-475e-8063-2b63363d1104 service nova] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] No waiting events found dispatching network-vif-plugged-05d7b2dd-9ebb-4ab6-a720-ea22509e855e {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:29:53 user nova-compute[82479]: WARNING nova.compute.manager [req-6d86a954-d5c1-439c-a464-6cfa5dc46585 req-02a6e1d3-9816-475e-8063-2b63363d1104 service nova] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Received unexpected event network-vif-plugged-05d7b2dd-9ebb-4ab6-a720-ea22509e855e for instance with vm_state building and task_state spawning.
Apr 14 00:29:53 user nova-compute[82479]: DEBUG nova.compute.manager [req-6d86a954-d5c1-439c-a464-6cfa5dc46585 req-02a6e1d3-9816-475e-8063-2b63363d1104 service nova] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] Received event network-vif-plugged-b1ca4eb0-7c25-407d-9baf-1d37f309e9e5 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:29:53 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-6d86a954-d5c1-439c-a464-6cfa5dc46585 req-02a6e1d3-9816-475e-8063-2b63363d1104 service nova] Acquiring lock "c04d101a-2c7f-4c9d-81c8-0f2d866e1534-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:29:53 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-6d86a954-d5c1-439c-a464-6cfa5dc46585 req-02a6e1d3-9816-475e-8063-2b63363d1104 service nova] Lock "c04d101a-2c7f-4c9d-81c8-0f2d866e1534-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:29:53 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-6d86a954-d5c1-439c-a464-6cfa5dc46585 req-02a6e1d3-9816-475e-8063-2b63363d1104 service nova] Lock "c04d101a-2c7f-4c9d-81c8-0f2d866e1534-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:29:53 user nova-compute[82479]: DEBUG nova.compute.manager [req-6d86a954-d5c1-439c-a464-6cfa5dc46585 req-02a6e1d3-9816-475e-8063-2b63363d1104 service nova] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] No waiting events found dispatching network-vif-plugged-b1ca4eb0-7c25-407d-9baf-1d37f309e9e5 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:29:53 user nova-compute[82479]: WARNING nova.compute.manager [req-6d86a954-d5c1-439c-a464-6cfa5dc46585 req-02a6e1d3-9816-475e-8063-2b63363d1104 service nova] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] Received unexpected event network-vif-plugged-b1ca4eb0-7c25-407d-9baf-1d37f309e9e5 for instance with vm_state building and task_state spawning.
Apr 14 00:29:53 user nova-compute[82479]: DEBUG nova.compute.manager [req-6d86a954-d5c1-439c-a464-6cfa5dc46585 req-02a6e1d3-9816-475e-8063-2b63363d1104 service nova] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] Received event network-vif-plugged-b1ca4eb0-7c25-407d-9baf-1d37f309e9e5 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:29:53 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-6d86a954-d5c1-439c-a464-6cfa5dc46585 req-02a6e1d3-9816-475e-8063-2b63363d1104 service nova] Acquiring lock "c04d101a-2c7f-4c9d-81c8-0f2d866e1534-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:29:53 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-6d86a954-d5c1-439c-a464-6cfa5dc46585 req-02a6e1d3-9816-475e-8063-2b63363d1104 service nova] Lock "c04d101a-2c7f-4c9d-81c8-0f2d866e1534-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:29:53 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-6d86a954-d5c1-439c-a464-6cfa5dc46585 req-02a6e1d3-9816-475e-8063-2b63363d1104 service nova] Lock "c04d101a-2c7f-4c9d-81c8-0f2d866e1534-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:29:53 user nova-compute[82479]: DEBUG nova.compute.manager [req-6d86a954-d5c1-439c-a464-6cfa5dc46585 req-02a6e1d3-9816-475e-8063-2b63363d1104 service nova] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] No waiting events found dispatching network-vif-plugged-b1ca4eb0-7c25-407d-9baf-1d37f309e9e5 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:29:53 user nova-compute[82479]: WARNING nova.compute.manager [req-6d86a954-d5c1-439c-a464-6cfa5dc46585 req-02a6e1d3-9816-475e-8063-2b63363d1104 service nova] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] Received unexpected event network-vif-plugged-b1ca4eb0-7c25-407d-9baf-1d37f309e9e5 for instance with vm_state building and task_state spawning.
Apr 14 00:29:53 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681432193.8022826, c04d101a-2c7f-4c9d-81c8-0f2d866e1534 => Resumed> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:29:53 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] VM Resumed (Lifecycle Event)
Apr 14 00:29:53 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] Instance event wait completed in 0 seconds for  {{(pid=82479) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 00:29:53 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] Guest created on hypervisor {{(pid=82479) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 00:29:53 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:29:53 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] Instance spawned successfully.
Apr 14 00:29:53 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 00:29:53 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:29:53 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:29:53 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681432193.8036945, c04d101a-2c7f-4c9d-81c8-0f2d866e1534 => Started> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:29:53 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] VM Started (Lifecycle Event)
Apr 14 00:29:53 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Instance event wait completed in 0 seconds for  {{(pid=82479) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 00:29:53 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Guest created on hypervisor {{(pid=82479) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 00:29:53 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] Found default for hw_cdrom_bus of ide {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:29:53 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] Found default for hw_disk_bus of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:29:53 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] Found default for hw_input_bus of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:29:53 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] Found default for hw_pointer_model of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:29:53 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] Found default for hw_video_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:29:53 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] Found default for hw_vif_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:29:53 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:29:53 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Instance spawned successfully.
Apr 14 00:29:53 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 00:29:53 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:29:53 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Found default for hw_cdrom_bus of ide {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:29:53 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Found default for hw_disk_bus of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:29:53 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Found default for hw_input_bus of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:29:53 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Found default for hw_pointer_model of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:29:53 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Found default for hw_video_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:29:53 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Found default for hw_vif_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:29:53 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:29:53 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681432193.872761, 5bd24977-c1b5-4bc5-b651-d6061483e781 => Resumed> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:29:53 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] VM Resumed (Lifecycle Event)
Apr 14 00:29:53 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:29:53 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:29:53 user nova-compute[82479]: INFO nova.compute.manager [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] Took 8.79 seconds to spawn the instance on the hypervisor.
Apr 14 00:29:53 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:29:53 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:29:53 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681432193.8739407, 5bd24977-c1b5-4bc5-b651-d6061483e781 => Started> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:29:53 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] VM Started (Lifecycle Event)
Apr 14 00:29:54 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:29:54 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:29:54 user nova-compute[82479]: INFO nova.compute.manager [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Took 9.17 seconds to spawn the instance on the hypervisor.
Apr 14 00:29:54 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:29:54 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:29:54 user nova-compute[82479]: INFO nova.compute.manager [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] Took 9.54 seconds to build instance.
Apr 14 00:29:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1fc3eb7a-7677-46fc-aecd-2db612a8be81 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "c04d101a-2c7f-4c9d-81c8-0f2d866e1534" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.636s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:29:54 user nova-compute[82479]: INFO nova.compute.manager [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Took 9.78 seconds to build instance.
Apr 14 00:29:54 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:29:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-c5ce64d1-8087-4b12-beb9-684548ad9da1 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "5bd24977-c1b5-4bc5-b651-d6061483e781" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.874s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:29:56 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:29:57 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:29:57 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Starting heal instance info cache {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 00:29:57 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Rebuilding the list of instances to heal {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 00:29:57 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "refresh_cache-2d04f694-0eba-46c3-a617-97d3de666de8" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:29:57 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquired lock "refresh_cache-2d04f694-0eba-46c3-a617-97d3de666de8" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:29:57 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Forcefully refreshing network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 00:29:57 user nova-compute[82479]: DEBUG nova.objects.instance [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lazy-loading 'info_cache' on Instance uuid 2d04f694-0eba-46c3-a617-97d3de666de8 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:29:58 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Updating instance_info_cache with network_info: [{"id": "e7556e77-8734-4ef9-b260-2503b06b73bc", "address": "fa:16:3e:5a:d1:62", "network": {"id": "8b306bb0-c969-4918-a696-dd539eaa3a21", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1341077591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e46ba54fdcdb45368f457001f26a281b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7556e77-87", "ovs_interfaceid": "e7556e77-8734-4ef9-b260-2503b06b73bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:29:58 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Releasing lock "refresh_cache-2d04f694-0eba-46c3-a617-97d3de666de8" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:29:58 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Updated the network info_cache for instance {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 00:29:59 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:29:59 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:30:03 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:30:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:30:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:30:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:30:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:30:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:30:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:30:05 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:30:05 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:30:06 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:30:08 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:30:09 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:30:10 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:30:10 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82479) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 00:30:10 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:30:10 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:30:10 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:30:10 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:30:10 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Auditing locally available compute resources for user (node: user) {{(pid=82479) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 00:30:10 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c04d101a-2c7f-4c9d-81c8-0f2d866e1534/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:30:10 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c04d101a-2c7f-4c9d-81c8-0f2d866e1534/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:30:10 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c04d101a-2c7f-4c9d-81c8-0f2d866e1534/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:30:10 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c04d101a-2c7f-4c9d-81c8-0f2d866e1534/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:30:10 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d04f694-0eba-46c3-a617-97d3de666de8/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:30:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d04f694-0eba-46c3-a617-97d3de666de8/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:30:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d04f694-0eba-46c3-a617-97d3de666de8/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:30:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d04f694-0eba-46c3-a617-97d3de666de8/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:30:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bd24977-c1b5-4bc5-b651-d6061483e781/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:30:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bd24977-c1b5-4bc5-b651-d6061483e781/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:30:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bd24977-c1b5-4bc5-b651-d6061483e781/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:30:11 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:30:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bd24977-c1b5-4bc5-b651-d6061483e781/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:30:12 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:30:12 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:30:12 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Hypervisor/Node resource view: name=user free_ram=8513MB free_disk=26.203365325927734GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82479) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 00:30:12 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:30:12 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:30:12 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 2d04f694-0eba-46c3-a617-97d3de666de8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:30:12 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 5bd24977-c1b5-4bc5-b651-d6061483e781 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:30:12 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance c04d101a-2c7f-4c9d-81c8-0f2d866e1534 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:30:12 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 00:30:12 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 00:30:12 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:30:12 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:30:12 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Compute_service record updated for user:user {{(pid=82479) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 00:30:12 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.242s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:30:13 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:30:14 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:30:16 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:30:19 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:30:21 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:30:24 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:30:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:30:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:30:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:30:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:30:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:30:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:30:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:30:36 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:30:36 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:30:38 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:30:39 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:30:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:30:42 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:30:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:30:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:30:46 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:30:48 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "61d1abb2-3c80-48de-a26b-1c8030081105" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:30:48 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "61d1abb2-3c80-48de-a26b-1c8030081105" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:30:48 user nova-compute[82479]: DEBUG nova.compute.manager [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Starting instance... {{(pid=82479) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 00:30:48 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:30:48 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:30:48 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82479) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 00:30:48 user nova-compute[82479]: INFO nova.compute.claims [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Claim successful on node user
Apr 14 00:30:48 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:30:48 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:30:48 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.270s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:30:48 user nova-compute[82479]: DEBUG nova.compute.manager [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Start building networks asynchronously for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 00:30:48 user nova-compute[82479]: DEBUG nova.compute.manager [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Allocating IP information in the background. {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 00:30:48 user nova-compute[82479]: DEBUG nova.network.neutron [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] allocate_for_instance() {{(pid=82479) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 00:30:48 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 00:30:48 user nova-compute[82479]: DEBUG nova.compute.manager [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Start building block device mappings for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 00:30:48 user nova-compute[82479]: DEBUG nova.compute.manager [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Start spawning the instance on the hypervisor. {{(pid=82479) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 00:30:48 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Creating instance directory {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 00:30:48 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Creating image(s)
Apr 14 00:30:48 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "/opt/stack/data/nova/instances/61d1abb2-3c80-48de-a26b-1c8030081105/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:30:48 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "/opt/stack/data/nova/instances/61d1abb2-3c80-48de-a26b-1c8030081105/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:30:48 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "/opt/stack/data/nova/instances/61d1abb2-3c80-48de-a26b-1c8030081105/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:30:48 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "4ce35c80b3bff307959a38a69a9348abf786c630" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:30:48 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "4ce35c80b3bff307959a38a69a9348abf786c630" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:30:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ce35c80b3bff307959a38a69a9348abf786c630.part --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:30:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:30:49 user nova-compute[82479]: DEBUG nova.policy [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e5ad76f13b78448887913c4d0bcb16af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46777f523af54eecb0e3260f14df7909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82479) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 00:30:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ce35c80b3bff307959a38a69a9348abf786c630.part --force-share --output=json" returned: 0 in 0.130s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:30:49 user nova-compute[82479]: DEBUG nova.virt.images [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] 69b3b215-794a-4b99-9d8b-56aa656eaf64 was qcow2, converting to raw {{(pid=82479) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 00:30:49 user nova-compute[82479]: DEBUG nova.privsep.utils [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82479) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 00:30:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4ce35c80b3bff307959a38a69a9348abf786c630.part /opt/stack/data/nova/instances/_base/4ce35c80b3bff307959a38a69a9348abf786c630.converted {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:30:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4ce35c80b3bff307959a38a69a9348abf786c630.part /opt/stack/data/nova/instances/_base/4ce35c80b3bff307959a38a69a9348abf786c630.converted" returned: 0 in 0.227s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:30:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ce35c80b3bff307959a38a69a9348abf786c630.converted --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:30:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ce35c80b3bff307959a38a69a9348abf786c630.converted --force-share --output=json" returned: 0 in 0.150s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:30:49 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "4ce35c80b3bff307959a38a69a9348abf786c630" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.858s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:30:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ce35c80b3bff307959a38a69a9348abf786c630 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:30:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ce35c80b3bff307959a38a69a9348abf786c630 --force-share --output=json" returned: 0 in 0.131s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:30:49 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "4ce35c80b3bff307959a38a69a9348abf786c630" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:30:49 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "4ce35c80b3bff307959a38a69a9348abf786c630" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:30:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ce35c80b3bff307959a38a69a9348abf786c630 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:30:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ce35c80b3bff307959a38a69a9348abf786c630 --force-share --output=json" returned: 0 in 0.131s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:30:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4ce35c80b3bff307959a38a69a9348abf786c630,backing_fmt=raw /opt/stack/data/nova/instances/61d1abb2-3c80-48de-a26b-1c8030081105/disk 1073741824 {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:30:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4ce35c80b3bff307959a38a69a9348abf786c630,backing_fmt=raw /opt/stack/data/nova/instances/61d1abb2-3c80-48de-a26b-1c8030081105/disk 1073741824" returned: 0 in 0.051s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:30:50 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "4ce35c80b3bff307959a38a69a9348abf786c630" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.189s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:30:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ce35c80b3bff307959a38a69a9348abf786c630 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:30:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ce35c80b3bff307959a38a69a9348abf786c630 --force-share --output=json" returned: 0 in 0.132s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:30:50 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Checking if we can resize image /opt/stack/data/nova/instances/61d1abb2-3c80-48de-a26b-1c8030081105/disk. size=1073741824 {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 00:30:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61d1abb2-3c80-48de-a26b-1c8030081105/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:30:50 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:30:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61d1abb2-3c80-48de-a26b-1c8030081105/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:30:50 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Cannot resize image /opt/stack/data/nova/instances/61d1abb2-3c80-48de-a26b-1c8030081105/disk to a smaller size. {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 00:30:50 user nova-compute[82479]: DEBUG nova.objects.instance [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lazy-loading 'migration_context' on Instance uuid 61d1abb2-3c80-48de-a26b-1c8030081105 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:30:50 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Created local disks {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 00:30:50 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Ensure instance console log exists: /opt/stack/data/nova/instances/61d1abb2-3c80-48de-a26b-1c8030081105/console.log {{(pid=82479) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 00:30:50 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:30:50 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:30:50 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:30:50 user nova-compute[82479]: DEBUG nova.network.neutron [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Successfully created port: bf80bc9c-a453-4809-8eb4-e57fe015351f {{(pid=82479) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 00:30:51 user nova-compute[82479]: DEBUG nova.network.neutron [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Successfully updated port: bf80bc9c-a453-4809-8eb4-e57fe015351f {{(pid=82479) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 00:30:51 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "refresh_cache-61d1abb2-3c80-48de-a26b-1c8030081105" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:30:51 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquired lock "refresh_cache-61d1abb2-3c80-48de-a26b-1c8030081105" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:30:51 user nova-compute[82479]: DEBUG nova.network.neutron [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 00:30:51 user nova-compute[82479]: DEBUG nova.compute.manager [req-658643f3-b7d0-42df-a791-242679cf9de4 req-99eab375-ad05-4fdd-a666-698bb96b1654 service nova] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Received event network-changed-bf80bc9c-a453-4809-8eb4-e57fe015351f {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:30:51 user nova-compute[82479]: DEBUG nova.compute.manager [req-658643f3-b7d0-42df-a791-242679cf9de4 req-99eab375-ad05-4fdd-a666-698bb96b1654 service nova] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Refreshing instance network info cache due to event network-changed-bf80bc9c-a453-4809-8eb4-e57fe015351f. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:30:51 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-658643f3-b7d0-42df-a791-242679cf9de4 req-99eab375-ad05-4fdd-a666-698bb96b1654 service nova] Acquiring lock "refresh_cache-61d1abb2-3c80-48de-a26b-1c8030081105" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:30:51 user nova-compute[82479]: DEBUG nova.network.neutron [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Instance cache missing network info. {{(pid=82479) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 00:30:51 user nova-compute[82479]: DEBUG nova.network.neutron [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Updating instance_info_cache with network_info: [{"id": "bf80bc9c-a453-4809-8eb4-e57fe015351f", "address": "fa:16:3e:fc:5e:3a", "network": {"id": "d7b8d180-999a-4f41-b677-e83b1c24a8a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1461510401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46777f523af54eecb0e3260f14df7909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf80bc9c-a4", "ovs_interfaceid": "bf80bc9c-a453-4809-8eb4-e57fe015351f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:30:51 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Releasing lock "refresh_cache-61d1abb2-3c80-48de-a26b-1c8030081105" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:30:51 user nova-compute[82479]: DEBUG nova.compute.manager [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Instance network_info: |[{"id": "bf80bc9c-a453-4809-8eb4-e57fe015351f", "address": "fa:16:3e:fc:5e:3a", "network": {"id": "d7b8d180-999a-4f41-b677-e83b1c24a8a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1461510401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46777f523af54eecb0e3260f14df7909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf80bc9c-a4", "ovs_interfaceid": "bf80bc9c-a453-4809-8eb4-e57fe015351f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 00:30:51 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-658643f3-b7d0-42df-a791-242679cf9de4 req-99eab375-ad05-4fdd-a666-698bb96b1654 service nova] Acquired lock "refresh_cache-61d1abb2-3c80-48de-a26b-1c8030081105" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:30:51 user nova-compute[82479]: DEBUG nova.network.neutron [req-658643f3-b7d0-42df-a791-242679cf9de4 req-99eab375-ad05-4fdd-a666-698bb96b1654 service nova] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Refreshing network info cache for port bf80bc9c-a453-4809-8eb4-e57fe015351f {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:30:51 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Start _get_guest_xml network_info=[{"id": "bf80bc9c-a453-4809-8eb4-e57fe015351f", "address": "fa:16:3e:fc:5e:3a", "network": {"id": "d7b8d180-999a-4f41-b677-e83b1c24a8a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1461510401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46777f523af54eecb0e3260f14df7909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf80bc9c-a4", "ovs_interfaceid": "bf80bc9c-a453-4809-8eb4-e57fe015351f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:30:46Z,direct_url=<?>,disk_format='qcow2',id=69b3b215-794a-4b99-9d8b-56aa656eaf64,min_disk=0,min_ram=0,name='tempest-scenario-img--673647311',owner='46777f523af54eecb0e3260f14df7909',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:30:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'image_id': '69b3b215-794a-4b99-9d8b-56aa656eaf64'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 00:30:51 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:30:51 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:30:51 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82479) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 00:30:51 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T00:02:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:30:46Z,direct_url=<?>,disk_format='qcow2',id=69b3b215-794a-4b99-9d8b-56aa656eaf64,min_disk=0,min_ram=0,name='tempest-scenario-img--673647311',owner='46777f523af54eecb0e3260f14df7909',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:30:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 00:30:51 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Flavor limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 00:30:51 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Image limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 00:30:51 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Flavor pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 00:30:51 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Image pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 00:30:51 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 00:30:51 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 00:30:51 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 00:30:51 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Got 1 possible topologies {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 00:30:51 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 00:30:51 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 00:30:51 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:30:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-135186904',display_name='tempest-TestMinimumBasicScenario-server-135186904',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-135186904',id=38,image_ref='69b3b215-794a-4b99-9d8b-56aa656eaf64',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbLqmsfqYW8VR6EP1yhbU8GU2QfZRlgJel1XZcbWJfjZ9yg1Nmlkybblt9S+WzcdNDudfvyq9SY0bU2LjYjKMTNT31rkJQgE4HvdP1jaLmQd6JssBlbCFkCHFCD6jWrNw==',key_name='tempest-TestMinimumBasicScenario-1820486155',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46777f523af54eecb0e3260f14df7909',ramdisk_id='',reservation_id='r-zjujq50w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='69b3b215-794a-4b99-9d8b-56aa656eaf64',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-598834355',owner_user_name='tempest-TestMinimumBasicScenario-598834355-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:30:49Z,user_data=None,user_id='e5ad76f13b78448887913c4d0bcb16af',uuid=61d1abb2-3c80-48de-a26b-1c8030081105,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf80bc9c-a453-4809-8eb4-e57fe015351f", "address": "fa:16:3e:fc:5e:3a", "network": {"id": "d7b8d180-999a-4f41-b677-e83b1c24a8a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1461510401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46777f523af54eecb0e3260f14df7909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf80bc9c-a4", "ovs_interfaceid": "bf80bc9c-a453-4809-8eb4-e57fe015351f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82479) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 00:30:51 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Converting VIF {"id": "bf80bc9c-a453-4809-8eb4-e57fe015351f", "address": "fa:16:3e:fc:5e:3a", "network": {"id": "d7b8d180-999a-4f41-b677-e83b1c24a8a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1461510401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46777f523af54eecb0e3260f14df7909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf80bc9c-a4", "ovs_interfaceid": "bf80bc9c-a453-4809-8eb4-e57fe015351f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:30:51 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:5e:3a,bridge_name='br-int',has_traffic_filtering=True,id=bf80bc9c-a453-4809-8eb4-e57fe015351f,network=Network(d7b8d180-999a-4f41-b677-e83b1c24a8a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf80bc9c-a4') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:30:51 user nova-compute[82479]: DEBUG nova.objects.instance [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lazy-loading 'pci_devices' on Instance uuid 61d1abb2-3c80-48de-a26b-1c8030081105 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:30:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:30:51 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] End _get_guest_xml xml=<domain type="kvm">
Apr 14 00:30:51 user nova-compute[82479]:   <uuid>61d1abb2-3c80-48de-a26b-1c8030081105</uuid>
Apr 14 00:30:51 user nova-compute[82479]:   <name>instance-00000026</name>
Apr 14 00:30:51 user nova-compute[82479]:   <memory>131072</memory>
Apr 14 00:30:51 user nova-compute[82479]:   <vcpu>1</vcpu>
Apr 14 00:30:51 user nova-compute[82479]:   <metadata>
Apr 14 00:30:51 user nova-compute[82479]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 00:30:51 user nova-compute[82479]:       <nova:package version="0.0.0"/>
Apr 14 00:30:51 user nova-compute[82479]:       <nova:name>tempest-TestMinimumBasicScenario-server-135186904</nova:name>
Apr 14 00:30:51 user nova-compute[82479]:       <nova:creationTime>2023-04-14 00:30:51</nova:creationTime>
Apr 14 00:30:51 user nova-compute[82479]:       <nova:flavor name="m1.nano">
Apr 14 00:30:51 user nova-compute[82479]:         <nova:memory>128</nova:memory>
Apr 14 00:30:51 user nova-compute[82479]:         <nova:disk>1</nova:disk>
Apr 14 00:30:51 user nova-compute[82479]:         <nova:swap>0</nova:swap>
Apr 14 00:30:51 user nova-compute[82479]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 00:30:51 user nova-compute[82479]:         <nova:vcpus>1</nova:vcpus>
Apr 14 00:30:51 user nova-compute[82479]:       </nova:flavor>
Apr 14 00:30:51 user nova-compute[82479]:       <nova:owner>
Apr 14 00:30:51 user nova-compute[82479]:         <nova:user uuid="e5ad76f13b78448887913c4d0bcb16af">tempest-TestMinimumBasicScenario-598834355-project-member</nova:user>
Apr 14 00:30:51 user nova-compute[82479]:         <nova:project uuid="46777f523af54eecb0e3260f14df7909">tempest-TestMinimumBasicScenario-598834355</nova:project>
Apr 14 00:30:51 user nova-compute[82479]:       </nova:owner>
Apr 14 00:30:51 user nova-compute[82479]:       <nova:root type="image" uuid="69b3b215-794a-4b99-9d8b-56aa656eaf64"/>
Apr 14 00:30:51 user nova-compute[82479]:       <nova:ports>
Apr 14 00:30:51 user nova-compute[82479]:         <nova:port uuid="bf80bc9c-a453-4809-8eb4-e57fe015351f">
Apr 14 00:30:51 user nova-compute[82479]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 14 00:30:51 user nova-compute[82479]:         </nova:port>
Apr 14 00:30:51 user nova-compute[82479]:       </nova:ports>
Apr 14 00:30:51 user nova-compute[82479]:     </nova:instance>
Apr 14 00:30:51 user nova-compute[82479]:   </metadata>
Apr 14 00:30:51 user nova-compute[82479]:   <sysinfo type="smbios">
Apr 14 00:30:51 user nova-compute[82479]:     <system>
Apr 14 00:30:51 user nova-compute[82479]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 00:30:51 user nova-compute[82479]:       <entry name="product">OpenStack Nova</entry>
Apr 14 00:30:51 user nova-compute[82479]:       <entry name="version">0.0.0</entry>
Apr 14 00:30:51 user nova-compute[82479]:       <entry name="serial">61d1abb2-3c80-48de-a26b-1c8030081105</entry>
Apr 14 00:30:51 user nova-compute[82479]:       <entry name="uuid">61d1abb2-3c80-48de-a26b-1c8030081105</entry>
Apr 14 00:30:51 user nova-compute[82479]:       <entry name="family">Virtual Machine</entry>
Apr 14 00:30:51 user nova-compute[82479]:     </system>
Apr 14 00:30:51 user nova-compute[82479]:   </sysinfo>
Apr 14 00:30:51 user nova-compute[82479]:   <os>
Apr 14 00:30:51 user nova-compute[82479]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 00:30:51 user nova-compute[82479]:     <boot dev="hd"/>
Apr 14 00:30:51 user nova-compute[82479]:     <smbios mode="sysinfo"/>
Apr 14 00:30:51 user nova-compute[82479]:   </os>
Apr 14 00:30:51 user nova-compute[82479]:   <features>
Apr 14 00:30:51 user nova-compute[82479]:     <acpi/>
Apr 14 00:30:51 user nova-compute[82479]:     <apic/>
Apr 14 00:30:51 user nova-compute[82479]:     <vmcoreinfo/>
Apr 14 00:30:51 user nova-compute[82479]:   </features>
Apr 14 00:30:51 user nova-compute[82479]:   <clock offset="utc">
Apr 14 00:30:51 user nova-compute[82479]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 00:30:51 user nova-compute[82479]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 00:30:51 user nova-compute[82479]:     <timer name="hpet" present="no"/>
Apr 14 00:30:51 user nova-compute[82479]:   </clock>
Apr 14 00:30:51 user nova-compute[82479]:   <cpu mode="custom" match="exact">
Apr 14 00:30:51 user nova-compute[82479]:     <model>Nehalem</model>
Apr 14 00:30:51 user nova-compute[82479]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 00:30:51 user nova-compute[82479]:   </cpu>
Apr 14 00:30:51 user nova-compute[82479]:   <devices>
Apr 14 00:30:51 user nova-compute[82479]:     <disk type="file" device="disk">
Apr 14 00:30:51 user nova-compute[82479]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 00:30:51 user nova-compute[82479]:       <source file="/opt/stack/data/nova/instances/61d1abb2-3c80-48de-a26b-1c8030081105/disk"/>
Apr 14 00:30:51 user nova-compute[82479]:       <target dev="vda" bus="virtio"/>
Apr 14 00:30:51 user nova-compute[82479]:     </disk>
Apr 14 00:30:51 user nova-compute[82479]:     <interface type="ethernet">
Apr 14 00:30:51 user nova-compute[82479]:       <mac address="fa:16:3e:fc:5e:3a"/>
Apr 14 00:30:51 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:30:51 user nova-compute[82479]:       <mtu size="1442"/>
Apr 14 00:30:51 user nova-compute[82479]:       <target dev="tapbf80bc9c-a4"/>
Apr 14 00:30:51 user nova-compute[82479]:     </interface>
Apr 14 00:30:51 user nova-compute[82479]:     <serial type="pty">
Apr 14 00:30:51 user nova-compute[82479]:       <log file="/opt/stack/data/nova/instances/61d1abb2-3c80-48de-a26b-1c8030081105/console.log" append="off"/>
Apr 14 00:30:51 user nova-compute[82479]:     </serial>
Apr 14 00:30:51 user nova-compute[82479]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 00:30:51 user nova-compute[82479]:     <video>
Apr 14 00:30:51 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:30:51 user nova-compute[82479]:     </video>
Apr 14 00:30:51 user nova-compute[82479]:     <rng model="virtio">
Apr 14 00:30:51 user nova-compute[82479]:       <backend model="random">/dev/urandom</backend>
Apr 14 00:30:51 user nova-compute[82479]:     </rng>
Apr 14 00:30:51 user nova-compute[82479]:     <controller type="usb" index="0" model="none"/>
Apr 14 00:30:51 user nova-compute[82479]:     <memballoon model="virtio">
Apr 14 00:30:51 user nova-compute[82479]:       <stats period="10"/>
Apr 14 00:30:51 user nova-compute[82479]:     </memballoon>
Apr 14 00:30:51 user nova-compute[82479]:   </devices>
Apr 14 00:30:51 user nova-compute[82479]: </domain>
Apr 14 00:30:51 user nova-compute[82479]:  {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 00:30:51 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:30:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-135186904',display_name='tempest-TestMinimumBasicScenario-server-135186904',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-135186904',id=38,image_ref='69b3b215-794a-4b99-9d8b-56aa656eaf64',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbLqmsfqYW8VR6EP1yhbU8GU2QfZRlgJel1XZcbWJfjZ9yg1Nmlkybblt9S+WzcdNDudfvyq9SY0bU2LjYjKMTNT31rkJQgE4HvdP1jaLmQd6JssBlbCFkCHFCD6jWrNw==',key_name='tempest-TestMinimumBasicScenario-1820486155',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46777f523af54eecb0e3260f14df7909',ramdisk_id='',reservation_id='r-zjujq50w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='69b3b215-794a-4b99-9d8b-56aa656eaf64',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-598834355',owner_user_name='tempest-TestMinimumBasicScenario-598834355-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:30:49Z,user_data=None,user_id='e5ad76f13b78448887913c4d0bcb16af',uuid=61d1abb2-3c80-48de-a26b-1c8030081105,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf80bc9c-a453-4809-8eb4-e57fe015351f", "address": "fa:16:3e:fc:5e:3a", "network": {"id": "d7b8d180-999a-4f41-b677-e83b1c24a8a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1461510401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46777f523af54eecb0e3260f14df7909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf80bc9c-a4", "ovs_interfaceid": "bf80bc9c-a453-4809-8eb4-e57fe015351f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 00:30:51 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Converting VIF {"id": "bf80bc9c-a453-4809-8eb4-e57fe015351f", "address": "fa:16:3e:fc:5e:3a", "network": {"id": "d7b8d180-999a-4f41-b677-e83b1c24a8a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1461510401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46777f523af54eecb0e3260f14df7909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf80bc9c-a4", "ovs_interfaceid": "bf80bc9c-a453-4809-8eb4-e57fe015351f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:30:51 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:5e:3a,bridge_name='br-int',has_traffic_filtering=True,id=bf80bc9c-a453-4809-8eb4-e57fe015351f,network=Network(d7b8d180-999a-4f41-b677-e83b1c24a8a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf80bc9c-a4') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:30:51 user nova-compute[82479]: DEBUG os_vif [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:5e:3a,bridge_name='br-int',has_traffic_filtering=True,id=bf80bc9c-a453-4809-8eb4-e57fe015351f,network=Network(d7b8d180-999a-4f41-b677-e83b1c24a8a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf80bc9c-a4') {{(pid=82479) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 00:30:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:30:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:30:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 00:30:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:30:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbf80bc9c-a4, may_exist=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:30:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbf80bc9c-a4, col_values=(('external_ids', {'iface-id': 'bf80bc9c-a453-4809-8eb4-e57fe015351f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:5e:3a', 'vm-uuid': '61d1abb2-3c80-48de-a26b-1c8030081105'}),)) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:30:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:30:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:30:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:30:51 user nova-compute[82479]: INFO os_vif [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:5e:3a,bridge_name='br-int',has_traffic_filtering=True,id=bf80bc9c-a453-4809-8eb4-e57fe015351f,network=Network(d7b8d180-999a-4f41-b677-e83b1c24a8a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf80bc9c-a4')
Apr 14 00:30:51 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:30:51 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] No VIF found with MAC fa:16:3e:fc:5e:3a, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:30:52 user nova-compute[82479]: DEBUG nova.network.neutron [req-658643f3-b7d0-42df-a791-242679cf9de4 req-99eab375-ad05-4fdd-a666-698bb96b1654 service nova] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Updated VIF entry in instance network info cache for port bf80bc9c-a453-4809-8eb4-e57fe015351f. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:30:52 user nova-compute[82479]: DEBUG nova.network.neutron [req-658643f3-b7d0-42df-a791-242679cf9de4 req-99eab375-ad05-4fdd-a666-698bb96b1654 service nova] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Updating instance_info_cache with network_info: [{"id": "bf80bc9c-a453-4809-8eb4-e57fe015351f", "address": "fa:16:3e:fc:5e:3a", "network": {"id": "d7b8d180-999a-4f41-b677-e83b1c24a8a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1461510401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46777f523af54eecb0e3260f14df7909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf80bc9c-a4", "ovs_interfaceid": "bf80bc9c-a453-4809-8eb4-e57fe015351f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:30:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-658643f3-b7d0-42df-a791-242679cf9de4 req-99eab375-ad05-4fdd-a666-698bb96b1654 service nova] Releasing lock "refresh_cache-61d1abb2-3c80-48de-a26b-1c8030081105" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:30:53 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:30:53 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:30:53 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:30:53 user nova-compute[82479]: DEBUG nova.compute.manager [req-e382fa9b-b794-4f40-b771-d66a5a957b56 req-502071f3-6da1-4896-b10e-57022d2245c5 service nova] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Received event network-vif-plugged-bf80bc9c-a453-4809-8eb4-e57fe015351f {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:30:53 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-e382fa9b-b794-4f40-b771-d66a5a957b56 req-502071f3-6da1-4896-b10e-57022d2245c5 service nova] Acquiring lock "61d1abb2-3c80-48de-a26b-1c8030081105-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:30:53 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-e382fa9b-b794-4f40-b771-d66a5a957b56 req-502071f3-6da1-4896-b10e-57022d2245c5 service nova] Lock "61d1abb2-3c80-48de-a26b-1c8030081105-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:30:53 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-e382fa9b-b794-4f40-b771-d66a5a957b56 req-502071f3-6da1-4896-b10e-57022d2245c5 service nova] Lock "61d1abb2-3c80-48de-a26b-1c8030081105-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:30:53 user nova-compute[82479]: DEBUG nova.compute.manager [req-e382fa9b-b794-4f40-b771-d66a5a957b56 req-502071f3-6da1-4896-b10e-57022d2245c5 service nova] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] No waiting events found dispatching network-vif-plugged-bf80bc9c-a453-4809-8eb4-e57fe015351f {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:30:53 user nova-compute[82479]: WARNING nova.compute.manager [req-e382fa9b-b794-4f40-b771-d66a5a957b56 req-502071f3-6da1-4896-b10e-57022d2245c5 service nova] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Received unexpected event network-vif-plugged-bf80bc9c-a453-4809-8eb4-e57fe015351f for instance with vm_state building and task_state spawning.
Apr 14 00:30:53 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:30:53 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:30:53 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:30:53 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:30:55 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681432255.1691933, 61d1abb2-3c80-48de-a26b-1c8030081105 => Resumed> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:30:55 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] VM Resumed (Lifecycle Event)
Apr 14 00:30:55 user nova-compute[82479]: DEBUG nova.compute.manager [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Instance event wait completed in 0 seconds for  {{(pid=82479) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 00:30:55 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Guest created on hypervisor {{(pid=82479) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 00:30:55 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Instance spawned successfully.
Apr 14 00:30:55 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 00:30:55 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:30:55 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:30:55 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Found default for hw_cdrom_bus of ide {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:30:55 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Found default for hw_disk_bus of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:30:55 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Found default for hw_input_bus of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:30:55 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Found default for hw_pointer_model of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:30:55 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Found default for hw_video_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:30:55 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Found default for hw_vif_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:30:55 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:30:55 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681432255.170384, 61d1abb2-3c80-48de-a26b-1c8030081105 => Started> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:30:55 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] VM Started (Lifecycle Event)
Apr 14 00:30:55 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:30:55 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:30:55 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:30:55 user nova-compute[82479]: INFO nova.compute.manager [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Took 6.32 seconds to spawn the instance on the hypervisor.
Apr 14 00:30:55 user nova-compute[82479]: DEBUG nova.compute.manager [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:30:55 user nova-compute[82479]: INFO nova.compute.manager [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Took 6.94 seconds to build instance.
Apr 14 00:30:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-e7ae951c-5810-442f-883f-22e5f5d7b33d tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "61d1abb2-3c80-48de-a26b-1c8030081105" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.040s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:30:55 user nova-compute[82479]: DEBUG nova.compute.manager [req-104dc970-34a8-484b-9e85-ec176abc8f0d req-4eba6de6-a108-4c04-bb40-55277f8784a9 service nova] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Received event network-vif-plugged-bf80bc9c-a453-4809-8eb4-e57fe015351f {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:30:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-104dc970-34a8-484b-9e85-ec176abc8f0d req-4eba6de6-a108-4c04-bb40-55277f8784a9 service nova] Acquiring lock "61d1abb2-3c80-48de-a26b-1c8030081105-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:30:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-104dc970-34a8-484b-9e85-ec176abc8f0d req-4eba6de6-a108-4c04-bb40-55277f8784a9 service nova] Lock "61d1abb2-3c80-48de-a26b-1c8030081105-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:30:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-104dc970-34a8-484b-9e85-ec176abc8f0d req-4eba6de6-a108-4c04-bb40-55277f8784a9 service nova] Lock "61d1abb2-3c80-48de-a26b-1c8030081105-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:30:55 user nova-compute[82479]: DEBUG nova.compute.manager [req-104dc970-34a8-484b-9e85-ec176abc8f0d req-4eba6de6-a108-4c04-bb40-55277f8784a9 service nova] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] No waiting events found dispatching network-vif-plugged-bf80bc9c-a453-4809-8eb4-e57fe015351f {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:30:55 user nova-compute[82479]: WARNING nova.compute.manager [req-104dc970-34a8-484b-9e85-ec176abc8f0d req-4eba6de6-a108-4c04-bb40-55277f8784a9 service nova] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Received unexpected event network-vif-plugged-bf80bc9c-a453-4809-8eb4-e57fe015351f for instance with vm_state active and task_state None.
Apr 14 00:30:56 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:30:56 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:30:59 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:30:59 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Starting heal instance info cache {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 00:30:59 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "refresh_cache-5bd24977-c1b5-4bc5-b651-d6061483e781" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:30:59 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquired lock "refresh_cache-5bd24977-c1b5-4bc5-b651-d6061483e781" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:30:59 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Forcefully refreshing network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 00:31:00 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Updating instance_info_cache with network_info: [{"id": "05d7b2dd-9ebb-4ab6-a720-ea22509e855e", "address": "fa:16:3e:73:07:f8", "network": {"id": "83abe289-89d1-4c43-bfc5-19bcfdcc8309", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2050684181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "851640ccdac240bcb6b9b0a89dd250d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05d7b2dd-9e", "ovs_interfaceid": "05d7b2dd-9ebb-4ab6-a720-ea22509e855e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:31:00 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Releasing lock "refresh_cache-5bd24977-c1b5-4bc5-b651-d6061483e781" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:31:00 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Updated the network info_cache for instance {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 00:31:00 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:31:00 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:31:00 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Cleaning up deleted instances {{(pid=82479) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 00:31:00 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] There are 0 instances to clean {{(pid=82479) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 00:31:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:31:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:31:04 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:31:05 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:31:05 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:31:05 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Cleaning up deleted instances with incomplete migration  {{(pid=82479) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 00:31:06 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:31:06 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:31:06 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:31:07 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:31:09 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:31:10 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:31:10 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82479) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 00:31:10 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:31:10 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:31:10 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:31:10 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:31:10 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Auditing locally available compute resources for user (node: user) {{(pid=82479) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 00:31:10 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c04d101a-2c7f-4c9d-81c8-0f2d866e1534/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:31:10 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c04d101a-2c7f-4c9d-81c8-0f2d866e1534/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:31:10 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c04d101a-2c7f-4c9d-81c8-0f2d866e1534/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:31:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c04d101a-2c7f-4c9d-81c8-0f2d866e1534/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:31:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d04f694-0eba-46c3-a617-97d3de666de8/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:31:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d04f694-0eba-46c3-a617-97d3de666de8/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:31:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d04f694-0eba-46c3-a617-97d3de666de8/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:31:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d04f694-0eba-46c3-a617-97d3de666de8/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:31:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61d1abb2-3c80-48de-a26b-1c8030081105/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:31:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61d1abb2-3c80-48de-a26b-1c8030081105/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:31:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61d1abb2-3c80-48de-a26b-1c8030081105/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:31:11 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:31:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61d1abb2-3c80-48de-a26b-1c8030081105/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:31:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bd24977-c1b5-4bc5-b651-d6061483e781/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:31:11 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:31:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bd24977-c1b5-4bc5-b651-d6061483e781/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:31:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bd24977-c1b5-4bc5-b651-d6061483e781/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:31:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bd24977-c1b5-4bc5-b651-d6061483e781/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:31:12 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:31:12 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:31:12 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Hypervisor/Node resource view: name=user free_ram=8448MB free_disk=26.126026153564453GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82479) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 00:31:12 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:31:12 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:31:12 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 2d04f694-0eba-46c3-a617-97d3de666de8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:31:12 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 5bd24977-c1b5-4bc5-b651-d6061483e781 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:31:12 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance c04d101a-2c7f-4c9d-81c8-0f2d866e1534 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:31:12 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 61d1abb2-3c80-48de-a26b-1c8030081105 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:31:12 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 00:31:12 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 00:31:12 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Refreshing inventories for resource provider 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 00:31:12 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Updating ProviderTree inventory for provider 3847975a-19aa-4b27-9180-14b5cc49044a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 00:31:12 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Updating inventory in ProviderTree for provider 3847975a-19aa-4b27-9180-14b5cc49044a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 00:31:12 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Refreshing aggregate associations for resource provider 3847975a-19aa-4b27-9180-14b5cc49044a, aggregates: None {{(pid=82479) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 00:31:12 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Refreshing trait associations for resource provider 3847975a-19aa-4b27-9180-14b5cc49044a, traits: COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,HW_CPU_X86_SSE42,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO {{(pid=82479) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 00:31:12 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:31:12 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:31:12 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Compute_service record updated for user:user {{(pid=82479) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 00:31:12 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.636s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:31:14 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:31:16 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:31:16 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:31:17 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:31:21 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:31:21 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:31:21 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:31:21 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:31:21 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:31:21 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:31:26 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:31:26 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:31:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:31:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:31:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:31:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:31:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:31:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:31:34 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-3b860bdb-dcd4-4169-a464-18c116308cbf tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Acquiring lock "5bd24977-c1b5-4bc5-b651-d6061483e781" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:31:34 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-3b860bdb-dcd4-4169-a464-18c116308cbf tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "5bd24977-c1b5-4bc5-b651-d6061483e781" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:31:34 user nova-compute[82479]: DEBUG nova.objects.instance [None req-3b860bdb-dcd4-4169-a464-18c116308cbf tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lazy-loading 'flavor' on Instance uuid 5bd24977-c1b5-4bc5-b651-d6061483e781 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:31:34 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-3b860bdb-dcd4-4169-a464-18c116308cbf tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Ignoring supplied device name: /dev/vdb
Apr 14 00:31:34 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-3b860bdb-dcd4-4169-a464-18c116308cbf tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "5bd24977-c1b5-4bc5-b651-d6061483e781" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:31:34 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f378054c-2018-4f2b-a8b9-a42a3161aa78 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Acquiring lock "c04d101a-2c7f-4c9d-81c8-0f2d866e1534" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:31:34 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f378054c-2018-4f2b-a8b9-a42a3161aa78 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "c04d101a-2c7f-4c9d-81c8-0f2d866e1534" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:31:34 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f378054c-2018-4f2b-a8b9-a42a3161aa78 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Acquiring lock "c04d101a-2c7f-4c9d-81c8-0f2d866e1534-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:31:34 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f378054c-2018-4f2b-a8b9-a42a3161aa78 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "c04d101a-2c7f-4c9d-81c8-0f2d866e1534-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:31:34 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f378054c-2018-4f2b-a8b9-a42a3161aa78 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "c04d101a-2c7f-4c9d-81c8-0f2d866e1534-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:31:34 user nova-compute[82479]: INFO nova.compute.manager [None req-f378054c-2018-4f2b-a8b9-a42a3161aa78 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] Terminating instance
Apr 14 00:31:34 user nova-compute[82479]: DEBUG nova.compute.manager [None req-f378054c-2018-4f2b-a8b9-a42a3161aa78 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] Start destroying the instance on the hypervisor. {{(pid=82479) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 00:31:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:31:34 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-3b860bdb-dcd4-4169-a464-18c116308cbf tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Acquiring lock "5bd24977-c1b5-4bc5-b651-d6061483e781" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:31:34 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-3b860bdb-dcd4-4169-a464-18c116308cbf tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "5bd24977-c1b5-4bc5-b651-d6061483e781" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:31:34 user nova-compute[82479]: INFO nova.compute.manager [None req-3b860bdb-dcd4-4169-a464-18c116308cbf tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Attaching volume 282895bf-6b53-4106-a1e2-abc962b1c521 to /dev/vdb
Apr 14 00:31:34 user nova-compute[82479]: DEBUG os_brick.utils [None req-3b860bdb-dcd4-4169-a464-18c116308cbf tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:31:34 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:31:34 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:31:34 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fdfc01f-9a27-4acd-b3f2-8acd02fd4858]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fec92fcfdd3\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:31:34 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:31:34 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:31:34 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a463660-db04-4feb-b589-6c7fd80c8073]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:31:34 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:31:34 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:31:34 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5efc8bb-fcac-4762-bb43-9ed51a80cbb6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:31:34 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[634c5d0e-cf5c-468e-b147-caa621e0f75d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:31:34 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-3b860bdb-dcd4-4169-a464-18c116308cbf tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Running cmd (subprocess): nvme version {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:31:34 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-3b860bdb-dcd4-4169-a464-18c116308cbf tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] 'nvme version' failed. Not Retrying. {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:31:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:31:34 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3b860bdb-dcd4-4169-a464-18c116308cbf tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] nvme not present on system {{(pid=82479) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 00:31:34 user nova-compute[82479]: DEBUG nova.compute.manager [req-3f559a85-108c-4cc0-bb55-e6de914b74a5 req-38ac184f-da62-4d5b-a093-fde72945d96f service nova] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] Received event network-vif-unplugged-b1ca4eb0-7c25-407d-9baf-1d37f309e9e5 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:31:34 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-3f559a85-108c-4cc0-bb55-e6de914b74a5 req-38ac184f-da62-4d5b-a093-fde72945d96f service nova] Acquiring lock "c04d101a-2c7f-4c9d-81c8-0f2d866e1534-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:31:34 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-3f559a85-108c-4cc0-bb55-e6de914b74a5 req-38ac184f-da62-4d5b-a093-fde72945d96f service nova] Lock "c04d101a-2c7f-4c9d-81c8-0f2d866e1534-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:31:34 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-3f559a85-108c-4cc0-bb55-e6de914b74a5 req-38ac184f-da62-4d5b-a093-fde72945d96f service nova] Lock "c04d101a-2c7f-4c9d-81c8-0f2d866e1534-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:31:34 user nova-compute[82479]: DEBUG nova.compute.manager [req-3f559a85-108c-4cc0-bb55-e6de914b74a5 req-38ac184f-da62-4d5b-a093-fde72945d96f service nova] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] No waiting events found dispatching network-vif-unplugged-b1ca4eb0-7c25-407d-9baf-1d37f309e9e5 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:31:34 user nova-compute[82479]: DEBUG nova.compute.manager [req-3f559a85-108c-4cc0-bb55-e6de914b74a5 req-38ac184f-da62-4d5b-a093-fde72945d96f service nova] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] Received event network-vif-unplugged-b1ca4eb0-7c25-407d-9baf-1d37f309e9e5 for instance with task_state deleting. {{(pid=82479) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 00:31:34 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:31:34 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:31:34 user nova-compute[82479]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 00:31:34 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b5da0f-dee5-4e79-bdff-a14d981bb694]: (4, '') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:31:34 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-3b860bdb-dcd4-4169-a464-18c116308cbf tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82479) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 00:31:34 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-3b860bdb-dcd4-4169-a464-18c116308cbf tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 00:31:34 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-3b860bdb-dcd4-4169-a464-18c116308cbf tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] LIGHTOS: no hostnqn found. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 00:31:34 user nova-compute[82479]: DEBUG os_brick.utils [None req-3b860bdb-dcd4-4169-a464-18c116308cbf tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fec92fcfdd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:31:34 user nova-compute[82479]: DEBUG nova.virt.block_device [None req-3b860bdb-dcd4-4169-a464-18c116308cbf tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Updating existing volume attachment record: e2d21594-3b0f-4b66-8062-ec9ef9b386ee {{(pid=82479) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 00:31:35 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:31:35 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:31:35 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:31:35 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] Instance destroyed successfully.
Apr 14 00:31:35 user nova-compute[82479]: DEBUG nova.objects.instance [None req-f378054c-2018-4f2b-a8b9-a42a3161aa78 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lazy-loading 'resources' on Instance uuid c04d101a-2c7f-4c9d-81c8-0f2d866e1534 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:31:35 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-f378054c-2018-4f2b-a8b9-a42a3161aa78 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:29:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-983427950',display_name='tempest-ServersNegativeTestJSON-server-983427950',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-983427950',id=37,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:29:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e46ba54fdcdb45368f457001f26a281b',ramdisk_id='',reservation_id='r-8vmhuy3y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-495782531',owner_user_name='tempest-ServersNegativeTestJSON-495782531-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T00:29:54Z,user_data=None,user_id='67248d6b437547918b0cc2b0cdf29536',uuid=c04d101a-2c7f-4c9d-81c8-0f2d866e1534,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b1ca4eb0-7c25-407d-9baf-1d37f309e9e5", "address": "fa:16:3e:50:69:97", "network": {"id": "8b306bb0-c969-4918-a696-dd539eaa3a21", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1341077591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e46ba54fdcdb45368f457001f26a281b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1ca4eb0-7c", "ovs_interfaceid": "b1ca4eb0-7c25-407d-9baf-1d37f309e9e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 00:31:35 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-f378054c-2018-4f2b-a8b9-a42a3161aa78 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Converting VIF {"id": "b1ca4eb0-7c25-407d-9baf-1d37f309e9e5", "address": "fa:16:3e:50:69:97", "network": {"id": "8b306bb0-c969-4918-a696-dd539eaa3a21", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1341077591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e46ba54fdcdb45368f457001f26a281b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1ca4eb0-7c", "ovs_interfaceid": "b1ca4eb0-7c25-407d-9baf-1d37f309e9e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:31:35 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-f378054c-2018-4f2b-a8b9-a42a3161aa78 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:69:97,bridge_name='br-int',has_traffic_filtering=True,id=b1ca4eb0-7c25-407d-9baf-1d37f309e9e5,network=Network(8b306bb0-c969-4918-a696-dd539eaa3a21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1ca4eb0-7c') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:31:35 user nova-compute[82479]: DEBUG os_vif [None req-f378054c-2018-4f2b-a8b9-a42a3161aa78 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:69:97,bridge_name='br-int',has_traffic_filtering=True,id=b1ca4eb0-7c25-407d-9baf-1d37f309e9e5,network=Network(8b306bb0-c969-4918-a696-dd539eaa3a21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1ca4eb0-7c') {{(pid=82479) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 00:31:35 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:31:35 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb1ca4eb0-7c, bridge=br-int, if_exists=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:31:35 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:31:35 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:31:35 user nova-compute[82479]: INFO os_vif [None req-f378054c-2018-4f2b-a8b9-a42a3161aa78 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:69:97,bridge_name='br-int',has_traffic_filtering=True,id=b1ca4eb0-7c25-407d-9baf-1d37f309e9e5,network=Network(8b306bb0-c969-4918-a696-dd539eaa3a21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1ca4eb0-7c')
Apr 14 00:31:35 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-f378054c-2018-4f2b-a8b9-a42a3161aa78 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] Deleting instance files /opt/stack/data/nova/instances/c04d101a-2c7f-4c9d-81c8-0f2d866e1534_del
Apr 14 00:31:35 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-f378054c-2018-4f2b-a8b9-a42a3161aa78 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] Deletion of /opt/stack/data/nova/instances/c04d101a-2c7f-4c9d-81c8-0f2d866e1534_del complete
Apr 14 00:31:35 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:31:35 user nova-compute[82479]: INFO nova.compute.manager [None req-f378054c-2018-4f2b-a8b9-a42a3161aa78 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] Took 0.66 seconds to destroy the instance on the hypervisor.
Apr 14 00:31:35 user nova-compute[82479]: DEBUG oslo.service.loopingcall [None req-f378054c-2018-4f2b-a8b9-a42a3161aa78 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82479) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 00:31:35 user nova-compute[82479]: DEBUG nova.compute.manager [-] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] Deallocating network for instance {{(pid=82479) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 00:31:35 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] deallocate_for_instance() {{(pid=82479) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 00:31:35 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] Updating instance_info_cache with network_info: [] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:31:35 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] Took 0.51 seconds to deallocate network for instance.
Apr 14 00:31:35 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f378054c-2018-4f2b-a8b9-a42a3161aa78 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:31:35 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f378054c-2018-4f2b-a8b9-a42a3161aa78 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:31:35 user nova-compute[82479]: DEBUG nova.compute.manager [req-e37079c1-a298-4c1f-9e6f-99289b2091b7 req-018e4b67-b664-464a-bcad-c3553a8df9da service nova] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] Received event network-vif-deleted-b1ca4eb0-7c25-407d-9baf-1d37f309e9e5 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:31:35 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-f378054c-2018-4f2b-a8b9-a42a3161aa78 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:31:35 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-f378054c-2018-4f2b-a8b9-a42a3161aa78 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:31:35 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f378054c-2018-4f2b-a8b9-a42a3161aa78 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.183s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:31:36 user nova-compute[82479]: INFO nova.scheduler.client.report [None req-f378054c-2018-4f2b-a8b9-a42a3161aa78 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Deleted allocations for instance c04d101a-2c7f-4c9d-81c8-0f2d866e1534
Apr 14 00:31:36 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f378054c-2018-4f2b-a8b9-a42a3161aa78 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "c04d101a-2c7f-4c9d-81c8-0f2d866e1534" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.532s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:31:36 user nova-compute[82479]: DEBUG nova.compute.manager [req-849ff8ad-46a2-48e2-8deb-c7ea31adb1fb req-1bb2bbb5-8401-41e0-b716-9cfb4d159bba service nova] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] Received event network-vif-plugged-b1ca4eb0-7c25-407d-9baf-1d37f309e9e5 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:31:36 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-849ff8ad-46a2-48e2-8deb-c7ea31adb1fb req-1bb2bbb5-8401-41e0-b716-9cfb4d159bba service nova] Acquiring lock "c04d101a-2c7f-4c9d-81c8-0f2d866e1534-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:31:36 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-849ff8ad-46a2-48e2-8deb-c7ea31adb1fb req-1bb2bbb5-8401-41e0-b716-9cfb4d159bba service nova] Lock "c04d101a-2c7f-4c9d-81c8-0f2d866e1534-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:31:36 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-849ff8ad-46a2-48e2-8deb-c7ea31adb1fb req-1bb2bbb5-8401-41e0-b716-9cfb4d159bba service nova] Lock "c04d101a-2c7f-4c9d-81c8-0f2d866e1534-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:31:36 user nova-compute[82479]: DEBUG nova.compute.manager [req-849ff8ad-46a2-48e2-8deb-c7ea31adb1fb req-1bb2bbb5-8401-41e0-b716-9cfb4d159bba service nova] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] No waiting events found dispatching network-vif-plugged-b1ca4eb0-7c25-407d-9baf-1d37f309e9e5 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:31:36 user nova-compute[82479]: WARNING nova.compute.manager [req-849ff8ad-46a2-48e2-8deb-c7ea31adb1fb req-1bb2bbb5-8401-41e0-b716-9cfb4d159bba service nova] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] Received unexpected event network-vif-plugged-b1ca4eb0-7c25-407d-9baf-1d37f309e9e5 for instance with vm_state deleted and task_state None.
Apr 14 00:31:39 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b860bdb-dcd4-4169-a464-18c116308cbf tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Calling os-brick to attach iSCSI Volume {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 00:31:39 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b860bdb-dcd4-4169-a464-18c116308cbf tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BzLabHdv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:31:39 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-3b860bdb-dcd4-4169-a464-18c116308cbf tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:31:39 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-3b860bdb-dcd4-4169-a464-18c116308cbf tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:31:39 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-3b860bdb-dcd4-4169-a464-18c116308cbf tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:31:39 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-3b860bdb-dcd4-4169-a464-18c116308cbf tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:31:39 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-3b860bdb-dcd4-4169-a464-18c116308cbf tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:31:39 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-3b860bdb-dcd4-4169-a464-18c116308cbf tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:31:39 user nova-compute[82479]: INFO os_brick.initiator.connectors.iscsi [None req-3b860bdb-dcd4-4169-a464-18c116308cbf tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 00:31:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521 -p 172.16.0.220:3260 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:31:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:31:39 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd5114d9-f14f-4b5e-9806-e8a84dee263a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:31:39 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b860bdb-dcd4-4169-a464-18c116308cbf tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 00:31:39 user nova-compute[82479]:  {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:31:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521 -p 172.16.0.220:3260 --interface default --op new {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:31:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:31:39 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb49b45-3db7-4b86-9ca0-4aaf6688114c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521] added\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:31:39 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b860bdb-dcd4-4169-a464-18c116308cbf tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521] added
Apr 14 00:31:39 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:31:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:31:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:31:39 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e499b8-f76e-497e-8806-db1201f2895d]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:31:39 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b860bdb-dcd4-4169-a464-18c116308cbf tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:31:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:31:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:31:39 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb93b851-1fb5-491f-b9fa-9d6feda8ba1b]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:31:39 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b860bdb-dcd4-4169-a464-18c116308cbf tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:31:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BzLabHdv {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:31:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BzLabHdv" returned: 0 in 0.035s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:31:39 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[be8b2331-c6d6-4011-9ddc-a12e2318c9b5]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:31:39 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b860bdb-dcd4-4169-a464-18c116308cbf tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BzLabHdv'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:31:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:31:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:31:39 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2258c1-84f4-4d92-8816-37d2d1acfdf4]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:31:39 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b860bdb-dcd4-4169-a464-18c116308cbf tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:31:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:31:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:31:39 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ba9ea4-7aae-46b8-92cb-78873c8f4488]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:31:39 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b860bdb-dcd4-4169-a464-18c116308cbf tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 00:31:39 user nova-compute[82479]:  {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:31:39 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b860bdb-dcd4-4169-a464-18c116308cbf tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 00:31:39 user nova-compute[82479]:  {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:31:39 user nova-compute[82479]: WARNING os_brick.initiator.connectors.iscsi [None req-3b860bdb-dcd4-4169-a464-18c116308cbf tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 00:31:39 user nova-compute[82479]: 
Apr 14 00:31:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521 -p 172.16.0.220:3260 --login {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:31:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:31:39 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2d3472-0ce2-4b08-8ef5-c61d5b6b7f1d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:31:39 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b860bdb-dcd4-4169-a464-18c116308cbf tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521, portal: 172.16.0.220,3260]
Apr 14 00:31:39 user nova-compute[82479]: Login to [iface: default, target: iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521, portal: 172.16.0.220,3260] successful.
Apr 14 00:31:39 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:31:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:31:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:31:39 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ccb3c3-b859-419d-a360-045f526d4f4d]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:31:39 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b860bdb-dcd4-4169-a464-18c116308cbf tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:31:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:31:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:31:39 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[44398395-ea4d-4d33-85d7-e0d6b8cfa717]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:31:39 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b860bdb-dcd4-4169-a464-18c116308cbf tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521 (non-flash)
Apr 14 00:31:39 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:31:39 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b860bdb-dcd4-4169-a464-18c116308cbf tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521 (non-flash)
Apr 14 00:31:39 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:31:39 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-3b860bdb-dcd4-4169-a464-18c116308cbf tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.429s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:31:39 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b860bdb-dcd4-4169-a464-18c116308cbf tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Connected to 172.16.0.220:3260 {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 00:31:39 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-3b860bdb-dcd4-4169-a464-18c116308cbf tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] HCTL ('33', '-', '-', 0) found on session 38 with lun 0 {{(pid=82479) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 00:31:39 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-3b860bdb-dcd4-4169-a464-18c116308cbf tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82479) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 00:31:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:31:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:31:39 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f1ca6b-a02c-4eba-ada8-a5ca9b77d614]: (4, ('- - 0', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:31:39 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-3b860bdb-dcd4-4169-a464-18c116308cbf tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82479) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 00:31:39 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b860bdb-dcd4-4169-a464-18c116308cbf tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BzLabHdv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 00:31:40 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:31:40 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-3b860bdb-dcd4-4169-a464-18c116308cbf tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.458s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:31:40 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b860bdb-dcd4-4169-a464-18c116308cbf tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] <== connect_volume: return (1459ms) {'type': 'block', 'scsi_wwn': '23965386266396139', 'path': '/dev/sdb'} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:31:40 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b860bdb-dcd4-4169-a464-18c116308cbf tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965386266396139', 'path': '/dev/sdb'} {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 00:31:40 user nova-compute[82479]: DEBUG nova.objects.instance [None req-3b860bdb-dcd4-4169-a464-18c116308cbf tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lazy-loading 'flavor' on Instance uuid 5bd24977-c1b5-4bc5-b651-d6061483e781 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:31:40 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-3b860bdb-dcd4-4169-a464-18c116308cbf tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 00:31:40 user nova-compute[82479]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:31:40 user nova-compute[82479]:   <source dev="/dev/sdb"/>
Apr 14 00:31:40 user nova-compute[82479]:   <target dev="vdb" bus="virtio"/>
Apr 14 00:31:40 user nova-compute[82479]:   <serial>282895bf-6b53-4106-a1e2-abc962b1c521</serial>
Apr 14 00:31:40 user nova-compute[82479]: </disk>
Apr 14 00:31:40 user nova-compute[82479]:  {{(pid=82479) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 00:31:41 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-3b860bdb-dcd4-4169-a464-18c116308cbf tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:31:41 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-3b860bdb-dcd4-4169-a464-18c116308cbf tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:31:41 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-3b860bdb-dcd4-4169-a464-18c116308cbf tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] No VIF found with MAC fa:16:3e:73:07:f8, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:31:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-3b860bdb-dcd4-4169-a464-18c116308cbf tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "5bd24977-c1b5-4bc5-b651-d6061483e781" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.708s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:31:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:31:45 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:31:50 user nova-compute[82479]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681432295.1342492, c04d101a-2c7f-4c9d-81c8-0f2d866e1534 => Stopped> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:31:50 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] VM Stopped (Lifecycle Event)
Apr 14 00:31:50 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c1021011-a398-4a3b-afe8-84985ac72956 None None] [instance: c04d101a-2c7f-4c9d-81c8-0f2d866e1534] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:31:50 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:31:53 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1f158d65-06bf-4041-9756-81ed6cea459e tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Acquiring lock "5bd24977-c1b5-4bc5-b651-d6061483e781" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:31:53 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1f158d65-06bf-4041-9756-81ed6cea459e tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "5bd24977-c1b5-4bc5-b651-d6061483e781" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:31:53 user nova-compute[82479]: INFO nova.compute.manager [None req-1f158d65-06bf-4041-9756-81ed6cea459e tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Detaching volume 282895bf-6b53-4106-a1e2-abc962b1c521
Apr 14 00:31:53 user nova-compute[82479]: INFO nova.virt.block_device [None req-1f158d65-06bf-4041-9756-81ed6cea459e tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Attempting to driver detach volume 282895bf-6b53-4106-a1e2-abc962b1c521 from mountpoint /dev/vdb
Apr 14 00:31:53 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1f158d65-06bf-4041-9756-81ed6cea459e tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Attempting to detach device vdb from instance 5bd24977-c1b5-4bc5-b651-d6061483e781 from the persistent domain config. {{(pid=82479) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 00:31:53 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-1f158d65-06bf-4041-9756-81ed6cea459e tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 00:31:53 user nova-compute[82479]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:31:53 user nova-compute[82479]:   <source dev="/dev/sdb"/>
Apr 14 00:31:53 user nova-compute[82479]:   <target dev="vdb" bus="virtio"/>
Apr 14 00:31:53 user nova-compute[82479]:   <serial>282895bf-6b53-4106-a1e2-abc962b1c521</serial>
Apr 14 00:31:53 user nova-compute[82479]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 00:31:53 user nova-compute[82479]: </disk>
Apr 14 00:31:53 user nova-compute[82479]:  {{(pid=82479) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 00:31:53 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-1f158d65-06bf-4041-9756-81ed6cea459e tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Successfully detached device vdb from instance 5bd24977-c1b5-4bc5-b651-d6061483e781 from the persistent domain config.
Apr 14 00:31:53 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1f158d65-06bf-4041-9756-81ed6cea459e tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5bd24977-c1b5-4bc5-b651-d6061483e781 from the live domain config. {{(pid=82479) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 00:31:53 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-1f158d65-06bf-4041-9756-81ed6cea459e tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 00:31:53 user nova-compute[82479]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:31:53 user nova-compute[82479]:   <source dev="/dev/sdb"/>
Apr 14 00:31:53 user nova-compute[82479]:   <target dev="vdb" bus="virtio"/>
Apr 14 00:31:53 user nova-compute[82479]:   <serial>282895bf-6b53-4106-a1e2-abc962b1c521</serial>
Apr 14 00:31:53 user nova-compute[82479]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 00:31:53 user nova-compute[82479]: </disk>
Apr 14 00:31:53 user nova-compute[82479]:  {{(pid=82479) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 00:31:53 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d20bc2aa-2191-40ba-bb81-7fa866b48bc4 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Acquiring lock "5bd24977-c1b5-4bc5-b651-d6061483e781" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:31:53 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Received event <DeviceRemovedEvent: 1681432313.9383228, 5bd24977-c1b5-4bc5-b651-d6061483e781 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82479) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 00:31:53 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1f158d65-06bf-4041-9756-81ed6cea459e tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5bd24977-c1b5-4bc5-b651-d6061483e781 {{(pid=82479) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 00:31:53 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-1f158d65-06bf-4041-9756-81ed6cea459e tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Successfully detached device vdb from instance 5bd24977-c1b5-4bc5-b651-d6061483e781 from the live domain config.
Apr 14 00:31:53 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f158d65-06bf-4041-9756-81ed6cea459e tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] calling os-brick to detach iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 00:31:53 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f158d65-06bf-4041-9756-81ed6cea459e tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, {'target_iqn': 'iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BzLabHdv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:31:53 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-1f158d65-06bf-4041-9756-81ed6cea459e tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:31:53 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-1f158d65-06bf-4041-9756-81ed6cea459e tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:31:53 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-1f158d65-06bf-4041-9756-81ed6cea459e tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:31:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:31:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:31:53 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f398d5-ad9a-4d04-80cf-dcd768af8746]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:31:53 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f158d65-06bf-4041-9756-81ed6cea459e tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 00:31:53 user nova-compute[82479]: No targets found.
Apr 14 00:31:53 user nova-compute[82479]: iSNS:
Apr 14 00:31:53 user nova-compute[82479]: No targets found.
Apr 14 00:31:53 user nova-compute[82479]: STATIC:
Apr 14 00:31:53 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521
Apr 14 00:31:53 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:31:53 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:31:53 user nova-compute[82479]: FIRMWARE:
Apr 14 00:31:53 user nova-compute[82479]: No targets found.
Apr 14 00:31:53 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:31:53 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f158d65-06bf-4041-9756-81ed6cea459e tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 00:31:53 user nova-compute[82479]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 00:31:53 user nova-compute[82479]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82479) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 00:31:53 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f158d65-06bf-4041-9756-81ed6cea459e tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521', 0)] {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 00:31:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:31:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:31:53 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc77883c-821c-4350-91f9-e2fd30e8d874]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:31:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:31:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:31:54 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b37079-e0ba-49e8-98e1-d3e4b6e4f16f]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:31:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f158d65-06bf-4041-9756-81ed6cea459e tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521 (non-flash)
Apr 14 00:31:54 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:31:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f158d65-06bf-4041-9756-81ed6cea459e tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521 (non-flash)
Apr 14 00:31:54 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:31:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f158d65-06bf-4041-9756-81ed6cea459e tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f33385d2440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521'): ({'sdb'}, set())}) {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 00:31:54 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-1f158d65-06bf-4041-9756-81ed6cea459e tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Removing single pathed devices sdb {{(pid=82479) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 00:31:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:31:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:31:54 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eed9c8c-ce0f-446c-a572-65f284b8b996]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:31:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:31:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:31:54 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[75419b6b-bda1-4f34-85de-a0efb22512fa]: (4, ('ok\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:31:54 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-1f158d65-06bf-4041-9756-81ed6cea459e tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Flushing IO for device /dev/sdb {{(pid=82479) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 00:31:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:31:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:31:54 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[2180048e-39b2-4495-addf-bd9a31584ad5]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:31:54 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-1f158d65-06bf-4041-9756-81ed6cea459e tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82479) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 00:31:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:31:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:31:54 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eceebe1-706f-45bb-a0de-f58bb1912378]: (4, ('1', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:31:54 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-1f158d65-06bf-4041-9756-81ed6cea459e tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 00:31:54 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-1f158d65-06bf-4041-9756-81ed6cea459e tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] SCSI volumes sdb have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 00:31:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f158d65-06bf-4041-9756-81ed6cea459e tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521')] {{(pid=82479) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 00:31:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:31:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:31:54 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf65b62a-6103-4564-bec6-b905cbf86a1a]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:31:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f158d65-06bf-4041-9756-81ed6cea459e tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:31:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521 -p 172.16.0.220:3260 --logout {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:31:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:31:54 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[b208026f-3122-435b-b839-069eb992454a]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:31:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f158d65-06bf-4041-9756-81ed6cea459e tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521, portal: 172.16.0.220,3260]
Apr 14 00:31:54 user nova-compute[82479]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521, portal: 172.16.0.220,3260] successful.
Apr 14 00:31:54 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:31:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521 -p 172.16.0.220:3260 --op delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:31:54 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:31:54 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[80953749-7ae2-4c3e-a202-088ae34f7cbb]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:31:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f158d65-06bf-4041-9756-81ed6cea459e tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:31:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-1f158d65-06bf-4041-9756-81ed6cea459e tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:31:54 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f158d65-06bf-4041-9756-81ed6cea459e tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] <== disconnect_volume: return (275ms) None {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:31:54 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f158d65-06bf-4041-9756-81ed6cea459e tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Disconnected iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 00:31:55 user nova-compute[82479]: DEBUG nova.objects.instance [None req-1f158d65-06bf-4041-9756-81ed6cea459e tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lazy-loading 'flavor' on Instance uuid 5bd24977-c1b5-4bc5-b651-d6061483e781 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:31:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1f158d65-06bf-4041-9756-81ed6cea459e tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "5bd24977-c1b5-4bc5-b651-d6061483e781" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.629s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:31:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d20bc2aa-2191-40ba-bb81-7fa866b48bc4 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "5bd24977-c1b5-4bc5-b651-d6061483e781" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.519s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:31:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d20bc2aa-2191-40ba-bb81-7fa866b48bc4 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Acquiring lock "5bd24977-c1b5-4bc5-b651-d6061483e781-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:31:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d20bc2aa-2191-40ba-bb81-7fa866b48bc4 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "5bd24977-c1b5-4bc5-b651-d6061483e781-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:31:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d20bc2aa-2191-40ba-bb81-7fa866b48bc4 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "5bd24977-c1b5-4bc5-b651-d6061483e781-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:31:55 user nova-compute[82479]: INFO nova.compute.manager [None req-d20bc2aa-2191-40ba-bb81-7fa866b48bc4 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Terminating instance
Apr 14 00:31:55 user nova-compute[82479]: DEBUG nova.compute.manager [None req-d20bc2aa-2191-40ba-bb81-7fa866b48bc4 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Start destroying the instance on the hypervisor. {{(pid=82479) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 00:31:55 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:31:55 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:31:55 user nova-compute[82479]: DEBUG nova.compute.manager [req-0d9fd327-ba97-4ad9-a6ab-a63d252fbdc3 req-e402c073-7ec6-4bd7-9aaf-e425598d647f service nova] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Received event network-vif-unplugged-05d7b2dd-9ebb-4ab6-a720-ea22509e855e {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:31:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0d9fd327-ba97-4ad9-a6ab-a63d252fbdc3 req-e402c073-7ec6-4bd7-9aaf-e425598d647f service nova] Acquiring lock "5bd24977-c1b5-4bc5-b651-d6061483e781-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:31:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0d9fd327-ba97-4ad9-a6ab-a63d252fbdc3 req-e402c073-7ec6-4bd7-9aaf-e425598d647f service nova] Lock "5bd24977-c1b5-4bc5-b651-d6061483e781-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:31:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0d9fd327-ba97-4ad9-a6ab-a63d252fbdc3 req-e402c073-7ec6-4bd7-9aaf-e425598d647f service nova] Lock "5bd24977-c1b5-4bc5-b651-d6061483e781-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:31:55 user nova-compute[82479]: DEBUG nova.compute.manager [req-0d9fd327-ba97-4ad9-a6ab-a63d252fbdc3 req-e402c073-7ec6-4bd7-9aaf-e425598d647f service nova] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] No waiting events found dispatching network-vif-unplugged-05d7b2dd-9ebb-4ab6-a720-ea22509e855e {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:31:55 user nova-compute[82479]: DEBUG nova.compute.manager [req-0d9fd327-ba97-4ad9-a6ab-a63d252fbdc3 req-e402c073-7ec6-4bd7-9aaf-e425598d647f service nova] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Received event network-vif-unplugged-05d7b2dd-9ebb-4ab6-a720-ea22509e855e for instance with task_state deleting. {{(pid=82479) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 00:31:55 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Instance destroyed successfully.
Apr 14 00:31:55 user nova-compute[82479]: DEBUG nova.objects.instance [None req-d20bc2aa-2191-40ba-bb81-7fa866b48bc4 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lazy-loading 'resources' on Instance uuid 5bd24977-c1b5-4bc5-b651-d6061483e781 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:31:55 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-d20bc2aa-2191-40ba-bb81-7fa866b48bc4 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:29:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-869198220',display_name='tempest-VolumesSnapshotTestJSON-instance-869198220',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-869198220',id=36,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:29:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='851640ccdac240bcb6b9b0a89dd250d8',ramdisk_id='',reservation_id='r-jabdxbqo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-655184435',owner_user_name='tempest-VolumesSnapshotTestJSON-655184435-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T00:29:54Z,user_data=None,user_id='f922c56244e442028d3265b23a8fffd5',uuid=5bd24977-c1b5-4bc5-b651-d6061483e781,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "05d7b2dd-9ebb-4ab6-a720-ea22509e855e", "address": "fa:16:3e:73:07:f8", "network": {"id": "83abe289-89d1-4c43-bfc5-19bcfdcc8309", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2050684181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "851640ccdac240bcb6b9b0a89dd250d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05d7b2dd-9e", "ovs_interfaceid": "05d7b2dd-9ebb-4ab6-a720-ea22509e855e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 00:31:55 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-d20bc2aa-2191-40ba-bb81-7fa866b48bc4 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Converting VIF {"id": "05d7b2dd-9ebb-4ab6-a720-ea22509e855e", "address": "fa:16:3e:73:07:f8", "network": {"id": "83abe289-89d1-4c43-bfc5-19bcfdcc8309", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2050684181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "851640ccdac240bcb6b9b0a89dd250d8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05d7b2dd-9e", "ovs_interfaceid": "05d7b2dd-9ebb-4ab6-a720-ea22509e855e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:31:55 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-d20bc2aa-2191-40ba-bb81-7fa866b48bc4 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:73:07:f8,bridge_name='br-int',has_traffic_filtering=True,id=05d7b2dd-9ebb-4ab6-a720-ea22509e855e,network=Network(83abe289-89d1-4c43-bfc5-19bcfdcc8309),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05d7b2dd-9e') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:31:55 user nova-compute[82479]: DEBUG os_vif [None req-d20bc2aa-2191-40ba-bb81-7fa866b48bc4 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:07:f8,bridge_name='br-int',has_traffic_filtering=True,id=05d7b2dd-9ebb-4ab6-a720-ea22509e855e,network=Network(83abe289-89d1-4c43-bfc5-19bcfdcc8309),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05d7b2dd-9e') {{(pid=82479) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 00:31:55 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:31:55 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap05d7b2dd-9e, bridge=br-int, if_exists=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:31:55 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:31:55 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:31:55 user nova-compute[82479]: INFO os_vif [None req-d20bc2aa-2191-40ba-bb81-7fa866b48bc4 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:07:f8,bridge_name='br-int',has_traffic_filtering=True,id=05d7b2dd-9ebb-4ab6-a720-ea22509e855e,network=Network(83abe289-89d1-4c43-bfc5-19bcfdcc8309),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05d7b2dd-9e')
Apr 14 00:31:55 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d20bc2aa-2191-40ba-bb81-7fa866b48bc4 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] calling os-brick to detach iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 00:31:55 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d20bc2aa-2191-40ba-bb81-7fa866b48bc4 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, {'target_iqn': 'iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BzLabHdv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:31:55 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-d20bc2aa-2191-40ba-bb81-7fa866b48bc4 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:31:55 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-d20bc2aa-2191-40ba-bb81-7fa866b48bc4 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:31:55 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-d20bc2aa-2191-40ba-bb81-7fa866b48bc4 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:31:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:31:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.016s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:31:55 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:31:55 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[0efc0df0-ae9a-48c2-9ef3-ace8bece6931]: Unexpected error while running command.
Apr 14 00:31:55 user nova-compute[82479]: Command: iscsiadm -m discoverydb -o show -P 1
Apr 14 00:31:55 user nova-compute[82479]: Exit code: 21
Apr 14 00:31:55 user nova-compute[82479]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 14 00:31:55 user nova-compute[82479]: Stderr: '' {{(pid=93289) _process_cmd /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:479}}
Apr 14 00:31:55 user nova-compute[82479]: Traceback (most recent call last):
Apr 14 00:31:55 user nova-compute[82479]:   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py", line 476, in _process_cmd
Apr 14 00:31:55 user nova-compute[82479]:     ret = func(*f_args, **f_kwargs)
Apr 14 00:31:55 user nova-compute[82479]:   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Apr 14 00:31:55 user nova-compute[82479]:     return func(*args, **kwargs)
Apr 14 00:31:55 user nova-compute[82479]:   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Apr 14 00:31:55 user nova-compute[82479]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Apr 14 00:31:55 user nova-compute[82479]:   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Apr 14 00:31:55 user nova-compute[82479]:     return putils.execute(on_execute=on_execute,
Apr 14 00:31:55 user nova-compute[82479]:   File "/usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py", line 438, in execute
Apr 14 00:31:55 user nova-compute[82479]:     raise ProcessExecutionError(exit_code=_returncode,
Apr 14 00:31:55 user nova-compute[82479]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 14 00:31:55 user nova-compute[82479]: Command: iscsiadm -m discoverydb -o show -P 1
Apr 14 00:31:55 user nova-compute[82479]: Exit code: 21
Apr 14 00:31:55 user nova-compute[82479]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 14 00:31:55 user nova-compute[82479]: Stderr: ''
Apr 14 00:31:55 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[0efc0df0-ae9a-48c2-9ef3-ace8bece6931]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:31:55 user nova-compute[82479]: ERROR os_brick.initiator.connectors.iscsi [None req-d20bc2aa-2191-40ba-bb81-7fa866b48bc4 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 14 00:31:55 user nova-compute[82479]: Command: iscsiadm -m discoverydb -o show -P 1
Apr 14 00:31:55 user nova-compute[82479]: Exit code: 21
Apr 14 00:31:55 user nova-compute[82479]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 14 00:31:55 user nova-compute[82479]: Stderr: ''
Apr 14 00:31:55 user nova-compute[82479]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Apr 14 00:31:55 user nova-compute[82479]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 206, in _get_ips_iqns_luns
Apr 14 00:31:55 user nova-compute[82479]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Apr 14 00:31:55 user nova-compute[82479]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 365, in _get_discoverydb_portals
Apr 14 00:31:55 user nova-compute[82479]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Apr 14 00:31:55 user nova-compute[82479]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 1177, in _run_iscsiadm_bare
Apr 14 00:31:55 user nova-compute[82479]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Apr 14 00:31:55 user nova-compute[82479]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/executor.py", line 55, in _execute
Apr 14 00:31:55 user nova-compute[82479]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Apr 14 00:31:55 user nova-compute[82479]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Apr 14 00:31:55 user nova-compute[82479]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Apr 14 00:31:55 user nova-compute[82479]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Apr 14 00:31:55 user nova-compute[82479]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Apr 14 00:31:55 user nova-compute[82479]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py", line 215, in remote_call
Apr 14 00:31:55 user nova-compute[82479]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Apr 14 00:31:55 user nova-compute[82479]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Apr 14 00:31:55 user nova-compute[82479]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Apr 14 00:31:55 user nova-compute[82479]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Apr 14 00:31:55 user nova-compute[82479]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Apr 14 00:31:55 user nova-compute[82479]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Apr 14 00:31:55 user nova-compute[82479]: ERROR os_brick.initiator.connectors.iscsi 
Apr 14 00:31:55 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d20bc2aa-2191-40ba-bb81-7fa866b48bc4 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=82479) _cleanup_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:923}}
Apr 14 00:31:55 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-d20bc2aa-2191-40ba-bb81-7fa866b48bc4 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.022s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:31:55 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d20bc2aa-2191-40ba-bb81-7fa866b48bc4 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] <== disconnect_volume: return (23ms) None {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:31:55 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d20bc2aa-2191-40ba-bb81-7fa866b48bc4 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Disconnected iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 00:31:55 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-d20bc2aa-2191-40ba-bb81-7fa866b48bc4 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Deleting instance files /opt/stack/data/nova/instances/5bd24977-c1b5-4bc5-b651-d6061483e781_del
Apr 14 00:31:55 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-d20bc2aa-2191-40ba-bb81-7fa866b48bc4 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Deletion of /opt/stack/data/nova/instances/5bd24977-c1b5-4bc5-b651-d6061483e781_del complete
Apr 14 00:31:55 user nova-compute[82479]: INFO nova.compute.manager [None req-d20bc2aa-2191-40ba-bb81-7fa866b48bc4 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Took 0.86 seconds to destroy the instance on the hypervisor.
Apr 14 00:31:55 user nova-compute[82479]: DEBUG oslo.service.loopingcall [None req-d20bc2aa-2191-40ba-bb81-7fa866b48bc4 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82479) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 00:31:55 user nova-compute[82479]: DEBUG nova.compute.manager [-] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Deallocating network for instance {{(pid=82479) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 00:31:55 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] deallocate_for_instance() {{(pid=82479) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 00:31:56 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Updating instance_info_cache with network_info: [] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:31:56 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Took 0.45 seconds to deallocate network for instance.
Apr 14 00:31:56 user nova-compute[82479]: DEBUG nova.compute.manager [req-16860b92-b6ca-4c68-bc98-01501b6120a0 req-3ddfd334-fb7e-4f21-9564-4157c2d91b89 service nova] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Received event network-vif-deleted-05d7b2dd-9ebb-4ab6-a720-ea22509e855e {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:31:56 user nova-compute[82479]: INFO nova.compute.manager [req-16860b92-b6ca-4c68-bc98-01501b6120a0 req-3ddfd334-fb7e-4f21-9564-4157c2d91b89 service nova] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Neutron deleted interface 05d7b2dd-9ebb-4ab6-a720-ea22509e855e; detaching it from the instance and deleting it from the info cache
Apr 14 00:31:56 user nova-compute[82479]: DEBUG nova.network.neutron [req-16860b92-b6ca-4c68-bc98-01501b6120a0 req-3ddfd334-fb7e-4f21-9564-4157c2d91b89 service nova] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Updating instance_info_cache with network_info: [] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:31:56 user nova-compute[82479]: WARNING nova.volume.cinder [None req-d20bc2aa-2191-40ba-bb81-7fa866b48bc4 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Attachment e2d21594-3b0f-4b66-8062-ec9ef9b386ee does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = e2d21594-3b0f-4b66-8062-ec9ef9b386ee. (HTTP 404) (Request-ID: req-aa1f8057-a4f8-4196-b9e2-95f85b8ec6ad)
Apr 14 00:31:56 user nova-compute[82479]: INFO nova.compute.manager [None req-d20bc2aa-2191-40ba-bb81-7fa866b48bc4 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Took 0.02 seconds to detach 1 volumes for instance.
Apr 14 00:31:56 user nova-compute[82479]: DEBUG nova.compute.manager [req-16860b92-b6ca-4c68-bc98-01501b6120a0 req-3ddfd334-fb7e-4f21-9564-4157c2d91b89 service nova] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Detach interface failed, port_id=05d7b2dd-9ebb-4ab6-a720-ea22509e855e, reason: Instance 5bd24977-c1b5-4bc5-b651-d6061483e781 could not be found. {{(pid=82479) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 00:31:56 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d20bc2aa-2191-40ba-bb81-7fa866b48bc4 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:31:56 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d20bc2aa-2191-40ba-bb81-7fa866b48bc4 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:31:56 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-d20bc2aa-2191-40ba-bb81-7fa866b48bc4 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:31:56 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-d20bc2aa-2191-40ba-bb81-7fa866b48bc4 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:31:56 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d20bc2aa-2191-40ba-bb81-7fa866b48bc4 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.152s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:31:56 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:31:56 user nova-compute[82479]: INFO nova.scheduler.client.report [None req-d20bc2aa-2191-40ba-bb81-7fa866b48bc4 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Deleted allocations for instance 5bd24977-c1b5-4bc5-b651-d6061483e781
Apr 14 00:31:56 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d20bc2aa-2191-40ba-bb81-7fa866b48bc4 tempest-VolumesSnapshotTestJSON-655184435 tempest-VolumesSnapshotTestJSON-655184435-project-member] Lock "5bd24977-c1b5-4bc5-b651-d6061483e781" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.651s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:31:57 user nova-compute[82479]: DEBUG nova.compute.manager [req-84514359-ea3d-41e3-b538-132f3cc26148 req-632ba772-39cb-426a-97c6-74f8ab1d2b8d service nova] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Received event network-vif-plugged-05d7b2dd-9ebb-4ab6-a720-ea22509e855e {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:31:57 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-84514359-ea3d-41e3-b538-132f3cc26148 req-632ba772-39cb-426a-97c6-74f8ab1d2b8d service nova] Acquiring lock "5bd24977-c1b5-4bc5-b651-d6061483e781-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:31:57 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-84514359-ea3d-41e3-b538-132f3cc26148 req-632ba772-39cb-426a-97c6-74f8ab1d2b8d service nova] Lock "5bd24977-c1b5-4bc5-b651-d6061483e781-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:31:57 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-84514359-ea3d-41e3-b538-132f3cc26148 req-632ba772-39cb-426a-97c6-74f8ab1d2b8d service nova] Lock "5bd24977-c1b5-4bc5-b651-d6061483e781-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:31:57 user nova-compute[82479]: DEBUG nova.compute.manager [req-84514359-ea3d-41e3-b538-132f3cc26148 req-632ba772-39cb-426a-97c6-74f8ab1d2b8d service nova] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] No waiting events found dispatching network-vif-plugged-05d7b2dd-9ebb-4ab6-a720-ea22509e855e {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:31:57 user nova-compute[82479]: WARNING nova.compute.manager [req-84514359-ea3d-41e3-b538-132f3cc26148 req-632ba772-39cb-426a-97c6-74f8ab1d2b8d service nova] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Received unexpected event network-vif-plugged-05d7b2dd-9ebb-4ab6-a720-ea22509e855e for instance with vm_state deleted and task_state None.
Apr 14 00:31:59 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:31:59 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Starting heal instance info cache {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 00:31:59 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Didn't find any instances for network info cache update. {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 00:32:00 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:32:00 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:32:02 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._sync_power_states {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:32:02 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Triggering sync for uuid 2d04f694-0eba-46c3-a617-97d3de666de8 {{(pid=82479) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 00:32:02 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Triggering sync for uuid 61d1abb2-3c80-48de-a26b-1c8030081105 {{(pid=82479) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 00:32:02 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "2d04f694-0eba-46c3-a617-97d3de666de8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:32:02 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "2d04f694-0eba-46c3-a617-97d3de666de8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:32:02 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "61d1abb2-3c80-48de-a26b-1c8030081105" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:32:02 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "61d1abb2-3c80-48de-a26b-1c8030081105" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:32:02 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "2d04f694-0eba-46c3-a617-97d3de666de8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:32:02 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "61d1abb2-3c80-48de-a26b-1c8030081105" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:32:05 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:32:06 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:32:07 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:32:08 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:32:09 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:32:10 user nova-compute[82479]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681432315.8042076, 5bd24977-c1b5-4bc5-b651-d6061483e781 => Stopped> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:32:10 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] VM Stopped (Lifecycle Event)
Apr 14 00:32:10 user nova-compute[82479]: DEBUG nova.compute.manager [None req-59e9bf43-3e48-4926-8de5-8ea675507b2f None None] [instance: 5bd24977-c1b5-4bc5-b651-d6061483e781] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:32:10 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:32:11 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:32:11 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82479) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 00:32:12 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:32:12 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:32:12 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:32:12 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:32:12 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Auditing locally available compute resources for user (node: user) {{(pid=82479) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 00:32:12 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d04f694-0eba-46c3-a617-97d3de666de8/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:32:12 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d04f694-0eba-46c3-a617-97d3de666de8/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:32:12 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d04f694-0eba-46c3-a617-97d3de666de8/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:32:13 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d04f694-0eba-46c3-a617-97d3de666de8/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:32:13 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61d1abb2-3c80-48de-a26b-1c8030081105/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:32:13 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61d1abb2-3c80-48de-a26b-1c8030081105/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:32:13 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61d1abb2-3c80-48de-a26b-1c8030081105/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:32:13 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61d1abb2-3c80-48de-a26b-1c8030081105/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:32:13 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:32:13 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:32:13 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Hypervisor/Node resource view: name=user free_ram=8650MB free_disk=26.16263198852539GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82479) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 00:32:13 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:32:13 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:32:13 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 2d04f694-0eba-46c3-a617-97d3de666de8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:32:13 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 61d1abb2-3c80-48de-a26b-1c8030081105 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:32:13 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 00:32:13 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 00:32:13 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:32:13 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:32:13 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Compute_service record updated for user:user {{(pid=82479) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 00:32:13 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.243s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:32:15 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:32:15 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:32:16 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:32:20 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:32:25 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:32:30 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:32:30 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:32:30 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:32:30 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:32:30 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:32:30 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:32:35 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:32:35 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:32:35 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:32:35 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:32:35 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:32:35 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:32:40 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f9f930ce-f1fc-4de5-be61-4d576644b325 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "61d1abb2-3c80-48de-a26b-1c8030081105" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:32:40 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f9f930ce-f1fc-4de5-be61-4d576644b325 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "61d1abb2-3c80-48de-a26b-1c8030081105" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:32:40 user nova-compute[82479]: DEBUG nova.objects.instance [None req-f9f930ce-f1fc-4de5-be61-4d576644b325 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lazy-loading 'flavor' on Instance uuid 61d1abb2-3c80-48de-a26b-1c8030081105 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:32:40 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f9f930ce-f1fc-4de5-be61-4d576644b325 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "61d1abb2-3c80-48de-a26b-1c8030081105" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:32:40 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f9f930ce-f1fc-4de5-be61-4d576644b325 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "61d1abb2-3c80-48de-a26b-1c8030081105" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:32:40 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f9f930ce-f1fc-4de5-be61-4d576644b325 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "61d1abb2-3c80-48de-a26b-1c8030081105" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:32:40 user nova-compute[82479]: INFO nova.compute.manager [None req-f9f930ce-f1fc-4de5-be61-4d576644b325 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Attaching volume 0f9e1f92-e142-4576-a375-32dc12d96c82 to /dev/vdb
Apr 14 00:32:40 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:32:40 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:32:40 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:32:40 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:32:40 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:32:40 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:32:40 user nova-compute[82479]: DEBUG os_brick.utils [None req-f9f930ce-f1fc-4de5-be61-4d576644b325 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:32:40 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:32:40 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:32:40 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6529ec5-9f39-4ee9-9c6a-b957ea702549]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fec92fcfdd3\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:32:40 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:32:40 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:32:40 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1fc704-4638-416d-b88a-552b8b6e6613]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:32:40 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:32:40 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:32:40 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[3743b634-859a-4f45-bc4b-c6224084e78a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:32:40 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[b535f40a-b5e9-4145-92d6-369e35877c7d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:32:40 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-f9f930ce-f1fc-4de5-be61-4d576644b325 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Running cmd (subprocess): nvme version {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:32:40 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-f9f930ce-f1fc-4de5-be61-4d576644b325 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] 'nvme version' failed. Not Retrying. {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:32:41 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f9f930ce-f1fc-4de5-be61-4d576644b325 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] nvme not present on system {{(pid=82479) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 00:32:41 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:32:41 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:32:41 user nova-compute[82479]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 00:32:41 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e5fb46-1e0f-48de-9b1c-3eff73df6a1a]: (4, '') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:32:41 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-f9f930ce-f1fc-4de5-be61-4d576644b325 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82479) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 00:32:41 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-f9f930ce-f1fc-4de5-be61-4d576644b325 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 00:32:41 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-f9f930ce-f1fc-4de5-be61-4d576644b325 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] LIGHTOS: no hostnqn found. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 00:32:41 user nova-compute[82479]: DEBUG os_brick.utils [None req-f9f930ce-f1fc-4de5-be61-4d576644b325 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fec92fcfdd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:32:41 user nova-compute[82479]: DEBUG nova.virt.block_device [None req-f9f930ce-f1fc-4de5-be61-4d576644b325 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Updating existing volume attachment record: 6ae724da-49f3-455b-a3a2-7986cfb73c5e {{(pid=82479) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 00:32:45 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:32:46 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9f930ce-f1fc-4de5-be61-4d576644b325 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Calling os-brick to attach iSCSI Volume {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 00:32:46 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f930ce-f1fc-4de5-be61-4d576644b325 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nrgBiqQL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:32:46 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-f9f930ce-f1fc-4de5-be61-4d576644b325 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:32:46 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-f9f930ce-f1fc-4de5-be61-4d576644b325 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:32:46 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-f9f930ce-f1fc-4de5-be61-4d576644b325 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:32:46 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-f9f930ce-f1fc-4de5-be61-4d576644b325 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:32:46 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-f9f930ce-f1fc-4de5-be61-4d576644b325 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:32:46 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-f9f930ce-f1fc-4de5-be61-4d576644b325 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:32:46 user nova-compute[82479]: INFO os_brick.initiator.connectors.iscsi [None req-f9f930ce-f1fc-4de5-be61-4d576644b325 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 00:32:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 -p 172.16.0.220:3260 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:32:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:32:46 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c122424-edf2-485c-912c-c1868765399d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:32:46 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f930ce-f1fc-4de5-be61-4d576644b325 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 00:32:46 user nova-compute[82479]:  {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:32:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 -p 172.16.0.220:3260 --interface default --op new {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:32:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:32:46 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[274f0be1-d948-45d7-98af-fa3c94df4860]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82] added\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:32:46 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f930ce-f1fc-4de5-be61-4d576644b325 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82] added
Apr 14 00:32:46 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:32:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:32:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:32:46 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[d042ba8f-b6b3-4284-8e03-399ddf16ea39]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:32:46 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f930ce-f1fc-4de5-be61-4d576644b325 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:32:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:32:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:32:46 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[9159aae4-4c47-4874-bd06-11d06a4f6525]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:32:46 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f930ce-f1fc-4de5-be61-4d576644b325 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:32:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nrgBiqQL {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:32:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nrgBiqQL" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:32:46 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[397cc832-29a3-4962-a78b-44a63cd3e52d]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:32:46 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f930ce-f1fc-4de5-be61-4d576644b325 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nrgBiqQL'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:32:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:32:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:32:46 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[2341afc5-d6c4-49bb-a58f-1ab4ad8b607e]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:32:46 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f930ce-f1fc-4de5-be61-4d576644b325 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:32:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:32:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:32:46 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a7fef3-197c-413a-bab5-23b20db058c8]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:32:46 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f930ce-f1fc-4de5-be61-4d576644b325 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 00:32:46 user nova-compute[82479]:  {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:32:46 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f930ce-f1fc-4de5-be61-4d576644b325 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 00:32:46 user nova-compute[82479]:  {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:32:46 user nova-compute[82479]: WARNING os_brick.initiator.connectors.iscsi [None req-f9f930ce-f1fc-4de5-be61-4d576644b325 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 00:32:46 user nova-compute[82479]: 
Apr 14 00:32:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 -p 172.16.0.220:3260 --login {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:32:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:32:46 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d5a540d-b428-401d-af7b-ac888c1e695a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:32:46 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f930ce-f1fc-4de5-be61-4d576644b325 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82, portal: 172.16.0.220,3260]
Apr 14 00:32:46 user nova-compute[82479]: Login to [iface: default, target: iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82, portal: 172.16.0.220,3260] successful.
Apr 14 00:32:46 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:32:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:32:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:32:46 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9e3402-21ad-444a-9fee-19d5745c133b]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:32:46 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f930ce-f1fc-4de5-be61-4d576644b325 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:32:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:32:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:32:46 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c03c5d-5f41-45b5-adc0-011a22c6e565]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:32:46 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f930ce-f1fc-4de5-be61-4d576644b325 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 (non-flash)
Apr 14 00:32:46 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:32:46 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f930ce-f1fc-4de5-be61-4d576644b325 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 (non-flash)
Apr 14 00:32:46 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:32:46 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-f9f930ce-f1fc-4de5-be61-4d576644b325 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:32:46 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f930ce-f1fc-4de5-be61-4d576644b325 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Connected to 172.16.0.220:3260 {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 00:32:46 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-f9f930ce-f1fc-4de5-be61-4d576644b325 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] HCTL ('33', '-', '-', 0) found on session 39 with lun 0 {{(pid=82479) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 00:32:46 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-f9f930ce-f1fc-4de5-be61-4d576644b325 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82479) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 00:32:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:32:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:32:46 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b54208-6ff5-4d29-a163-f504da71984d]: (4, ('- - 0', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:32:46 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-f9f930ce-f1fc-4de5-be61-4d576644b325 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82479) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 00:32:46 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f930ce-f1fc-4de5-be61-4d576644b325 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nrgBiqQL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 00:32:47 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-f9f930ce-f1fc-4de5-be61-4d576644b325 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:32:47 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9f930ce-f1fc-4de5-be61-4d576644b325 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '26266376662366566', 'path': '/dev/sdb'} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:32:47 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9f930ce-f1fc-4de5-be61-4d576644b325 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266376662366566', 'path': '/dev/sdb'} {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 00:32:47 user nova-compute[82479]: DEBUG nova.objects.instance [None req-f9f930ce-f1fc-4de5-be61-4d576644b325 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lazy-loading 'flavor' on Instance uuid 61d1abb2-3c80-48de-a26b-1c8030081105 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:32:47 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-f9f930ce-f1fc-4de5-be61-4d576644b325 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 00:32:47 user nova-compute[82479]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:32:47 user nova-compute[82479]:   <source dev="/dev/sdb"/>
Apr 14 00:32:47 user nova-compute[82479]:   <target dev="vdb" bus="virtio"/>
Apr 14 00:32:47 user nova-compute[82479]:   <serial>0f9e1f92-e142-4576-a375-32dc12d96c82</serial>
Apr 14 00:32:47 user nova-compute[82479]: </disk>
Apr 14 00:32:47 user nova-compute[82479]:  {{(pid=82479) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 00:32:47 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-f9f930ce-f1fc-4de5-be61-4d576644b325 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:32:47 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-f9f930ce-f1fc-4de5-be61-4d576644b325 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:32:47 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-f9f930ce-f1fc-4de5-be61-4d576644b325 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] No VIF found with MAC fa:16:3e:fc:5e:3a, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:32:47 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f9f930ce-f1fc-4de5-be61-4d576644b325 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "61d1abb2-3c80-48de-a26b-1c8030081105" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.100s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:32:50 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:32:54 user nova-compute[82479]: DEBUG nova.compute.manager [req-c5fd4170-f5a4-4209-9a65-3d096b0d2b22 req-1f35ff5e-700c-4299-a751-897d721ef0df service nova] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Received event network-changed-bf80bc9c-a453-4809-8eb4-e57fe015351f {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:32:54 user nova-compute[82479]: DEBUG nova.compute.manager [req-c5fd4170-f5a4-4209-9a65-3d096b0d2b22 req-1f35ff5e-700c-4299-a751-897d721ef0df service nova] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Refreshing instance network info cache due to event network-changed-bf80bc9c-a453-4809-8eb4-e57fe015351f. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:32:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-c5fd4170-f5a4-4209-9a65-3d096b0d2b22 req-1f35ff5e-700c-4299-a751-897d721ef0df service nova] Acquiring lock "refresh_cache-61d1abb2-3c80-48de-a26b-1c8030081105" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:32:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-c5fd4170-f5a4-4209-9a65-3d096b0d2b22 req-1f35ff5e-700c-4299-a751-897d721ef0df service nova] Acquired lock "refresh_cache-61d1abb2-3c80-48de-a26b-1c8030081105" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:32:54 user nova-compute[82479]: DEBUG nova.network.neutron [req-c5fd4170-f5a4-4209-9a65-3d096b0d2b22 req-1f35ff5e-700c-4299-a751-897d721ef0df service nova] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Refreshing network info cache for port bf80bc9c-a453-4809-8eb4-e57fe015351f {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:32:54 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:32:55 user nova-compute[82479]: DEBUG nova.network.neutron [req-c5fd4170-f5a4-4209-9a65-3d096b0d2b22 req-1f35ff5e-700c-4299-a751-897d721ef0df service nova] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Updated VIF entry in instance network info cache for port bf80bc9c-a453-4809-8eb4-e57fe015351f. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:32:55 user nova-compute[82479]: DEBUG nova.network.neutron [req-c5fd4170-f5a4-4209-9a65-3d096b0d2b22 req-1f35ff5e-700c-4299-a751-897d721ef0df service nova] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Updating instance_info_cache with network_info: [{"id": "bf80bc9c-a453-4809-8eb4-e57fe015351f", "address": "fa:16:3e:fc:5e:3a", "network": {"id": "d7b8d180-999a-4f41-b677-e83b1c24a8a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1461510401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46777f523af54eecb0e3260f14df7909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf80bc9c-a4", "ovs_interfaceid": "bf80bc9c-a453-4809-8eb4-e57fe015351f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:32:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-c5fd4170-f5a4-4209-9a65-3d096b0d2b22 req-1f35ff5e-700c-4299-a751-897d721ef0df service nova] Releasing lock "refresh_cache-61d1abb2-3c80-48de-a26b-1c8030081105" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:32:55 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:32:56 user nova-compute[82479]: DEBUG nova.compute.manager [req-8016fc5e-fd83-4f3a-80e7-14aa7afd71cf req-59d59577-4cc7-43ce-ad16-44df3f266062 service nova] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Received event network-changed-bf80bc9c-a453-4809-8eb4-e57fe015351f {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:32:56 user nova-compute[82479]: DEBUG nova.compute.manager [req-8016fc5e-fd83-4f3a-80e7-14aa7afd71cf req-59d59577-4cc7-43ce-ad16-44df3f266062 service nova] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Refreshing instance network info cache due to event network-changed-bf80bc9c-a453-4809-8eb4-e57fe015351f. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:32:56 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-8016fc5e-fd83-4f3a-80e7-14aa7afd71cf req-59d59577-4cc7-43ce-ad16-44df3f266062 service nova] Acquiring lock "refresh_cache-61d1abb2-3c80-48de-a26b-1c8030081105" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:32:56 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-8016fc5e-fd83-4f3a-80e7-14aa7afd71cf req-59d59577-4cc7-43ce-ad16-44df3f266062 service nova] Acquired lock "refresh_cache-61d1abb2-3c80-48de-a26b-1c8030081105" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:32:56 user nova-compute[82479]: DEBUG nova.network.neutron [req-8016fc5e-fd83-4f3a-80e7-14aa7afd71cf req-59d59577-4cc7-43ce-ad16-44df3f266062 service nova] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Refreshing network info cache for port bf80bc9c-a453-4809-8eb4-e57fe015351f {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:32:56 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:32:57 user nova-compute[82479]: DEBUG nova.network.neutron [req-8016fc5e-fd83-4f3a-80e7-14aa7afd71cf req-59d59577-4cc7-43ce-ad16-44df3f266062 service nova] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Updated VIF entry in instance network info cache for port bf80bc9c-a453-4809-8eb4-e57fe015351f. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:32:57 user nova-compute[82479]: DEBUG nova.network.neutron [req-8016fc5e-fd83-4f3a-80e7-14aa7afd71cf req-59d59577-4cc7-43ce-ad16-44df3f266062 service nova] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Updating instance_info_cache with network_info: [{"id": "bf80bc9c-a453-4809-8eb4-e57fe015351f", "address": "fa:16:3e:fc:5e:3a", "network": {"id": "d7b8d180-999a-4f41-b677-e83b1c24a8a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1461510401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46777f523af54eecb0e3260f14df7909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf80bc9c-a4", "ovs_interfaceid": "bf80bc9c-a453-4809-8eb4-e57fe015351f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:32:57 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-8016fc5e-fd83-4f3a-80e7-14aa7afd71cf req-59d59577-4cc7-43ce-ad16-44df3f266062 service nova] Releasing lock "refresh_cache-61d1abb2-3c80-48de-a26b-1c8030081105" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:32:59 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:32:59 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Starting heal instance info cache {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 00:32:59 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Rebuilding the list of instances to heal {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 00:32:59 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "refresh_cache-2d04f694-0eba-46c3-a617-97d3de666de8" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:32:59 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquired lock "refresh_cache-2d04f694-0eba-46c3-a617-97d3de666de8" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:32:59 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Forcefully refreshing network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 00:32:59 user nova-compute[82479]: DEBUG nova.objects.instance [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lazy-loading 'info_cache' on Instance uuid 2d04f694-0eba-46c3-a617-97d3de666de8 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:32:59 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "61d1abb2-3c80-48de-a26b-1c8030081105" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:32:59 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "61d1abb2-3c80-48de-a26b-1c8030081105" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:32:59 user nova-compute[82479]: INFO nova.compute.manager [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Rebooting instance
Apr 14 00:32:59 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "refresh_cache-61d1abb2-3c80-48de-a26b-1c8030081105" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:32:59 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquired lock "refresh_cache-61d1abb2-3c80-48de-a26b-1c8030081105" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:32:59 user nova-compute[82479]: DEBUG nova.network.neutron [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 00:33:00 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Updating instance_info_cache with network_info: [{"id": "e7556e77-8734-4ef9-b260-2503b06b73bc", "address": "fa:16:3e:5a:d1:62", "network": {"id": "8b306bb0-c969-4918-a696-dd539eaa3a21", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1341077591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e46ba54fdcdb45368f457001f26a281b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7556e77-87", "ovs_interfaceid": "e7556e77-8734-4ef9-b260-2503b06b73bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:33:00 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Releasing lock "refresh_cache-2d04f694-0eba-46c3-a617-97d3de666de8" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:33:00 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Updated the network info_cache for instance {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 00:33:00 user nova-compute[82479]: DEBUG nova.network.neutron [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Updating instance_info_cache with network_info: [{"id": "bf80bc9c-a453-4809-8eb4-e57fe015351f", "address": "fa:16:3e:fc:5e:3a", "network": {"id": "d7b8d180-999a-4f41-b677-e83b1c24a8a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1461510401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46777f523af54eecb0e3260f14df7909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf80bc9c-a4", "ovs_interfaceid": "bf80bc9c-a453-4809-8eb4-e57fe015351f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:33:00 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Releasing lock "refresh_cache-61d1abb2-3c80-48de-a26b-1c8030081105" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:33:00 user nova-compute[82479]: DEBUG nova.compute.manager [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:33:00 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:33:00 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:33:00 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:33:00 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:33:00 user nova-compute[82479]: DEBUG nova.compute.manager [req-cd28fa9a-cef5-4bc8-823f-d8da1c88f563 req-ce39973f-fdf2-4c1e-ac84-2bb4d881fdf7 service nova] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Received event network-vif-unplugged-bf80bc9c-a453-4809-8eb4-e57fe015351f {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:33:00 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-cd28fa9a-cef5-4bc8-823f-d8da1c88f563 req-ce39973f-fdf2-4c1e-ac84-2bb4d881fdf7 service nova] Acquiring lock "61d1abb2-3c80-48de-a26b-1c8030081105-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:33:00 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-cd28fa9a-cef5-4bc8-823f-d8da1c88f563 req-ce39973f-fdf2-4c1e-ac84-2bb4d881fdf7 service nova] Lock "61d1abb2-3c80-48de-a26b-1c8030081105-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:33:00 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-cd28fa9a-cef5-4bc8-823f-d8da1c88f563 req-ce39973f-fdf2-4c1e-ac84-2bb4d881fdf7 service nova] Lock "61d1abb2-3c80-48de-a26b-1c8030081105-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:33:00 user nova-compute[82479]: DEBUG nova.compute.manager [req-cd28fa9a-cef5-4bc8-823f-d8da1c88f563 req-ce39973f-fdf2-4c1e-ac84-2bb4d881fdf7 service nova] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] No waiting events found dispatching network-vif-unplugged-bf80bc9c-a453-4809-8eb4-e57fe015351f {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:33:00 user nova-compute[82479]: WARNING nova.compute.manager [req-cd28fa9a-cef5-4bc8-823f-d8da1c88f563 req-ce39973f-fdf2-4c1e-ac84-2bb4d881fdf7 service nova] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Received unexpected event network-vif-unplugged-bf80bc9c-a453-4809-8eb4-e57fe015351f for instance with vm_state active and task_state reboot_started_hard.
Apr 14 00:33:01 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Instance destroyed successfully.
Apr 14 00:33:01 user nova-compute[82479]: DEBUG nova.objects.instance [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lazy-loading 'resources' on Instance uuid 61d1abb2-3c80-48de-a26b-1c8030081105 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:30:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-135186904',display_name='tempest-TestMinimumBasicScenario-server-135186904',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-135186904',id=38,image_ref='69b3b215-794a-4b99-9d8b-56aa656eaf64',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbLqmsfqYW8VR6EP1yhbU8GU2QfZRlgJel1XZcbWJfjZ9yg1Nmlkybblt9S+WzcdNDudfvyq9SY0bU2LjYjKMTNT31rkJQgE4HvdP1jaLmQd6JssBlbCFkCHFCD6jWrNw==',key_name='tempest-TestMinimumBasicScenario-1820486155',keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:30:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46777f523af54eecb0e3260f14df7909',ramdisk_id='',reservation_id='r-zjujq50w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='69b3b215-794a-4b99-9d8b-56aa656eaf64',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-598834355',owner_user_name='tempest-TestMinimumBasicScenario-598834355-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T00:33:01Z,user_data=None,user_id='e5ad76f13b78448887913c4d0bcb16af',uuid=61d1abb2-3c80-48de-a26b-1c8030081105,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf80bc9c-a453-4809-8eb4-e57fe015351f", "address": "fa:16:3e:fc:5e:3a", "network": {"id": "d7b8d180-999a-4f41-b677-e83b1c24a8a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1461510401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46777f523af54eecb0e3260f14df7909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf80bc9c-a4", "ovs_interfaceid": "bf80bc9c-a453-4809-8eb4-e57fe015351f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Converting VIF {"id": "bf80bc9c-a453-4809-8eb4-e57fe015351f", "address": "fa:16:3e:fc:5e:3a", "network": {"id": "d7b8d180-999a-4f41-b677-e83b1c24a8a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1461510401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46777f523af54eecb0e3260f14df7909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf80bc9c-a4", "ovs_interfaceid": "bf80bc9c-a453-4809-8eb4-e57fe015351f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fc:5e:3a,bridge_name='br-int',has_traffic_filtering=True,id=bf80bc9c-a453-4809-8eb4-e57fe015351f,network=Network(d7b8d180-999a-4f41-b677-e83b1c24a8a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf80bc9c-a4') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG os_vif [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:5e:3a,bridge_name='br-int',has_traffic_filtering=True,id=bf80bc9c-a453-4809-8eb4-e57fe015351f,network=Network(d7b8d180-999a-4f41-b677-e83b1c24a8a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf80bc9c-a4') {{(pid=82479) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbf80bc9c-a4, bridge=br-int, if_exists=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:33:01 user nova-compute[82479]: INFO os_vif [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:5e:3a,bridge_name='br-int',has_traffic_filtering=True,id=bf80bc9c-a453-4809-8eb4-e57fe015351f,network=Network(d7b8d180-999a-4f41-b677-e83b1c24a8a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf80bc9c-a4')
Apr 14 00:33:01 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] calling os-brick to detach iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, {'target_iqn': 'iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nrgBiqQL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:33:01 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:33:01 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a47f8e-e03c-4c10-b56b-7166f042c31d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 00:33:01 user nova-compute[82479]: No targets found.
Apr 14 00:33:01 user nova-compute[82479]: iSNS:
Apr 14 00:33:01 user nova-compute[82479]: No targets found.
Apr 14 00:33:01 user nova-compute[82479]: STATIC:
Apr 14 00:33:01 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82
Apr 14 00:33:01 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:33:01 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:33:01 user nova-compute[82479]: FIRMWARE:
Apr 14 00:33:01 user nova-compute[82479]: No targets found.
Apr 14 00:33:01 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 00:33:01 user nova-compute[82479]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 00:33:01 user nova-compute[82479]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82479) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82', 0)] {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[7250c1bb-afaf-451f-b3c7-45f85a9fc8d2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[31345df0-0d35-4a04-b183-1044472c219f]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 (non-flash)
Apr 14 00:33:01 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 (non-flash)
Apr 14 00:33:01 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3338358550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82'): ({'sdb'}, set())}) {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Removing single pathed devices sdb {{(pid=82479) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[875a93b0-cae1-4187-8229-0484ca9ca38b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1c9820-4cea-46c5-a65f-199f1af45046]: (4, ('ok\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Flushing IO for device /dev/sdb {{(pid=82479) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b911e40-b9e2-45d2-909f-dd036be38ee5]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82479) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4b085c-9a3f-4591-b8bc-b905799c3f9b]: (4, ('1', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] SCSI volumes sdb have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82')] {{(pid=82479) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d3b9e9-e284-4806-83fc-7e573908b03d]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 -p 172.16.0.220:3260 --logout {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[702167ae-7286-4fed-885f-5a4e4350a62d]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82, portal: 172.16.0.220,3260]
Apr 14 00:33:01 user nova-compute[82479]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82, portal: 172.16.0.220,3260] successful.
Apr 14 00:33:01 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 -p 172.16.0.220:3260 --op delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec77254e-318f-4b68-b226-0affd09a3e8c]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] <== disconnect_volume: return (280ms) None {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Disconnected iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Start _get_guest_xml network_info=[{"id": "bf80bc9c-a453-4809-8eb4-e57fe015351f", "address": "fa:16:3e:fc:5e:3a", "network": {"id": "d7b8d180-999a-4f41-b677-e83b1c24a8a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1461510401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46777f523af54eecb0e3260f14df7909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf80bc9c-a4", "ovs_interfaceid": "bf80bc9c-a453-4809-8eb4-e57fe015351f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=69b3b215-794a-4b99-9d8b-56aa656eaf64,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'image_id': '69b3b215-794a-4b99-9d8b-56aa656eaf64'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': None, 'device_type': 'disk', 'delete_on_termination': False, 'attachment_id': '6ae724da-49f3-455b-a3a2-7986cfb73c5e', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nrgBiqQL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '61d1abb2-3c80-48de-a26b-1c8030081105', 'attached_at': '', 'detached_at': '', 'volume_id': '0f9e1f92-e142-4576-a375-32dc12d96c82', 'serial': '0f9e1f92-e142-4576-a375-32dc12d96c82'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 00:33:01 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:33:01 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:33:01 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82479) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T00:02:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=69b3b215-794a-4b99-9d8b-56aa656eaf64,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Flavor limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Image limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Flavor pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Image pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Got 1 possible topologies {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG nova.objects.instance [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lazy-loading 'vcpu_model' on Instance uuid 61d1abb2-3c80-48de-a26b-1c8030081105 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Calling os-brick to attach iSCSI Volume {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nrgBiqQL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:33:01 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:33:01 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:33:01 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:33:01 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:33:01 user nova-compute[82479]: INFO os_brick.initiator.connectors.iscsi [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 00:33:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 -p 172.16.0.220:3260 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a5a58e-4537-4ae1-93fc-2f60d3214d8a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 00:33:01 user nova-compute[82479]:  {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 -p 172.16.0.220:3260 --interface default --op new {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc16e11-2eab-447d-ac4e-e445dbc86eb3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82] added\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82] added
Apr 14 00:33:01 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ccd52c3-f06a-4cf8-a3d4-977228d877d2]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:33:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:33:02 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:33:02 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3175683-a6ca-4e21-9110-8b2508bdafa3]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:33:02 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:33:02 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nrgBiqQL {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:33:02 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nrgBiqQL" returned: 0 in 0.024s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:33:02 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[51350143-cc0d-49a0-91b9-fea63d2159f0]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:33:02 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nrgBiqQL'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:33:02 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:33:02 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:33:02 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f0342a-f0b2-4042-ad2f-130b8a82cdfb]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:33:02 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:33:02 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:33:02 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:33:02 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b045635-424c-410c-945f-7881eb646e14]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:33:02 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 00:33:02 user nova-compute[82479]:  {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:33:02 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 00:33:02 user nova-compute[82479]:  {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:33:02 user nova-compute[82479]: WARNING os_brick.initiator.connectors.iscsi [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 00:33:02 user nova-compute[82479]: 
Apr 14 00:33:02 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 -p 172.16.0.220:3260 --login {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:33:02 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:33:02 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[698d833a-b642-49e3-8e7a-0ca6394b12da]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:33:02 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82, portal: 172.16.0.220,3260]
Apr 14 00:33:02 user nova-compute[82479]: Login to [iface: default, target: iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82, portal: 172.16.0.220,3260] successful.
Apr 14 00:33:02 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:33:02 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:33:02 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:33:02 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[08178577-5fa6-4d63-93b8-23a28db43ea4]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:33:02 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:33:02 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:33:02 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:33:02 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[e584cd30-e01e-4366-af51-0976e3d81f79]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:33:02 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 (non-flash)
Apr 14 00:33:02 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:33:02 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 (non-flash)
Apr 14 00:33:02 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:33:02 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:33:02 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Connected to 172.16.0.220:3260 {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 00:33:02 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] HCTL ('33', '-', '-', 0) found on session 40 with lun 0 {{(pid=82479) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 00:33:02 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82479) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 00:33:02 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:33:02 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:33:02 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[b915efce-be1e-4ee4-a6fc-7e318c495f61]: (4, ('- - 0', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:33:02 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Searching for a device in session 40 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82479) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 00:33:02 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nrgBiqQL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 00:33:02 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:33:03 user nova-compute[82479]: DEBUG nova.compute.manager [req-88653eb9-dc8c-4db0-94ad-76e5f0bbbee2 req-f6730087-1074-4f22-a0a7-cb115b37c536 service nova] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Received event network-vif-plugged-bf80bc9c-a453-4809-8eb4-e57fe015351f {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:33:03 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-88653eb9-dc8c-4db0-94ad-76e5f0bbbee2 req-f6730087-1074-4f22-a0a7-cb115b37c536 service nova] Acquiring lock "61d1abb2-3c80-48de-a26b-1c8030081105-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:33:03 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-88653eb9-dc8c-4db0-94ad-76e5f0bbbee2 req-f6730087-1074-4f22-a0a7-cb115b37c536 service nova] Lock "61d1abb2-3c80-48de-a26b-1c8030081105-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:33:03 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-88653eb9-dc8c-4db0-94ad-76e5f0bbbee2 req-f6730087-1074-4f22-a0a7-cb115b37c536 service nova] Lock "61d1abb2-3c80-48de-a26b-1c8030081105-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:33:03 user nova-compute[82479]: DEBUG nova.compute.manager [req-88653eb9-dc8c-4db0-94ad-76e5f0bbbee2 req-f6730087-1074-4f22-a0a7-cb115b37c536 service nova] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] No waiting events found dispatching network-vif-plugged-bf80bc9c-a453-4809-8eb4-e57fe015351f {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:33:03 user nova-compute[82479]: WARNING nova.compute.manager [req-88653eb9-dc8c-4db0-94ad-76e5f0bbbee2 req-f6730087-1074-4f22-a0a7-cb115b37c536 service nova] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Received unexpected event network-vif-plugged-bf80bc9c-a453-4809-8eb4-e57fe015351f for instance with vm_state active and task_state reboot_started_hard.
Apr 14 00:33:03 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:33:03 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '26266376662366566', 'path': '/dev/sdb'} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:33:03 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266376662366566', 'path': '/dev/sdb'} {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 00:33:03 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:30:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-135186904',display_name='tempest-TestMinimumBasicScenario-server-135186904',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-135186904',id=38,image_ref='69b3b215-794a-4b99-9d8b-56aa656eaf64',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbLqmsfqYW8VR6EP1yhbU8GU2QfZRlgJel1XZcbWJfjZ9yg1Nmlkybblt9S+WzcdNDudfvyq9SY0bU2LjYjKMTNT31rkJQgE4HvdP1jaLmQd6JssBlbCFkCHFCD6jWrNw==',key_name='tempest-TestMinimumBasicScenario-1820486155',keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:30:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46777f523af54eecb0e3260f14df7909',ramdisk_id='',reservation_id='r-zjujq50w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='69b3b215-794a-4b99-9d8b-56aa656eaf64',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-598834355',owner_user_name='tempest-TestMinimumBasicScenario-598834355-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T00:33:01Z,user_data=None,user_id='e5ad76f13b78448887913c4d0bcb16af',uuid=61d1abb2-3c80-48de-a26b-1c8030081105,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf80bc9c-a453-4809-8eb4-e57fe015351f", "address": "fa:16:3e:fc:5e:3a", "network": {"id": "d7b8d180-999a-4f41-b677-e83b1c24a8a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1461510401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46777f523af54eecb0e3260f14df7909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf80bc9c-a4", "ovs_interfaceid": "bf80bc9c-a453-4809-8eb4-e57fe015351f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82479) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 00:33:03 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Converting VIF {"id": "bf80bc9c-a453-4809-8eb4-e57fe015351f", "address": "fa:16:3e:fc:5e:3a", "network": {"id": "d7b8d180-999a-4f41-b677-e83b1c24a8a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1461510401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46777f523af54eecb0e3260f14df7909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf80bc9c-a4", "ovs_interfaceid": "bf80bc9c-a453-4809-8eb4-e57fe015351f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:33:03 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fc:5e:3a,bridge_name='br-int',has_traffic_filtering=True,id=bf80bc9c-a453-4809-8eb4-e57fe015351f,network=Network(d7b8d180-999a-4f41-b677-e83b1c24a8a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf80bc9c-a4') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:33:03 user nova-compute[82479]: DEBUG nova.objects.instance [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lazy-loading 'pci_devices' on Instance uuid 61d1abb2-3c80-48de-a26b-1c8030081105 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:33:03 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] End _get_guest_xml xml=<domain type="kvm">
Apr 14 00:33:03 user nova-compute[82479]:   <uuid>61d1abb2-3c80-48de-a26b-1c8030081105</uuid>
Apr 14 00:33:03 user nova-compute[82479]:   <name>instance-00000026</name>
Apr 14 00:33:03 user nova-compute[82479]:   <memory>131072</memory>
Apr 14 00:33:03 user nova-compute[82479]:   <vcpu>1</vcpu>
Apr 14 00:33:03 user nova-compute[82479]:   <metadata>
Apr 14 00:33:03 user nova-compute[82479]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 00:33:03 user nova-compute[82479]:       <nova:package version="0.0.0"/>
Apr 14 00:33:03 user nova-compute[82479]:       <nova:name>tempest-TestMinimumBasicScenario-server-135186904</nova:name>
Apr 14 00:33:03 user nova-compute[82479]:       <nova:creationTime>2023-04-14 00:33:01</nova:creationTime>
Apr 14 00:33:03 user nova-compute[82479]:       <nova:flavor name="m1.nano">
Apr 14 00:33:03 user nova-compute[82479]:         <nova:memory>128</nova:memory>
Apr 14 00:33:03 user nova-compute[82479]:         <nova:disk>1</nova:disk>
Apr 14 00:33:03 user nova-compute[82479]:         <nova:swap>0</nova:swap>
Apr 14 00:33:03 user nova-compute[82479]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 00:33:03 user nova-compute[82479]:         <nova:vcpus>1</nova:vcpus>
Apr 14 00:33:03 user nova-compute[82479]:       </nova:flavor>
Apr 14 00:33:03 user nova-compute[82479]:       <nova:owner>
Apr 14 00:33:03 user nova-compute[82479]:         <nova:user uuid="e5ad76f13b78448887913c4d0bcb16af">tempest-TestMinimumBasicScenario-598834355-project-member</nova:user>
Apr 14 00:33:03 user nova-compute[82479]:         <nova:project uuid="46777f523af54eecb0e3260f14df7909">tempest-TestMinimumBasicScenario-598834355</nova:project>
Apr 14 00:33:03 user nova-compute[82479]:       </nova:owner>
Apr 14 00:33:03 user nova-compute[82479]:       <nova:root type="image" uuid="69b3b215-794a-4b99-9d8b-56aa656eaf64"/>
Apr 14 00:33:03 user nova-compute[82479]:       <nova:ports>
Apr 14 00:33:03 user nova-compute[82479]:         <nova:port uuid="bf80bc9c-a453-4809-8eb4-e57fe015351f">
Apr 14 00:33:03 user nova-compute[82479]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 14 00:33:03 user nova-compute[82479]:         </nova:port>
Apr 14 00:33:03 user nova-compute[82479]:       </nova:ports>
Apr 14 00:33:03 user nova-compute[82479]:     </nova:instance>
Apr 14 00:33:03 user nova-compute[82479]:   </metadata>
Apr 14 00:33:03 user nova-compute[82479]:   <sysinfo type="smbios">
Apr 14 00:33:03 user nova-compute[82479]:     <system>
Apr 14 00:33:03 user nova-compute[82479]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 00:33:03 user nova-compute[82479]:       <entry name="product">OpenStack Nova</entry>
Apr 14 00:33:03 user nova-compute[82479]:       <entry name="version">0.0.0</entry>
Apr 14 00:33:03 user nova-compute[82479]:       <entry name="serial">61d1abb2-3c80-48de-a26b-1c8030081105</entry>
Apr 14 00:33:03 user nova-compute[82479]:       <entry name="uuid">61d1abb2-3c80-48de-a26b-1c8030081105</entry>
Apr 14 00:33:03 user nova-compute[82479]:       <entry name="family">Virtual Machine</entry>
Apr 14 00:33:03 user nova-compute[82479]:     </system>
Apr 14 00:33:03 user nova-compute[82479]:   </sysinfo>
Apr 14 00:33:03 user nova-compute[82479]:   <os>
Apr 14 00:33:03 user nova-compute[82479]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 00:33:03 user nova-compute[82479]:     <boot dev="hd"/>
Apr 14 00:33:03 user nova-compute[82479]:     <smbios mode="sysinfo"/>
Apr 14 00:33:03 user nova-compute[82479]:   </os>
Apr 14 00:33:03 user nova-compute[82479]:   <features>
Apr 14 00:33:03 user nova-compute[82479]:     <acpi/>
Apr 14 00:33:03 user nova-compute[82479]:     <apic/>
Apr 14 00:33:03 user nova-compute[82479]:     <vmcoreinfo/>
Apr 14 00:33:03 user nova-compute[82479]:   </features>
Apr 14 00:33:03 user nova-compute[82479]:   <clock offset="utc">
Apr 14 00:33:03 user nova-compute[82479]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 00:33:03 user nova-compute[82479]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 00:33:03 user nova-compute[82479]:     <timer name="hpet" present="no"/>
Apr 14 00:33:03 user nova-compute[82479]:   </clock>
Apr 14 00:33:03 user nova-compute[82479]:   <cpu mode="custom" match="exact">
Apr 14 00:33:03 user nova-compute[82479]:     <model>Nehalem</model>
Apr 14 00:33:03 user nova-compute[82479]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 00:33:03 user nova-compute[82479]:   </cpu>
Apr 14 00:33:03 user nova-compute[82479]:   <devices>
Apr 14 00:33:03 user nova-compute[82479]:     <disk type="file" device="disk">
Apr 14 00:33:03 user nova-compute[82479]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 00:33:03 user nova-compute[82479]:       <source file="/opt/stack/data/nova/instances/61d1abb2-3c80-48de-a26b-1c8030081105/disk"/>
Apr 14 00:33:03 user nova-compute[82479]:       <target dev="vda" bus="virtio"/>
Apr 14 00:33:03 user nova-compute[82479]:     </disk>
Apr 14 00:33:03 user nova-compute[82479]:     <disk type="block" device="disk">
Apr 14 00:33:03 user nova-compute[82479]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:33:03 user nova-compute[82479]:       <source dev="/dev/sdb"/>
Apr 14 00:33:03 user nova-compute[82479]:       <target dev="vdb" bus="virtio"/>
Apr 14 00:33:03 user nova-compute[82479]:       <serial>0f9e1f92-e142-4576-a375-32dc12d96c82</serial>
Apr 14 00:33:03 user nova-compute[82479]:     </disk>
Apr 14 00:33:03 user nova-compute[82479]:     <interface type="ethernet">
Apr 14 00:33:03 user nova-compute[82479]:       <mac address="fa:16:3e:fc:5e:3a"/>
Apr 14 00:33:03 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:33:03 user nova-compute[82479]:       <mtu size="1442"/>
Apr 14 00:33:03 user nova-compute[82479]:       <target dev="tapbf80bc9c-a4"/>
Apr 14 00:33:03 user nova-compute[82479]:     </interface>
Apr 14 00:33:03 user nova-compute[82479]:     <serial type="pty">
Apr 14 00:33:03 user nova-compute[82479]:       <log file="/opt/stack/data/nova/instances/61d1abb2-3c80-48de-a26b-1c8030081105/console.log" append="off"/>
Apr 14 00:33:03 user nova-compute[82479]:     </serial>
Apr 14 00:33:03 user nova-compute[82479]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 00:33:03 user nova-compute[82479]:     <video>
Apr 14 00:33:03 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:33:03 user nova-compute[82479]:     </video>
Apr 14 00:33:03 user nova-compute[82479]:     <rng model="virtio">
Apr 14 00:33:03 user nova-compute[82479]:       <backend model="random">/dev/urandom</backend>
Apr 14 00:33:03 user nova-compute[82479]:     </rng>
Apr 14 00:33:03 user nova-compute[82479]:     <controller type="usb" index="0" model="none"/>
Apr 14 00:33:03 user nova-compute[82479]:     <memballoon model="virtio">
Apr 14 00:33:03 user nova-compute[82479]:       <stats period="10"/>
Apr 14 00:33:03 user nova-compute[82479]:     </memballoon>
Apr 14 00:33:03 user nova-compute[82479]:   </devices>
Apr 14 00:33:03 user nova-compute[82479]: </domain>
Apr 14 00:33:03 user nova-compute[82479]:  {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 00:33:03 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61d1abb2-3c80-48de-a26b-1c8030081105/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:33:03 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61d1abb2-3c80-48de-a26b-1c8030081105/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:33:03 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61d1abb2-3c80-48de-a26b-1c8030081105/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:33:03 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61d1abb2-3c80-48de-a26b-1c8030081105/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:33:03 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:33:03 user nova-compute[82479]: DEBUG nova.objects.instance [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lazy-loading 'trusted_certs' on Instance uuid 61d1abb2-3c80-48de-a26b-1c8030081105 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:33:03 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ce35c80b3bff307959a38a69a9348abf786c630 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:33:03 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ce35c80b3bff307959a38a69a9348abf786c630 --force-share --output=json" returned: 0 in 0.131s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:33:03 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Checking if we can resize image /opt/stack/data/nova/instances/61d1abb2-3c80-48de-a26b-1c8030081105/disk. size=1073741824 {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 00:33:03 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61d1abb2-3c80-48de-a26b-1c8030081105/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:33:03 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61d1abb2-3c80-48de-a26b-1c8030081105/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:33:03 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Cannot resize image /opt/stack/data/nova/instances/61d1abb2-3c80-48de-a26b-1c8030081105/disk to a smaller size. {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 00:33:03 user nova-compute[82479]: DEBUG nova.objects.instance [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lazy-loading 'migration_context' on Instance uuid 61d1abb2-3c80-48de-a26b-1c8030081105 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:33:03 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:30:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-135186904',display_name='tempest-TestMinimumBasicScenario-server-135186904',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-135186904',id=38,image_ref='69b3b215-794a-4b99-9d8b-56aa656eaf64',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbLqmsfqYW8VR6EP1yhbU8GU2QfZRlgJel1XZcbWJfjZ9yg1Nmlkybblt9S+WzcdNDudfvyq9SY0bU2LjYjKMTNT31rkJQgE4HvdP1jaLmQd6JssBlbCFkCHFCD6jWrNw==',key_name='tempest-TestMinimumBasicScenario-1820486155',keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:30:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='46777f523af54eecb0e3260f14df7909',ramdisk_id='',reservation_id='r-zjujq50w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='69b3b215-794a-4b99-9d8b-56aa656eaf64',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-598834355',owner_user_name='tempest-TestMinimumBasicScenario-598834355-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:33:01Z,user_data=None,user_id='e5ad76f13b78448887913c4d0bcb16af',uuid=61d1abb2-3c80-48de-a26b-1c8030081105,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf80bc9c-a453-4809-8eb4-e57fe015351f", "address": "fa:16:3e:fc:5e:3a", "network": {"id": "d7b8d180-999a-4f41-b677-e83b1c24a8a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1461510401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46777f523af54eecb0e3260f14df7909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf80bc9c-a4", "ovs_interfaceid": "bf80bc9c-a453-4809-8eb4-e57fe015351f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 00:33:03 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Converting VIF {"id": "bf80bc9c-a453-4809-8eb4-e57fe015351f", "address": "fa:16:3e:fc:5e:3a", "network": {"id": "d7b8d180-999a-4f41-b677-e83b1c24a8a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1461510401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46777f523af54eecb0e3260f14df7909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf80bc9c-a4", "ovs_interfaceid": "bf80bc9c-a453-4809-8eb4-e57fe015351f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:33:03 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fc:5e:3a,bridge_name='br-int',has_traffic_filtering=True,id=bf80bc9c-a453-4809-8eb4-e57fe015351f,network=Network(d7b8d180-999a-4f41-b677-e83b1c24a8a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf80bc9c-a4') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:33:03 user nova-compute[82479]: DEBUG os_vif [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:5e:3a,bridge_name='br-int',has_traffic_filtering=True,id=bf80bc9c-a453-4809-8eb4-e57fe015351f,network=Network(d7b8d180-999a-4f41-b677-e83b1c24a8a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf80bc9c-a4') {{(pid=82479) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 00:33:03 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:33:03 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:33:03 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 00:33:03 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:33:03 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbf80bc9c-a4, may_exist=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:33:03 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbf80bc9c-a4, col_values=(('external_ids', {'iface-id': 'bf80bc9c-a453-4809-8eb4-e57fe015351f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:5e:3a', 'vm-uuid': '61d1abb2-3c80-48de-a26b-1c8030081105'}),)) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:33:03 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:33:03 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:33:03 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:33:03 user nova-compute[82479]: INFO os_vif [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:5e:3a,bridge_name='br-int',has_traffic_filtering=True,id=bf80bc9c-a453-4809-8eb4-e57fe015351f,network=Network(d7b8d180-999a-4f41-b677-e83b1c24a8a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf80bc9c-a4')
Apr 14 00:33:05 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:33:05 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:33:05 user nova-compute[82479]: DEBUG nova.compute.manager [req-131d39c3-c869-4bb3-9c56-fad6d963e537 req-944cf972-2407-479d-b4da-c3e86ae26fea service nova] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Received event network-vif-plugged-bf80bc9c-a453-4809-8eb4-e57fe015351f {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:33:05 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-131d39c3-c869-4bb3-9c56-fad6d963e537 req-944cf972-2407-479d-b4da-c3e86ae26fea service nova] Acquiring lock "61d1abb2-3c80-48de-a26b-1c8030081105-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:33:05 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-131d39c3-c869-4bb3-9c56-fad6d963e537 req-944cf972-2407-479d-b4da-c3e86ae26fea service nova] Lock "61d1abb2-3c80-48de-a26b-1c8030081105-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:33:05 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-131d39c3-c869-4bb3-9c56-fad6d963e537 req-944cf972-2407-479d-b4da-c3e86ae26fea service nova] Lock "61d1abb2-3c80-48de-a26b-1c8030081105-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:33:05 user nova-compute[82479]: DEBUG nova.compute.manager [req-131d39c3-c869-4bb3-9c56-fad6d963e537 req-944cf972-2407-479d-b4da-c3e86ae26fea service nova] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] No waiting events found dispatching network-vif-plugged-bf80bc9c-a453-4809-8eb4-e57fe015351f {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:33:05 user nova-compute[82479]: WARNING nova.compute.manager [req-131d39c3-c869-4bb3-9c56-fad6d963e537 req-944cf972-2407-479d-b4da-c3e86ae26fea service nova] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Received unexpected event network-vif-plugged-bf80bc9c-a453-4809-8eb4-e57fe015351f for instance with vm_state active and task_state reboot_started_hard.
Apr 14 00:33:05 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:33:05 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:33:05 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:33:06 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:33:06 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:33:07 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Removed pending event for 61d1abb2-3c80-48de-a26b-1c8030081105 due to event {{(pid=82479) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 00:33:07 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681432387.4447796, 61d1abb2-3c80-48de-a26b-1c8030081105 => Resumed> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:33:07 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] VM Resumed (Lifecycle Event)
Apr 14 00:33:07 user nova-compute[82479]: DEBUG nova.compute.manager [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Instance event wait completed in 0 seconds for  {{(pid=82479) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 00:33:07 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Instance rebooted successfully.
Apr 14 00:33:07 user nova-compute[82479]: DEBUG nova.compute.manager [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:33:07 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:33:07 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:33:07 user nova-compute[82479]: DEBUG nova.compute.manager [req-bca7cd6a-0054-4707-bbb8-0ca585535008 req-8e59ca8a-c915-4b35-a828-dc687f71274d service nova] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Received event network-vif-plugged-bf80bc9c-a453-4809-8eb4-e57fe015351f {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:33:07 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-bca7cd6a-0054-4707-bbb8-0ca585535008 req-8e59ca8a-c915-4b35-a828-dc687f71274d service nova] Acquiring lock "61d1abb2-3c80-48de-a26b-1c8030081105-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:33:07 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-bca7cd6a-0054-4707-bbb8-0ca585535008 req-8e59ca8a-c915-4b35-a828-dc687f71274d service nova] Lock "61d1abb2-3c80-48de-a26b-1c8030081105-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:33:07 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-bca7cd6a-0054-4707-bbb8-0ca585535008 req-8e59ca8a-c915-4b35-a828-dc687f71274d service nova] Lock "61d1abb2-3c80-48de-a26b-1c8030081105-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:33:07 user nova-compute[82479]: DEBUG nova.compute.manager [req-bca7cd6a-0054-4707-bbb8-0ca585535008 req-8e59ca8a-c915-4b35-a828-dc687f71274d service nova] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] No waiting events found dispatching network-vif-plugged-bf80bc9c-a453-4809-8eb4-e57fe015351f {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:33:07 user nova-compute[82479]: WARNING nova.compute.manager [req-bca7cd6a-0054-4707-bbb8-0ca585535008 req-8e59ca8a-c915-4b35-a828-dc687f71274d service nova] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Received unexpected event network-vif-plugged-bf80bc9c-a453-4809-8eb4-e57fe015351f for instance with vm_state active and task_state reboot_started_hard.
Apr 14 00:33:07 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Apr 14 00:33:07 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681432387.4464064, 61d1abb2-3c80-48de-a26b-1c8030081105 => Started> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:33:07 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] VM Started (Lifecycle Event)
Apr 14 00:33:07 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:33:07 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:33:07 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d924a0a9-ed61-4a06-a09e-d8afd4073864 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "61d1abb2-3c80-48de-a26b-1c8030081105" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.605s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:33:07 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:33:08 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:33:08 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:33:09 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:33:10 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:33:11 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:33:11 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82479) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 00:33:11 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:33:12 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:33:12 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:33:12 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:33:12 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:33:12 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Auditing locally available compute resources for user (node: user) {{(pid=82479) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 00:33:12 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d04f694-0eba-46c3-a617-97d3de666de8/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:33:12 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d04f694-0eba-46c3-a617-97d3de666de8/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:33:12 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d04f694-0eba-46c3-a617-97d3de666de8/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:33:13 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d04f694-0eba-46c3-a617-97d3de666de8/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:33:13 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61d1abb2-3c80-48de-a26b-1c8030081105/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:33:13 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61d1abb2-3c80-48de-a26b-1c8030081105/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:33:13 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61d1abb2-3c80-48de-a26b-1c8030081105/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:33:13 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61d1abb2-3c80-48de-a26b-1c8030081105/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:33:13 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:33:13 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:33:13 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:33:13 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Hypervisor/Node resource view: name=user free_ram=8586MB free_disk=26.15976333618164GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82479) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 00:33:13 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:33:13 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:33:13 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 2d04f694-0eba-46c3-a617-97d3de666de8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:33:13 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 61d1abb2-3c80-48de-a26b-1c8030081105 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:33:13 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 00:33:13 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 00:33:13 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:33:13 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:33:13 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:33:13 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Compute_service record updated for user:user {{(pid=82479) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 00:33:13 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.229s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:33:15 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:33:18 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:33:18 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:33:18 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:33:18 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:33:18 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:33:18 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:33:21 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:33:23 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:33:24 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:33:26 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:33:28 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:33:33 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:33:33 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:33:33 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:33:33 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:33:33 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:33:33 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:33:36 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:33:38 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:33:43 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:33:43 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:33:43 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:33:43 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:33:43 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:33:43 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:33:48 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:33:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:33:53 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:33:58 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:34:01 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:34:01 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Starting heal instance info cache {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 00:34:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "refresh_cache-61d1abb2-3c80-48de-a26b-1c8030081105" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:34:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquired lock "refresh_cache-61d1abb2-3c80-48de-a26b-1c8030081105" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:34:01 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Forcefully refreshing network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 00:34:02 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Updating instance_info_cache with network_info: [{"id": "bf80bc9c-a453-4809-8eb4-e57fe015351f", "address": "fa:16:3e:fc:5e:3a", "network": {"id": "d7b8d180-999a-4f41-b677-e83b1c24a8a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1461510401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46777f523af54eecb0e3260f14df7909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf80bc9c-a4", "ovs_interfaceid": "bf80bc9c-a453-4809-8eb4-e57fe015351f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:34:02 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Releasing lock "refresh_cache-61d1abb2-3c80-48de-a26b-1c8030081105" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:34:02 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Updated the network info_cache for instance {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 00:34:03 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:34:03 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:34:03 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:34:03 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:34:03 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:34:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:34:04 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:34:08 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:34:09 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:34:09 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:34:09 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:34:09 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:34:09 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:34:09 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:34:09 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:34:09 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:34:10 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:34:11 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:34:11 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82479) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 00:34:14 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:34:14 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:34:14 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:34:14 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:34:14 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:34:14 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Auditing locally available compute resources for user (node: user) {{(pid=82479) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 00:34:14 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d04f694-0eba-46c3-a617-97d3de666de8/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:34:14 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d04f694-0eba-46c3-a617-97d3de666de8/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:34:14 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d04f694-0eba-46c3-a617-97d3de666de8/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:34:14 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d04f694-0eba-46c3-a617-97d3de666de8/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:34:14 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61d1abb2-3c80-48de-a26b-1c8030081105/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:34:15 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61d1abb2-3c80-48de-a26b-1c8030081105/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:34:15 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61d1abb2-3c80-48de-a26b-1c8030081105/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:34:15 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61d1abb2-3c80-48de-a26b-1c8030081105/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:34:15 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:34:15 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:34:15 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:34:15 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Hypervisor/Node resource view: name=user free_ram=8706MB free_disk=26.157806396484375GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82479) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 00:34:15 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:34:15 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:34:15 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 2d04f694-0eba-46c3-a617-97d3de666de8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:34:15 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 61d1abb2-3c80-48de-a26b-1c8030081105 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:34:15 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 00:34:15 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 00:34:15 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:34:15 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:34:15 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Compute_service record updated for user:user {{(pid=82479) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 00:34:15 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.199s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:34:16 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:34:19 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:34:19 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:34:19 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:34:19 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:34:19 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:34:19 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:34:24 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:34:26 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:34:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:34:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:34:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:34:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:34:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:34:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:34:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:34:39 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:34:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:34:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:34:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:34:51 user nova-compute[82479]: DEBUG nova.compute.manager [req-ab6a28cd-793e-456a-b9c1-aa1ae0910538 req-633f4ee6-f4d3-4e98-b718-338ed64f4cc1 service nova] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Received event network-changed-bf80bc9c-a453-4809-8eb4-e57fe015351f {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:34:51 user nova-compute[82479]: DEBUG nova.compute.manager [req-ab6a28cd-793e-456a-b9c1-aa1ae0910538 req-633f4ee6-f4d3-4e98-b718-338ed64f4cc1 service nova] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Refreshing instance network info cache due to event network-changed-bf80bc9c-a453-4809-8eb4-e57fe015351f. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:34:51 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-ab6a28cd-793e-456a-b9c1-aa1ae0910538 req-633f4ee6-f4d3-4e98-b718-338ed64f4cc1 service nova] Acquiring lock "refresh_cache-61d1abb2-3c80-48de-a26b-1c8030081105" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:34:51 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-ab6a28cd-793e-456a-b9c1-aa1ae0910538 req-633f4ee6-f4d3-4e98-b718-338ed64f4cc1 service nova] Acquired lock "refresh_cache-61d1abb2-3c80-48de-a26b-1c8030081105" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:34:51 user nova-compute[82479]: DEBUG nova.network.neutron [req-ab6a28cd-793e-456a-b9c1-aa1ae0910538 req-633f4ee6-f4d3-4e98-b718-338ed64f4cc1 service nova] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Refreshing network info cache for port bf80bc9c-a453-4809-8eb4-e57fe015351f {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:34:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:34:51 user nova-compute[82479]: DEBUG nova.network.neutron [req-ab6a28cd-793e-456a-b9c1-aa1ae0910538 req-633f4ee6-f4d3-4e98-b718-338ed64f4cc1 service nova] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Updated VIF entry in instance network info cache for port bf80bc9c-a453-4809-8eb4-e57fe015351f. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:34:51 user nova-compute[82479]: DEBUG nova.network.neutron [req-ab6a28cd-793e-456a-b9c1-aa1ae0910538 req-633f4ee6-f4d3-4e98-b718-338ed64f4cc1 service nova] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Updating instance_info_cache with network_info: [{"id": "bf80bc9c-a453-4809-8eb4-e57fe015351f", "address": "fa:16:3e:fc:5e:3a", "network": {"id": "d7b8d180-999a-4f41-b677-e83b1c24a8a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1461510401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46777f523af54eecb0e3260f14df7909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf80bc9c-a4", "ovs_interfaceid": "bf80bc9c-a453-4809-8eb4-e57fe015351f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:34:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-ab6a28cd-793e-456a-b9c1-aa1ae0910538 req-633f4ee6-f4d3-4e98-b718-338ed64f4cc1 service nova] Releasing lock "refresh_cache-61d1abb2-3c80-48de-a26b-1c8030081105" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:34:52 user nova-compute[82479]: DEBUG nova.compute.manager [req-832ac897-c3f1-44a7-9c78-62c3293cca6d req-bd202076-a622-4df3-b1c9-de2c9f6000d7 service nova] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Received event network-changed-bf80bc9c-a453-4809-8eb4-e57fe015351f {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:34:52 user nova-compute[82479]: DEBUG nova.compute.manager [req-832ac897-c3f1-44a7-9c78-62c3293cca6d req-bd202076-a622-4df3-b1c9-de2c9f6000d7 service nova] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Refreshing instance network info cache due to event network-changed-bf80bc9c-a453-4809-8eb4-e57fe015351f. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:34:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-832ac897-c3f1-44a7-9c78-62c3293cca6d req-bd202076-a622-4df3-b1c9-de2c9f6000d7 service nova] Acquiring lock "refresh_cache-61d1abb2-3c80-48de-a26b-1c8030081105" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:34:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-832ac897-c3f1-44a7-9c78-62c3293cca6d req-bd202076-a622-4df3-b1c9-de2c9f6000d7 service nova] Acquired lock "refresh_cache-61d1abb2-3c80-48de-a26b-1c8030081105" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:34:52 user nova-compute[82479]: DEBUG nova.network.neutron [req-832ac897-c3f1-44a7-9c78-62c3293cca6d req-bd202076-a622-4df3-b1c9-de2c9f6000d7 service nova] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Refreshing network info cache for port bf80bc9c-a453-4809-8eb4-e57fe015351f {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:34:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-728271bc-9cf3-427f-b312-6dd320d229ea tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "61d1abb2-3c80-48de-a26b-1c8030081105" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:34:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-728271bc-9cf3-427f-b312-6dd320d229ea tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "61d1abb2-3c80-48de-a26b-1c8030081105" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:34:52 user nova-compute[82479]: INFO nova.compute.manager [None req-728271bc-9cf3-427f-b312-6dd320d229ea tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Detaching volume 0f9e1f92-e142-4576-a375-32dc12d96c82
Apr 14 00:34:52 user nova-compute[82479]: INFO nova.virt.block_device [None req-728271bc-9cf3-427f-b312-6dd320d229ea tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Attempting to driver detach volume 0f9e1f92-e142-4576-a375-32dc12d96c82 from mountpoint /dev/vdb
Apr 14 00:34:52 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-728271bc-9cf3-427f-b312-6dd320d229ea tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Attempting to detach device vdb from instance 61d1abb2-3c80-48de-a26b-1c8030081105 from the persistent domain config. {{(pid=82479) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 00:34:52 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-728271bc-9cf3-427f-b312-6dd320d229ea tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 00:34:52 user nova-compute[82479]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:34:52 user nova-compute[82479]:   <source dev="/dev/sdb"/>
Apr 14 00:34:52 user nova-compute[82479]:   <target dev="vdb" bus="virtio"/>
Apr 14 00:34:52 user nova-compute[82479]:   <serial>0f9e1f92-e142-4576-a375-32dc12d96c82</serial>
Apr 14 00:34:52 user nova-compute[82479]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 00:34:52 user nova-compute[82479]: </disk>
Apr 14 00:34:52 user nova-compute[82479]:  {{(pid=82479) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 00:34:52 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-728271bc-9cf3-427f-b312-6dd320d229ea tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Successfully detached device vdb from instance 61d1abb2-3c80-48de-a26b-1c8030081105 from the persistent domain config.
Apr 14 00:34:52 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-728271bc-9cf3-427f-b312-6dd320d229ea tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 61d1abb2-3c80-48de-a26b-1c8030081105 from the live domain config. {{(pid=82479) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 00:34:52 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-728271bc-9cf3-427f-b312-6dd320d229ea tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 00:34:52 user nova-compute[82479]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:34:52 user nova-compute[82479]:   <source dev="/dev/sdb"/>
Apr 14 00:34:52 user nova-compute[82479]:   <target dev="vdb" bus="virtio"/>
Apr 14 00:34:52 user nova-compute[82479]:   <serial>0f9e1f92-e142-4576-a375-32dc12d96c82</serial>
Apr 14 00:34:52 user nova-compute[82479]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 00:34:52 user nova-compute[82479]: </disk>
Apr 14 00:34:52 user nova-compute[82479]:  {{(pid=82479) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 00:34:52 user nova-compute[82479]: DEBUG nova.network.neutron [req-832ac897-c3f1-44a7-9c78-62c3293cca6d req-bd202076-a622-4df3-b1c9-de2c9f6000d7 service nova] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Updated VIF entry in instance network info cache for port bf80bc9c-a453-4809-8eb4-e57fe015351f. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:34:52 user nova-compute[82479]: DEBUG nova.network.neutron [req-832ac897-c3f1-44a7-9c78-62c3293cca6d req-bd202076-a622-4df3-b1c9-de2c9f6000d7 service nova] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Updating instance_info_cache with network_info: [{"id": "bf80bc9c-a453-4809-8eb4-e57fe015351f", "address": "fa:16:3e:fc:5e:3a", "network": {"id": "d7b8d180-999a-4f41-b677-e83b1c24a8a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1461510401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46777f523af54eecb0e3260f14df7909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf80bc9c-a4", "ovs_interfaceid": "bf80bc9c-a453-4809-8eb4-e57fe015351f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:34:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-832ac897-c3f1-44a7-9c78-62c3293cca6d req-bd202076-a622-4df3-b1c9-de2c9f6000d7 service nova] Releasing lock "refresh_cache-61d1abb2-3c80-48de-a26b-1c8030081105" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:34:53 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Received event <DeviceRemovedEvent: 1681432493.0903156, 61d1abb2-3c80-48de-a26b-1c8030081105 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82479) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 00:34:53 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-728271bc-9cf3-427f-b312-6dd320d229ea tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 61d1abb2-3c80-48de-a26b-1c8030081105 {{(pid=82479) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 00:34:53 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-728271bc-9cf3-427f-b312-6dd320d229ea tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Successfully detached device vdb from instance 61d1abb2-3c80-48de-a26b-1c8030081105 from the live domain config.
Apr 14 00:34:53 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-728271bc-9cf3-427f-b312-6dd320d229ea tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] calling os-brick to detach iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 00:34:53 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-728271bc-9cf3-427f-b312-6dd320d229ea tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, {'target_iqn': 'iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nrgBiqQL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:34:53 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-728271bc-9cf3-427f-b312-6dd320d229ea tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:34:53 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-728271bc-9cf3-427f-b312-6dd320d229ea tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:34:53 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-728271bc-9cf3-427f-b312-6dd320d229ea tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:34:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:34:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:34:53 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba9ac7d-c009-480b-b729-82842348f22d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:34:53 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-728271bc-9cf3-427f-b312-6dd320d229ea tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 00:34:53 user nova-compute[82479]: No targets found.
Apr 14 00:34:53 user nova-compute[82479]: iSNS:
Apr 14 00:34:53 user nova-compute[82479]: No targets found.
Apr 14 00:34:53 user nova-compute[82479]: STATIC:
Apr 14 00:34:53 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82
Apr 14 00:34:53 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:34:53 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:34:53 user nova-compute[82479]: FIRMWARE:
Apr 14 00:34:53 user nova-compute[82479]: No targets found.
Apr 14 00:34:53 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:34:53 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-728271bc-9cf3-427f-b312-6dd320d229ea tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 00:34:53 user nova-compute[82479]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 00:34:53 user nova-compute[82479]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82479) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 00:34:53 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-728271bc-9cf3-427f-b312-6dd320d229ea tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82', 0)] {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 00:34:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:34:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:34:53 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98c453e-ce20-489d-9df8-75eb280d2932]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:34:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:34:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:34:53 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec225f1-7406-4680-b9e0-80fc455b6a87]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:34:53 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-728271bc-9cf3-427f-b312-6dd320d229ea tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 (non-flash)
Apr 14 00:34:53 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:34:53 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-728271bc-9cf3-427f-b312-6dd320d229ea tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 (non-flash)
Apr 14 00:34:53 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:34:53 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-728271bc-9cf3-427f-b312-6dd320d229ea tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f33387ae5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82'): ({'sdb'}, set())}) {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 00:34:53 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-728271bc-9cf3-427f-b312-6dd320d229ea tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Removing single pathed devices sdb {{(pid=82479) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 00:34:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:34:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:34:53 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1551b1-041a-4fdb-a5d5-64a92b2dda3d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:34:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:34:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:34:53 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[db801fd3-aadd-43be-8426-fb4e1975a921]: (4, ('ok\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:34:53 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-728271bc-9cf3-427f-b312-6dd320d229ea tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Flushing IO for device /dev/sdb {{(pid=82479) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 00:34:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:34:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:34:53 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[e081f279-9ab3-4338-9f32-f0c96e81e7ad]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:34:53 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-728271bc-9cf3-427f-b312-6dd320d229ea tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82479) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 00:34:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:34:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:34:53 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[53fb90b4-5740-48fc-a60c-84017e769863]: (4, ('1', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:34:53 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-728271bc-9cf3-427f-b312-6dd320d229ea tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 00:34:53 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-728271bc-9cf3-427f-b312-6dd320d229ea tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] SCSI volumes sdb have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 00:34:53 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-728271bc-9cf3-427f-b312-6dd320d229ea tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82')] {{(pid=82479) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 00:34:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:34:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:34:53 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2220a6d-c9f6-4bbe-aa69-8f73cb91c2a1]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:34:53 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-728271bc-9cf3-427f-b312-6dd320d229ea tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:34:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 -p 172.16.0.220:3260 --logout {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:34:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:34:53 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[febb4852-9c79-47eb-9d37-9ec236eb48fd]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:34:53 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-728271bc-9cf3-427f-b312-6dd320d229ea tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82, portal: 172.16.0.220,3260]
Apr 14 00:34:53 user nova-compute[82479]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82, portal: 172.16.0.220,3260] successful.
Apr 14 00:34:53 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:34:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 -p 172.16.0.220:3260 --op delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:34:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:34:53 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ebdd9f5-96e8-417c-ac56-e9b5ae08f4a3]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:34:53 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-728271bc-9cf3-427f-b312-6dd320d229ea tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:34:53 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-728271bc-9cf3-427f-b312-6dd320d229ea tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:34:53 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-728271bc-9cf3-427f-b312-6dd320d229ea tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] <== disconnect_volume: return (287ms) None {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:34:53 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-728271bc-9cf3-427f-b312-6dd320d229ea tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Disconnected iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 00:34:54 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:34:54 user nova-compute[82479]: DEBUG nova.objects.instance [None req-728271bc-9cf3-427f-b312-6dd320d229ea tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lazy-loading 'flavor' on Instance uuid 61d1abb2-3c80-48de-a26b-1c8030081105 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:34:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-728271bc-9cf3-427f-b312-6dd320d229ea tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "61d1abb2-3c80-48de-a26b-1c8030081105" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.635s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:34:59 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:35:01 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:35:01 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Starting heal instance info cache {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 00:35:01 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Rebuilding the list of instances to heal {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 00:35:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "refresh_cache-2d04f694-0eba-46c3-a617-97d3de666de8" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:35:01 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquired lock "refresh_cache-2d04f694-0eba-46c3-a617-97d3de666de8" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:35:01 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Forcefully refreshing network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 00:35:01 user nova-compute[82479]: DEBUG nova.objects.instance [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lazy-loading 'info_cache' on Instance uuid 2d04f694-0eba-46c3-a617-97d3de666de8 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:35:02 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Updating instance_info_cache with network_info: [{"id": "e7556e77-8734-4ef9-b260-2503b06b73bc", "address": "fa:16:3e:5a:d1:62", "network": {"id": "8b306bb0-c969-4918-a696-dd539eaa3a21", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1341077591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e46ba54fdcdb45368f457001f26a281b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7556e77-87", "ovs_interfaceid": "e7556e77-8734-4ef9-b260-2503b06b73bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:35:02 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Releasing lock "refresh_cache-2d04f694-0eba-46c3-a617-97d3de666de8" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:35:02 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Updated the network info_cache for instance {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 00:35:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:35:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:35:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:35:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:35:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:35:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:35:04 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:35:06 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:35:09 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:35:09 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:35:09 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:35:09 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:35:09 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:35:09 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:35:09 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:35:10 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:35:10 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:35:10 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:35:12 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:35:12 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82479) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 00:35:14 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:35:14 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:35:14 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:35:14 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:35:14 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:35:14 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Auditing locally available compute resources for user (node: user) {{(pid=82479) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 00:35:14 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d04f694-0eba-46c3-a617-97d3de666de8/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:35:14 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d04f694-0eba-46c3-a617-97d3de666de8/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:35:14 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d04f694-0eba-46c3-a617-97d3de666de8/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:35:14 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d04f694-0eba-46c3-a617-97d3de666de8/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:35:14 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61d1abb2-3c80-48de-a26b-1c8030081105/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:35:15 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61d1abb2-3c80-48de-a26b-1c8030081105/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:35:15 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61d1abb2-3c80-48de-a26b-1c8030081105/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:35:15 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/61d1abb2-3c80-48de-a26b-1c8030081105/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:35:15 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:35:15 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:35:15 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Hypervisor/Node resource view: name=user free_ram=8688MB free_disk=26.15692901611328GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82479) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 00:35:15 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:35:15 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:35:15 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 2d04f694-0eba-46c3-a617-97d3de666de8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:35:15 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 61d1abb2-3c80-48de-a26b-1c8030081105 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:35:15 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 00:35:15 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 00:35:15 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:35:15 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:35:15 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Compute_service record updated for user:user {{(pid=82479) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 00:35:15 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.223s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:35:16 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:35:19 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:35:24 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:35:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:35:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:35:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:35:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:35:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:35:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:35:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:35:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:35:39 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:35:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:35:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:35:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:35:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:35:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:35:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:35:47 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-eaae6b17-fa9c-4336-aa7d-87b88272e9fa tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "61d1abb2-3c80-48de-a26b-1c8030081105" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:35:47 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-eaae6b17-fa9c-4336-aa7d-87b88272e9fa tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "61d1abb2-3c80-48de-a26b-1c8030081105" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:35:47 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-eaae6b17-fa9c-4336-aa7d-87b88272e9fa tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "61d1abb2-3c80-48de-a26b-1c8030081105-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:35:47 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-eaae6b17-fa9c-4336-aa7d-87b88272e9fa tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "61d1abb2-3c80-48de-a26b-1c8030081105-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:35:47 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-eaae6b17-fa9c-4336-aa7d-87b88272e9fa tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "61d1abb2-3c80-48de-a26b-1c8030081105-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:35:47 user nova-compute[82479]: INFO nova.compute.manager [None req-eaae6b17-fa9c-4336-aa7d-87b88272e9fa tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Terminating instance
Apr 14 00:35:47 user nova-compute[82479]: DEBUG nova.compute.manager [None req-eaae6b17-fa9c-4336-aa7d-87b88272e9fa tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Start destroying the instance on the hypervisor. {{(pid=82479) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 00:35:47 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:35:47 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:35:47 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:35:47 user nova-compute[82479]: DEBUG nova.compute.manager [req-5074067a-7c5e-46f0-81cb-ce0889022007 req-a2a7a180-5c9e-479a-bb98-29e9f6acca78 service nova] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Received event network-vif-unplugged-bf80bc9c-a453-4809-8eb4-e57fe015351f {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:35:47 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-5074067a-7c5e-46f0-81cb-ce0889022007 req-a2a7a180-5c9e-479a-bb98-29e9f6acca78 service nova] Acquiring lock "61d1abb2-3c80-48de-a26b-1c8030081105-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:35:47 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-5074067a-7c5e-46f0-81cb-ce0889022007 req-a2a7a180-5c9e-479a-bb98-29e9f6acca78 service nova] Lock "61d1abb2-3c80-48de-a26b-1c8030081105-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:35:47 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-5074067a-7c5e-46f0-81cb-ce0889022007 req-a2a7a180-5c9e-479a-bb98-29e9f6acca78 service nova] Lock "61d1abb2-3c80-48de-a26b-1c8030081105-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:35:47 user nova-compute[82479]: DEBUG nova.compute.manager [req-5074067a-7c5e-46f0-81cb-ce0889022007 req-a2a7a180-5c9e-479a-bb98-29e9f6acca78 service nova] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] No waiting events found dispatching network-vif-unplugged-bf80bc9c-a453-4809-8eb4-e57fe015351f {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:35:47 user nova-compute[82479]: DEBUG nova.compute.manager [req-5074067a-7c5e-46f0-81cb-ce0889022007 req-a2a7a180-5c9e-479a-bb98-29e9f6acca78 service nova] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Received event network-vif-unplugged-bf80bc9c-a453-4809-8eb4-e57fe015351f for instance with task_state deleting. {{(pid=82479) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 00:35:48 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Instance destroyed successfully.
Apr 14 00:35:48 user nova-compute[82479]: DEBUG nova.objects.instance [None req-eaae6b17-fa9c-4336-aa7d-87b88272e9fa tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lazy-loading 'resources' on Instance uuid 61d1abb2-3c80-48de-a26b-1c8030081105 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:35:48 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-eaae6b17-fa9c-4336-aa7d-87b88272e9fa tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:30:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-135186904',display_name='tempest-TestMinimumBasicScenario-server-135186904',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-135186904',id=38,image_ref='69b3b215-794a-4b99-9d8b-56aa656eaf64',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbLqmsfqYW8VR6EP1yhbU8GU2QfZRlgJel1XZcbWJfjZ9yg1Nmlkybblt9S+WzcdNDudfvyq9SY0bU2LjYjKMTNT31rkJQgE4HvdP1jaLmQd6JssBlbCFkCHFCD6jWrNw==',key_name='tempest-TestMinimumBasicScenario-1820486155',keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:30:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46777f523af54eecb0e3260f14df7909',ramdisk_id='',reservation_id='r-zjujq50w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='69b3b215-794a-4b99-9d8b-56aa656eaf64',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-598834355',owner_user_name='tempest-TestMinimumBasicScenario-598834355-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T00:33:08Z,user_data=None,user_id='e5ad76f13b78448887913c4d0bcb16af',uuid=61d1abb2-3c80-48de-a26b-1c8030081105,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf80bc9c-a453-4809-8eb4-e57fe015351f", "address": "fa:16:3e:fc:5e:3a", "network": {"id": "d7b8d180-999a-4f41-b677-e83b1c24a8a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1461510401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46777f523af54eecb0e3260f14df7909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf80bc9c-a4", "ovs_interfaceid": "bf80bc9c-a453-4809-8eb4-e57fe015351f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 00:35:48 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-eaae6b17-fa9c-4336-aa7d-87b88272e9fa tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Converting VIF {"id": "bf80bc9c-a453-4809-8eb4-e57fe015351f", "address": "fa:16:3e:fc:5e:3a", "network": {"id": "d7b8d180-999a-4f41-b677-e83b1c24a8a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1461510401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46777f523af54eecb0e3260f14df7909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf80bc9c-a4", "ovs_interfaceid": "bf80bc9c-a453-4809-8eb4-e57fe015351f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:35:48 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-eaae6b17-fa9c-4336-aa7d-87b88272e9fa tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fc:5e:3a,bridge_name='br-int',has_traffic_filtering=True,id=bf80bc9c-a453-4809-8eb4-e57fe015351f,network=Network(d7b8d180-999a-4f41-b677-e83b1c24a8a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf80bc9c-a4') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:35:48 user nova-compute[82479]: DEBUG os_vif [None req-eaae6b17-fa9c-4336-aa7d-87b88272e9fa tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:5e:3a,bridge_name='br-int',has_traffic_filtering=True,id=bf80bc9c-a453-4809-8eb4-e57fe015351f,network=Network(d7b8d180-999a-4f41-b677-e83b1c24a8a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf80bc9c-a4') {{(pid=82479) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 00:35:48 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:35:48 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbf80bc9c-a4, bridge=br-int, if_exists=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:35:48 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:35:48 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:35:48 user nova-compute[82479]: INFO os_vif [None req-eaae6b17-fa9c-4336-aa7d-87b88272e9fa tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:5e:3a,bridge_name='br-int',has_traffic_filtering=True,id=bf80bc9c-a453-4809-8eb4-e57fe015351f,network=Network(d7b8d180-999a-4f41-b677-e83b1c24a8a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf80bc9c-a4')
Apr 14 00:35:48 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-eaae6b17-fa9c-4336-aa7d-87b88272e9fa tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Deleting instance files /opt/stack/data/nova/instances/61d1abb2-3c80-48de-a26b-1c8030081105_del
Apr 14 00:35:48 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-eaae6b17-fa9c-4336-aa7d-87b88272e9fa tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Deletion of /opt/stack/data/nova/instances/61d1abb2-3c80-48de-a26b-1c8030081105_del complete
Apr 14 00:35:48 user nova-compute[82479]: INFO nova.compute.manager [None req-eaae6b17-fa9c-4336-aa7d-87b88272e9fa tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Took 0.83 seconds to destroy the instance on the hypervisor.
Apr 14 00:35:48 user nova-compute[82479]: DEBUG oslo.service.loopingcall [None req-eaae6b17-fa9c-4336-aa7d-87b88272e9fa tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82479) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 00:35:48 user nova-compute[82479]: DEBUG nova.compute.manager [-] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Deallocating network for instance {{(pid=82479) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 00:35:48 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] deallocate_for_instance() {{(pid=82479) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 00:35:48 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Updating instance_info_cache with network_info: [] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:35:48 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Took 0.65 seconds to deallocate network for instance.
Apr 14 00:35:48 user nova-compute[82479]: DEBUG nova.compute.manager [req-88d6c400-8965-4ded-8068-402fa63891b9 req-780a6bcf-956b-41a4-a79c-4f21f643b7a4 service nova] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Received event network-vif-deleted-bf80bc9c-a453-4809-8eb4-e57fe015351f {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:35:48 user nova-compute[82479]: INFO nova.compute.manager [req-88d6c400-8965-4ded-8068-402fa63891b9 req-780a6bcf-956b-41a4-a79c-4f21f643b7a4 service nova] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Neutron deleted interface bf80bc9c-a453-4809-8eb4-e57fe015351f; detaching it from the instance and deleting it from the info cache
Apr 14 00:35:48 user nova-compute[82479]: DEBUG nova.network.neutron [req-88d6c400-8965-4ded-8068-402fa63891b9 req-780a6bcf-956b-41a4-a79c-4f21f643b7a4 service nova] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Updating instance_info_cache with network_info: [] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:35:48 user nova-compute[82479]: DEBUG nova.compute.manager [req-88d6c400-8965-4ded-8068-402fa63891b9 req-780a6bcf-956b-41a4-a79c-4f21f643b7a4 service nova] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Detach interface failed, port_id=bf80bc9c-a453-4809-8eb4-e57fe015351f, reason: Instance 61d1abb2-3c80-48de-a26b-1c8030081105 could not be found. {{(pid=82479) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 00:35:49 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-eaae6b17-fa9c-4336-aa7d-87b88272e9fa tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:35:49 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-eaae6b17-fa9c-4336-aa7d-87b88272e9fa tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:35:49 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-eaae6b17-fa9c-4336-aa7d-87b88272e9fa tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:35:49 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-eaae6b17-fa9c-4336-aa7d-87b88272e9fa tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:35:49 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-eaae6b17-fa9c-4336-aa7d-87b88272e9fa tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.147s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:35:49 user nova-compute[82479]: INFO nova.scheduler.client.report [None req-eaae6b17-fa9c-4336-aa7d-87b88272e9fa tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Deleted allocations for instance 61d1abb2-3c80-48de-a26b-1c8030081105
Apr 14 00:35:49 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-eaae6b17-fa9c-4336-aa7d-87b88272e9fa tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "61d1abb2-3c80-48de-a26b-1c8030081105" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.826s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:35:50 user nova-compute[82479]: DEBUG nova.compute.manager [req-cff005cc-41b9-4e2c-958d-61298bad3c9e req-b85c2f59-4a3a-4ee6-b0a0-05bb9b1a6ff7 service nova] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Received event network-vif-plugged-bf80bc9c-a453-4809-8eb4-e57fe015351f {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:35:50 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-cff005cc-41b9-4e2c-958d-61298bad3c9e req-b85c2f59-4a3a-4ee6-b0a0-05bb9b1a6ff7 service nova] Acquiring lock "61d1abb2-3c80-48de-a26b-1c8030081105-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:35:50 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-cff005cc-41b9-4e2c-958d-61298bad3c9e req-b85c2f59-4a3a-4ee6-b0a0-05bb9b1a6ff7 service nova] Lock "61d1abb2-3c80-48de-a26b-1c8030081105-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:35:50 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-cff005cc-41b9-4e2c-958d-61298bad3c9e req-b85c2f59-4a3a-4ee6-b0a0-05bb9b1a6ff7 service nova] Lock "61d1abb2-3c80-48de-a26b-1c8030081105-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:35:50 user nova-compute[82479]: DEBUG nova.compute.manager [req-cff005cc-41b9-4e2c-958d-61298bad3c9e req-b85c2f59-4a3a-4ee6-b0a0-05bb9b1a6ff7 service nova] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] No waiting events found dispatching network-vif-plugged-bf80bc9c-a453-4809-8eb4-e57fe015351f {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:35:50 user nova-compute[82479]: WARNING nova.compute.manager [req-cff005cc-41b9-4e2c-958d-61298bad3c9e req-b85c2f59-4a3a-4ee6-b0a0-05bb9b1a6ff7 service nova] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Received unexpected event network-vif-plugged-bf80bc9c-a453-4809-8eb4-e57fe015351f for instance with vm_state deleted and task_state None.
Apr 14 00:35:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:35:53 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:35:58 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:36:01 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:36:01 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Starting heal instance info cache {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 00:36:01 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Didn't find any instances for network info cache update. {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 00:36:03 user nova-compute[82479]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681432548.1771472, 61d1abb2-3c80-48de-a26b-1c8030081105 => Stopped> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:36:03 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] VM Stopped (Lifecycle Event)
Apr 14 00:36:03 user nova-compute[82479]: DEBUG nova.compute.manager [None req-712e2c76-1a24-418c-8d3b-1fd310343e87 None None] [instance: 61d1abb2-3c80-48de-a26b-1c8030081105] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:36:03 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:36:05 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:36:06 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:36:06 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Cleaning up deleted instances {{(pid=82479) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 00:36:06 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] There are 0 instances to clean {{(pid=82479) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 00:36:08 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:36:08 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:36:08 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Cleaning up deleted instances with incomplete migration  {{(pid=82479) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 00:36:10 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:36:10 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:36:11 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:36:12 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:36:12 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:36:12 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82479) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 00:36:13 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:36:15 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:36:16 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:36:16 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:36:16 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:36:16 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:36:16 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Auditing locally available compute resources for user (node: user) {{(pid=82479) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 00:36:16 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d04f694-0eba-46c3-a617-97d3de666de8/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:36:16 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d04f694-0eba-46c3-a617-97d3de666de8/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:36:16 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d04f694-0eba-46c3-a617-97d3de666de8/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:36:16 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d04f694-0eba-46c3-a617-97d3de666de8/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:36:17 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:36:17 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:36:17 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Hypervisor/Node resource view: name=user free_ram=8778MB free_disk=26.17595672607422GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82479) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 00:36:17 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:36:17 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:36:17 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 2d04f694-0eba-46c3-a617-97d3de666de8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:36:17 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 00:36:17 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 00:36:17 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Refreshing inventories for resource provider 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 00:36:17 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Updating ProviderTree inventory for provider 3847975a-19aa-4b27-9180-14b5cc49044a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 00:36:17 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Updating inventory in ProviderTree for provider 3847975a-19aa-4b27-9180-14b5cc49044a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 00:36:17 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Refreshing aggregate associations for resource provider 3847975a-19aa-4b27-9180-14b5cc49044a, aggregates: None {{(pid=82479) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 00:36:17 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Refreshing trait associations for resource provider 3847975a-19aa-4b27-9180-14b5cc49044a, traits: COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,HW_CPU_X86_SSE42,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO {{(pid=82479) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 00:36:17 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:36:17 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:36:17 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Compute_service record updated for user:user {{(pid=82479) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 00:36:17 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.519s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:36:18 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:36:23 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:36:28 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:36:28 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:36:33 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:36:37 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-99fbb088-9f9d-42be-8fc9-0c69c21bd473 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Acquiring lock "2d04f694-0eba-46c3-a617-97d3de666de8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:36:37 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-99fbb088-9f9d-42be-8fc9-0c69c21bd473 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "2d04f694-0eba-46c3-a617-97d3de666de8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:36:37 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-99fbb088-9f9d-42be-8fc9-0c69c21bd473 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Acquiring lock "2d04f694-0eba-46c3-a617-97d3de666de8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:36:37 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-99fbb088-9f9d-42be-8fc9-0c69c21bd473 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "2d04f694-0eba-46c3-a617-97d3de666de8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:36:37 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-99fbb088-9f9d-42be-8fc9-0c69c21bd473 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "2d04f694-0eba-46c3-a617-97d3de666de8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:36:37 user nova-compute[82479]: INFO nova.compute.manager [None req-99fbb088-9f9d-42be-8fc9-0c69c21bd473 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Terminating instance
Apr 14 00:36:37 user nova-compute[82479]: DEBUG nova.compute.manager [None req-99fbb088-9f9d-42be-8fc9-0c69c21bd473 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Start destroying the instance on the hypervisor. {{(pid=82479) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 00:36:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:36:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:36:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:36:37 user nova-compute[82479]: DEBUG nova.compute.manager [req-87d35c34-cf65-4647-9cab-a19cac12f195 req-00de6003-fa1c-4488-bce8-bd69e4d953f7 service nova] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Received event network-vif-unplugged-e7556e77-8734-4ef9-b260-2503b06b73bc {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:36:37 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-87d35c34-cf65-4647-9cab-a19cac12f195 req-00de6003-fa1c-4488-bce8-bd69e4d953f7 service nova] Acquiring lock "2d04f694-0eba-46c3-a617-97d3de666de8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:36:37 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-87d35c34-cf65-4647-9cab-a19cac12f195 req-00de6003-fa1c-4488-bce8-bd69e4d953f7 service nova] Lock "2d04f694-0eba-46c3-a617-97d3de666de8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:36:37 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-87d35c34-cf65-4647-9cab-a19cac12f195 req-00de6003-fa1c-4488-bce8-bd69e4d953f7 service nova] Lock "2d04f694-0eba-46c3-a617-97d3de666de8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:36:37 user nova-compute[82479]: DEBUG nova.compute.manager [req-87d35c34-cf65-4647-9cab-a19cac12f195 req-00de6003-fa1c-4488-bce8-bd69e4d953f7 service nova] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] No waiting events found dispatching network-vif-unplugged-e7556e77-8734-4ef9-b260-2503b06b73bc {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:36:37 user nova-compute[82479]: DEBUG nova.compute.manager [req-87d35c34-cf65-4647-9cab-a19cac12f195 req-00de6003-fa1c-4488-bce8-bd69e4d953f7 service nova] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Received event network-vif-unplugged-e7556e77-8734-4ef9-b260-2503b06b73bc for instance with task_state deleting. {{(pid=82479) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 00:36:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:36:37 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Instance destroyed successfully.
Apr 14 00:36:37 user nova-compute[82479]: DEBUG nova.objects.instance [None req-99fbb088-9f9d-42be-8fc9-0c69c21bd473 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lazy-loading 'resources' on Instance uuid 2d04f694-0eba-46c3-a617-97d3de666de8 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:36:37 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-99fbb088-9f9d-42be-8fc9-0c69c21bd473 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:27:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1146244002',display_name='tempest-ServersNegativeTestJSON-server-1146244002',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1146244002',id=35,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:27:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e46ba54fdcdb45368f457001f26a281b',ramdisk_id='',reservation_id='r-9vy07ao1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-495782531',owner_user_name='tempest-ServersNegativeTestJSON-495782531-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T00:27:59Z,user_data=None,user_id='67248d6b437547918b0cc2b0cdf29536',uuid=2d04f694-0eba-46c3-a617-97d3de666de8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e7556e77-8734-4ef9-b260-2503b06b73bc", "address": "fa:16:3e:5a:d1:62", "network": {"id": "8b306bb0-c969-4918-a696-dd539eaa3a21", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1341077591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e46ba54fdcdb45368f457001f26a281b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7556e77-87", "ovs_interfaceid": "e7556e77-8734-4ef9-b260-2503b06b73bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 00:36:37 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-99fbb088-9f9d-42be-8fc9-0c69c21bd473 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Converting VIF {"id": "e7556e77-8734-4ef9-b260-2503b06b73bc", "address": "fa:16:3e:5a:d1:62", "network": {"id": "8b306bb0-c969-4918-a696-dd539eaa3a21", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1341077591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e46ba54fdcdb45368f457001f26a281b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7556e77-87", "ovs_interfaceid": "e7556e77-8734-4ef9-b260-2503b06b73bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:36:37 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-99fbb088-9f9d-42be-8fc9-0c69c21bd473 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5a:d1:62,bridge_name='br-int',has_traffic_filtering=True,id=e7556e77-8734-4ef9-b260-2503b06b73bc,network=Network(8b306bb0-c969-4918-a696-dd539eaa3a21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7556e77-87') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:36:37 user nova-compute[82479]: DEBUG os_vif [None req-99fbb088-9f9d-42be-8fc9-0c69c21bd473 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:d1:62,bridge_name='br-int',has_traffic_filtering=True,id=e7556e77-8734-4ef9-b260-2503b06b73bc,network=Network(8b306bb0-c969-4918-a696-dd539eaa3a21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7556e77-87') {{(pid=82479) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 00:36:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:36:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape7556e77-87, bridge=br-int, if_exists=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:36:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:36:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:36:37 user nova-compute[82479]: INFO os_vif [None req-99fbb088-9f9d-42be-8fc9-0c69c21bd473 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:d1:62,bridge_name='br-int',has_traffic_filtering=True,id=e7556e77-8734-4ef9-b260-2503b06b73bc,network=Network(8b306bb0-c969-4918-a696-dd539eaa3a21),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7556e77-87')
Apr 14 00:36:37 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-99fbb088-9f9d-42be-8fc9-0c69c21bd473 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Deleting instance files /opt/stack/data/nova/instances/2d04f694-0eba-46c3-a617-97d3de666de8_del
Apr 14 00:36:37 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-99fbb088-9f9d-42be-8fc9-0c69c21bd473 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Deletion of /opt/stack/data/nova/instances/2d04f694-0eba-46c3-a617-97d3de666de8_del complete
Apr 14 00:36:37 user nova-compute[82479]: INFO nova.compute.manager [None req-99fbb088-9f9d-42be-8fc9-0c69c21bd473 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Took 0.86 seconds to destroy the instance on the hypervisor.
Apr 14 00:36:37 user nova-compute[82479]: DEBUG oslo.service.loopingcall [None req-99fbb088-9f9d-42be-8fc9-0c69c21bd473 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82479) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 00:36:37 user nova-compute[82479]: DEBUG nova.compute.manager [-] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Deallocating network for instance {{(pid=82479) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 00:36:37 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] deallocate_for_instance() {{(pid=82479) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 00:36:38 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Updating instance_info_cache with network_info: [] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:36:38 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Took 0.52 seconds to deallocate network for instance.
Apr 14 00:36:38 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-99fbb088-9f9d-42be-8fc9-0c69c21bd473 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:36:38 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-99fbb088-9f9d-42be-8fc9-0c69c21bd473 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:36:38 user nova-compute[82479]: DEBUG nova.compute.manager [req-1115fa41-fe3b-4e9a-a578-a49bcee68c7f req-6a3abc7c-d49b-4d43-b26d-64cb216d072a service nova] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Received event network-vif-deleted-e7556e77-8734-4ef9-b260-2503b06b73bc {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:36:38 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-99fbb088-9f9d-42be-8fc9-0c69c21bd473 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:36:38 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-99fbb088-9f9d-42be-8fc9-0c69c21bd473 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:36:38 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-99fbb088-9f9d-42be-8fc9-0c69c21bd473 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.107s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:36:38 user nova-compute[82479]: INFO nova.scheduler.client.report [None req-99fbb088-9f9d-42be-8fc9-0c69c21bd473 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Deleted allocations for instance 2d04f694-0eba-46c3-a617-97d3de666de8
Apr 14 00:36:38 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-99fbb088-9f9d-42be-8fc9-0c69c21bd473 tempest-ServersNegativeTestJSON-495782531 tempest-ServersNegativeTestJSON-495782531-project-member] Lock "2d04f694-0eba-46c3-a617-97d3de666de8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.675s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:36:39 user nova-compute[82479]: DEBUG nova.compute.manager [req-2fc62634-b234-461c-92b3-cfab1d75d35f req-6a890d65-1c1c-408e-8dee-96d8522df482 service nova] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Received event network-vif-plugged-e7556e77-8734-4ef9-b260-2503b06b73bc {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:36:39 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-2fc62634-b234-461c-92b3-cfab1d75d35f req-6a890d65-1c1c-408e-8dee-96d8522df482 service nova] Acquiring lock "2d04f694-0eba-46c3-a617-97d3de666de8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:36:39 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-2fc62634-b234-461c-92b3-cfab1d75d35f req-6a890d65-1c1c-408e-8dee-96d8522df482 service nova] Lock "2d04f694-0eba-46c3-a617-97d3de666de8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:36:39 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-2fc62634-b234-461c-92b3-cfab1d75d35f req-6a890d65-1c1c-408e-8dee-96d8522df482 service nova] Lock "2d04f694-0eba-46c3-a617-97d3de666de8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:36:39 user nova-compute[82479]: DEBUG nova.compute.manager [req-2fc62634-b234-461c-92b3-cfab1d75d35f req-6a890d65-1c1c-408e-8dee-96d8522df482 service nova] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] No waiting events found dispatching network-vif-plugged-e7556e77-8734-4ef9-b260-2503b06b73bc {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:36:39 user nova-compute[82479]: WARNING nova.compute.manager [req-2fc62634-b234-461c-92b3-cfab1d75d35f req-6a890d65-1c1c-408e-8dee-96d8522df482 service nova] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Received unexpected event network-vif-plugged-e7556e77-8734-4ef9-b260-2503b06b73bc for instance with vm_state deleted and task_state None.
Apr 14 00:36:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "0580f210-dd0b-4fc4-bcb2-e3db659e9cdc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:36:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "0580f210-dd0b-4fc4-bcb2-e3db659e9cdc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:36:41 user nova-compute[82479]: DEBUG nova.compute.manager [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Starting instance... {{(pid=82479) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 00:36:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:36:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:36:41 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82479) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 00:36:41 user nova-compute[82479]: INFO nova.compute.claims [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Claim successful on node user
Apr 14 00:36:41 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:36:41 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:36:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.211s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:36:41 user nova-compute[82479]: DEBUG nova.compute.manager [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Start building networks asynchronously for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 00:36:41 user nova-compute[82479]: DEBUG nova.compute.manager [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Allocating IP information in the background. {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 00:36:41 user nova-compute[82479]: DEBUG nova.network.neutron [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] allocate_for_instance() {{(pid=82479) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 00:36:41 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 00:36:41 user nova-compute[82479]: DEBUG nova.compute.manager [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Start building block device mappings for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 00:36:41 user nova-compute[82479]: DEBUG nova.policy [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e5ad76f13b78448887913c4d0bcb16af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46777f523af54eecb0e3260f14df7909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82479) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 00:36:41 user nova-compute[82479]: DEBUG nova.compute.manager [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Start spawning the instance on the hypervisor. {{(pid=82479) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 00:36:41 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Creating instance directory {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 00:36:41 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Creating image(s)
Apr 14 00:36:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "/opt/stack/data/nova/instances/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:36:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "/opt/stack/data/nova/instances/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:36:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "/opt/stack/data/nova/instances/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:36:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6c31422ec53b3e546a6532bebba7e376fae5e05d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:36:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6c31422ec53b3e546a6532bebba7e376fae5e05d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:36:42 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6c31422ec53b3e546a6532bebba7e376fae5e05d.part --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:36:42 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6c31422ec53b3e546a6532bebba7e376fae5e05d.part --force-share --output=json" returned: 0 in 0.135s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:36:42 user nova-compute[82479]: DEBUG nova.virt.images [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] 11c4f6c7-2375-4030-96df-c731bbfc9a8a was qcow2, converting to raw {{(pid=82479) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 00:36:42 user nova-compute[82479]: DEBUG nova.privsep.utils [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=82479) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 00:36:42 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6c31422ec53b3e546a6532bebba7e376fae5e05d.part /opt/stack/data/nova/instances/_base/6c31422ec53b3e546a6532bebba7e376fae5e05d.converted {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:36:42 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6c31422ec53b3e546a6532bebba7e376fae5e05d.part /opt/stack/data/nova/instances/_base/6c31422ec53b3e546a6532bebba7e376fae5e05d.converted" returned: 0 in 0.218s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:36:42 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6c31422ec53b3e546a6532bebba7e376fae5e05d.converted --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:36:42 user nova-compute[82479]: DEBUG nova.network.neutron [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Successfully created port: 79b2086a-dcff-4bb6-893c-d852a886de1d {{(pid=82479) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 00:36:42 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6c31422ec53b3e546a6532bebba7e376fae5e05d.converted --force-share --output=json" returned: 0 in 0.140s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:36:42 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6c31422ec53b3e546a6532bebba7e376fae5e05d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.872s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:36:42 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6c31422ec53b3e546a6532bebba7e376fae5e05d --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:36:42 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6c31422ec53b3e546a6532bebba7e376fae5e05d --force-share --output=json" returned: 0 in 0.136s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:36:42 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "6c31422ec53b3e546a6532bebba7e376fae5e05d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:36:42 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6c31422ec53b3e546a6532bebba7e376fae5e05d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:36:42 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6c31422ec53b3e546a6532bebba7e376fae5e05d --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:36:42 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:36:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6c31422ec53b3e546a6532bebba7e376fae5e05d --force-share --output=json" returned: 0 in 0.132s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:36:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6c31422ec53b3e546a6532bebba7e376fae5e05d,backing_fmt=raw /opt/stack/data/nova/instances/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc/disk 1073741824 {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:36:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6c31422ec53b3e546a6532bebba7e376fae5e05d,backing_fmt=raw /opt/stack/data/nova/instances/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc/disk 1073741824" returned: 0 in 0.055s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:36:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "6c31422ec53b3e546a6532bebba7e376fae5e05d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:36:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6c31422ec53b3e546a6532bebba7e376fae5e05d --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:36:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6c31422ec53b3e546a6532bebba7e376fae5e05d --force-share --output=json" returned: 0 in 0.133s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:36:43 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc/disk. size=1073741824 {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 00:36:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:36:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:36:43 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Cannot resize image /opt/stack/data/nova/instances/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc/disk to a smaller size. {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 00:36:43 user nova-compute[82479]: DEBUG nova.objects.instance [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lazy-loading 'migration_context' on Instance uuid 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:36:43 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Created local disks {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 00:36:43 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Ensure instance console log exists: /opt/stack/data/nova/instances/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc/console.log {{(pid=82479) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 00:36:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:36:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:36:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:36:43 user nova-compute[82479]: DEBUG nova.network.neutron [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Successfully updated port: 79b2086a-dcff-4bb6-893c-d852a886de1d {{(pid=82479) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 00:36:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "refresh_cache-0580f210-dd0b-4fc4-bcb2-e3db659e9cdc" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:36:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquired lock "refresh_cache-0580f210-dd0b-4fc4-bcb2-e3db659e9cdc" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:36:43 user nova-compute[82479]: DEBUG nova.network.neutron [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 00:36:43 user nova-compute[82479]: DEBUG nova.compute.manager [req-75dd5eb1-a526-448a-9280-22de8f914d60 req-d136e9cf-bd29-4e06-bf2c-500853db0240 service nova] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Received event network-changed-79b2086a-dcff-4bb6-893c-d852a886de1d {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:36:43 user nova-compute[82479]: DEBUG nova.compute.manager [req-75dd5eb1-a526-448a-9280-22de8f914d60 req-d136e9cf-bd29-4e06-bf2c-500853db0240 service nova] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Refreshing instance network info cache due to event network-changed-79b2086a-dcff-4bb6-893c-d852a886de1d. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:36:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-75dd5eb1-a526-448a-9280-22de8f914d60 req-d136e9cf-bd29-4e06-bf2c-500853db0240 service nova] Acquiring lock "refresh_cache-0580f210-dd0b-4fc4-bcb2-e3db659e9cdc" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:36:43 user nova-compute[82479]: DEBUG nova.network.neutron [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Instance cache missing network info. {{(pid=82479) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 00:36:43 user nova-compute[82479]: DEBUG nova.network.neutron [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Updating instance_info_cache with network_info: [{"id": "79b2086a-dcff-4bb6-893c-d852a886de1d", "address": "fa:16:3e:23:48:56", "network": {"id": "d7b8d180-999a-4f41-b677-e83b1c24a8a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1461510401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46777f523af54eecb0e3260f14df7909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79b2086a-dc", "ovs_interfaceid": "79b2086a-dcff-4bb6-893c-d852a886de1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:36:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Releasing lock "refresh_cache-0580f210-dd0b-4fc4-bcb2-e3db659e9cdc" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:36:43 user nova-compute[82479]: DEBUG nova.compute.manager [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Instance network_info: |[{"id": "79b2086a-dcff-4bb6-893c-d852a886de1d", "address": "fa:16:3e:23:48:56", "network": {"id": "d7b8d180-999a-4f41-b677-e83b1c24a8a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1461510401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46777f523af54eecb0e3260f14df7909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79b2086a-dc", "ovs_interfaceid": "79b2086a-dcff-4bb6-893c-d852a886de1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 00:36:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-75dd5eb1-a526-448a-9280-22de8f914d60 req-d136e9cf-bd29-4e06-bf2c-500853db0240 service nova] Acquired lock "refresh_cache-0580f210-dd0b-4fc4-bcb2-e3db659e9cdc" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:36:43 user nova-compute[82479]: DEBUG nova.network.neutron [req-75dd5eb1-a526-448a-9280-22de8f914d60 req-d136e9cf-bd29-4e06-bf2c-500853db0240 service nova] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Refreshing network info cache for port 79b2086a-dcff-4bb6-893c-d852a886de1d {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:36:43 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Start _get_guest_xml network_info=[{"id": "79b2086a-dcff-4bb6-893c-d852a886de1d", "address": "fa:16:3e:23:48:56", "network": {"id": "d7b8d180-999a-4f41-b677-e83b1c24a8a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1461510401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46777f523af54eecb0e3260f14df7909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79b2086a-dc", "ovs_interfaceid": "79b2086a-dcff-4bb6-893c-d852a886de1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:36:39Z,direct_url=<?>,disk_format='qcow2',id=11c4f6c7-2375-4030-96df-c731bbfc9a8a,min_disk=0,min_ram=0,name='tempest-scenario-img--163142488',owner='46777f523af54eecb0e3260f14df7909',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:36:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'image_id': '11c4f6c7-2375-4030-96df-c731bbfc9a8a'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 00:36:43 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:36:43 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:36:43 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82479) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 00:36:43 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T00:02:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:36:39Z,direct_url=<?>,disk_format='qcow2',id=11c4f6c7-2375-4030-96df-c731bbfc9a8a,min_disk=0,min_ram=0,name='tempest-scenario-img--163142488',owner='46777f523af54eecb0e3260f14df7909',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:36:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 00:36:43 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Flavor limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 00:36:43 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Image limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 00:36:43 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Flavor pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 00:36:43 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Image pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 00:36:43 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 00:36:43 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 00:36:43 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 00:36:43 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Got 1 possible topologies {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 00:36:43 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 00:36:43 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 00:36:43 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:36:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1367836214',display_name='tempest-TestMinimumBasicScenario-server-1367836214',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1367836214',id=39,image_ref='11c4f6c7-2375-4030-96df-c731bbfc9a8a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCU8iJCvLdXte1ng454W6MPjmwOaCNiooSbUzryCYaPKsm+elaQXxHL7pJqwwJUB3WBM5uXW0vPbCSXH/dGpXulUINeoD4fVc77lCjWDhdsnf0Qt5ZAqjG8F4xyRbxqxJg==',key_name='tempest-TestMinimumBasicScenario-1685780787',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46777f523af54eecb0e3260f14df7909',ramdisk_id='',reservation_id='r-4x5vm7fo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='11c4f6c7-2375-4030-96df-c731bbfc9a8a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-598834355',owner_user_name='tempest-TestMinimumBasicScenario-598834355-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:36:42Z,user_data=None,user_id='e5ad76f13b78448887913c4d0bcb16af',uuid=0580f210-dd0b-4fc4-bcb2-e3db659e9cdc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79b2086a-dcff-4bb6-893c-d852a886de1d", "address": "fa:16:3e:23:48:56", "network": {"id": "d7b8d180-999a-4f41-b677-e83b1c24a8a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1461510401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46777f523af54eecb0e3260f14df7909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79b2086a-dc", "ovs_interfaceid": "79b2086a-dcff-4bb6-893c-d852a886de1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82479) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 00:36:43 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Converting VIF {"id": "79b2086a-dcff-4bb6-893c-d852a886de1d", "address": "fa:16:3e:23:48:56", "network": {"id": "d7b8d180-999a-4f41-b677-e83b1c24a8a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1461510401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46777f523af54eecb0e3260f14df7909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79b2086a-dc", "ovs_interfaceid": "79b2086a-dcff-4bb6-893c-d852a886de1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:36:43 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:48:56,bridge_name='br-int',has_traffic_filtering=True,id=79b2086a-dcff-4bb6-893c-d852a886de1d,network=Network(d7b8d180-999a-4f41-b677-e83b1c24a8a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79b2086a-dc') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:36:43 user nova-compute[82479]: DEBUG nova.objects.instance [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lazy-loading 'pci_devices' on Instance uuid 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:36:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] End _get_guest_xml xml=<domain type="kvm">
Apr 14 00:36:44 user nova-compute[82479]:   <uuid>0580f210-dd0b-4fc4-bcb2-e3db659e9cdc</uuid>
Apr 14 00:36:44 user nova-compute[82479]:   <name>instance-00000027</name>
Apr 14 00:36:44 user nova-compute[82479]:   <memory>131072</memory>
Apr 14 00:36:44 user nova-compute[82479]:   <vcpu>1</vcpu>
Apr 14 00:36:44 user nova-compute[82479]:   <metadata>
Apr 14 00:36:44 user nova-compute[82479]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 00:36:44 user nova-compute[82479]:       <nova:package version="0.0.0"/>
Apr 14 00:36:44 user nova-compute[82479]:       <nova:name>tempest-TestMinimumBasicScenario-server-1367836214</nova:name>
Apr 14 00:36:44 user nova-compute[82479]:       <nova:creationTime>2023-04-14 00:36:43</nova:creationTime>
Apr 14 00:36:44 user nova-compute[82479]:       <nova:flavor name="m1.nano">
Apr 14 00:36:44 user nova-compute[82479]:         <nova:memory>128</nova:memory>
Apr 14 00:36:44 user nova-compute[82479]:         <nova:disk>1</nova:disk>
Apr 14 00:36:44 user nova-compute[82479]:         <nova:swap>0</nova:swap>
Apr 14 00:36:44 user nova-compute[82479]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 00:36:44 user nova-compute[82479]:         <nova:vcpus>1</nova:vcpus>
Apr 14 00:36:44 user nova-compute[82479]:       </nova:flavor>
Apr 14 00:36:44 user nova-compute[82479]:       <nova:owner>
Apr 14 00:36:44 user nova-compute[82479]:         <nova:user uuid="e5ad76f13b78448887913c4d0bcb16af">tempest-TestMinimumBasicScenario-598834355-project-member</nova:user>
Apr 14 00:36:44 user nova-compute[82479]:         <nova:project uuid="46777f523af54eecb0e3260f14df7909">tempest-TestMinimumBasicScenario-598834355</nova:project>
Apr 14 00:36:44 user nova-compute[82479]:       </nova:owner>
Apr 14 00:36:44 user nova-compute[82479]:       <nova:root type="image" uuid="11c4f6c7-2375-4030-96df-c731bbfc9a8a"/>
Apr 14 00:36:44 user nova-compute[82479]:       <nova:ports>
Apr 14 00:36:44 user nova-compute[82479]:         <nova:port uuid="79b2086a-dcff-4bb6-893c-d852a886de1d">
Apr 14 00:36:44 user nova-compute[82479]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 14 00:36:44 user nova-compute[82479]:         </nova:port>
Apr 14 00:36:44 user nova-compute[82479]:       </nova:ports>
Apr 14 00:36:44 user nova-compute[82479]:     </nova:instance>
Apr 14 00:36:44 user nova-compute[82479]:   </metadata>
Apr 14 00:36:44 user nova-compute[82479]:   <sysinfo type="smbios">
Apr 14 00:36:44 user nova-compute[82479]:     <system>
Apr 14 00:36:44 user nova-compute[82479]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 00:36:44 user nova-compute[82479]:       <entry name="product">OpenStack Nova</entry>
Apr 14 00:36:44 user nova-compute[82479]:       <entry name="version">0.0.0</entry>
Apr 14 00:36:44 user nova-compute[82479]:       <entry name="serial">0580f210-dd0b-4fc4-bcb2-e3db659e9cdc</entry>
Apr 14 00:36:44 user nova-compute[82479]:       <entry name="uuid">0580f210-dd0b-4fc4-bcb2-e3db659e9cdc</entry>
Apr 14 00:36:44 user nova-compute[82479]:       <entry name="family">Virtual Machine</entry>
Apr 14 00:36:44 user nova-compute[82479]:     </system>
Apr 14 00:36:44 user nova-compute[82479]:   </sysinfo>
Apr 14 00:36:44 user nova-compute[82479]:   <os>
Apr 14 00:36:44 user nova-compute[82479]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 00:36:44 user nova-compute[82479]:     <boot dev="hd"/>
Apr 14 00:36:44 user nova-compute[82479]:     <smbios mode="sysinfo"/>
Apr 14 00:36:44 user nova-compute[82479]:   </os>
Apr 14 00:36:44 user nova-compute[82479]:   <features>
Apr 14 00:36:44 user nova-compute[82479]:     <acpi/>
Apr 14 00:36:44 user nova-compute[82479]:     <apic/>
Apr 14 00:36:44 user nova-compute[82479]:     <vmcoreinfo/>
Apr 14 00:36:44 user nova-compute[82479]:   </features>
Apr 14 00:36:44 user nova-compute[82479]:   <clock offset="utc">
Apr 14 00:36:44 user nova-compute[82479]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 00:36:44 user nova-compute[82479]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 00:36:44 user nova-compute[82479]:     <timer name="hpet" present="no"/>
Apr 14 00:36:44 user nova-compute[82479]:   </clock>
Apr 14 00:36:44 user nova-compute[82479]:   <cpu mode="custom" match="exact">
Apr 14 00:36:44 user nova-compute[82479]:     <model>Nehalem</model>
Apr 14 00:36:44 user nova-compute[82479]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 00:36:44 user nova-compute[82479]:   </cpu>
Apr 14 00:36:44 user nova-compute[82479]:   <devices>
Apr 14 00:36:44 user nova-compute[82479]:     <disk type="file" device="disk">
Apr 14 00:36:44 user nova-compute[82479]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 00:36:44 user nova-compute[82479]:       <source file="/opt/stack/data/nova/instances/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc/disk"/>
Apr 14 00:36:44 user nova-compute[82479]:       <target dev="vda" bus="virtio"/>
Apr 14 00:36:44 user nova-compute[82479]:     </disk>
Apr 14 00:36:44 user nova-compute[82479]:     <interface type="ethernet">
Apr 14 00:36:44 user nova-compute[82479]:       <mac address="fa:16:3e:23:48:56"/>
Apr 14 00:36:44 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:36:44 user nova-compute[82479]:       <mtu size="1442"/>
Apr 14 00:36:44 user nova-compute[82479]:       <target dev="tap79b2086a-dc"/>
Apr 14 00:36:44 user nova-compute[82479]:     </interface>
Apr 14 00:36:44 user nova-compute[82479]:     <serial type="pty">
Apr 14 00:36:44 user nova-compute[82479]:       <log file="/opt/stack/data/nova/instances/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc/console.log" append="off"/>
Apr 14 00:36:44 user nova-compute[82479]:     </serial>
Apr 14 00:36:44 user nova-compute[82479]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 00:36:44 user nova-compute[82479]:     <video>
Apr 14 00:36:44 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:36:44 user nova-compute[82479]:     </video>
Apr 14 00:36:44 user nova-compute[82479]:     <rng model="virtio">
Apr 14 00:36:44 user nova-compute[82479]:       <backend model="random">/dev/urandom</backend>
Apr 14 00:36:44 user nova-compute[82479]:     </rng>
Apr 14 00:36:44 user nova-compute[82479]:     <controller type="usb" index="0" model="none"/>
Apr 14 00:36:44 user nova-compute[82479]:     <memballoon model="virtio">
Apr 14 00:36:44 user nova-compute[82479]:       <stats period="10"/>
Apr 14 00:36:44 user nova-compute[82479]:     </memballoon>
Apr 14 00:36:44 user nova-compute[82479]:   </devices>
Apr 14 00:36:44 user nova-compute[82479]: </domain>
Apr 14 00:36:44 user nova-compute[82479]:  {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 00:36:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:36:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1367836214',display_name='tempest-TestMinimumBasicScenario-server-1367836214',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1367836214',id=39,image_ref='11c4f6c7-2375-4030-96df-c731bbfc9a8a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCU8iJCvLdXte1ng454W6MPjmwOaCNiooSbUzryCYaPKsm+elaQXxHL7pJqwwJUB3WBM5uXW0vPbCSXH/dGpXulUINeoD4fVc77lCjWDhdsnf0Qt5ZAqjG8F4xyRbxqxJg==',key_name='tempest-TestMinimumBasicScenario-1685780787',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46777f523af54eecb0e3260f14df7909',ramdisk_id='',reservation_id='r-4x5vm7fo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='11c4f6c7-2375-4030-96df-c731bbfc9a8a',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-598834355',owner_user_name='tempest-TestMinimumBasicScenario-598834355-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:36:42Z,user_data=None,user_id='e5ad76f13b78448887913c4d0bcb16af',uuid=0580f210-dd0b-4fc4-bcb2-e3db659e9cdc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79b2086a-dcff-4bb6-893c-d852a886de1d", "address": "fa:16:3e:23:48:56", "network": {"id": "d7b8d180-999a-4f41-b677-e83b1c24a8a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1461510401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46777f523af54eecb0e3260f14df7909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79b2086a-dc", "ovs_interfaceid": "79b2086a-dcff-4bb6-893c-d852a886de1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 00:36:44 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Converting VIF {"id": "79b2086a-dcff-4bb6-893c-d852a886de1d", "address": "fa:16:3e:23:48:56", "network": {"id": "d7b8d180-999a-4f41-b677-e83b1c24a8a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1461510401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46777f523af54eecb0e3260f14df7909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79b2086a-dc", "ovs_interfaceid": "79b2086a-dcff-4bb6-893c-d852a886de1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:36:44 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:48:56,bridge_name='br-int',has_traffic_filtering=True,id=79b2086a-dcff-4bb6-893c-d852a886de1d,network=Network(d7b8d180-999a-4f41-b677-e83b1c24a8a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79b2086a-dc') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:36:44 user nova-compute[82479]: DEBUG os_vif [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:48:56,bridge_name='br-int',has_traffic_filtering=True,id=79b2086a-dcff-4bb6-893c-d852a886de1d,network=Network(d7b8d180-999a-4f41-b677-e83b1c24a8a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79b2086a-dc') {{(pid=82479) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 00:36:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:36:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:36:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 00:36:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:36:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap79b2086a-dc, may_exist=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:36:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap79b2086a-dc, col_values=(('external_ids', {'iface-id': '79b2086a-dcff-4bb6-893c-d852a886de1d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:48:56', 'vm-uuid': '0580f210-dd0b-4fc4-bcb2-e3db659e9cdc'}),)) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:36:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:36:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:36:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:36:44 user nova-compute[82479]: INFO os_vif [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:48:56,bridge_name='br-int',has_traffic_filtering=True,id=79b2086a-dcff-4bb6-893c-d852a886de1d,network=Network(d7b8d180-999a-4f41-b677-e83b1c24a8a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79b2086a-dc')
Apr 14 00:36:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:36:44 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] No VIF found with MAC fa:16:3e:23:48:56, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:36:44 user nova-compute[82479]: DEBUG nova.network.neutron [req-75dd5eb1-a526-448a-9280-22de8f914d60 req-d136e9cf-bd29-4e06-bf2c-500853db0240 service nova] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Updated VIF entry in instance network info cache for port 79b2086a-dcff-4bb6-893c-d852a886de1d. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:36:44 user nova-compute[82479]: DEBUG nova.network.neutron [req-75dd5eb1-a526-448a-9280-22de8f914d60 req-d136e9cf-bd29-4e06-bf2c-500853db0240 service nova] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Updating instance_info_cache with network_info: [{"id": "79b2086a-dcff-4bb6-893c-d852a886de1d", "address": "fa:16:3e:23:48:56", "network": {"id": "d7b8d180-999a-4f41-b677-e83b1c24a8a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1461510401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46777f523af54eecb0e3260f14df7909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79b2086a-dc", "ovs_interfaceid": "79b2086a-dcff-4bb6-893c-d852a886de1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:36:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-75dd5eb1-a526-448a-9280-22de8f914d60 req-d136e9cf-bd29-4e06-bf2c-500853db0240 service nova] Releasing lock "refresh_cache-0580f210-dd0b-4fc4-bcb2-e3db659e9cdc" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:36:45 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:36:45 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:36:45 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:36:45 user nova-compute[82479]: DEBUG nova.compute.manager [req-717a44b3-f5fe-423c-bb5d-8b8919a485e0 req-6e6730c4-c7d4-48a7-ad2d-b38371869d9a service nova] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Received event network-vif-plugged-79b2086a-dcff-4bb6-893c-d852a886de1d {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:36:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-717a44b3-f5fe-423c-bb5d-8b8919a485e0 req-6e6730c4-c7d4-48a7-ad2d-b38371869d9a service nova] Acquiring lock "0580f210-dd0b-4fc4-bcb2-e3db659e9cdc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:36:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-717a44b3-f5fe-423c-bb5d-8b8919a485e0 req-6e6730c4-c7d4-48a7-ad2d-b38371869d9a service nova] Lock "0580f210-dd0b-4fc4-bcb2-e3db659e9cdc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:36:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-717a44b3-f5fe-423c-bb5d-8b8919a485e0 req-6e6730c4-c7d4-48a7-ad2d-b38371869d9a service nova] Lock "0580f210-dd0b-4fc4-bcb2-e3db659e9cdc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:36:45 user nova-compute[82479]: DEBUG nova.compute.manager [req-717a44b3-f5fe-423c-bb5d-8b8919a485e0 req-6e6730c4-c7d4-48a7-ad2d-b38371869d9a service nova] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] No waiting events found dispatching network-vif-plugged-79b2086a-dcff-4bb6-893c-d852a886de1d {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:36:45 user nova-compute[82479]: WARNING nova.compute.manager [req-717a44b3-f5fe-423c-bb5d-8b8919a485e0 req-6e6730c4-c7d4-48a7-ad2d-b38371869d9a service nova] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Received unexpected event network-vif-plugged-79b2086a-dcff-4bb6-893c-d852a886de1d for instance with vm_state building and task_state spawning.
Apr 14 00:36:45 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:36:45 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:36:46 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:36:47 user nova-compute[82479]: DEBUG nova.compute.manager [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Instance event wait completed in 0 seconds for  {{(pid=82479) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 00:36:47 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Guest created on hypervisor {{(pid=82479) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 00:36:47 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681432607.5647116, 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc => Resumed> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:36:47 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] VM Resumed (Lifecycle Event)
Apr 14 00:36:47 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Instance spawned successfully.
Apr 14 00:36:47 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 00:36:47 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:36:47 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:36:47 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Found default for hw_cdrom_bus of ide {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:36:47 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Found default for hw_disk_bus of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:36:47 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Found default for hw_input_bus of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:36:47 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Found default for hw_pointer_model of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:36:47 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Found default for hw_video_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:36:47 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Found default for hw_vif_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:36:47 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:36:47 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681432607.5648553, 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc => Started> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:36:47 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] VM Started (Lifecycle Event)
Apr 14 00:36:47 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:36:47 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:36:47 user nova-compute[82479]: DEBUG nova.compute.manager [req-4ec4dd22-d2e9-4276-8c8b-2d6fd32b02e7 req-036c91d6-d103-4b6a-8149-c89473d516f0 service nova] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Received event network-vif-plugged-79b2086a-dcff-4bb6-893c-d852a886de1d {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:36:47 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-4ec4dd22-d2e9-4276-8c8b-2d6fd32b02e7 req-036c91d6-d103-4b6a-8149-c89473d516f0 service nova] Acquiring lock "0580f210-dd0b-4fc4-bcb2-e3db659e9cdc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:36:47 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-4ec4dd22-d2e9-4276-8c8b-2d6fd32b02e7 req-036c91d6-d103-4b6a-8149-c89473d516f0 service nova] Lock "0580f210-dd0b-4fc4-bcb2-e3db659e9cdc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:36:47 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-4ec4dd22-d2e9-4276-8c8b-2d6fd32b02e7 req-036c91d6-d103-4b6a-8149-c89473d516f0 service nova] Lock "0580f210-dd0b-4fc4-bcb2-e3db659e9cdc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:36:47 user nova-compute[82479]: DEBUG nova.compute.manager [req-4ec4dd22-d2e9-4276-8c8b-2d6fd32b02e7 req-036c91d6-d103-4b6a-8149-c89473d516f0 service nova] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] No waiting events found dispatching network-vif-plugged-79b2086a-dcff-4bb6-893c-d852a886de1d {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:36:47 user nova-compute[82479]: WARNING nova.compute.manager [req-4ec4dd22-d2e9-4276-8c8b-2d6fd32b02e7 req-036c91d6-d103-4b6a-8149-c89473d516f0 service nova] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Received unexpected event network-vif-plugged-79b2086a-dcff-4bb6-893c-d852a886de1d for instance with vm_state building and task_state spawning.
Apr 14 00:36:47 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:36:47 user nova-compute[82479]: INFO nova.compute.manager [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Took 5.87 seconds to spawn the instance on the hypervisor.
Apr 14 00:36:47 user nova-compute[82479]: DEBUG nova.compute.manager [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:36:47 user nova-compute[82479]: INFO nova.compute.manager [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Took 6.37 seconds to build instance.
Apr 14 00:36:47 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-2d978056-00da-40fc-bb87-f1afac1b0a98 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "0580f210-dd0b-4fc4-bcb2-e3db659e9cdc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.469s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:36:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:36:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:36:52 user nova-compute[82479]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681432597.8819456, 2d04f694-0eba-46c3-a617-97d3de666de8 => Stopped> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:36:52 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] VM Stopped (Lifecycle Event)
Apr 14 00:36:52 user nova-compute[82479]: DEBUG nova.compute.manager [None req-08df0e71-ca23-4629-bade-06bd6049da51 None None] [instance: 2d04f694-0eba-46c3-a617-97d3de666de8] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:36:54 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:36:59 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:37:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:37:03 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:37:03 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Starting heal instance info cache {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 00:37:03 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Rebuilding the list of instances to heal {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 00:37:03 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "refresh_cache-0580f210-dd0b-4fc4-bcb2-e3db659e9cdc" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:37:03 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquired lock "refresh_cache-0580f210-dd0b-4fc4-bcb2-e3db659e9cdc" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:37:03 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Forcefully refreshing network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 00:37:03 user nova-compute[82479]: DEBUG nova.objects.instance [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lazy-loading 'info_cache' on Instance uuid 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:37:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:37:04 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Updating instance_info_cache with network_info: [{"id": "79b2086a-dcff-4bb6-893c-d852a886de1d", "address": "fa:16:3e:23:48:56", "network": {"id": "d7b8d180-999a-4f41-b677-e83b1c24a8a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1461510401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46777f523af54eecb0e3260f14df7909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79b2086a-dc", "ovs_interfaceid": "79b2086a-dcff-4bb6-893c-d852a886de1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:37:04 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Releasing lock "refresh_cache-0580f210-dd0b-4fc4-bcb2-e3db659e9cdc" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:37:04 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Updated the network info_cache for instance {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 00:37:06 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:37:07 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:37:07 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:37:09 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:37:10 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:37:11 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:37:11 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:37:12 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:37:13 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:37:13 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82479) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 00:37:14 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:37:14 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:37:16 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:37:16 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:37:16 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:37:16 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:37:16 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:37:16 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Auditing locally available compute resources for user (node: user) {{(pid=82479) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 00:37:16 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:37:16 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:37:16 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:37:16 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:37:16 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:37:17 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:37:17 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:37:17 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Hypervisor/Node resource view: name=user free_ram=8743MB free_disk=26.15017318725586GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82479) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 00:37:17 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:37:17 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:37:17 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:37:17 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 00:37:17 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 00:37:17 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:37:17 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:37:17 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Compute_service record updated for user:user {{(pid=82479) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 00:37:17 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.236s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:37:19 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:37:24 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:37:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:37:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:37:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:37:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:37:39 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:37:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:37:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:37:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:37:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:37:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:37:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:37:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:37:54 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:37:59 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:37:59 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:37:59 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:37:59 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:37:59 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:37:59 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:38:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:38:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:38:06 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:38:06 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Starting heal instance info cache {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 00:38:06 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Rebuilding the list of instances to heal {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 00:38:06 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "refresh_cache-0580f210-dd0b-4fc4-bcb2-e3db659e9cdc" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:38:06 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquired lock "refresh_cache-0580f210-dd0b-4fc4-bcb2-e3db659e9cdc" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:38:06 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Forcefully refreshing network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 00:38:06 user nova-compute[82479]: DEBUG nova.objects.instance [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lazy-loading 'info_cache' on Instance uuid 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:38:06 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:38:07 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Updating instance_info_cache with network_info: [{"id": "79b2086a-dcff-4bb6-893c-d852a886de1d", "address": "fa:16:3e:23:48:56", "network": {"id": "d7b8d180-999a-4f41-b677-e83b1c24a8a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1461510401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46777f523af54eecb0e3260f14df7909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79b2086a-dc", "ovs_interfaceid": "79b2086a-dcff-4bb6-893c-d852a886de1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:38:07 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Releasing lock "refresh_cache-0580f210-dd0b-4fc4-bcb2-e3db659e9cdc" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:38:07 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Updated the network info_cache for instance {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 00:38:08 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:38:09 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:38:10 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:38:11 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:38:14 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:38:14 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:38:14 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:38:14 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82479) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 00:38:16 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:38:16 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:38:16 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:38:16 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:38:16 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:38:16 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:38:16 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Auditing locally available compute resources for user (node: user) {{(pid=82479) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 00:38:16 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:38:16 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:38:16 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:38:17 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:38:17 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:38:17 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:38:17 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Hypervisor/Node resource view: name=user free_ram=8848MB free_disk=26.14798355102539GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82479) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 00:38:17 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:38:17 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:38:17 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:38:17 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 00:38:17 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 00:38:17 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:38:17 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:38:17 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Compute_service record updated for user:user {{(pid=82479) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 00:38:17 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.173s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:38:19 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:38:24 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:38:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:38:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:38:34 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-88377e18-ebd9-4f45-9991-112fe4b62705 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "0580f210-dd0b-4fc4-bcb2-e3db659e9cdc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:38:34 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-88377e18-ebd9-4f45-9991-112fe4b62705 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "0580f210-dd0b-4fc4-bcb2-e3db659e9cdc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:38:35 user nova-compute[82479]: DEBUG nova.objects.instance [None req-88377e18-ebd9-4f45-9991-112fe4b62705 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lazy-loading 'flavor' on Instance uuid 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:38:35 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-88377e18-ebd9-4f45-9991-112fe4b62705 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "0580f210-dd0b-4fc4-bcb2-e3db659e9cdc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.172s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:38:35 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-88377e18-ebd9-4f45-9991-112fe4b62705 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "0580f210-dd0b-4fc4-bcb2-e3db659e9cdc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:38:35 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-88377e18-ebd9-4f45-9991-112fe4b62705 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "0580f210-dd0b-4fc4-bcb2-e3db659e9cdc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:38:35 user nova-compute[82479]: INFO nova.compute.manager [None req-88377e18-ebd9-4f45-9991-112fe4b62705 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Attaching volume 17f3af17-ec13-4449-90ee-4b4f2375cd14 to /dev/vdb
Apr 14 00:38:35 user nova-compute[82479]: DEBUG os_brick.utils [None req-88377e18-ebd9-4f45-9991-112fe4b62705 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:38:35 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:38:35 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:38:35 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e68d732-0c67-4875-be67-a37472981608]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fec92fcfdd3\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:38:35 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:38:35 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:38:35 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3722145-152a-4760-bf86-14fa7dfe09fd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:38:35 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:38:35 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:38:35 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec0cf4cb-32f9-4071-a5aa-7a2d62de8a08]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:38:35 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a1fe96-7f34-49b5-8687-deb8e4c56432]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:38:35 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-88377e18-ebd9-4f45-9991-112fe4b62705 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Running cmd (subprocess): nvme version {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:38:35 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-88377e18-ebd9-4f45-9991-112fe4b62705 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] 'nvme version' failed. Not Retrying. {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:38:35 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.nvmeof [None req-88377e18-ebd9-4f45-9991-112fe4b62705 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] nvme not present on system {{(pid=82479) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 00:38:35 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:38:35 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:38:35 user nova-compute[82479]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 00:38:35 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad91d0e-389e-48b8-842d-dc0669a3feca]: (4, '') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:38:35 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-88377e18-ebd9-4f45-9991-112fe4b62705 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82479) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 00:38:35 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-88377e18-ebd9-4f45-9991-112fe4b62705 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 00:38:35 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-88377e18-ebd9-4f45-9991-112fe4b62705 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] LIGHTOS: no hostnqn found. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 00:38:35 user nova-compute[82479]: DEBUG os_brick.utils [None req-88377e18-ebd9-4f45-9991-112fe4b62705 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fec92fcfdd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:38:35 user nova-compute[82479]: DEBUG nova.virt.block_device [None req-88377e18-ebd9-4f45-9991-112fe4b62705 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Updating existing volume attachment record: 060be45f-01c0-469c-b566-550c166434d0 {{(pid=82479) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 00:38:39 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:38:39 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88377e18-ebd9-4f45-9991-112fe4b62705 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Calling os-brick to attach iSCSI Volume {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 00:38:39 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-88377e18-ebd9-4f45-9991-112fe4b62705 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OWCVLeKa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:38:39 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-88377e18-ebd9-4f45-9991-112fe4b62705 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:38:39 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-88377e18-ebd9-4f45-9991-112fe4b62705 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:38:39 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-88377e18-ebd9-4f45-9991-112fe4b62705 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:38:39 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-88377e18-ebd9-4f45-9991-112fe4b62705 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:38:39 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-88377e18-ebd9-4f45-9991-112fe4b62705 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:38:39 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-88377e18-ebd9-4f45-9991-112fe4b62705 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:38:39 user nova-compute[82479]: INFO os_brick.initiator.connectors.iscsi [None req-88377e18-ebd9-4f45-9991-112fe4b62705 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 00:38:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14 -p 172.16.0.220:3260 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:38:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:38:39 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9daab21-4c82-4547-b62b-3e7214e2f1da]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:38:39 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-88377e18-ebd9-4f45-9991-112fe4b62705 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 00:38:39 user nova-compute[82479]:  {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:38:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14 -p 172.16.0.220:3260 --interface default --op new {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:38:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:38:39 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[59992ff9-21ea-4b16-bfa0-914cb409780e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14] added\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:38:39 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-88377e18-ebd9-4f45-9991-112fe4b62705 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14] added
Apr 14 00:38:39 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:38:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:38:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:38:39 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d53ed8-905f-4980-b72b-466192975a80]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:38:39 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-88377e18-ebd9-4f45-9991-112fe4b62705 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:38:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:38:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:38:39 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1c4180-f111-4027-9864-7d7a6347ce44]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:38:39 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-88377e18-ebd9-4f45-9991-112fe4b62705 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:38:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OWCVLeKa {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:38:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OWCVLeKa" returned: 0 in 0.017s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:38:39 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[194b16db-d078-42fc-8490-262d11d17ba0]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:38:39 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-88377e18-ebd9-4f45-9991-112fe4b62705 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OWCVLeKa'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:38:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:38:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:38:39 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0dfafc-f880-4a80-9657-13f0a499e620]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:38:39 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-88377e18-ebd9-4f45-9991-112fe4b62705 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:38:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:38:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:38:39 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6199e0-c8a8-4507-9d21-52685a2b6e17]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:38:39 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-88377e18-ebd9-4f45-9991-112fe4b62705 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 00:38:39 user nova-compute[82479]:  {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:38:39 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-88377e18-ebd9-4f45-9991-112fe4b62705 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 00:38:39 user nova-compute[82479]:  {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:38:39 user nova-compute[82479]: WARNING os_brick.initiator.connectors.iscsi [None req-88377e18-ebd9-4f45-9991-112fe4b62705 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 00:38:39 user nova-compute[82479]: 
Apr 14 00:38:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14 -p 172.16.0.220:3260 --login {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:38:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:38:39 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[7763e712-8e4f-43e5-bc3d-19a2b2e9887c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:38:39 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-88377e18-ebd9-4f45-9991-112fe4b62705 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14, portal: 172.16.0.220,3260]
Apr 14 00:38:39 user nova-compute[82479]: Login to [iface: default, target: iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14, portal: 172.16.0.220,3260] successful.
Apr 14 00:38:39 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:38:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:38:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:38:39 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[65900ea1-cb23-4d9e-9d7d-3f1a5427405f]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:38:39 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-88377e18-ebd9-4f45-9991-112fe4b62705 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:38:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:38:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:38:39 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6cb84e-5f1d-4911-9ba5-5140894a1795]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:38:39 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-88377e18-ebd9-4f45-9991-112fe4b62705 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14 (non-flash)
Apr 14 00:38:39 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:38:39 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-88377e18-ebd9-4f45-9991-112fe4b62705 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14 (non-flash)
Apr 14 00:38:39 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:38:39 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-88377e18-ebd9-4f45-9991-112fe4b62705 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:38:39 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-88377e18-ebd9-4f45-9991-112fe4b62705 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Connected to 172.16.0.220:3260 {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 00:38:39 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-88377e18-ebd9-4f45-9991-112fe4b62705 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] HCTL ('33', '-', '-', 0) found on session 41 with lun 0 {{(pid=82479) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 00:38:39 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-88377e18-ebd9-4f45-9991-112fe4b62705 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82479) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 00:38:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:38:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:38:39 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f24fb6a-d93a-494e-984e-6844d1cc1248]: (4, ('- - 0', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:38:39 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-88377e18-ebd9-4f45-9991-112fe4b62705 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: None {{(pid=82479) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 00:38:40 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-88377e18-ebd9-4f45-9991-112fe4b62705 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82479) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 00:38:40 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-88377e18-ebd9-4f45-9991-112fe4b62705 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OWCVLeKa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 00:38:40 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-88377e18-ebd9-4f45-9991-112fe4b62705 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:38:40 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-88377e18-ebd9-4f45-9991-112fe4b62705 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '26464663733356534', 'path': '/dev/sdb'} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:38:40 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88377e18-ebd9-4f45-9991-112fe4b62705 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464663733356534', 'path': '/dev/sdb'} {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 00:38:40 user nova-compute[82479]: DEBUG nova.objects.instance [None req-88377e18-ebd9-4f45-9991-112fe4b62705 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lazy-loading 'flavor' on Instance uuid 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:38:40 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-88377e18-ebd9-4f45-9991-112fe4b62705 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 00:38:40 user nova-compute[82479]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:38:40 user nova-compute[82479]:   <source dev="/dev/sdb"/>
Apr 14 00:38:40 user nova-compute[82479]:   <target dev="vdb" bus="virtio"/>
Apr 14 00:38:40 user nova-compute[82479]:   <serial>17f3af17-ec13-4449-90ee-4b4f2375cd14</serial>
Apr 14 00:38:40 user nova-compute[82479]: </disk>
Apr 14 00:38:40 user nova-compute[82479]:  {{(pid=82479) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 00:38:41 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-88377e18-ebd9-4f45-9991-112fe4b62705 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:38:41 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-88377e18-ebd9-4f45-9991-112fe4b62705 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:38:41 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-88377e18-ebd9-4f45-9991-112fe4b62705 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] No VIF found with MAC fa:16:3e:23:48:56, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:38:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-88377e18-ebd9-4f45-9991-112fe4b62705 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "0580f210-dd0b-4fc4-bcb2-e3db659e9cdc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.241s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:38:43 user nova-compute[82479]: DEBUG nova.compute.manager [req-9d005a74-d550-493f-b1b5-06f2a7cd2396 req-10daf692-5285-45a8-979e-fb8f856cca88 service nova] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Received event network-changed-79b2086a-dcff-4bb6-893c-d852a886de1d {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:38:43 user nova-compute[82479]: DEBUG nova.compute.manager [req-9d005a74-d550-493f-b1b5-06f2a7cd2396 req-10daf692-5285-45a8-979e-fb8f856cca88 service nova] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Refreshing instance network info cache due to event network-changed-79b2086a-dcff-4bb6-893c-d852a886de1d. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:38:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-9d005a74-d550-493f-b1b5-06f2a7cd2396 req-10daf692-5285-45a8-979e-fb8f856cca88 service nova] Acquiring lock "refresh_cache-0580f210-dd0b-4fc4-bcb2-e3db659e9cdc" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:38:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-9d005a74-d550-493f-b1b5-06f2a7cd2396 req-10daf692-5285-45a8-979e-fb8f856cca88 service nova] Acquired lock "refresh_cache-0580f210-dd0b-4fc4-bcb2-e3db659e9cdc" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:38:43 user nova-compute[82479]: DEBUG nova.network.neutron [req-9d005a74-d550-493f-b1b5-06f2a7cd2396 req-10daf692-5285-45a8-979e-fb8f856cca88 service nova] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Refreshing network info cache for port 79b2086a-dcff-4bb6-893c-d852a886de1d {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:38:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:38:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:38:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:38:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:38:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:38:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:38:44 user nova-compute[82479]: DEBUG nova.network.neutron [req-9d005a74-d550-493f-b1b5-06f2a7cd2396 req-10daf692-5285-45a8-979e-fb8f856cca88 service nova] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Updated VIF entry in instance network info cache for port 79b2086a-dcff-4bb6-893c-d852a886de1d. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:38:44 user nova-compute[82479]: DEBUG nova.network.neutron [req-9d005a74-d550-493f-b1b5-06f2a7cd2396 req-10daf692-5285-45a8-979e-fb8f856cca88 service nova] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Updating instance_info_cache with network_info: [{"id": "79b2086a-dcff-4bb6-893c-d852a886de1d", "address": "fa:16:3e:23:48:56", "network": {"id": "d7b8d180-999a-4f41-b677-e83b1c24a8a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1461510401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46777f523af54eecb0e3260f14df7909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79b2086a-dc", "ovs_interfaceid": "79b2086a-dcff-4bb6-893c-d852a886de1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:38:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-9d005a74-d550-493f-b1b5-06f2a7cd2396 req-10daf692-5285-45a8-979e-fb8f856cca88 service nova] Releasing lock "refresh_cache-0580f210-dd0b-4fc4-bcb2-e3db659e9cdc" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:38:46 user nova-compute[82479]: DEBUG nova.compute.manager [req-0ab91762-fa28-4d06-bb13-e82853eb565e req-2e125e49-913e-4edd-ad55-4b8e75e5bf63 service nova] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Received event network-changed-79b2086a-dcff-4bb6-893c-d852a886de1d {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:38:46 user nova-compute[82479]: DEBUG nova.compute.manager [req-0ab91762-fa28-4d06-bb13-e82853eb565e req-2e125e49-913e-4edd-ad55-4b8e75e5bf63 service nova] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Refreshing instance network info cache due to event network-changed-79b2086a-dcff-4bb6-893c-d852a886de1d. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:38:46 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0ab91762-fa28-4d06-bb13-e82853eb565e req-2e125e49-913e-4edd-ad55-4b8e75e5bf63 service nova] Acquiring lock "refresh_cache-0580f210-dd0b-4fc4-bcb2-e3db659e9cdc" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:38:46 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0ab91762-fa28-4d06-bb13-e82853eb565e req-2e125e49-913e-4edd-ad55-4b8e75e5bf63 service nova] Acquired lock "refresh_cache-0580f210-dd0b-4fc4-bcb2-e3db659e9cdc" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:38:46 user nova-compute[82479]: DEBUG nova.network.neutron [req-0ab91762-fa28-4d06-bb13-e82853eb565e req-2e125e49-913e-4edd-ad55-4b8e75e5bf63 service nova] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Refreshing network info cache for port 79b2086a-dcff-4bb6-893c-d852a886de1d {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:38:46 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:38:46 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-6f9f5483-34e0-4c8c-a237-2aefb157360a tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "0580f210-dd0b-4fc4-bcb2-e3db659e9cdc" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:38:46 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-6f9f5483-34e0-4c8c-a237-2aefb157360a tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "0580f210-dd0b-4fc4-bcb2-e3db659e9cdc" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:38:46 user nova-compute[82479]: INFO nova.compute.manager [None req-6f9f5483-34e0-4c8c-a237-2aefb157360a tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Rebooting instance
Apr 14 00:38:47 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-6f9f5483-34e0-4c8c-a237-2aefb157360a tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "refresh_cache-0580f210-dd0b-4fc4-bcb2-e3db659e9cdc" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:38:47 user nova-compute[82479]: DEBUG nova.network.neutron [req-0ab91762-fa28-4d06-bb13-e82853eb565e req-2e125e49-913e-4edd-ad55-4b8e75e5bf63 service nova] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Updated VIF entry in instance network info cache for port 79b2086a-dcff-4bb6-893c-d852a886de1d. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:38:47 user nova-compute[82479]: DEBUG nova.network.neutron [req-0ab91762-fa28-4d06-bb13-e82853eb565e req-2e125e49-913e-4edd-ad55-4b8e75e5bf63 service nova] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Updating instance_info_cache with network_info: [{"id": "79b2086a-dcff-4bb6-893c-d852a886de1d", "address": "fa:16:3e:23:48:56", "network": {"id": "d7b8d180-999a-4f41-b677-e83b1c24a8a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1461510401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46777f523af54eecb0e3260f14df7909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79b2086a-dc", "ovs_interfaceid": "79b2086a-dcff-4bb6-893c-d852a886de1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:38:47 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0ab91762-fa28-4d06-bb13-e82853eb565e req-2e125e49-913e-4edd-ad55-4b8e75e5bf63 service nova] Releasing lock "refresh_cache-0580f210-dd0b-4fc4-bcb2-e3db659e9cdc" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:38:47 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-6f9f5483-34e0-4c8c-a237-2aefb157360a tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquired lock "refresh_cache-0580f210-dd0b-4fc4-bcb2-e3db659e9cdc" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:38:47 user nova-compute[82479]: DEBUG nova.network.neutron [None req-6f9f5483-34e0-4c8c-a237-2aefb157360a tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 00:38:47 user nova-compute[82479]: DEBUG nova.network.neutron [None req-6f9f5483-34e0-4c8c-a237-2aefb157360a tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Updating instance_info_cache with network_info: [{"id": "79b2086a-dcff-4bb6-893c-d852a886de1d", "address": "fa:16:3e:23:48:56", "network": {"id": "d7b8d180-999a-4f41-b677-e83b1c24a8a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1461510401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46777f523af54eecb0e3260f14df7909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79b2086a-dc", "ovs_interfaceid": "79b2086a-dcff-4bb6-893c-d852a886de1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:38:47 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-6f9f5483-34e0-4c8c-a237-2aefb157360a tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Releasing lock "refresh_cache-0580f210-dd0b-4fc4-bcb2-e3db659e9cdc" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:38:47 user nova-compute[82479]: DEBUG nova.compute.manager [None req-6f9f5483-34e0-4c8c-a237-2aefb157360a tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:38:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:38:50 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:38:50 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:38:50 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:38:50 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:38:50 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:38:50 user nova-compute[82479]: DEBUG nova.compute.manager [req-3ab82d64-fadd-4517-b87b-95f83a45de37 req-ce15671a-7d50-4029-9328-892a2092135e service nova] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Received event network-vif-unplugged-79b2086a-dcff-4bb6-893c-d852a886de1d {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:38:50 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-3ab82d64-fadd-4517-b87b-95f83a45de37 req-ce15671a-7d50-4029-9328-892a2092135e service nova] Acquiring lock "0580f210-dd0b-4fc4-bcb2-e3db659e9cdc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:38:50 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-3ab82d64-fadd-4517-b87b-95f83a45de37 req-ce15671a-7d50-4029-9328-892a2092135e service nova] Lock "0580f210-dd0b-4fc4-bcb2-e3db659e9cdc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:38:50 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-3ab82d64-fadd-4517-b87b-95f83a45de37 req-ce15671a-7d50-4029-9328-892a2092135e service nova] Lock "0580f210-dd0b-4fc4-bcb2-e3db659e9cdc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:38:50 user nova-compute[82479]: DEBUG nova.compute.manager [req-3ab82d64-fadd-4517-b87b-95f83a45de37 req-ce15671a-7d50-4029-9328-892a2092135e service nova] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] No waiting events found dispatching network-vif-unplugged-79b2086a-dcff-4bb6-893c-d852a886de1d {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:38:50 user nova-compute[82479]: WARNING nova.compute.manager [req-3ab82d64-fadd-4517-b87b-95f83a45de37 req-ce15671a-7d50-4029-9328-892a2092135e service nova] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Received unexpected event network-vif-unplugged-79b2086a-dcff-4bb6-893c-d852a886de1d for instance with vm_state active and task_state reboot_started.
Apr 14 00:38:50 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:38:50 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:38:50 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-6f9f5483-34e0-4c8c-a237-2aefb157360a tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Instance shutdown successfully.
Apr 14 00:38:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:38:52 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:38:52 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:38:52 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:38:52 user nova-compute[82479]: DEBUG nova.compute.manager [req-e0cb255a-2fa3-4ca1-9269-4822a59e3a2f req-d77c8354-5d47-413a-9ea5-21b4c7fc02df service nova] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Received event network-vif-plugged-79b2086a-dcff-4bb6-893c-d852a886de1d {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:38:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-e0cb255a-2fa3-4ca1-9269-4822a59e3a2f req-d77c8354-5d47-413a-9ea5-21b4c7fc02df service nova] Acquiring lock "0580f210-dd0b-4fc4-bcb2-e3db659e9cdc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:38:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-e0cb255a-2fa3-4ca1-9269-4822a59e3a2f req-d77c8354-5d47-413a-9ea5-21b4c7fc02df service nova] Lock "0580f210-dd0b-4fc4-bcb2-e3db659e9cdc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:38:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-e0cb255a-2fa3-4ca1-9269-4822a59e3a2f req-d77c8354-5d47-413a-9ea5-21b4c7fc02df service nova] Lock "0580f210-dd0b-4fc4-bcb2-e3db659e9cdc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:38:52 user nova-compute[82479]: DEBUG nova.compute.manager [req-e0cb255a-2fa3-4ca1-9269-4822a59e3a2f req-d77c8354-5d47-413a-9ea5-21b4c7fc02df service nova] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] No waiting events found dispatching network-vif-plugged-79b2086a-dcff-4bb6-893c-d852a886de1d {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:38:52 user nova-compute[82479]: WARNING nova.compute.manager [req-e0cb255a-2fa3-4ca1-9269-4822a59e3a2f req-d77c8354-5d47-413a-9ea5-21b4c7fc02df service nova] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Received unexpected event network-vif-plugged-79b2086a-dcff-4bb6-893c-d852a886de1d for instance with vm_state active and task_state reboot_started.
Apr 14 00:38:52 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:38:52 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:38:52 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:38:52 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:38:54 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:38:54 user nova-compute[82479]: DEBUG nova.virt.libvirt.host [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Removed pending event for 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc due to event {{(pid=82479) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 00:38:54 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681432734.2476578, 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc => Resumed> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:38:54 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] VM Resumed (Lifecycle Event)
Apr 14 00:38:54 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Instance running successfully.
Apr 14 00:38:54 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-6f9f5483-34e0-4c8c-a237-2aefb157360a tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Instance soft rebooted successfully.
Apr 14 00:38:54 user nova-compute[82479]: DEBUG nova.compute.manager [None req-6f9f5483-34e0-4c8c-a237-2aefb157360a tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:38:54 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:38:54 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:38:54 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] During sync_power_state the instance has a pending task (reboot_started). Skip.
Apr 14 00:38:54 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681432734.2497435, 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc => Started> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:38:54 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] VM Started (Lifecycle Event)
Apr 14 00:38:54 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:38:54 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:38:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-6f9f5483-34e0-4c8c-a237-2aefb157360a tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "0580f210-dd0b-4fc4-bcb2-e3db659e9cdc" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.361s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:38:54 user nova-compute[82479]: DEBUG nova.compute.manager [req-d7d9580d-5292-477b-8fa4-d36f7f5b734a req-4bb4100a-f693-4666-9af1-f5cbce59170c service nova] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Received event network-vif-plugged-79b2086a-dcff-4bb6-893c-d852a886de1d {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:38:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-d7d9580d-5292-477b-8fa4-d36f7f5b734a req-4bb4100a-f693-4666-9af1-f5cbce59170c service nova] Acquiring lock "0580f210-dd0b-4fc4-bcb2-e3db659e9cdc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:38:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-d7d9580d-5292-477b-8fa4-d36f7f5b734a req-4bb4100a-f693-4666-9af1-f5cbce59170c service nova] Lock "0580f210-dd0b-4fc4-bcb2-e3db659e9cdc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:38:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-d7d9580d-5292-477b-8fa4-d36f7f5b734a req-4bb4100a-f693-4666-9af1-f5cbce59170c service nova] Lock "0580f210-dd0b-4fc4-bcb2-e3db659e9cdc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:38:54 user nova-compute[82479]: DEBUG nova.compute.manager [req-d7d9580d-5292-477b-8fa4-d36f7f5b734a req-4bb4100a-f693-4666-9af1-f5cbce59170c service nova] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] No waiting events found dispatching network-vif-plugged-79b2086a-dcff-4bb6-893c-d852a886de1d {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:38:54 user nova-compute[82479]: WARNING nova.compute.manager [req-d7d9580d-5292-477b-8fa4-d36f7f5b734a req-4bb4100a-f693-4666-9af1-f5cbce59170c service nova] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Received unexpected event network-vif-plugged-79b2086a-dcff-4bb6-893c-d852a886de1d for instance with vm_state active and task_state None.
Apr 14 00:38:54 user nova-compute[82479]: DEBUG nova.compute.manager [req-d7d9580d-5292-477b-8fa4-d36f7f5b734a req-4bb4100a-f693-4666-9af1-f5cbce59170c service nova] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Received event network-vif-plugged-79b2086a-dcff-4bb6-893c-d852a886de1d {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:38:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-d7d9580d-5292-477b-8fa4-d36f7f5b734a req-4bb4100a-f693-4666-9af1-f5cbce59170c service nova] Acquiring lock "0580f210-dd0b-4fc4-bcb2-e3db659e9cdc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:38:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-d7d9580d-5292-477b-8fa4-d36f7f5b734a req-4bb4100a-f693-4666-9af1-f5cbce59170c service nova] Lock "0580f210-dd0b-4fc4-bcb2-e3db659e9cdc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:38:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-d7d9580d-5292-477b-8fa4-d36f7f5b734a req-4bb4100a-f693-4666-9af1-f5cbce59170c service nova] Lock "0580f210-dd0b-4fc4-bcb2-e3db659e9cdc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:38:54 user nova-compute[82479]: DEBUG nova.compute.manager [req-d7d9580d-5292-477b-8fa4-d36f7f5b734a req-4bb4100a-f693-4666-9af1-f5cbce59170c service nova] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] No waiting events found dispatching network-vif-plugged-79b2086a-dcff-4bb6-893c-d852a886de1d {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:38:54 user nova-compute[82479]: WARNING nova.compute.manager [req-d7d9580d-5292-477b-8fa4-d36f7f5b734a req-4bb4100a-f693-4666-9af1-f5cbce59170c service nova] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Received unexpected event network-vif-plugged-79b2086a-dcff-4bb6-893c-d852a886de1d for instance with vm_state active and task_state None.
Apr 14 00:38:56 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:38:59 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:39:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:39:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:39:06 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:39:06 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Starting heal instance info cache {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 00:39:06 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Rebuilding the list of instances to heal {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 00:39:06 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "refresh_cache-0580f210-dd0b-4fc4-bcb2-e3db659e9cdc" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:39:06 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquired lock "refresh_cache-0580f210-dd0b-4fc4-bcb2-e3db659e9cdc" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:39:06 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Forcefully refreshing network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 00:39:06 user nova-compute[82479]: DEBUG nova.objects.instance [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lazy-loading 'info_cache' on Instance uuid 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:39:06 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:39:07 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Updating instance_info_cache with network_info: [{"id": "79b2086a-dcff-4bb6-893c-d852a886de1d", "address": "fa:16:3e:23:48:56", "network": {"id": "d7b8d180-999a-4f41-b677-e83b1c24a8a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1461510401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46777f523af54eecb0e3260f14df7909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79b2086a-dc", "ovs_interfaceid": "79b2086a-dcff-4bb6-893c-d852a886de1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:39:07 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Releasing lock "refresh_cache-0580f210-dd0b-4fc4-bcb2-e3db659e9cdc" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:39:07 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Updated the network info_cache for instance {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 00:39:08 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:39:09 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:39:09 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:39:11 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:39:12 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:39:13 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:39:14 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:39:16 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:39:16 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:39:16 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82479) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 00:39:16 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:39:16 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:39:16 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:39:16 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:39:16 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Auditing locally available compute resources for user (node: user) {{(pid=82479) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 00:39:16 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:39:16 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:39:16 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:39:16 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:39:17 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:39:17 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:39:17 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:39:17 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:39:17 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Hypervisor/Node resource view: name=user free_ram=8794MB free_disk=26.14594268798828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82479) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 00:39:17 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:39:17 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:39:17 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:39:17 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 00:39:17 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 00:39:17 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:39:17 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:39:17 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Compute_service record updated for user:user {{(pid=82479) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 00:39:17 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.180s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:39:18 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:39:18 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:39:19 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:39:21 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:39:24 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:39:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:39:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:39:36 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:39:39 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:39:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:39:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:39:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:39:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:39:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:39:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:39:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:39:54 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:39:59 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:40:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:40:06 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:40:07 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:40:07 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Starting heal instance info cache {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 00:40:07 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Rebuilding the list of instances to heal {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 00:40:07 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "refresh_cache-0580f210-dd0b-4fc4-bcb2-e3db659e9cdc" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:40:07 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquired lock "refresh_cache-0580f210-dd0b-4fc4-bcb2-e3db659e9cdc" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:40:07 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Forcefully refreshing network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 00:40:07 user nova-compute[82479]: DEBUG nova.objects.instance [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lazy-loading 'info_cache' on Instance uuid 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:40:08 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Updating instance_info_cache with network_info: [{"id": "79b2086a-dcff-4bb6-893c-d852a886de1d", "address": "fa:16:3e:23:48:56", "network": {"id": "d7b8d180-999a-4f41-b677-e83b1c24a8a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1461510401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46777f523af54eecb0e3260f14df7909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79b2086a-dc", "ovs_interfaceid": "79b2086a-dcff-4bb6-893c-d852a886de1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:40:08 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Releasing lock "refresh_cache-0580f210-dd0b-4fc4-bcb2-e3db659e9cdc" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:40:08 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Updated the network info_cache for instance {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 00:40:09 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:40:09 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:40:14 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:40:14 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:40:14 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:40:16 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:40:16 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:40:16 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:40:16 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:40:16 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Auditing locally available compute resources for user (node: user) {{(pid=82479) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 00:40:16 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:40:16 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:40:16 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:40:16 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:40:16 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:40:17 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:40:17 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:40:17 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Hypervisor/Node resource view: name=user free_ram=8827MB free_disk=26.145362854003906GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82479) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 00:40:17 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:40:17 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:40:17 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:40:17 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 00:40:17 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 00:40:17 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:40:17 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:40:17 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Compute_service record updated for user:user {{(pid=82479) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 00:40:17 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.174s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:40:18 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:40:18 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:40:18 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:40:18 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82479) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 00:40:19 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:40:19 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:40:24 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:40:24 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:40:24 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:40:24 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:40:24 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:40:24 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:40:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:40:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:40:36 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:40:36 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:40:36 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:40:36 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:40:36 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:40:36 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:40:36 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:40:36 user nova-compute[82479]: DEBUG nova.virt.libvirt.imagecache [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Verify base images {{(pid=82479) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Apr 14 00:40:36 user nova-compute[82479]: DEBUG nova.virt.libvirt.imagecache [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Image id 11c4f6c7-2375-4030-96df-c731bbfc9a8a yields fingerprint 6c31422ec53b3e546a6532bebba7e376fae5e05d {{(pid=82479) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Apr 14 00:40:36 user nova-compute[82479]: INFO nova.virt.libvirt.imagecache [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] image 11c4f6c7-2375-4030-96df-c731bbfc9a8a at (/opt/stack/data/nova/instances/_base/6c31422ec53b3e546a6532bebba7e376fae5e05d): checking
Apr 14 00:40:36 user nova-compute[82479]: DEBUG nova.virt.libvirt.imagecache [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] image 11c4f6c7-2375-4030-96df-c731bbfc9a8a at (/opt/stack/data/nova/instances/_base/6c31422ec53b3e546a6532bebba7e376fae5e05d): image is in use {{(pid=82479) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Apr 14 00:40:36 user nova-compute[82479]: DEBUG nova.virt.libvirt.imagecache [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=82479) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Apr 14 00:40:36 user nova-compute[82479]: DEBUG nova.virt.libvirt.imagecache [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc is a valid instance name {{(pid=82479) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Apr 14 00:40:36 user nova-compute[82479]: DEBUG nova.virt.libvirt.imagecache [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc has a disk file {{(pid=82479) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Apr 14 00:40:36 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:40:36 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:40:36 user nova-compute[82479]: DEBUG nova.virt.libvirt.imagecache [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc is backed by 6c31422ec53b3e546a6532bebba7e376fae5e05d {{(pid=82479) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Apr 14 00:40:36 user nova-compute[82479]: WARNING nova.virt.libvirt.imagecache [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Unknown base file: /opt/stack/data/nova/instances/_base/a32c52384e5fdec946cb243a19fafeb83db04cd9
Apr 14 00:40:36 user nova-compute[82479]: WARNING nova.virt.libvirt.imagecache [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Unknown base file: /opt/stack/data/nova/instances/_base/2e082cf3dca1b4faa0412b293755b87fb31401cf
Apr 14 00:40:36 user nova-compute[82479]: WARNING nova.virt.libvirt.imagecache [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Unknown base file: /opt/stack/data/nova/instances/_base/e7b497aade2cf3320c9dd648df0aba732d7e7d55
Apr 14 00:40:36 user nova-compute[82479]: WARNING nova.virt.libvirt.imagecache [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Unknown base file: /opt/stack/data/nova/instances/_base/848691fef127d924018cc71228374edf26f59158
Apr 14 00:40:36 user nova-compute[82479]: WARNING nova.virt.libvirt.imagecache [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Unknown base file: /opt/stack/data/nova/instances/_base/790e6a0fbf8f17170f30a5686b33244e6dbee48a
Apr 14 00:40:36 user nova-compute[82479]: WARNING nova.virt.libvirt.imagecache [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Unknown base file: /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4
Apr 14 00:40:36 user nova-compute[82479]: WARNING nova.virt.libvirt.imagecache [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Unknown base file: /opt/stack/data/nova/instances/_base/2b62e8d46ab06db23c4b2d8ac0ee1f254fec5cba
Apr 14 00:40:36 user nova-compute[82479]: WARNING nova.virt.libvirt.imagecache [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Unknown base file: /opt/stack/data/nova/instances/_base/4ce35c80b3bff307959a38a69a9348abf786c630
Apr 14 00:40:36 user nova-compute[82479]: WARNING nova.virt.libvirt.imagecache [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Unknown base file: /opt/stack/data/nova/instances/_base/e5212d7ee0db0e10a8cd5cd85caac0b32ffc37cb
Apr 14 00:40:36 user nova-compute[82479]: INFO nova.virt.libvirt.imagecache [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Active base files: /opt/stack/data/nova/instances/_base/6c31422ec53b3e546a6532bebba7e376fae5e05d
Apr 14 00:40:36 user nova-compute[82479]: INFO nova.virt.libvirt.imagecache [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Removable base files: /opt/stack/data/nova/instances/_base/a32c52384e5fdec946cb243a19fafeb83db04cd9 /opt/stack/data/nova/instances/_base/2e082cf3dca1b4faa0412b293755b87fb31401cf /opt/stack/data/nova/instances/_base/e7b497aade2cf3320c9dd648df0aba732d7e7d55 /opt/stack/data/nova/instances/_base/848691fef127d924018cc71228374edf26f59158 /opt/stack/data/nova/instances/_base/790e6a0fbf8f17170f30a5686b33244e6dbee48a /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 /opt/stack/data/nova/instances/_base/2b62e8d46ab06db23c4b2d8ac0ee1f254fec5cba /opt/stack/data/nova/instances/_base/4ce35c80b3bff307959a38a69a9348abf786c630 /opt/stack/data/nova/instances/_base/e5212d7ee0db0e10a8cd5cd85caac0b32ffc37cb
Apr 14 00:40:36 user nova-compute[82479]: INFO nova.virt.libvirt.imagecache [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a32c52384e5fdec946cb243a19fafeb83db04cd9
Apr 14 00:40:36 user nova-compute[82479]: INFO nova.virt.libvirt.imagecache [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/2e082cf3dca1b4faa0412b293755b87fb31401cf
Apr 14 00:40:36 user nova-compute[82479]: INFO nova.virt.libvirt.imagecache [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e7b497aade2cf3320c9dd648df0aba732d7e7d55
Apr 14 00:40:36 user nova-compute[82479]: INFO nova.virt.libvirt.imagecache [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/848691fef127d924018cc71228374edf26f59158
Apr 14 00:40:36 user nova-compute[82479]: INFO nova.virt.libvirt.imagecache [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/790e6a0fbf8f17170f30a5686b33244e6dbee48a
Apr 14 00:40:36 user nova-compute[82479]: INFO nova.virt.libvirt.imagecache [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4
Apr 14 00:40:36 user nova-compute[82479]: INFO nova.virt.libvirt.imagecache [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/2b62e8d46ab06db23c4b2d8ac0ee1f254fec5cba
Apr 14 00:40:36 user nova-compute[82479]: INFO nova.virt.libvirt.imagecache [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/4ce35c80b3bff307959a38a69a9348abf786c630
Apr 14 00:40:36 user nova-compute[82479]: INFO nova.virt.libvirt.imagecache [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e5212d7ee0db0e10a8cd5cd85caac0b32ffc37cb
Apr 14 00:40:36 user nova-compute[82479]: DEBUG nova.virt.libvirt.imagecache [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Verification complete {{(pid=82479) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Apr 14 00:40:36 user nova-compute[82479]: DEBUG nova.virt.libvirt.imagecache [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Verify swap images {{(pid=82479) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Apr 14 00:40:36 user nova-compute[82479]: DEBUG nova.virt.libvirt.imagecache [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Verify ephemeral images {{(pid=82479) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Apr 14 00:40:38 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:40:38 user nova-compute[82479]: DEBUG nova.compute.manager [req-ded1dfc2-18f6-411b-82b5-17f088dbf515 req-57722ac7-82b0-47d7-aaad-061ea5014a22 service nova] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Received event network-changed-79b2086a-dcff-4bb6-893c-d852a886de1d {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:40:38 user nova-compute[82479]: DEBUG nova.compute.manager [req-ded1dfc2-18f6-411b-82b5-17f088dbf515 req-57722ac7-82b0-47d7-aaad-061ea5014a22 service nova] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Refreshing instance network info cache due to event network-changed-79b2086a-dcff-4bb6-893c-d852a886de1d. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:40:38 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-ded1dfc2-18f6-411b-82b5-17f088dbf515 req-57722ac7-82b0-47d7-aaad-061ea5014a22 service nova] Acquiring lock "refresh_cache-0580f210-dd0b-4fc4-bcb2-e3db659e9cdc" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:40:38 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-ded1dfc2-18f6-411b-82b5-17f088dbf515 req-57722ac7-82b0-47d7-aaad-061ea5014a22 service nova] Acquired lock "refresh_cache-0580f210-dd0b-4fc4-bcb2-e3db659e9cdc" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:40:38 user nova-compute[82479]: DEBUG nova.network.neutron [req-ded1dfc2-18f6-411b-82b5-17f088dbf515 req-57722ac7-82b0-47d7-aaad-061ea5014a22 service nova] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Refreshing network info cache for port 79b2086a-dcff-4bb6-893c-d852a886de1d {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:40:38 user nova-compute[82479]: DEBUG nova.network.neutron [req-ded1dfc2-18f6-411b-82b5-17f088dbf515 req-57722ac7-82b0-47d7-aaad-061ea5014a22 service nova] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Updated VIF entry in instance network info cache for port 79b2086a-dcff-4bb6-893c-d852a886de1d. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:40:38 user nova-compute[82479]: DEBUG nova.network.neutron [req-ded1dfc2-18f6-411b-82b5-17f088dbf515 req-57722ac7-82b0-47d7-aaad-061ea5014a22 service nova] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Updating instance_info_cache with network_info: [{"id": "79b2086a-dcff-4bb6-893c-d852a886de1d", "address": "fa:16:3e:23:48:56", "network": {"id": "d7b8d180-999a-4f41-b677-e83b1c24a8a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1461510401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46777f523af54eecb0e3260f14df7909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79b2086a-dc", "ovs_interfaceid": "79b2086a-dcff-4bb6-893c-d852a886de1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:40:39 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-ded1dfc2-18f6-411b-82b5-17f088dbf515 req-57722ac7-82b0-47d7-aaad-061ea5014a22 service nova] Releasing lock "refresh_cache-0580f210-dd0b-4fc4-bcb2-e3db659e9cdc" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:40:39 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:40:39 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-07bd6d89-37e6-4f8d-a7d4-2f6e998da520 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "0580f210-dd0b-4fc4-bcb2-e3db659e9cdc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:40:39 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-07bd6d89-37e6-4f8d-a7d4-2f6e998da520 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "0580f210-dd0b-4fc4-bcb2-e3db659e9cdc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:40:39 user nova-compute[82479]: INFO nova.compute.manager [None req-07bd6d89-37e6-4f8d-a7d4-2f6e998da520 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Detaching volume 17f3af17-ec13-4449-90ee-4b4f2375cd14
Apr 14 00:40:39 user nova-compute[82479]: INFO nova.virt.block_device [None req-07bd6d89-37e6-4f8d-a7d4-2f6e998da520 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Attempting to driver detach volume 17f3af17-ec13-4449-90ee-4b4f2375cd14 from mountpoint /dev/vdb
Apr 14 00:40:39 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-07bd6d89-37e6-4f8d-a7d4-2f6e998da520 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Attempting to detach device vdb from instance 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc from the persistent domain config. {{(pid=82479) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 00:40:39 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-07bd6d89-37e6-4f8d-a7d4-2f6e998da520 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 00:40:39 user nova-compute[82479]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:40:39 user nova-compute[82479]:   <source dev="/dev/sdb"/>
Apr 14 00:40:39 user nova-compute[82479]:   <target dev="vdb" bus="virtio"/>
Apr 14 00:40:39 user nova-compute[82479]:   <serial>17f3af17-ec13-4449-90ee-4b4f2375cd14</serial>
Apr 14 00:40:39 user nova-compute[82479]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 00:40:39 user nova-compute[82479]: </disk>
Apr 14 00:40:39 user nova-compute[82479]:  {{(pid=82479) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 00:40:39 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-07bd6d89-37e6-4f8d-a7d4-2f6e998da520 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Successfully detached device vdb from instance 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc from the persistent domain config.
Apr 14 00:40:39 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-07bd6d89-37e6-4f8d-a7d4-2f6e998da520 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc from the live domain config. {{(pid=82479) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 00:40:39 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-07bd6d89-37e6-4f8d-a7d4-2f6e998da520 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 00:40:39 user nova-compute[82479]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:40:39 user nova-compute[82479]:   <source dev="/dev/sdb"/>
Apr 14 00:40:39 user nova-compute[82479]:   <target dev="vdb" bus="virtio"/>
Apr 14 00:40:39 user nova-compute[82479]:   <serial>17f3af17-ec13-4449-90ee-4b4f2375cd14</serial>
Apr 14 00:40:39 user nova-compute[82479]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 00:40:39 user nova-compute[82479]: </disk>
Apr 14 00:40:39 user nova-compute[82479]:  {{(pid=82479) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 00:40:40 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Received event <DeviceRemovedEvent: 1681432840.0656338, 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82479) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 00:40:40 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-07bd6d89-37e6-4f8d-a7d4-2f6e998da520 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc {{(pid=82479) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 00:40:40 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-07bd6d89-37e6-4f8d-a7d4-2f6e998da520 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Successfully detached device vdb from instance 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc from the live domain config.
Apr 14 00:40:40 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07bd6d89-37e6-4f8d-a7d4-2f6e998da520 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] calling os-brick to detach iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 00:40:40 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-07bd6d89-37e6-4f8d-a7d4-2f6e998da520 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, {'target_iqn': 'iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OWCVLeKa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:40:40 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-07bd6d89-37e6-4f8d-a7d4-2f6e998da520 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:40:40 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-07bd6d89-37e6-4f8d-a7d4-2f6e998da520 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:40:40 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-07bd6d89-37e6-4f8d-a7d4-2f6e998da520 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:40:40 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:40:40 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:40:40 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[817d5ecb-1e18-46df-98dc-961b240dbe8f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:40:40 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-07bd6d89-37e6-4f8d-a7d4-2f6e998da520 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 00:40:40 user nova-compute[82479]: No targets found.
Apr 14 00:40:40 user nova-compute[82479]: iSNS:
Apr 14 00:40:40 user nova-compute[82479]: No targets found.
Apr 14 00:40:40 user nova-compute[82479]: STATIC:
Apr 14 00:40:40 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14
Apr 14 00:40:40 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:40:40 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:40:40 user nova-compute[82479]: FIRMWARE:
Apr 14 00:40:40 user nova-compute[82479]: No targets found.
Apr 14 00:40:40 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:40:40 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-07bd6d89-37e6-4f8d-a7d4-2f6e998da520 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 00:40:40 user nova-compute[82479]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 00:40:40 user nova-compute[82479]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82479) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 00:40:40 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-07bd6d89-37e6-4f8d-a7d4-2f6e998da520 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14', 0)] {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 00:40:40 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:40:40 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:40:40 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[82edb607-813c-4615-af98-908872473c02]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:40:40 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:40:40 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:40:40 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e78a19f-2d61-49c2-8bf3-a4679e1c2c73]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:40:40 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-07bd6d89-37e6-4f8d-a7d4-2f6e998da520 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14 (non-flash)
Apr 14 00:40:40 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:40:40 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-07bd6d89-37e6-4f8d-a7d4-2f6e998da520 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14 (non-flash)
Apr 14 00:40:40 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:40:40 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-07bd6d89-37e6-4f8d-a7d4-2f6e998da520 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f33301905e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14'): ({'sdb'}, set())}) {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 00:40:40 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-07bd6d89-37e6-4f8d-a7d4-2f6e998da520 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Removing single pathed devices sdb {{(pid=82479) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 00:40:40 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:40:40 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:40:40 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f7f423e-39e1-4c8d-bf57-736e5dc50dae]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:40:40 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:40:40 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:40:40 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[612af45d-be7c-407a-b8f2-68d8789291d7]: (4, ('ok\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:40:40 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-07bd6d89-37e6-4f8d-a7d4-2f6e998da520 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Flushing IO for device /dev/sdb {{(pid=82479) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 00:40:40 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:40:40 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:40:40 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7e4b3b-65a2-46f7-8e32-19d69a22f953]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:40:40 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-07bd6d89-37e6-4f8d-a7d4-2f6e998da520 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82479) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 00:40:40 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:40:40 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:40:40 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[022ba860-fffb-41b3-863a-63c11a1d1f4d]: (4, ('1', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:40:40 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-07bd6d89-37e6-4f8d-a7d4-2f6e998da520 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 00:40:40 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-07bd6d89-37e6-4f8d-a7d4-2f6e998da520 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] SCSI volumes sdb have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 00:40:40 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-07bd6d89-37e6-4f8d-a7d4-2f6e998da520 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14')] {{(pid=82479) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 00:40:40 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:40:40 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:40:40 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f93d719-e021-4bd7-8a75-512f971ffb14]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:40:40 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-07bd6d89-37e6-4f8d-a7d4-2f6e998da520 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:40:40 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14 -p 172.16.0.220:3260 --logout {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:40:40 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:40:40 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[130afa27-ced7-4f8e-bafa-d956d4c79e04]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:40:40 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-07bd6d89-37e6-4f8d-a7d4-2f6e998da520 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14, portal: 172.16.0.220,3260]
Apr 14 00:40:40 user nova-compute[82479]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14, portal: 172.16.0.220,3260] successful.
Apr 14 00:40:40 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:40:40 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14 -p 172.16.0.220:3260 --op delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:40:40 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:40:40 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d859423-2f11-44be-ab3e-dd3eb081c33d]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:40:40 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-07bd6d89-37e6-4f8d-a7d4-2f6e998da520 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:40:40 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-07bd6d89-37e6-4f8d-a7d4-2f6e998da520 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:40:40 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-07bd6d89-37e6-4f8d-a7d4-2f6e998da520 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] <== disconnect_volume: return (336ms) None {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:40:40 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07bd6d89-37e6-4f8d-a7d4-2f6e998da520 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Disconnected iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 00:40:40 user nova-compute[82479]: DEBUG nova.compute.manager [req-73c5174c-31bd-419c-8ecb-6b3979de137b req-50c711fa-3f29-49cf-967e-d166a2ef871b service nova] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Received event network-changed-79b2086a-dcff-4bb6-893c-d852a886de1d {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:40:40 user nova-compute[82479]: DEBUG nova.compute.manager [req-73c5174c-31bd-419c-8ecb-6b3979de137b req-50c711fa-3f29-49cf-967e-d166a2ef871b service nova] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Refreshing instance network info cache due to event network-changed-79b2086a-dcff-4bb6-893c-d852a886de1d. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:40:40 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-73c5174c-31bd-419c-8ecb-6b3979de137b req-50c711fa-3f29-49cf-967e-d166a2ef871b service nova] Acquiring lock "refresh_cache-0580f210-dd0b-4fc4-bcb2-e3db659e9cdc" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:40:40 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-73c5174c-31bd-419c-8ecb-6b3979de137b req-50c711fa-3f29-49cf-967e-d166a2ef871b service nova] Acquired lock "refresh_cache-0580f210-dd0b-4fc4-bcb2-e3db659e9cdc" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:40:40 user nova-compute[82479]: DEBUG nova.network.neutron [req-73c5174c-31bd-419c-8ecb-6b3979de137b req-50c711fa-3f29-49cf-967e-d166a2ef871b service nova] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Refreshing network info cache for port 79b2086a-dcff-4bb6-893c-d852a886de1d {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:40:41 user nova-compute[82479]: DEBUG nova.network.neutron [req-73c5174c-31bd-419c-8ecb-6b3979de137b req-50c711fa-3f29-49cf-967e-d166a2ef871b service nova] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Updated VIF entry in instance network info cache for port 79b2086a-dcff-4bb6-893c-d852a886de1d. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:40:41 user nova-compute[82479]: DEBUG nova.network.neutron [req-73c5174c-31bd-419c-8ecb-6b3979de137b req-50c711fa-3f29-49cf-967e-d166a2ef871b service nova] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Updating instance_info_cache with network_info: [{"id": "79b2086a-dcff-4bb6-893c-d852a886de1d", "address": "fa:16:3e:23:48:56", "network": {"id": "d7b8d180-999a-4f41-b677-e83b1c24a8a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1461510401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46777f523af54eecb0e3260f14df7909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79b2086a-dc", "ovs_interfaceid": "79b2086a-dcff-4bb6-893c-d852a886de1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:40:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-73c5174c-31bd-419c-8ecb-6b3979de137b req-50c711fa-3f29-49cf-967e-d166a2ef871b service nova] Releasing lock "refresh_cache-0580f210-dd0b-4fc4-bcb2-e3db659e9cdc" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:40:41 user nova-compute[82479]: DEBUG nova.objects.instance [None req-07bd6d89-37e6-4f8d-a7d4-2f6e998da520 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lazy-loading 'flavor' on Instance uuid 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:40:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-07bd6d89-37e6-4f8d-a7d4-2f6e998da520 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "0580f210-dd0b-4fc4-bcb2-e3db659e9cdc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.744s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:40:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:40:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:40:46 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:40:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:40:54 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:40:59 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:40:59 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:40:59 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:40:59 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:40:59 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:40:59 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:41:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:41:06 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:41:09 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:41:09 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:41:09 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Starting heal instance info cache {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 00:41:09 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Rebuilding the list of instances to heal {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 00:41:09 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "refresh_cache-0580f210-dd0b-4fc4-bcb2-e3db659e9cdc" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:41:09 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquired lock "refresh_cache-0580f210-dd0b-4fc4-bcb2-e3db659e9cdc" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:41:09 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Forcefully refreshing network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 00:41:09 user nova-compute[82479]: DEBUG nova.objects.instance [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lazy-loading 'info_cache' on Instance uuid 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:41:10 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Updating instance_info_cache with network_info: [{"id": "79b2086a-dcff-4bb6-893c-d852a886de1d", "address": "fa:16:3e:23:48:56", "network": {"id": "d7b8d180-999a-4f41-b677-e83b1c24a8a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1461510401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46777f523af54eecb0e3260f14df7909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79b2086a-dc", "ovs_interfaceid": "79b2086a-dcff-4bb6-893c-d852a886de1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:41:10 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Releasing lock "refresh_cache-0580f210-dd0b-4fc4-bcb2-e3db659e9cdc" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:41:10 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Updated the network info_cache for instance {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 00:41:10 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:41:12 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:41:12 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:41:12 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Cleaning up deleted instances {{(pid=82479) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 00:41:12 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] There are 0 instances to clean {{(pid=82479) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 00:41:14 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:41:14 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:41:14 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:41:17 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:41:17 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82479) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 00:41:18 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:41:18 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:41:18 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:41:18 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:41:18 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Auditing locally available compute resources for user (node: user) {{(pid=82479) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 00:41:18 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:41:18 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:41:18 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:41:18 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:41:19 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:41:19 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:41:19 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:41:19 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Hypervisor/Node resource view: name=user free_ram=8821MB free_disk=26.144546508789062GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82479) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 00:41:19 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:41:19 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:41:19 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:41:19 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 00:41:19 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 00:41:19 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Refreshing inventories for resource provider 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 00:41:19 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Updating ProviderTree inventory for provider 3847975a-19aa-4b27-9180-14b5cc49044a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 00:41:19 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Updating inventory in ProviderTree for provider 3847975a-19aa-4b27-9180-14b5cc49044a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 00:41:19 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Refreshing aggregate associations for resource provider 3847975a-19aa-4b27-9180-14b5cc49044a, aggregates: None {{(pid=82479) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 00:41:19 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Refreshing trait associations for resource provider 3847975a-19aa-4b27-9180-14b5cc49044a, traits: COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,HW_CPU_X86_SSE42,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO {{(pid=82479) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 00:41:19 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:41:19 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:41:19 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Compute_service record updated for user:user {{(pid=82479) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 00:41:19 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.462s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:41:20 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:41:20 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:41:20 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:41:22 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:41:22 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Cleaning up deleted instances with incomplete migration  {{(pid=82479) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 00:41:24 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:41:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:41:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:41:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:41:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:41:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:41:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:41:33 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a5ca03cf-41a7-4991-a6a9-b500527bac12 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "0580f210-dd0b-4fc4-bcb2-e3db659e9cdc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:41:33 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a5ca03cf-41a7-4991-a6a9-b500527bac12 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "0580f210-dd0b-4fc4-bcb2-e3db659e9cdc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:41:33 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a5ca03cf-41a7-4991-a6a9-b500527bac12 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "0580f210-dd0b-4fc4-bcb2-e3db659e9cdc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:41:33 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a5ca03cf-41a7-4991-a6a9-b500527bac12 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "0580f210-dd0b-4fc4-bcb2-e3db659e9cdc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:41:33 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a5ca03cf-41a7-4991-a6a9-b500527bac12 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "0580f210-dd0b-4fc4-bcb2-e3db659e9cdc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:41:33 user nova-compute[82479]: INFO nova.compute.manager [None req-a5ca03cf-41a7-4991-a6a9-b500527bac12 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Terminating instance
Apr 14 00:41:33 user nova-compute[82479]: DEBUG nova.compute.manager [None req-a5ca03cf-41a7-4991-a6a9-b500527bac12 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Start destroying the instance on the hypervisor. {{(pid=82479) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 00:41:33 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:41:33 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:41:33 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:41:33 user nova-compute[82479]: DEBUG nova.compute.manager [req-ecc01d5e-aabb-42dd-9da9-24969ae51bb6 req-4d35ab11-2434-42e9-aa08-a8ecf639dc3c service nova] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Received event network-vif-unplugged-79b2086a-dcff-4bb6-893c-d852a886de1d {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:41:33 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-ecc01d5e-aabb-42dd-9da9-24969ae51bb6 req-4d35ab11-2434-42e9-aa08-a8ecf639dc3c service nova] Acquiring lock "0580f210-dd0b-4fc4-bcb2-e3db659e9cdc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:41:33 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-ecc01d5e-aabb-42dd-9da9-24969ae51bb6 req-4d35ab11-2434-42e9-aa08-a8ecf639dc3c service nova] Lock "0580f210-dd0b-4fc4-bcb2-e3db659e9cdc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:41:33 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-ecc01d5e-aabb-42dd-9da9-24969ae51bb6 req-4d35ab11-2434-42e9-aa08-a8ecf639dc3c service nova] Lock "0580f210-dd0b-4fc4-bcb2-e3db659e9cdc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:41:33 user nova-compute[82479]: DEBUG nova.compute.manager [req-ecc01d5e-aabb-42dd-9da9-24969ae51bb6 req-4d35ab11-2434-42e9-aa08-a8ecf639dc3c service nova] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] No waiting events found dispatching network-vif-unplugged-79b2086a-dcff-4bb6-893c-d852a886de1d {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:41:33 user nova-compute[82479]: DEBUG nova.compute.manager [req-ecc01d5e-aabb-42dd-9da9-24969ae51bb6 req-4d35ab11-2434-42e9-aa08-a8ecf639dc3c service nova] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Received event network-vif-unplugged-79b2086a-dcff-4bb6-893c-d852a886de1d for instance with task_state deleting. {{(pid=82479) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 00:41:34 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Instance destroyed successfully.
Apr 14 00:41:34 user nova-compute[82479]: DEBUG nova.objects.instance [None req-a5ca03cf-41a7-4991-a6a9-b500527bac12 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lazy-loading 'resources' on Instance uuid 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:41:34 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-a5ca03cf-41a7-4991-a6a9-b500527bac12 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:36:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1367836214',display_name='tempest-TestMinimumBasicScenario-server-1367836214',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1367836214',id=39,image_ref='11c4f6c7-2375-4030-96df-c731bbfc9a8a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCU8iJCvLdXte1ng454W6MPjmwOaCNiooSbUzryCYaPKsm+elaQXxHL7pJqwwJUB3WBM5uXW0vPbCSXH/dGpXulUINeoD4fVc77lCjWDhdsnf0Qt5ZAqjG8F4xyRbxqxJg==',key_name='tempest-TestMinimumBasicScenario-1685780787',keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:36:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46777f523af54eecb0e3260f14df7909',ramdisk_id='',reservation_id='r-4x5vm7fo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='11c4f6c7-2375-4030-96df-c731bbfc9a8a',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-598834355',owner_user_name='tempest-TestMinimumBasicScenario-598834355-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T00:38:54Z,user_data=None,user_id='e5ad76f13b78448887913c4d0bcb16af',uuid=0580f210-dd0b-4fc4-bcb2-e3db659e9cdc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "79b2086a-dcff-4bb6-893c-d852a886de1d", "address": "fa:16:3e:23:48:56", "network": {"id": "d7b8d180-999a-4f41-b677-e83b1c24a8a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1461510401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46777f523af54eecb0e3260f14df7909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79b2086a-dc", "ovs_interfaceid": "79b2086a-dcff-4bb6-893c-d852a886de1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 00:41:34 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-a5ca03cf-41a7-4991-a6a9-b500527bac12 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Converting VIF {"id": "79b2086a-dcff-4bb6-893c-d852a886de1d", "address": "fa:16:3e:23:48:56", "network": {"id": "d7b8d180-999a-4f41-b677-e83b1c24a8a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1461510401-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46777f523af54eecb0e3260f14df7909", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79b2086a-dc", "ovs_interfaceid": "79b2086a-dcff-4bb6-893c-d852a886de1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:41:34 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-a5ca03cf-41a7-4991-a6a9-b500527bac12 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:48:56,bridge_name='br-int',has_traffic_filtering=True,id=79b2086a-dcff-4bb6-893c-d852a886de1d,network=Network(d7b8d180-999a-4f41-b677-e83b1c24a8a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79b2086a-dc') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:41:34 user nova-compute[82479]: DEBUG os_vif [None req-a5ca03cf-41a7-4991-a6a9-b500527bac12 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:48:56,bridge_name='br-int',has_traffic_filtering=True,id=79b2086a-dcff-4bb6-893c-d852a886de1d,network=Network(d7b8d180-999a-4f41-b677-e83b1c24a8a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79b2086a-dc') {{(pid=82479) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 00:41:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:41:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap79b2086a-dc, bridge=br-int, if_exists=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:41:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:41:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:41:34 user nova-compute[82479]: INFO os_vif [None req-a5ca03cf-41a7-4991-a6a9-b500527bac12 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:48:56,bridge_name='br-int',has_traffic_filtering=True,id=79b2086a-dcff-4bb6-893c-d852a886de1d,network=Network(d7b8d180-999a-4f41-b677-e83b1c24a8a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79b2086a-dc')
Apr 14 00:41:34 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-a5ca03cf-41a7-4991-a6a9-b500527bac12 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Deleting instance files /opt/stack/data/nova/instances/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc_del
Apr 14 00:41:34 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-a5ca03cf-41a7-4991-a6a9-b500527bac12 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Deletion of /opt/stack/data/nova/instances/0580f210-dd0b-4fc4-bcb2-e3db659e9cdc_del complete
Apr 14 00:41:34 user nova-compute[82479]: INFO nova.compute.manager [None req-a5ca03cf-41a7-4991-a6a9-b500527bac12 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Took 0.96 seconds to destroy the instance on the hypervisor.
Apr 14 00:41:34 user nova-compute[82479]: DEBUG oslo.service.loopingcall [None req-a5ca03cf-41a7-4991-a6a9-b500527bac12 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82479) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 00:41:34 user nova-compute[82479]: DEBUG nova.compute.manager [-] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Deallocating network for instance {{(pid=82479) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 00:41:34 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] deallocate_for_instance() {{(pid=82479) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 00:41:35 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:41:35 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Updating instance_info_cache with network_info: [] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:41:35 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Took 0.78 seconds to deallocate network for instance.
Apr 14 00:41:35 user nova-compute[82479]: DEBUG nova.compute.manager [req-d02b2cf7-197f-4d2f-814b-73aa7b4f1c60 req-38fa0b38-d202-4fb5-b400-0be25455eecf service nova] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Received event network-vif-deleted-79b2086a-dcff-4bb6-893c-d852a886de1d {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:41:35 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a5ca03cf-41a7-4991-a6a9-b500527bac12 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:41:35 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a5ca03cf-41a7-4991-a6a9-b500527bac12 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:41:35 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-a5ca03cf-41a7-4991-a6a9-b500527bac12 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:41:35 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-a5ca03cf-41a7-4991-a6a9-b500527bac12 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:41:35 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a5ca03cf-41a7-4991-a6a9-b500527bac12 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.110s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:41:35 user nova-compute[82479]: INFO nova.scheduler.client.report [None req-a5ca03cf-41a7-4991-a6a9-b500527bac12 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Deleted allocations for instance 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc
Apr 14 00:41:35 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a5ca03cf-41a7-4991-a6a9-b500527bac12 tempest-TestMinimumBasicScenario-598834355 tempest-TestMinimumBasicScenario-598834355-project-member] Lock "0580f210-dd0b-4fc4-bcb2-e3db659e9cdc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.162s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:41:35 user nova-compute[82479]: DEBUG nova.compute.manager [req-a0b2f130-ba6c-4393-8e76-6420eae4454e req-3d618b3f-12bb-4b25-8944-c27c8dfe0584 service nova] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Received event network-vif-plugged-79b2086a-dcff-4bb6-893c-d852a886de1d {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:41:35 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-a0b2f130-ba6c-4393-8e76-6420eae4454e req-3d618b3f-12bb-4b25-8944-c27c8dfe0584 service nova] Acquiring lock "0580f210-dd0b-4fc4-bcb2-e3db659e9cdc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:41:35 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-a0b2f130-ba6c-4393-8e76-6420eae4454e req-3d618b3f-12bb-4b25-8944-c27c8dfe0584 service nova] Lock "0580f210-dd0b-4fc4-bcb2-e3db659e9cdc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:41:35 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-a0b2f130-ba6c-4393-8e76-6420eae4454e req-3d618b3f-12bb-4b25-8944-c27c8dfe0584 service nova] Lock "0580f210-dd0b-4fc4-bcb2-e3db659e9cdc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:41:35 user nova-compute[82479]: DEBUG nova.compute.manager [req-a0b2f130-ba6c-4393-8e76-6420eae4454e req-3d618b3f-12bb-4b25-8944-c27c8dfe0584 service nova] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] No waiting events found dispatching network-vif-plugged-79b2086a-dcff-4bb6-893c-d852a886de1d {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:41:35 user nova-compute[82479]: WARNING nova.compute.manager [req-a0b2f130-ba6c-4393-8e76-6420eae4454e req-3d618b3f-12bb-4b25-8944-c27c8dfe0584 service nova] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Received unexpected event network-vif-plugged-79b2086a-dcff-4bb6-893c-d852a886de1d for instance with vm_state deleted and task_state None.
Apr 14 00:41:39 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:41:39 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:41:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:41:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:41:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:41:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:41:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:41:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:41:49 user nova-compute[82479]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681432894.288047, 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc => Stopped> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:41:49 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] VM Stopped (Lifecycle Event)
Apr 14 00:41:49 user nova-compute[82479]: DEBUG nova.compute.manager [None req-6c75373e-7ecf-4d68-a8f2-39e1d287a8e1 None None] [instance: 0580f210-dd0b-4fc4-bcb2-e3db659e9cdc] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:41:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:41:54 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:41:59 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:42:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:42:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:42:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:42:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:42:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:42:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:42:08 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._sync_power_states {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:42:09 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:42:10 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:42:10 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Starting heal instance info cache {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 00:42:10 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Rebuilding the list of instances to heal {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 00:42:10 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Didn't find any instances for network info cache update. {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 00:42:12 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:42:14 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:42:14 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:42:15 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:42:17 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:42:17 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82479) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 00:42:19 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:42:19 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:42:19 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:42:19 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:42:19 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:42:19 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Auditing locally available compute resources for user (node: user) {{(pid=82479) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 00:42:20 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:42:20 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:42:20 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Hypervisor/Node resource view: name=user free_ram=8938MB free_disk=26.16373062133789GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82479) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 00:42:20 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:42:20 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:42:20 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 00:42:20 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 00:42:20 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:42:20 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:42:20 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Compute_service record updated for user:user {{(pid=82479) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 00:42:20 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.170s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:42:21 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:42:21 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:42:22 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:42:24 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:42:24 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:42:26 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:42:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:42:30 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:42:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:42:36 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:42:39 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:42:39 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:42:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:42:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:42:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:42:46 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:42:46 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:42:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:42:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:42:54 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:42:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "b84a5b31-1959-4a5e-88f5-66b6a0179b09" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:42:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "b84a5b31-1959-4a5e-88f5-66b6a0179b09" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:42:54 user nova-compute[82479]: DEBUG nova.compute.manager [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Starting instance... {{(pid=82479) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 00:42:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:42:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:42:54 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82479) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 00:42:54 user nova-compute[82479]: INFO nova.compute.claims [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Claim successful on node user
Apr 14 00:42:55 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:42:55 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:42:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.195s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:42:55 user nova-compute[82479]: DEBUG nova.compute.manager [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Start building networks asynchronously for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 00:42:55 user nova-compute[82479]: DEBUG nova.compute.manager [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Allocating IP information in the background. {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 00:42:55 user nova-compute[82479]: DEBUG nova.network.neutron [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] allocate_for_instance() {{(pid=82479) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 00:42:55 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 00:42:55 user nova-compute[82479]: DEBUG nova.compute.manager [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Start building block device mappings for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 00:42:55 user nova-compute[82479]: INFO nova.virt.block_device [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Booting with volume snapshot a7e35933-c830-4d32-abde-a95c31b23f63 at /dev/vda
Apr 14 00:42:55 user nova-compute[82479]: DEBUG nova.policy [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cfb66031fcf84659a3b80cdb76ffddc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934526a2dfa45f4bd5df4edee11d98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82479) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 00:42:56 user nova-compute[82479]: DEBUG nova.network.neutron [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Successfully created port: 5d572ef8-2fc4-4431-b8be-efd367a8866a {{(pid=82479) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 00:42:57 user nova-compute[82479]: DEBUG nova.network.neutron [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Successfully updated port: 5d572ef8-2fc4-4431-b8be-efd367a8866a {{(pid=82479) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 00:42:57 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "refresh_cache-b84a5b31-1959-4a5e-88f5-66b6a0179b09" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:42:57 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquired lock "refresh_cache-b84a5b31-1959-4a5e-88f5-66b6a0179b09" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:42:57 user nova-compute[82479]: DEBUG nova.network.neutron [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 00:42:57 user nova-compute[82479]: DEBUG nova.network.neutron [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Instance cache missing network info. {{(pid=82479) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 00:42:57 user nova-compute[82479]: DEBUG nova.compute.manager [req-5d95655c-571c-4a61-bbeb-778f827f796d req-4eb52201-f504-4a30-af8e-1e526ddceb68 service nova] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Received event network-changed-5d572ef8-2fc4-4431-b8be-efd367a8866a {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:42:57 user nova-compute[82479]: DEBUG nova.compute.manager [req-5d95655c-571c-4a61-bbeb-778f827f796d req-4eb52201-f504-4a30-af8e-1e526ddceb68 service nova] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Refreshing instance network info cache due to event network-changed-5d572ef8-2fc4-4431-b8be-efd367a8866a. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:42:57 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-5d95655c-571c-4a61-bbeb-778f827f796d req-4eb52201-f504-4a30-af8e-1e526ddceb68 service nova] Acquiring lock "refresh_cache-b84a5b31-1959-4a5e-88f5-66b6a0179b09" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:42:57 user nova-compute[82479]: DEBUG nova.network.neutron [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Updating instance_info_cache with network_info: [{"id": "5d572ef8-2fc4-4431-b8be-efd367a8866a", "address": "fa:16:3e:65:5b:65", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d572ef8-2f", "ovs_interfaceid": "5d572ef8-2fc4-4431-b8be-efd367a8866a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:42:57 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Releasing lock "refresh_cache-b84a5b31-1959-4a5e-88f5-66b6a0179b09" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:42:57 user nova-compute[82479]: DEBUG nova.compute.manager [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Instance network_info: |[{"id": "5d572ef8-2fc4-4431-b8be-efd367a8866a", "address": "fa:16:3e:65:5b:65", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d572ef8-2f", "ovs_interfaceid": "5d572ef8-2fc4-4431-b8be-efd367a8866a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 00:42:57 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-5d95655c-571c-4a61-bbeb-778f827f796d req-4eb52201-f504-4a30-af8e-1e526ddceb68 service nova] Acquired lock "refresh_cache-b84a5b31-1959-4a5e-88f5-66b6a0179b09" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:42:57 user nova-compute[82479]: DEBUG nova.network.neutron [req-5d95655c-571c-4a61-bbeb-778f827f796d req-4eb52201-f504-4a30-af8e-1e526ddceb68 service nova] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Refreshing network info cache for port 5d572ef8-2fc4-4431-b8be-efd367a8866a {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:42:58 user nova-compute[82479]: DEBUG nova.network.neutron [req-5d95655c-571c-4a61-bbeb-778f827f796d req-4eb52201-f504-4a30-af8e-1e526ddceb68 service nova] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Updated VIF entry in instance network info cache for port 5d572ef8-2fc4-4431-b8be-efd367a8866a. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:42:58 user nova-compute[82479]: DEBUG nova.network.neutron [req-5d95655c-571c-4a61-bbeb-778f827f796d req-4eb52201-f504-4a30-af8e-1e526ddceb68 service nova] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Updating instance_info_cache with network_info: [{"id": "5d572ef8-2fc4-4431-b8be-efd367a8866a", "address": "fa:16:3e:65:5b:65", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d572ef8-2f", "ovs_interfaceid": "5d572ef8-2fc4-4431-b8be-efd367a8866a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:42:58 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-5d95655c-571c-4a61-bbeb-778f827f796d req-4eb52201-f504-4a30-af8e-1e526ddceb68 service nova] Releasing lock "refresh_cache-b84a5b31-1959-4a5e-88f5-66b6a0179b09" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:42:59 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:43:00 user nova-compute[82479]: DEBUG os_brick.utils [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:43:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:43:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:43:00 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d528056-b4e8-4563-8e24-02d913e4a044]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fec92fcfdd3\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:43:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:43:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:43:00 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[1299d0f1-cfad-4190-9922-075f8745f5c5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:43:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:43:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:43:00 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a832ff-6682-43b5-8777-0d6ff1aee22c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:43:00 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[406743a9-f3c0-4fec-a659-342e38978ca4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:43:00 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Running cmd (subprocess): nvme version {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:43:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] 'nvme version' failed. Not Retrying. {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:43:01 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.nvmeof [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] nvme not present on system {{(pid=82479) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 00:43:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:43:01 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:43:01 user nova-compute[82479]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 00:43:01 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0deb53b-22da-42bb-9e91-eac224138c78]: (4, '') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:43:01 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82479) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 00:43:01 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 00:43:01 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] LIGHTOS: no hostnqn found. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 00:43:01 user nova-compute[82479]: DEBUG os_brick.utils [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fec92fcfdd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:43:01 user nova-compute[82479]: DEBUG nova.virt.block_device [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Updating existing volume attachment record: 88806eb1-d65c-4041-acc1-55d42ba956bc {{(pid=82479) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 00:43:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:43:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:43:05 user nova-compute[82479]: DEBUG nova.compute.manager [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Start spawning the instance on the hypervisor. {{(pid=82479) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 00:43:05 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Creating instance directory {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 00:43:05 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Creating image(s)
Apr 14 00:43:05 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Did not create local disks {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 00:43:05 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Ensure instance console log exists: /opt/stack/data/nova/instances/b84a5b31-1959-4a5e-88f5-66b6a0179b09/console.log {{(pid=82479) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 00:43:05 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:43:05 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:43:05 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:43:05 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Start _get_guest_xml network_info=[{"id": "5d572ef8-2fc4-4431-b8be-efd367a8866a", "address": "fa:16:3e:65:5b:65", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d572ef8-2f", "ovs_interfaceid": "5d572ef8-2fc4-4431-b8be-efd367a8866a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': True, 'attachment_id': '88806eb1-d65c-4041-acc1-55d42ba956bc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QXWvJOjm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b84a5b31-1959-4a5e-88f5-66b6a0179b09', 'attached_at': '', 'detached_at': '', 'volume_id': '9ddd1cc0-8674-458e-bd7e-2479493c1fd3', 'serial': '9ddd1cc0-8674-458e-bd7e-2479493c1fd3'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 00:43:05 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:43:05 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:43:05 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82479) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 00:43:05 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T00:02:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 00:43:05 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Flavor limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 00:43:05 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Image limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 00:43:05 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Flavor pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 00:43:05 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Image pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 00:43:05 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 00:43:05 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 00:43:05 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 00:43:05 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Got 1 possible topologies {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 00:43:05 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 00:43:05 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 00:43:05 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Calling os-brick to attach iSCSI Volume {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 00:43:05 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QXWvJOjm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:43:05 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:43:05 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:43:05 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:43:05 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:43:05 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:43:05 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:43:05 user nova-compute[82479]: INFO os_brick.initiator.connectors.iscsi [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 00:43:05 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3 -p 172.16.0.220:3260 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:43:05 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:43:05 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1cdf80-7217-4904-b5b3-fc0770a9cd8a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:43:05 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 00:43:05 user nova-compute[82479]:  {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:43:05 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3 -p 172.16.0.220:3260 --interface default --op new {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:43:05 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:43:05 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[365575df-d35a-4f69-9fb5-8cde8de6a866]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3] added\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:43:05 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3] added
Apr 14 00:43:05 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:43:05 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:43:05 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:43:05 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[9557ea6f-9510-4cd3-b1a0-2a642edcaf31]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:43:05 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:43:05 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:43:05 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:43:05 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d94cfc-48fb-4fd6-8955-73b702e19d04]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:43:05 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:43:05 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QXWvJOjm {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:43:05 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QXWvJOjm" returned: 0 in 0.022s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:43:05 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e7368f5-0087-461c-873f-906c81809409]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:43:05 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QXWvJOjm'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:43:05 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:43:05 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:43:05 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[46833971-50b7-4fbb-8a0f-ec466f8d3afb]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:43:05 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:43:05 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:43:05 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:43:05 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[62354d94-662c-443e-bfed-b09b6efe3d88]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:43:05 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 00:43:05 user nova-compute[82479]:  {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:43:05 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 00:43:05 user nova-compute[82479]:  {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:43:05 user nova-compute[82479]: WARNING os_brick.initiator.connectors.iscsi [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 00:43:05 user nova-compute[82479]: 
Apr 14 00:43:05 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3 -p 172.16.0.220:3260 --login {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:43:05 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:43:05 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb6bd8f-b7c7-448c-967d-a802bc3dbdf7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:43:05 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3, portal: 172.16.0.220,3260]
Apr 14 00:43:05 user nova-compute[82479]: Login to [iface: default, target: iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3, portal: 172.16.0.220,3260] successful.
Apr 14 00:43:05 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:43:05 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:43:05 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:43:05 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[52908caa-4363-4b6e-9f4e-523f5ad7ec1d]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:43:05 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:43:05 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:43:05 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:43:05 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a8f2daf-f508-4049-af3e-66e4bd67e104]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:43:05 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3 (non-flash)
Apr 14 00:43:05 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:43:05 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3 (non-flash)
Apr 14 00:43:05 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:43:05 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:43:05 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Connected to 172.16.0.220:3260 {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 00:43:05 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=82479) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 00:43:05 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82479) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 00:43:05 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:43:05 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:43:05 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[64bb3a01-4780-49a6-adfb-6113dff2ecfb]: (4, ('- - 0', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:43:05 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: None {{(pid=82479) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 00:43:06 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82479) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 00:43:06 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QXWvJOjm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 00:43:06 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:43:06 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '23430356132613163', 'path': '/dev/sdb'} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:43:06 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23430356132613163', 'path': '/dev/sdb'} {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 00:43:06 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:42:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1536217770',display_name='tempest-TestVolumeBootPattern-server-1536217770',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1536217770',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0934526a2dfa45f4bd5df4edee11d98a',ramdisk_id='',reservation_id='r-gjjkwj0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-260409128',owner_user_name='tempest-TestVolumeBootPattern-260409128-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:42:55Z,user_data=None,user_id='cfb66031fcf84659a3b80cdb76ffddc0',uuid=b84a5b31-1959-4a5e-88f5-66b6a0179b09,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d572ef8-2fc4-4431-b8be-efd367a8866a", "address": "fa:16:3e:65:5b:65", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d572ef8-2f", "ovs_interfaceid": "5d572ef8-2fc4-4431-b8be-efd367a8866a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82479) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 00:43:06 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Converting VIF {"id": "5d572ef8-2fc4-4431-b8be-efd367a8866a", "address": "fa:16:3e:65:5b:65", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d572ef8-2f", "ovs_interfaceid": "5d572ef8-2fc4-4431-b8be-efd367a8866a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:43:06 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:5b:65,bridge_name='br-int',has_traffic_filtering=True,id=5d572ef8-2fc4-4431-b8be-efd367a8866a,network=Network(6dec18bc-e73b-450e-b0d2-e36653017f20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d572ef8-2f') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:43:06 user nova-compute[82479]: DEBUG nova.objects.instance [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lazy-loading 'pci_devices' on Instance uuid b84a5b31-1959-4a5e-88f5-66b6a0179b09 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:43:06 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] End _get_guest_xml xml=<domain type="kvm">
Apr 14 00:43:06 user nova-compute[82479]:   <uuid>b84a5b31-1959-4a5e-88f5-66b6a0179b09</uuid>
Apr 14 00:43:06 user nova-compute[82479]:   <name>instance-00000028</name>
Apr 14 00:43:06 user nova-compute[82479]:   <memory>131072</memory>
Apr 14 00:43:06 user nova-compute[82479]:   <vcpu>1</vcpu>
Apr 14 00:43:06 user nova-compute[82479]:   <metadata>
Apr 14 00:43:06 user nova-compute[82479]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 00:43:06 user nova-compute[82479]:       <nova:package version="0.0.0"/>
Apr 14 00:43:06 user nova-compute[82479]:       <nova:name>tempest-TestVolumeBootPattern-server-1536217770</nova:name>
Apr 14 00:43:06 user nova-compute[82479]:       <nova:creationTime>2023-04-14 00:43:05</nova:creationTime>
Apr 14 00:43:06 user nova-compute[82479]:       <nova:flavor name="m1.nano">
Apr 14 00:43:06 user nova-compute[82479]:         <nova:memory>128</nova:memory>
Apr 14 00:43:06 user nova-compute[82479]:         <nova:disk>1</nova:disk>
Apr 14 00:43:06 user nova-compute[82479]:         <nova:swap>0</nova:swap>
Apr 14 00:43:06 user nova-compute[82479]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 00:43:06 user nova-compute[82479]:         <nova:vcpus>1</nova:vcpus>
Apr 14 00:43:06 user nova-compute[82479]:       </nova:flavor>
Apr 14 00:43:06 user nova-compute[82479]:       <nova:owner>
Apr 14 00:43:06 user nova-compute[82479]:         <nova:user uuid="cfb66031fcf84659a3b80cdb76ffddc0">tempest-TestVolumeBootPattern-260409128-project-member</nova:user>
Apr 14 00:43:06 user nova-compute[82479]:         <nova:project uuid="0934526a2dfa45f4bd5df4edee11d98a">tempest-TestVolumeBootPattern-260409128</nova:project>
Apr 14 00:43:06 user nova-compute[82479]:       </nova:owner>
Apr 14 00:43:06 user nova-compute[82479]:       <nova:ports>
Apr 14 00:43:06 user nova-compute[82479]:         <nova:port uuid="5d572ef8-2fc4-4431-b8be-efd367a8866a">
Apr 14 00:43:06 user nova-compute[82479]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 14 00:43:06 user nova-compute[82479]:         </nova:port>
Apr 14 00:43:06 user nova-compute[82479]:       </nova:ports>
Apr 14 00:43:06 user nova-compute[82479]:     </nova:instance>
Apr 14 00:43:06 user nova-compute[82479]:   </metadata>
Apr 14 00:43:06 user nova-compute[82479]:   <sysinfo type="smbios">
Apr 14 00:43:06 user nova-compute[82479]:     <system>
Apr 14 00:43:06 user nova-compute[82479]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 00:43:06 user nova-compute[82479]:       <entry name="product">OpenStack Nova</entry>
Apr 14 00:43:06 user nova-compute[82479]:       <entry name="version">0.0.0</entry>
Apr 14 00:43:06 user nova-compute[82479]:       <entry name="serial">b84a5b31-1959-4a5e-88f5-66b6a0179b09</entry>
Apr 14 00:43:06 user nova-compute[82479]:       <entry name="uuid">b84a5b31-1959-4a5e-88f5-66b6a0179b09</entry>
Apr 14 00:43:06 user nova-compute[82479]:       <entry name="family">Virtual Machine</entry>
Apr 14 00:43:06 user nova-compute[82479]:     </system>
Apr 14 00:43:06 user nova-compute[82479]:   </sysinfo>
Apr 14 00:43:06 user nova-compute[82479]:   <os>
Apr 14 00:43:06 user nova-compute[82479]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 00:43:06 user nova-compute[82479]:     <boot dev="hd"/>
Apr 14 00:43:06 user nova-compute[82479]:     <smbios mode="sysinfo"/>
Apr 14 00:43:06 user nova-compute[82479]:   </os>
Apr 14 00:43:06 user nova-compute[82479]:   <features>
Apr 14 00:43:06 user nova-compute[82479]:     <acpi/>
Apr 14 00:43:06 user nova-compute[82479]:     <apic/>
Apr 14 00:43:06 user nova-compute[82479]:     <vmcoreinfo/>
Apr 14 00:43:06 user nova-compute[82479]:   </features>
Apr 14 00:43:06 user nova-compute[82479]:   <clock offset="utc">
Apr 14 00:43:06 user nova-compute[82479]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 00:43:06 user nova-compute[82479]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 00:43:06 user nova-compute[82479]:     <timer name="hpet" present="no"/>
Apr 14 00:43:06 user nova-compute[82479]:   </clock>
Apr 14 00:43:06 user nova-compute[82479]:   <cpu mode="custom" match="exact">
Apr 14 00:43:06 user nova-compute[82479]:     <model>Nehalem</model>
Apr 14 00:43:06 user nova-compute[82479]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 00:43:06 user nova-compute[82479]:   </cpu>
Apr 14 00:43:06 user nova-compute[82479]:   <devices>
Apr 14 00:43:06 user nova-compute[82479]:     <disk type="block" device="disk">
Apr 14 00:43:06 user nova-compute[82479]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:43:06 user nova-compute[82479]:       <source dev="/dev/sdb"/>
Apr 14 00:43:06 user nova-compute[82479]:       <target dev="vda" bus="virtio"/>
Apr 14 00:43:06 user nova-compute[82479]:       <serial>9ddd1cc0-8674-458e-bd7e-2479493c1fd3</serial>
Apr 14 00:43:06 user nova-compute[82479]:     </disk>
Apr 14 00:43:06 user nova-compute[82479]:     <interface type="ethernet">
Apr 14 00:43:06 user nova-compute[82479]:       <mac address="fa:16:3e:65:5b:65"/>
Apr 14 00:43:06 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:43:06 user nova-compute[82479]:       <mtu size="1442"/>
Apr 14 00:43:06 user nova-compute[82479]:       <target dev="tap5d572ef8-2f"/>
Apr 14 00:43:06 user nova-compute[82479]:     </interface>
Apr 14 00:43:06 user nova-compute[82479]:     <serial type="pty">
Apr 14 00:43:06 user nova-compute[82479]:       <log file="/opt/stack/data/nova/instances/b84a5b31-1959-4a5e-88f5-66b6a0179b09/console.log" append="off"/>
Apr 14 00:43:06 user nova-compute[82479]:     </serial>
Apr 14 00:43:06 user nova-compute[82479]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 00:43:06 user nova-compute[82479]:     <video>
Apr 14 00:43:06 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:43:06 user nova-compute[82479]:     </video>
Apr 14 00:43:06 user nova-compute[82479]:     <rng model="virtio">
Apr 14 00:43:06 user nova-compute[82479]:       <backend model="random">/dev/urandom</backend>
Apr 14 00:43:06 user nova-compute[82479]:     </rng>
Apr 14 00:43:06 user nova-compute[82479]:     <controller type="usb" index="0" model="none"/>
Apr 14 00:43:06 user nova-compute[82479]:     <memballoon model="virtio">
Apr 14 00:43:06 user nova-compute[82479]:       <stats period="10"/>
Apr 14 00:43:06 user nova-compute[82479]:     </memballoon>
Apr 14 00:43:06 user nova-compute[82479]:   </devices>
Apr 14 00:43:06 user nova-compute[82479]: </domain>
Apr 14 00:43:06 user nova-compute[82479]:  {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 00:43:06 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:42:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1536217770',display_name='tempest-TestVolumeBootPattern-server-1536217770',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1536217770',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0934526a2dfa45f4bd5df4edee11d98a',ramdisk_id='',reservation_id='r-gjjkwj0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-260409128',owner_user_name='tempest-TestVolumeBootPattern-260409128-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:42:55Z,user_data=None,user_id='cfb66031fcf84659a3b80cdb76ffddc0',uuid=b84a5b31-1959-4a5e-88f5-66b6a0179b09,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d572ef8-2fc4-4431-b8be-efd367a8866a", "address": "fa:16:3e:65:5b:65", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d572ef8-2f", "ovs_interfaceid": "5d572ef8-2fc4-4431-b8be-efd367a8866a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 00:43:06 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Converting VIF {"id": "5d572ef8-2fc4-4431-b8be-efd367a8866a", "address": "fa:16:3e:65:5b:65", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d572ef8-2f", "ovs_interfaceid": "5d572ef8-2fc4-4431-b8be-efd367a8866a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:43:06 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:5b:65,bridge_name='br-int',has_traffic_filtering=True,id=5d572ef8-2fc4-4431-b8be-efd367a8866a,network=Network(6dec18bc-e73b-450e-b0d2-e36653017f20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d572ef8-2f') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:43:06 user nova-compute[82479]: DEBUG os_vif [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:5b:65,bridge_name='br-int',has_traffic_filtering=True,id=5d572ef8-2fc4-4431-b8be-efd367a8866a,network=Network(6dec18bc-e73b-450e-b0d2-e36653017f20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d572ef8-2f') {{(pid=82479) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 00:43:06 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:43:06 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:43:06 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 00:43:06 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:43:06 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5d572ef8-2f, may_exist=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:43:06 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5d572ef8-2f, col_values=(('external_ids', {'iface-id': '5d572ef8-2fc4-4431-b8be-efd367a8866a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:5b:65', 'vm-uuid': 'b84a5b31-1959-4a5e-88f5-66b6a0179b09'}),)) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:43:06 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:43:06 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:43:06 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:43:06 user nova-compute[82479]: INFO os_vif [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:5b:65,bridge_name='br-int',has_traffic_filtering=True,id=5d572ef8-2fc4-4431-b8be-efd367a8866a,network=Network(6dec18bc-e73b-450e-b0d2-e36653017f20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d572ef8-2f')
Apr 14 00:43:06 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:43:06 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] No VIF found with MAC fa:16:3e:65:5b:65, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:43:08 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:43:08 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:43:08 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:43:08 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:43:08 user nova-compute[82479]: DEBUG nova.compute.manager [req-184c759b-9cfc-4528-9031-9b5eb13b69c4 req-eb282c42-06a9-4141-84ec-988f0d697f2b service nova] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Received event network-vif-plugged-5d572ef8-2fc4-4431-b8be-efd367a8866a {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:43:08 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-184c759b-9cfc-4528-9031-9b5eb13b69c4 req-eb282c42-06a9-4141-84ec-988f0d697f2b service nova] Acquiring lock "b84a5b31-1959-4a5e-88f5-66b6a0179b09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:43:08 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-184c759b-9cfc-4528-9031-9b5eb13b69c4 req-eb282c42-06a9-4141-84ec-988f0d697f2b service nova] Lock "b84a5b31-1959-4a5e-88f5-66b6a0179b09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:43:08 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-184c759b-9cfc-4528-9031-9b5eb13b69c4 req-eb282c42-06a9-4141-84ec-988f0d697f2b service nova] Lock "b84a5b31-1959-4a5e-88f5-66b6a0179b09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:43:08 user nova-compute[82479]: DEBUG nova.compute.manager [req-184c759b-9cfc-4528-9031-9b5eb13b69c4 req-eb282c42-06a9-4141-84ec-988f0d697f2b service nova] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] No waiting events found dispatching network-vif-plugged-5d572ef8-2fc4-4431-b8be-efd367a8866a {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:43:08 user nova-compute[82479]: WARNING nova.compute.manager [req-184c759b-9cfc-4528-9031-9b5eb13b69c4 req-eb282c42-06a9-4141-84ec-988f0d697f2b service nova] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Received unexpected event network-vif-plugged-5d572ef8-2fc4-4431-b8be-efd367a8866a for instance with vm_state building and task_state spawning.
Apr 14 00:43:08 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:43:08 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:43:08 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:43:10 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681432990.3004572, b84a5b31-1959-4a5e-88f5-66b6a0179b09 => Resumed> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:43:10 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] VM Resumed (Lifecycle Event)
Apr 14 00:43:10 user nova-compute[82479]: DEBUG nova.compute.manager [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Instance event wait completed in 0 seconds for  {{(pid=82479) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 00:43:10 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Guest created on hypervisor {{(pid=82479) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 00:43:10 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Instance spawned successfully.
Apr 14 00:43:10 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 00:43:10 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:43:10 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:43:10 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Found default for hw_cdrom_bus of ide {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:43:10 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Found default for hw_disk_bus of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:43:10 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Found default for hw_input_bus of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:43:10 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Found default for hw_pointer_model of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:43:10 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Found default for hw_video_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:43:10 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Found default for hw_vif_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:43:10 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:43:10 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681432990.3022397, b84a5b31-1959-4a5e-88f5-66b6a0179b09 => Started> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:43:10 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] VM Started (Lifecycle Event)
Apr 14 00:43:10 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:43:10 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:43:10 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:43:10 user nova-compute[82479]: INFO nova.compute.manager [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Took 4.97 seconds to spawn the instance on the hypervisor.
Apr 14 00:43:10 user nova-compute[82479]: DEBUG nova.compute.manager [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:43:10 user nova-compute[82479]: INFO nova.compute.manager [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Took 15.59 seconds to build instance.
Apr 14 00:43:10 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-40329473-01b7-49ac-b0b8-3166ff7fb72c tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "b84a5b31-1959-4a5e-88f5-66b6a0179b09" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.690s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:43:10 user nova-compute[82479]: DEBUG nova.compute.manager [req-e064cf8b-a713-436d-8213-34e69f745a62 req-d30e02cb-2ff4-4a82-a9f6-5d21558fe573 service nova] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Received event network-vif-plugged-5d572ef8-2fc4-4431-b8be-efd367a8866a {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:43:10 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-e064cf8b-a713-436d-8213-34e69f745a62 req-d30e02cb-2ff4-4a82-a9f6-5d21558fe573 service nova] Acquiring lock "b84a5b31-1959-4a5e-88f5-66b6a0179b09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:43:10 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-e064cf8b-a713-436d-8213-34e69f745a62 req-d30e02cb-2ff4-4a82-a9f6-5d21558fe573 service nova] Lock "b84a5b31-1959-4a5e-88f5-66b6a0179b09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:43:10 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-e064cf8b-a713-436d-8213-34e69f745a62 req-d30e02cb-2ff4-4a82-a9f6-5d21558fe573 service nova] Lock "b84a5b31-1959-4a5e-88f5-66b6a0179b09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:43:10 user nova-compute[82479]: DEBUG nova.compute.manager [req-e064cf8b-a713-436d-8213-34e69f745a62 req-d30e02cb-2ff4-4a82-a9f6-5d21558fe573 service nova] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] No waiting events found dispatching network-vif-plugged-5d572ef8-2fc4-4431-b8be-efd367a8866a {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:43:10 user nova-compute[82479]: WARNING nova.compute.manager [req-e064cf8b-a713-436d-8213-34e69f745a62 req-d30e02cb-2ff4-4a82-a9f6-5d21558fe573 service nova] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Received unexpected event network-vif-plugged-5d572ef8-2fc4-4431-b8be-efd367a8866a for instance with vm_state active and task_state None.
Apr 14 00:43:11 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:43:11 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:43:12 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:43:12 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Starting heal instance info cache {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 00:43:12 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Rebuilding the list of instances to heal {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 00:43:12 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "refresh_cache-b84a5b31-1959-4a5e-88f5-66b6a0179b09" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:43:12 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquired lock "refresh_cache-b84a5b31-1959-4a5e-88f5-66b6a0179b09" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:43:12 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Forcefully refreshing network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 00:43:12 user nova-compute[82479]: DEBUG nova.objects.instance [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lazy-loading 'info_cache' on Instance uuid b84a5b31-1959-4a5e-88f5-66b6a0179b09 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:43:13 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Updating instance_info_cache with network_info: [{"id": "5d572ef8-2fc4-4431-b8be-efd367a8866a", "address": "fa:16:3e:65:5b:65", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d572ef8-2f", "ovs_interfaceid": "5d572ef8-2fc4-4431-b8be-efd367a8866a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:43:13 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Releasing lock "refresh_cache-b84a5b31-1959-4a5e-88f5-66b6a0179b09" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:43:13 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Updated the network info_cache for instance {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 00:43:13 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:43:14 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:43:14 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:43:16 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:43:16 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:43:16 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:43:17 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:43:17 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82479) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 00:43:20 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:43:20 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:43:20 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:43:20 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:43:20 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Auditing locally available compute resources for user (node: user) {{(pid=82479) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 00:43:20 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:43:21 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:43:21 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:43:21 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Hypervisor/Node resource view: name=user free_ram=8775MB free_disk=26.190750122070312GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82479) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 00:43:21 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:43:21 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:43:21 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance b84a5b31-1959-4a5e-88f5-66b6a0179b09 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:43:21 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 00:43:21 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 00:43:21 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:43:21 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:43:21 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Compute_service record updated for user:user {{(pid=82479) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 00:43:21 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.176s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:43:21 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:43:21 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:43:21 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:43:21 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:43:21 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:43:21 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:43:22 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:43:23 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:43:24 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:43:26 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:43:26 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:43:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:43:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:43:36 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:43:36 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:43:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:43:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:43:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:43:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:43:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:43:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:43:46 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:43:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:43:56 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:43:56 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:44:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:44:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:44:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:44:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:44:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:44:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:44:06 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:44:11 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:44:11 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:44:11 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:44:11 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:44:11 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:44:11 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:44:12 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:44:12 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Starting heal instance info cache {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 00:44:12 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Rebuilding the list of instances to heal {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 00:44:12 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "refresh_cache-b84a5b31-1959-4a5e-88f5-66b6a0179b09" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:44:12 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquired lock "refresh_cache-b84a5b31-1959-4a5e-88f5-66b6a0179b09" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:44:12 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Forcefully refreshing network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 00:44:12 user nova-compute[82479]: DEBUG nova.objects.instance [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lazy-loading 'info_cache' on Instance uuid b84a5b31-1959-4a5e-88f5-66b6a0179b09 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:44:13 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Updating instance_info_cache with network_info: [{"id": "5d572ef8-2fc4-4431-b8be-efd367a8866a", "address": "fa:16:3e:65:5b:65", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d572ef8-2f", "ovs_interfaceid": "5d572ef8-2fc4-4431-b8be-efd367a8866a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:44:13 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Releasing lock "refresh_cache-b84a5b31-1959-4a5e-88f5-66b6a0179b09" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:44:13 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Updated the network info_cache for instance {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 00:44:13 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:44:14 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:44:16 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:44:16 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:44:19 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:44:19 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82479) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 00:44:20 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:44:20 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:44:20 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:44:20 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:44:20 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Auditing locally available compute resources for user (node: user) {{(pid=82479) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 00:44:20 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:44:21 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:44:21 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:44:21 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Hypervisor/Node resource view: name=user free_ram=8816MB free_disk=26.19007110595703GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82479) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 00:44:21 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:44:21 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:44:21 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance b84a5b31-1959-4a5e-88f5-66b6a0179b09 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:44:21 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 00:44:21 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 00:44:21 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:44:21 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:44:21 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Compute_service record updated for user:user {{(pid=82479) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 00:44:21 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.153s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:44:21 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:44:21 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:44:21 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:44:21 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:44:21 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:44:21 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:44:23 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:44:24 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:44:25 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:44:26 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:44:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:44:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:44:36 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:44:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:44:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:44:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:44:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:44:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:44:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:44:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-3b32a642-3277-4b90-b499-daf6d37f74d2 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "b84a5b31-1959-4a5e-88f5-66b6a0179b09" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:44:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-3b32a642-3277-4b90-b499-daf6d37f74d2 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "b84a5b31-1959-4a5e-88f5-66b6a0179b09" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:44:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-3b32a642-3277-4b90-b499-daf6d37f74d2 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "b84a5b31-1959-4a5e-88f5-66b6a0179b09-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:44:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-3b32a642-3277-4b90-b499-daf6d37f74d2 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "b84a5b31-1959-4a5e-88f5-66b6a0179b09-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:44:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-3b32a642-3277-4b90-b499-daf6d37f74d2 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "b84a5b31-1959-4a5e-88f5-66b6a0179b09-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:44:45 user nova-compute[82479]: INFO nova.compute.manager [None req-3b32a642-3277-4b90-b499-daf6d37f74d2 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Terminating instance
Apr 14 00:44:45 user nova-compute[82479]: DEBUG nova.compute.manager [None req-3b32a642-3277-4b90-b499-daf6d37f74d2 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Start destroying the instance on the hypervisor. {{(pid=82479) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 00:44:45 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:44:45 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:44:45 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:44:45 user nova-compute[82479]: DEBUG nova.compute.manager [req-fb56d279-2436-466e-9d96-492d474b55ca req-2255782f-a32d-4871-9dd8-625b19f25b5b service nova] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Received event network-vif-unplugged-5d572ef8-2fc4-4431-b8be-efd367a8866a {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:44:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-fb56d279-2436-466e-9d96-492d474b55ca req-2255782f-a32d-4871-9dd8-625b19f25b5b service nova] Acquiring lock "b84a5b31-1959-4a5e-88f5-66b6a0179b09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:44:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-fb56d279-2436-466e-9d96-492d474b55ca req-2255782f-a32d-4871-9dd8-625b19f25b5b service nova] Lock "b84a5b31-1959-4a5e-88f5-66b6a0179b09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:44:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-fb56d279-2436-466e-9d96-492d474b55ca req-2255782f-a32d-4871-9dd8-625b19f25b5b service nova] Lock "b84a5b31-1959-4a5e-88f5-66b6a0179b09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:44:45 user nova-compute[82479]: DEBUG nova.compute.manager [req-fb56d279-2436-466e-9d96-492d474b55ca req-2255782f-a32d-4871-9dd8-625b19f25b5b service nova] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] No waiting events found dispatching network-vif-unplugged-5d572ef8-2fc4-4431-b8be-efd367a8866a {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:44:45 user nova-compute[82479]: DEBUG nova.compute.manager [req-fb56d279-2436-466e-9d96-492d474b55ca req-2255782f-a32d-4871-9dd8-625b19f25b5b service nova] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Received event network-vif-unplugged-5d572ef8-2fc4-4431-b8be-efd367a8866a for instance with task_state deleting. {{(pid=82479) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 00:44:45 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:44:45 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Instance destroyed successfully.
Apr 14 00:44:45 user nova-compute[82479]: DEBUG nova.objects.instance [None req-3b32a642-3277-4b90-b499-daf6d37f74d2 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lazy-loading 'resources' on Instance uuid b84a5b31-1959-4a5e-88f5-66b6a0179b09 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:44:45 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-3b32a642-3277-4b90-b499-daf6d37f74d2 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:42:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1536217770',display_name='tempest-TestVolumeBootPattern-server-1536217770',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1536217770',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:43:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0934526a2dfa45f4bd5df4edee11d98a',ramdisk_id='',reservation_id='r-gjjkwj0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-260409128',owner_user_name='tempest-TestVolumeBootPattern-260409128-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T00:43:10Z,user_data=None,user_id='cfb66031fcf84659a3b80cdb76ffddc0',uuid=b84a5b31-1959-4a5e-88f5-66b6a0179b09,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5d572ef8-2fc4-4431-b8be-efd367a8866a", "address": "fa:16:3e:65:5b:65", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d572ef8-2f", "ovs_interfaceid": "5d572ef8-2fc4-4431-b8be-efd367a8866a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 00:44:45 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-3b32a642-3277-4b90-b499-daf6d37f74d2 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Converting VIF {"id": "5d572ef8-2fc4-4431-b8be-efd367a8866a", "address": "fa:16:3e:65:5b:65", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d572ef8-2f", "ovs_interfaceid": "5d572ef8-2fc4-4431-b8be-efd367a8866a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:44:45 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-3b32a642-3277-4b90-b499-daf6d37f74d2 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:65:5b:65,bridge_name='br-int',has_traffic_filtering=True,id=5d572ef8-2fc4-4431-b8be-efd367a8866a,network=Network(6dec18bc-e73b-450e-b0d2-e36653017f20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d572ef8-2f') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:44:45 user nova-compute[82479]: DEBUG os_vif [None req-3b32a642-3277-4b90-b499-daf6d37f74d2 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:5b:65,bridge_name='br-int',has_traffic_filtering=True,id=5d572ef8-2fc4-4431-b8be-efd367a8866a,network=Network(6dec18bc-e73b-450e-b0d2-e36653017f20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d572ef8-2f') {{(pid=82479) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 00:44:45 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:44:45 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5d572ef8-2f, bridge=br-int, if_exists=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:44:45 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:44:45 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:44:45 user nova-compute[82479]: INFO os_vif [None req-3b32a642-3277-4b90-b499-daf6d37f74d2 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:5b:65,bridge_name='br-int',has_traffic_filtering=True,id=5d572ef8-2fc4-4431-b8be-efd367a8866a,network=Network(6dec18bc-e73b-450e-b0d2-e36653017f20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d572ef8-2f')
Apr 14 00:44:45 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b32a642-3277-4b90-b499-daf6d37f74d2 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] calling os-brick to detach iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 00:44:45 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b32a642-3277-4b90-b499-daf6d37f74d2 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, {'target_iqn': 'iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QXWvJOjm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:44:45 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-3b32a642-3277-4b90-b499-daf6d37f74d2 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:44:45 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-3b32a642-3277-4b90-b499-daf6d37f74d2 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:44:45 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-3b32a642-3277-4b90-b499-daf6d37f74d2 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:44:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:44:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:44:45 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee694964-7463-45f9-9a0b-34064e63b58a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:44:45 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b32a642-3277-4b90-b499-daf6d37f74d2 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 00:44:45 user nova-compute[82479]: No targets found.
Apr 14 00:44:45 user nova-compute[82479]: iSNS:
Apr 14 00:44:45 user nova-compute[82479]: No targets found.
Apr 14 00:44:45 user nova-compute[82479]: STATIC:
Apr 14 00:44:45 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3
Apr 14 00:44:45 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:44:45 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:44:45 user nova-compute[82479]: FIRMWARE:
Apr 14 00:44:45 user nova-compute[82479]: No targets found.
Apr 14 00:44:45 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:44:45 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b32a642-3277-4b90-b499-daf6d37f74d2 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 00:44:45 user nova-compute[82479]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 00:44:45 user nova-compute[82479]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82479) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 00:44:45 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b32a642-3277-4b90-b499-daf6d37f74d2 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3', 0)] {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 00:44:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:44:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:44:46 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eac923c-8286-4014-a8ac-dc122077ec9c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:44:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:44:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:44:46 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ccb48c-e872-4748-9035-7069ad5443ae]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:44:46 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b32a642-3277-4b90-b499-daf6d37f74d2 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3 (non-flash)
Apr 14 00:44:46 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:44:46 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b32a642-3277-4b90-b499-daf6d37f74d2 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3 (non-flash)
Apr 14 00:44:46 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:44:46 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b32a642-3277-4b90-b499-daf6d37f74d2 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3344b0cca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3'): ({'sdb'}, set())}) {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 00:44:46 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-3b32a642-3277-4b90-b499-daf6d37f74d2 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Removing single pathed devices sdb {{(pid=82479) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 00:44:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:44:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:44:46 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9d8cc7-3c54-4859-b53b-9e4aae7ff17f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:44:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:44:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:44:46 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b1195f5-11d8-47f5-b077-0f2a82d6ba7e]: (4, ('ok\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:44:46 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-3b32a642-3277-4b90-b499-daf6d37f74d2 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Flushing IO for device /dev/sdb {{(pid=82479) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 00:44:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:44:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:44:46 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[400b9b41-3e11-4868-846d-b28246f4eabb]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:44:46 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-3b32a642-3277-4b90-b499-daf6d37f74d2 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82479) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 00:44:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:44:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:44:46 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b637543-e223-4be4-8357-6e7e641d4a0a]: (4, ('1', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:44:46 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-3b32a642-3277-4b90-b499-daf6d37f74d2 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 00:44:46 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-3b32a642-3277-4b90-b499-daf6d37f74d2 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] SCSI volumes sdb have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 00:44:46 user nova-compute[82479]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23430356132613163', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_d49ec777', '/dev/disk/by-id/scsi-1SCST_BIOd49ec777-405a2a1c7c0a1056') {{(pid=93289) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 14 00:44:46 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[25de6989-6b28-4e0d-99a8-22634017e66d]: (4, None) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:44:46 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b32a642-3277-4b90-b499-daf6d37f74d2 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3')] {{(pid=82479) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 00:44:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:44:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:44:46 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75c235b-2d3a-4237-8cc3-f9d101c77b22]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:44:46 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b32a642-3277-4b90-b499-daf6d37f74d2 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:44:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3 -p 172.16.0.220:3260 --logout {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:44:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:44:46 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c381f91-0655-4ec1-9b0e-457a0a118646]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:44:46 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b32a642-3277-4b90-b499-daf6d37f74d2 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3, portal: 172.16.0.220,3260]
Apr 14 00:44:46 user nova-compute[82479]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3, portal: 172.16.0.220,3260] successful.
Apr 14 00:44:46 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:44:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3 -p 172.16.0.220:3260 --op delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:44:46 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:44:46 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d99421-0baf-4b96-8406-f61f8bdc4eeb]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:44:46 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b32a642-3277-4b90-b499-daf6d37f74d2 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:44:46 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-3b32a642-3277-4b90-b499-daf6d37f74d2 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:44:46 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b32a642-3277-4b90-b499-daf6d37f74d2 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] <== disconnect_volume: return (294ms) None {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:44:46 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b32a642-3277-4b90-b499-daf6d37f74d2 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Disconnected iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 00:44:46 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-3b32a642-3277-4b90-b499-daf6d37f74d2 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Deleting instance files /opt/stack/data/nova/instances/b84a5b31-1959-4a5e-88f5-66b6a0179b09_del
Apr 14 00:44:46 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-3b32a642-3277-4b90-b499-daf6d37f74d2 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Deletion of /opt/stack/data/nova/instances/b84a5b31-1959-4a5e-88f5-66b6a0179b09_del complete
Apr 14 00:44:46 user nova-compute[82479]: INFO nova.compute.manager [None req-3b32a642-3277-4b90-b499-daf6d37f74d2 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Took 1.12 seconds to destroy the instance on the hypervisor.
Apr 14 00:44:46 user nova-compute[82479]: DEBUG oslo.service.loopingcall [None req-3b32a642-3277-4b90-b499-daf6d37f74d2 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82479) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 00:44:46 user nova-compute[82479]: DEBUG nova.compute.manager [-] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Deallocating network for instance {{(pid=82479) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 00:44:46 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] deallocate_for_instance() {{(pid=82479) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 00:44:47 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Updating instance_info_cache with network_info: [] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:44:47 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Took 0.72 seconds to deallocate network for instance.
Apr 14 00:44:47 user nova-compute[82479]: DEBUG nova.compute.manager [req-74d71acd-6b68-4911-97b2-ddeeb5e3e72f req-066b84f2-72bf-495f-96a9-55ff74467e6d service nova] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Received event network-vif-deleted-5d572ef8-2fc4-4431-b8be-efd367a8866a {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:44:47 user nova-compute[82479]: DEBUG nova.compute.manager [req-b0100cbd-eecc-4b88-b055-da1b5efef95b req-f9a56b91-c380-4689-bd8a-0a6eb2183b02 service nova] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Received event network-vif-plugged-5d572ef8-2fc4-4431-b8be-efd367a8866a {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:44:47 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-b0100cbd-eecc-4b88-b055-da1b5efef95b req-f9a56b91-c380-4689-bd8a-0a6eb2183b02 service nova] Acquiring lock "b84a5b31-1959-4a5e-88f5-66b6a0179b09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:44:47 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-b0100cbd-eecc-4b88-b055-da1b5efef95b req-f9a56b91-c380-4689-bd8a-0a6eb2183b02 service nova] Lock "b84a5b31-1959-4a5e-88f5-66b6a0179b09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:44:47 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-b0100cbd-eecc-4b88-b055-da1b5efef95b req-f9a56b91-c380-4689-bd8a-0a6eb2183b02 service nova] Lock "b84a5b31-1959-4a5e-88f5-66b6a0179b09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:44:47 user nova-compute[82479]: DEBUG nova.compute.manager [req-b0100cbd-eecc-4b88-b055-da1b5efef95b req-f9a56b91-c380-4689-bd8a-0a6eb2183b02 service nova] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] No waiting events found dispatching network-vif-plugged-5d572ef8-2fc4-4431-b8be-efd367a8866a {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:44:47 user nova-compute[82479]: WARNING nova.compute.manager [req-b0100cbd-eecc-4b88-b055-da1b5efef95b req-f9a56b91-c380-4689-bd8a-0a6eb2183b02 service nova] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Received unexpected event network-vif-plugged-5d572ef8-2fc4-4431-b8be-efd367a8866a for instance with vm_state active and task_state deleting.
Apr 14 00:44:47 user nova-compute[82479]: INFO nova.compute.manager [None req-3b32a642-3277-4b90-b499-daf6d37f74d2 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Took 0.89 seconds to detach 1 volumes for instance.
Apr 14 00:44:47 user nova-compute[82479]: DEBUG nova.compute.manager [None req-3b32a642-3277-4b90-b499-daf6d37f74d2 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Deleting volume: 9ddd1cc0-8674-458e-bd7e-2479493c1fd3 {{(pid=82479) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 14 00:44:48 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-3b32a642-3277-4b90-b499-daf6d37f74d2 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:44:48 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-3b32a642-3277-4b90-b499-daf6d37f74d2 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:44:48 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-3b32a642-3277-4b90-b499-daf6d37f74d2 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:44:48 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-3b32a642-3277-4b90-b499-daf6d37f74d2 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:44:48 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-3b32a642-3277-4b90-b499-daf6d37f74d2 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.127s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:44:48 user nova-compute[82479]: INFO nova.scheduler.client.report [None req-3b32a642-3277-4b90-b499-daf6d37f74d2 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Deleted allocations for instance b84a5b31-1959-4a5e-88f5-66b6a0179b09
Apr 14 00:44:48 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-3b32a642-3277-4b90-b499-daf6d37f74d2 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "b84a5b31-1959-4a5e-88f5-66b6a0179b09" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.152s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:44:50 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:44:55 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:45:00 user nova-compute[82479]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681433085.9305406, b84a5b31-1959-4a5e-88f5-66b6a0179b09 => Stopped> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:45:00 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] VM Stopped (Lifecycle Event)
Apr 14 00:45:00 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:45:00 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:45:00 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:45:00 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:45:00 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:45:00 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1b892f11-c420-4b06-93d7-4826b5f05582 None None] [instance: b84a5b31-1959-4a5e-88f5-66b6a0179b09] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:45:00 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:45:05 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4994-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:45:10 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:45:13 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:45:13 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Starting heal instance info cache {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 00:45:13 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Rebuilding the list of instances to heal {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 00:45:13 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Didn't find any instances for network info cache update. {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 00:45:14 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:45:15 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:45:15 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:45:15 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:45:18 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:45:20 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:45:20 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82479) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 00:45:20 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:45:22 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:45:22 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:45:22 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:45:22 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:45:22 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Auditing locally available compute resources for user (node: user) {{(pid=82479) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 00:45:23 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:45:23 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:45:23 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Hypervisor/Node resource view: name=user free_ram=8926MB free_disk=26.173625946044922GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82479) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 00:45:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:45:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:45:23 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 00:45:23 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 00:45:23 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:45:23 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:45:23 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Compute_service record updated for user:user {{(pid=82479) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 00:45:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.151s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:45:24 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:45:25 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:45:25 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:45:27 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:45:30 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:45:35 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:45:40 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:45:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "b80a7b33-5a5f-4db3-8d3a-0a9e9946aace" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:45:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "b80a7b33-5a5f-4db3-8d3a-0a9e9946aace" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:45:44 user nova-compute[82479]: DEBUG nova.compute.manager [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Starting instance... {{(pid=82479) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 00:45:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:45:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:45:45 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82479) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 00:45:45 user nova-compute[82479]: INFO nova.compute.claims [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Claim successful on node user
Apr 14 00:45:45 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:45:45 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:45:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.192s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:45:45 user nova-compute[82479]: DEBUG nova.compute.manager [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Start building networks asynchronously for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 00:45:45 user nova-compute[82479]: DEBUG nova.compute.manager [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Allocating IP information in the background. {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 00:45:45 user nova-compute[82479]: DEBUG nova.network.neutron [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] allocate_for_instance() {{(pid=82479) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 00:45:45 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 00:45:45 user nova-compute[82479]: DEBUG nova.compute.manager [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Start building block device mappings for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 00:45:45 user nova-compute[82479]: INFO nova.virt.block_device [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Booting with volume 12bc0a58-041c-488e-a961-6c37f530e1b9 at /dev/vda
Apr 14 00:45:45 user nova-compute[82479]: DEBUG nova.policy [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cfb66031fcf84659a3b80cdb76ffddc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934526a2dfa45f4bd5df4edee11d98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82479) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 00:45:45 user nova-compute[82479]: DEBUG os_brick.utils [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:45:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:45:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:45:45 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[144284fc-f9a6-4555-88c6-fcfc4a553520]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fec92fcfdd3\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:45:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:45:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:45:45 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e10223-2ea0-402c-9519-546058ba2ddd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:45:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:45:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:45:45 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[852d8a9e-fa4f-49a5-a66c-a82dc89c47d3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:45:45 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8eb2b5-93a1-4e48-ace6-fd5f17696f65]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:45:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Running cmd (subprocess): nvme version {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:45:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] 'nvme version' failed. Not Retrying. {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:45:45 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] nvme not present on system {{(pid=82479) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 00:45:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:45:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:45:45 user nova-compute[82479]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 00:45:45 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b0c40a-8219-4d7b-a190-8887ecde2f5a]: (4, '') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:45:45 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82479) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 00:45:45 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 00:45:45 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] LIGHTOS: no hostnqn found. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 00:45:45 user nova-compute[82479]: DEBUG os_brick.utils [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fec92fcfdd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:45:45 user nova-compute[82479]: DEBUG nova.virt.block_device [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Updating existing volume attachment record: 48e5b1e8-d24c-4155-a0f1-0f5c4e5fce57 {{(pid=82479) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 00:45:45 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:45:46 user nova-compute[82479]: DEBUG nova.network.neutron [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Successfully created port: b7e5db2e-9e0c-47a3-9d0d-e1b310dcf77b {{(pid=82479) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 00:45:46 user nova-compute[82479]: DEBUG nova.network.neutron [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Successfully updated port: b7e5db2e-9e0c-47a3-9d0d-e1b310dcf77b {{(pid=82479) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 00:45:46 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "refresh_cache-b80a7b33-5a5f-4db3-8d3a-0a9e9946aace" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:45:46 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquired lock "refresh_cache-b80a7b33-5a5f-4db3-8d3a-0a9e9946aace" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:45:46 user nova-compute[82479]: DEBUG nova.network.neutron [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 00:45:46 user nova-compute[82479]: DEBUG nova.compute.manager [req-a67a6c1a-4c72-4441-8ccd-1680608eb1e1 req-32098868-2134-45e4-be6c-a26b04a9d857 service nova] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Received event network-changed-b7e5db2e-9e0c-47a3-9d0d-e1b310dcf77b {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:45:46 user nova-compute[82479]: DEBUG nova.compute.manager [req-a67a6c1a-4c72-4441-8ccd-1680608eb1e1 req-32098868-2134-45e4-be6c-a26b04a9d857 service nova] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Refreshing instance network info cache due to event network-changed-b7e5db2e-9e0c-47a3-9d0d-e1b310dcf77b. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:45:46 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-a67a6c1a-4c72-4441-8ccd-1680608eb1e1 req-32098868-2134-45e4-be6c-a26b04a9d857 service nova] Acquiring lock "refresh_cache-b80a7b33-5a5f-4db3-8d3a-0a9e9946aace" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:45:46 user nova-compute[82479]: DEBUG nova.network.neutron [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Instance cache missing network info. {{(pid=82479) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 00:45:47 user nova-compute[82479]: DEBUG nova.network.neutron [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Updating instance_info_cache with network_info: [{"id": "b7e5db2e-9e0c-47a3-9d0d-e1b310dcf77b", "address": "fa:16:3e:17:ec:b0", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7e5db2e-9e", "ovs_interfaceid": "b7e5db2e-9e0c-47a3-9d0d-e1b310dcf77b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:45:47 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Releasing lock "refresh_cache-b80a7b33-5a5f-4db3-8d3a-0a9e9946aace" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:45:47 user nova-compute[82479]: DEBUG nova.compute.manager [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Instance network_info: |[{"id": "b7e5db2e-9e0c-47a3-9d0d-e1b310dcf77b", "address": "fa:16:3e:17:ec:b0", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7e5db2e-9e", "ovs_interfaceid": "b7e5db2e-9e0c-47a3-9d0d-e1b310dcf77b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 00:45:47 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-a67a6c1a-4c72-4441-8ccd-1680608eb1e1 req-32098868-2134-45e4-be6c-a26b04a9d857 service nova] Acquired lock "refresh_cache-b80a7b33-5a5f-4db3-8d3a-0a9e9946aace" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:45:47 user nova-compute[82479]: DEBUG nova.network.neutron [req-a67a6c1a-4c72-4441-8ccd-1680608eb1e1 req-32098868-2134-45e4-be6c-a26b04a9d857 service nova] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Refreshing network info cache for port b7e5db2e-9e0c-47a3-9d0d-e1b310dcf77b {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:45:47 user nova-compute[82479]: DEBUG nova.network.neutron [req-a67a6c1a-4c72-4441-8ccd-1680608eb1e1 req-32098868-2134-45e4-be6c-a26b04a9d857 service nova] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Updated VIF entry in instance network info cache for port b7e5db2e-9e0c-47a3-9d0d-e1b310dcf77b. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:45:47 user nova-compute[82479]: DEBUG nova.network.neutron [req-a67a6c1a-4c72-4441-8ccd-1680608eb1e1 req-32098868-2134-45e4-be6c-a26b04a9d857 service nova] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Updating instance_info_cache with network_info: [{"id": "b7e5db2e-9e0c-47a3-9d0d-e1b310dcf77b", "address": "fa:16:3e:17:ec:b0", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7e5db2e-9e", "ovs_interfaceid": "b7e5db2e-9e0c-47a3-9d0d-e1b310dcf77b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:45:47 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-a67a6c1a-4c72-4441-8ccd-1680608eb1e1 req-32098868-2134-45e4-be6c-a26b04a9d857 service nova] Releasing lock "refresh_cache-b80a7b33-5a5f-4db3-8d3a-0a9e9946aace" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG nova.compute.manager [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Start spawning the instance on the hypervisor. {{(pid=82479) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Creating instance directory {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 00:45:50 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Creating image(s)
Apr 14 00:45:50 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Did not create local disks {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Ensure instance console log exists: /opt/stack/data/nova/instances/b80a7b33-5a5f-4db3-8d3a-0a9e9946aace/console.log {{(pid=82479) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Start _get_guest_xml network_info=[{"id": "b7e5db2e-9e0c-47a3-9d0d-e1b310dcf77b", "address": "fa:16:3e:17:ec:b0", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7e5db2e-9e", "ovs_interfaceid": "b7e5db2e-9e0c-47a3-9d0d-e1b310dcf77b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': True, 'attachment_id': '48e5b1e8-d24c-4155-a0f1-0f5c4e5fce57', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SjFWIcAx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b80a7b33-5a5f-4db3-8d3a-0a9e9946aace', 'attached_at': '', 'detached_at': '', 'volume_id': '12bc0a58-041c-488e-a961-6c37f530e1b9', 'serial': '12bc0a58-041c-488e-a961-6c37f530e1b9'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 00:45:50 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:45:50 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:45:50 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82479) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T00:02:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Flavor limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Image limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Flavor pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Image pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Got 1 possible topologies {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Calling os-brick to attach iSCSI Volume {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SjFWIcAx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:45:50 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:45:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:45:50 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:45:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:45:50 user nova-compute[82479]: INFO os_brick.initiator.connectors.iscsi [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 00:45:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9 -p 172.16.0.220:3260 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc984ea7-b5fe-4c52-8e8f-7abdc8f8cfff]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 00:45:50 user nova-compute[82479]:  {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9 -p 172.16.0.220:3260 --interface default --op new {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3462bb7-ddfe-4f3c-889c-f9ea101be3ca]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9] added\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9] added
Apr 14 00:45:50 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef984ff-ce26-41c7-95d0-7a97f0e8e76c]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[613bd1b5-41c9-4883-8eb5-d86a739460ef]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SjFWIcAx {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SjFWIcAx" returned: 0 in 0.017s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ce5422-8c5f-4deb-9adf-9f647a31c08b]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SjFWIcAx'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc992e3b-41ac-4aad-b6fa-7b4bc524c579]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bad14a4-047e-41d4-a91c-c526deb4f949]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 00:45:50 user nova-compute[82479]:  {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 00:45:50 user nova-compute[82479]:  {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:45:50 user nova-compute[82479]: WARNING os_brick.initiator.connectors.iscsi [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 00:45:50 user nova-compute[82479]: 
Apr 14 00:45:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9 -p 172.16.0.220:3260 --login {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[6159994f-34e3-4f8a-adb9-bf9bfa2290e4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9, portal: 172.16.0.220,3260]
Apr 14 00:45:50 user nova-compute[82479]: Login to [iface: default, target: iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9, portal: 172.16.0.220,3260] successful.
Apr 14 00:45:50 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2902b6-b8a6-422b-9231-0ce6d57f9301]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5902e66-7a6c-4326-85dd-b30081318540]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9 (non-flash)
Apr 14 00:45:50 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9 (non-flash)
Apr 14 00:45:50 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.247s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Connected to 172.16.0.220:3260 {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=82479) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82479) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[129315b6-3d6d-42f8-aa94-07bca0887a62]: (4, ('- - 0', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82479) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SjFWIcAx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:45:50 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:45:51 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:45:51 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '26163633363333437', 'path': '/dev/sdb'} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:45:51 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26163633363333437', 'path': '/dev/sdb'} {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 00:45:51 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:45:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-425557895',display_name='tempest-TestVolumeBootPattern-volume-backed-server-425557895',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-425557895',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0934526a2dfa45f4bd5df4edee11d98a',ramdisk_id='',reservation_id='r-polg3ri7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-260409128',owner_user_name='tempest-TestVolumeBootPattern-260409128-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:45:45Z,user_data=None,user_id='cfb66031fcf84659a3b80cdb76ffddc0',uuid=b80a7b33-5a5f-4db3-8d3a-0a9e9946aace,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7e5db2e-9e0c-47a3-9d0d-e1b310dcf77b", "address": "fa:16:3e:17:ec:b0", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7e5db2e-9e", "ovs_interfaceid": "b7e5db2e-9e0c-47a3-9d0d-e1b310dcf77b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82479) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 00:45:51 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Converting VIF {"id": "b7e5db2e-9e0c-47a3-9d0d-e1b310dcf77b", "address": "fa:16:3e:17:ec:b0", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7e5db2e-9e", "ovs_interfaceid": "b7e5db2e-9e0c-47a3-9d0d-e1b310dcf77b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:45:51 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:ec:b0,bridge_name='br-int',has_traffic_filtering=True,id=b7e5db2e-9e0c-47a3-9d0d-e1b310dcf77b,network=Network(6dec18bc-e73b-450e-b0d2-e36653017f20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7e5db2e-9e') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:45:51 user nova-compute[82479]: DEBUG nova.objects.instance [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lazy-loading 'pci_devices' on Instance uuid b80a7b33-5a5f-4db3-8d3a-0a9e9946aace {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:45:51 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] End _get_guest_xml xml=<domain type="kvm">
Apr 14 00:45:51 user nova-compute[82479]:   <uuid>b80a7b33-5a5f-4db3-8d3a-0a9e9946aace</uuid>
Apr 14 00:45:51 user nova-compute[82479]:   <name>instance-00000029</name>
Apr 14 00:45:51 user nova-compute[82479]:   <memory>131072</memory>
Apr 14 00:45:51 user nova-compute[82479]:   <vcpu>1</vcpu>
Apr 14 00:45:51 user nova-compute[82479]:   <metadata>
Apr 14 00:45:51 user nova-compute[82479]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 00:45:51 user nova-compute[82479]:       <nova:package version="0.0.0"/>
Apr 14 00:45:51 user nova-compute[82479]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-425557895</nova:name>
Apr 14 00:45:51 user nova-compute[82479]:       <nova:creationTime>2023-04-14 00:45:50</nova:creationTime>
Apr 14 00:45:51 user nova-compute[82479]:       <nova:flavor name="m1.nano">
Apr 14 00:45:51 user nova-compute[82479]:         <nova:memory>128</nova:memory>
Apr 14 00:45:51 user nova-compute[82479]:         <nova:disk>1</nova:disk>
Apr 14 00:45:51 user nova-compute[82479]:         <nova:swap>0</nova:swap>
Apr 14 00:45:51 user nova-compute[82479]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 00:45:51 user nova-compute[82479]:         <nova:vcpus>1</nova:vcpus>
Apr 14 00:45:51 user nova-compute[82479]:       </nova:flavor>
Apr 14 00:45:51 user nova-compute[82479]:       <nova:owner>
Apr 14 00:45:51 user nova-compute[82479]:         <nova:user uuid="cfb66031fcf84659a3b80cdb76ffddc0">tempest-TestVolumeBootPattern-260409128-project-member</nova:user>
Apr 14 00:45:51 user nova-compute[82479]:         <nova:project uuid="0934526a2dfa45f4bd5df4edee11d98a">tempest-TestVolumeBootPattern-260409128</nova:project>
Apr 14 00:45:51 user nova-compute[82479]:       </nova:owner>
Apr 14 00:45:51 user nova-compute[82479]:       <nova:ports>
Apr 14 00:45:51 user nova-compute[82479]:         <nova:port uuid="b7e5db2e-9e0c-47a3-9d0d-e1b310dcf77b">
Apr 14 00:45:51 user nova-compute[82479]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 00:45:51 user nova-compute[82479]:         </nova:port>
Apr 14 00:45:51 user nova-compute[82479]:       </nova:ports>
Apr 14 00:45:51 user nova-compute[82479]:     </nova:instance>
Apr 14 00:45:51 user nova-compute[82479]:   </metadata>
Apr 14 00:45:51 user nova-compute[82479]:   <sysinfo type="smbios">
Apr 14 00:45:51 user nova-compute[82479]:     <system>
Apr 14 00:45:51 user nova-compute[82479]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 00:45:51 user nova-compute[82479]:       <entry name="product">OpenStack Nova</entry>
Apr 14 00:45:51 user nova-compute[82479]:       <entry name="version">0.0.0</entry>
Apr 14 00:45:51 user nova-compute[82479]:       <entry name="serial">b80a7b33-5a5f-4db3-8d3a-0a9e9946aace</entry>
Apr 14 00:45:51 user nova-compute[82479]:       <entry name="uuid">b80a7b33-5a5f-4db3-8d3a-0a9e9946aace</entry>
Apr 14 00:45:51 user nova-compute[82479]:       <entry name="family">Virtual Machine</entry>
Apr 14 00:45:51 user nova-compute[82479]:     </system>
Apr 14 00:45:51 user nova-compute[82479]:   </sysinfo>
Apr 14 00:45:51 user nova-compute[82479]:   <os>
Apr 14 00:45:51 user nova-compute[82479]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 00:45:51 user nova-compute[82479]:     <boot dev="hd"/>
Apr 14 00:45:51 user nova-compute[82479]:     <smbios mode="sysinfo"/>
Apr 14 00:45:51 user nova-compute[82479]:   </os>
Apr 14 00:45:51 user nova-compute[82479]:   <features>
Apr 14 00:45:51 user nova-compute[82479]:     <acpi/>
Apr 14 00:45:51 user nova-compute[82479]:     <apic/>
Apr 14 00:45:51 user nova-compute[82479]:     <vmcoreinfo/>
Apr 14 00:45:51 user nova-compute[82479]:   </features>
Apr 14 00:45:51 user nova-compute[82479]:   <clock offset="utc">
Apr 14 00:45:51 user nova-compute[82479]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 00:45:51 user nova-compute[82479]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 00:45:51 user nova-compute[82479]:     <timer name="hpet" present="no"/>
Apr 14 00:45:51 user nova-compute[82479]:   </clock>
Apr 14 00:45:51 user nova-compute[82479]:   <cpu mode="custom" match="exact">
Apr 14 00:45:51 user nova-compute[82479]:     <model>Nehalem</model>
Apr 14 00:45:51 user nova-compute[82479]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 00:45:51 user nova-compute[82479]:   </cpu>
Apr 14 00:45:51 user nova-compute[82479]:   <devices>
Apr 14 00:45:51 user nova-compute[82479]:     <disk type="block" device="disk">
Apr 14 00:45:51 user nova-compute[82479]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:45:51 user nova-compute[82479]:       <source dev="/dev/sdb"/>
Apr 14 00:45:51 user nova-compute[82479]:       <target dev="vda" bus="virtio"/>
Apr 14 00:45:51 user nova-compute[82479]:       <serial>12bc0a58-041c-488e-a961-6c37f530e1b9</serial>
Apr 14 00:45:51 user nova-compute[82479]:     </disk>
Apr 14 00:45:51 user nova-compute[82479]:     <interface type="ethernet">
Apr 14 00:45:51 user nova-compute[82479]:       <mac address="fa:16:3e:17:ec:b0"/>
Apr 14 00:45:51 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:45:51 user nova-compute[82479]:       <mtu size="1442"/>
Apr 14 00:45:51 user nova-compute[82479]:       <target dev="tapb7e5db2e-9e"/>
Apr 14 00:45:51 user nova-compute[82479]:     </interface>
Apr 14 00:45:51 user nova-compute[82479]:     <serial type="pty">
Apr 14 00:45:51 user nova-compute[82479]:       <log file="/opt/stack/data/nova/instances/b80a7b33-5a5f-4db3-8d3a-0a9e9946aace/console.log" append="off"/>
Apr 14 00:45:51 user nova-compute[82479]:     </serial>
Apr 14 00:45:51 user nova-compute[82479]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 00:45:51 user nova-compute[82479]:     <video>
Apr 14 00:45:51 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:45:51 user nova-compute[82479]:     </video>
Apr 14 00:45:51 user nova-compute[82479]:     <rng model="virtio">
Apr 14 00:45:51 user nova-compute[82479]:       <backend model="random">/dev/urandom</backend>
Apr 14 00:45:51 user nova-compute[82479]:     </rng>
Apr 14 00:45:51 user nova-compute[82479]:     <controller type="usb" index="0" model="none"/>
Apr 14 00:45:51 user nova-compute[82479]:     <memballoon model="virtio">
Apr 14 00:45:51 user nova-compute[82479]:       <stats period="10"/>
Apr 14 00:45:51 user nova-compute[82479]:     </memballoon>
Apr 14 00:45:51 user nova-compute[82479]:   </devices>
Apr 14 00:45:51 user nova-compute[82479]: </domain>
Apr 14 00:45:51 user nova-compute[82479]:  {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 00:45:51 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:45:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-425557895',display_name='tempest-TestVolumeBootPattern-volume-backed-server-425557895',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-425557895',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0934526a2dfa45f4bd5df4edee11d98a',ramdisk_id='',reservation_id='r-polg3ri7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-260409128',owner_user_name='tempest-TestVolumeBootPattern-260409128-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:45:45Z,user_data=None,user_id='cfb66031fcf84659a3b80cdb76ffddc0',uuid=b80a7b33-5a5f-4db3-8d3a-0a9e9946aace,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7e5db2e-9e0c-47a3-9d0d-e1b310dcf77b", "address": "fa:16:3e:17:ec:b0", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7e5db2e-9e", "ovs_interfaceid": "b7e5db2e-9e0c-47a3-9d0d-e1b310dcf77b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 00:45:51 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Converting VIF {"id": "b7e5db2e-9e0c-47a3-9d0d-e1b310dcf77b", "address": "fa:16:3e:17:ec:b0", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7e5db2e-9e", "ovs_interfaceid": "b7e5db2e-9e0c-47a3-9d0d-e1b310dcf77b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:45:51 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:ec:b0,bridge_name='br-int',has_traffic_filtering=True,id=b7e5db2e-9e0c-47a3-9d0d-e1b310dcf77b,network=Network(6dec18bc-e73b-450e-b0d2-e36653017f20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7e5db2e-9e') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:45:51 user nova-compute[82479]: DEBUG os_vif [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:ec:b0,bridge_name='br-int',has_traffic_filtering=True,id=b7e5db2e-9e0c-47a3-9d0d-e1b310dcf77b,network=Network(6dec18bc-e73b-450e-b0d2-e36653017f20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7e5db2e-9e') {{(pid=82479) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 00:45:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:45:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:45:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 00:45:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:45:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb7e5db2e-9e, may_exist=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:45:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb7e5db2e-9e, col_values=(('external_ids', {'iface-id': 'b7e5db2e-9e0c-47a3-9d0d-e1b310dcf77b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:ec:b0', 'vm-uuid': 'b80a7b33-5a5f-4db3-8d3a-0a9e9946aace'}),)) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:45:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:45:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:45:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:45:51 user nova-compute[82479]: INFO os_vif [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:ec:b0,bridge_name='br-int',has_traffic_filtering=True,id=b7e5db2e-9e0c-47a3-9d0d-e1b310dcf77b,network=Network(6dec18bc-e73b-450e-b0d2-e36653017f20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7e5db2e-9e')
Apr 14 00:45:51 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:45:51 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] No VIF found with MAC fa:16:3e:17:ec:b0, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:45:52 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:45:52 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:45:52 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:45:52 user nova-compute[82479]: DEBUG nova.compute.manager [req-d9567fdd-f40a-4fd1-8bb7-d5c0c742c82c req-d6647596-53a6-4599-ac52-558426c20ebd service nova] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Received event network-vif-plugged-b7e5db2e-9e0c-47a3-9d0d-e1b310dcf77b {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:45:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-d9567fdd-f40a-4fd1-8bb7-d5c0c742c82c req-d6647596-53a6-4599-ac52-558426c20ebd service nova] Acquiring lock "b80a7b33-5a5f-4db3-8d3a-0a9e9946aace-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:45:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-d9567fdd-f40a-4fd1-8bb7-d5c0c742c82c req-d6647596-53a6-4599-ac52-558426c20ebd service nova] Lock "b80a7b33-5a5f-4db3-8d3a-0a9e9946aace-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:45:53 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-d9567fdd-f40a-4fd1-8bb7-d5c0c742c82c req-d6647596-53a6-4599-ac52-558426c20ebd service nova] Lock "b80a7b33-5a5f-4db3-8d3a-0a9e9946aace-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:45:53 user nova-compute[82479]: DEBUG nova.compute.manager [req-d9567fdd-f40a-4fd1-8bb7-d5c0c742c82c req-d6647596-53a6-4599-ac52-558426c20ebd service nova] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] No waiting events found dispatching network-vif-plugged-b7e5db2e-9e0c-47a3-9d0d-e1b310dcf77b {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:45:53 user nova-compute[82479]: WARNING nova.compute.manager [req-d9567fdd-f40a-4fd1-8bb7-d5c0c742c82c req-d6647596-53a6-4599-ac52-558426c20ebd service nova] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Received unexpected event network-vif-plugged-b7e5db2e-9e0c-47a3-9d0d-e1b310dcf77b for instance with vm_state building and task_state spawning.
Apr 14 00:45:53 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:45:53 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:45:53 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:45:53 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:45:54 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681433154.7700675, b80a7b33-5a5f-4db3-8d3a-0a9e9946aace => Resumed> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:45:54 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] VM Resumed (Lifecycle Event)
Apr 14 00:45:54 user nova-compute[82479]: DEBUG nova.compute.manager [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Instance event wait completed in 0 seconds for  {{(pid=82479) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 00:45:54 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Guest created on hypervisor {{(pid=82479) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 00:45:54 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Instance spawned successfully.
Apr 14 00:45:54 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 00:45:54 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:45:54 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:45:54 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Found default for hw_cdrom_bus of ide {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:45:54 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Found default for hw_disk_bus of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:45:54 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Found default for hw_input_bus of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:45:54 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Found default for hw_pointer_model of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:45:54 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Found default for hw_video_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:45:54 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Found default for hw_vif_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:45:54 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:45:54 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681433154.7734392, b80a7b33-5a5f-4db3-8d3a-0a9e9946aace => Started> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:45:54 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] VM Started (Lifecycle Event)
Apr 14 00:45:54 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:45:54 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:45:54 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:45:54 user nova-compute[82479]: INFO nova.compute.manager [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Took 4.87 seconds to spawn the instance on the hypervisor.
Apr 14 00:45:54 user nova-compute[82479]: DEBUG nova.compute.manager [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:45:54 user nova-compute[82479]: INFO nova.compute.manager [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Took 10.00 seconds to build instance.
Apr 14 00:45:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-9cedfa8d-d534-433e-8468-56bee4ebaafe tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "b80a7b33-5a5f-4db3-8d3a-0a9e9946aace" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.090s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:45:55 user nova-compute[82479]: DEBUG nova.compute.manager [req-2cccc819-73dc-464a-8373-25c5fdca1333 req-cba715c4-85bc-439b-a9d2-e9183991dd4b service nova] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Received event network-vif-plugged-b7e5db2e-9e0c-47a3-9d0d-e1b310dcf77b {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:45:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-2cccc819-73dc-464a-8373-25c5fdca1333 req-cba715c4-85bc-439b-a9d2-e9183991dd4b service nova] Acquiring lock "b80a7b33-5a5f-4db3-8d3a-0a9e9946aace-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:45:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-2cccc819-73dc-464a-8373-25c5fdca1333 req-cba715c4-85bc-439b-a9d2-e9183991dd4b service nova] Lock "b80a7b33-5a5f-4db3-8d3a-0a9e9946aace-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:45:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-2cccc819-73dc-464a-8373-25c5fdca1333 req-cba715c4-85bc-439b-a9d2-e9183991dd4b service nova] Lock "b80a7b33-5a5f-4db3-8d3a-0a9e9946aace-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:45:55 user nova-compute[82479]: DEBUG nova.compute.manager [req-2cccc819-73dc-464a-8373-25c5fdca1333 req-cba715c4-85bc-439b-a9d2-e9183991dd4b service nova] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] No waiting events found dispatching network-vif-plugged-b7e5db2e-9e0c-47a3-9d0d-e1b310dcf77b {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:45:55 user nova-compute[82479]: WARNING nova.compute.manager [req-2cccc819-73dc-464a-8373-25c5fdca1333 req-cba715c4-85bc-439b-a9d2-e9183991dd4b service nova] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Received unexpected event network-vif-plugged-b7e5db2e-9e0c-47a3-9d0d-e1b310dcf77b for instance with vm_state active and task_state None.
Apr 14 00:45:56 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:45:56 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:46:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:46:06 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:46:06 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:46:11 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:46:11 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:46:14 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:46:14 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Starting heal instance info cache {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 00:46:14 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Rebuilding the list of instances to heal {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 00:46:14 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "refresh_cache-b80a7b33-5a5f-4db3-8d3a-0a9e9946aace" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:46:14 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquired lock "refresh_cache-b80a7b33-5a5f-4db3-8d3a-0a9e9946aace" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:46:14 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Forcefully refreshing network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 00:46:14 user nova-compute[82479]: DEBUG nova.objects.instance [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lazy-loading 'info_cache' on Instance uuid b80a7b33-5a5f-4db3-8d3a-0a9e9946aace {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:46:15 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Updating instance_info_cache with network_info: [{"id": "b7e5db2e-9e0c-47a3-9d0d-e1b310dcf77b", "address": "fa:16:3e:17:ec:b0", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7e5db2e-9e", "ovs_interfaceid": "b7e5db2e-9e0c-47a3-9d0d-e1b310dcf77b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:46:15 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Releasing lock "refresh_cache-b80a7b33-5a5f-4db3-8d3a-0a9e9946aace" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:46:15 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Updated the network info_cache for instance {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 00:46:16 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:46:16 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:46:17 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:46:17 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:46:19 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:46:19 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:46:19 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Cleaning up deleted instances {{(pid=82479) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 00:46:19 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] There are 0 instances to clean {{(pid=82479) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 00:46:21 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:46:21 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:46:22 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:46:22 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82479) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 00:46:22 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:46:22 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:46:22 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:46:22 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:46:22 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Auditing locally available compute resources for user (node: user) {{(pid=82479) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 00:46:22 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:46:23 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:46:23 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:46:23 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Hypervisor/Node resource view: name=user free_ram=8797MB free_disk=26.171600341796875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82479) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 00:46:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:46:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:46:23 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance b80a7b33-5a5f-4db3-8d3a-0a9e9946aace actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:46:23 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 00:46:23 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 00:46:23 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Refreshing inventories for resource provider 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 00:46:23 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Updating ProviderTree inventory for provider 3847975a-19aa-4b27-9180-14b5cc49044a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 00:46:23 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Updating inventory in ProviderTree for provider 3847975a-19aa-4b27-9180-14b5cc49044a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 00:46:23 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Refreshing aggregate associations for resource provider 3847975a-19aa-4b27-9180-14b5cc49044a, aggregates: None {{(pid=82479) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 00:46:23 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Refreshing trait associations for resource provider 3847975a-19aa-4b27-9180-14b5cc49044a, traits: COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,HW_CPU_X86_SSE42,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO {{(pid=82479) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 00:46:23 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:46:23 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:46:23 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Compute_service record updated for user:user {{(pid=82479) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 00:46:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.427s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:46:25 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:46:26 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:46:27 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:46:28 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:46:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:46:34 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:46:34 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Cleaning up deleted instances with incomplete migration  {{(pid=82479) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 00:46:36 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:46:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:46:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:46:45 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:46:46 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:46:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:46:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:46:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:46:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:46:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:46:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:46:56 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:47:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:47:06 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:47:11 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:47:14 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:47:14 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Starting heal instance info cache {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 00:47:14 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Rebuilding the list of instances to heal {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 00:47:14 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "refresh_cache-b80a7b33-5a5f-4db3-8d3a-0a9e9946aace" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:47:14 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquired lock "refresh_cache-b80a7b33-5a5f-4db3-8d3a-0a9e9946aace" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:47:14 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Forcefully refreshing network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 00:47:14 user nova-compute[82479]: DEBUG nova.objects.instance [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lazy-loading 'info_cache' on Instance uuid b80a7b33-5a5f-4db3-8d3a-0a9e9946aace {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:47:15 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Updating instance_info_cache with network_info: [{"id": "b7e5db2e-9e0c-47a3-9d0d-e1b310dcf77b", "address": "fa:16:3e:17:ec:b0", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7e5db2e-9e", "ovs_interfaceid": "b7e5db2e-9e0c-47a3-9d0d-e1b310dcf77b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:47:15 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Releasing lock "refresh_cache-b80a7b33-5a5f-4db3-8d3a-0a9e9946aace" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:47:15 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Updated the network info_cache for instance {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 00:47:16 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:47:16 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:47:17 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:47:17 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:47:19 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:47:19 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:47:21 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:47:23 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:47:23 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82479) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 00:47:23 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:47:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:47:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:47:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:47:23 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Auditing locally available compute resources for user (node: user) {{(pid=82479) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 00:47:23 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:47:24 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:47:24 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:47:24 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Hypervisor/Node resource view: name=user free_ram=8824MB free_disk=26.17102813720703GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82479) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 00:47:24 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:47:24 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:47:24 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance b80a7b33-5a5f-4db3-8d3a-0a9e9946aace actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:47:24 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 00:47:24 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 00:47:24 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:47:24 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:47:24 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Compute_service record updated for user:user {{(pid=82479) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 00:47:24 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.186s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:47:26 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:47:26 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:47:29 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:47:29 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:47:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:47:36 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:47:38 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "1aa2f565-f4cf-4979-875f-0a5d34b6c121" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:47:38 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "1aa2f565-f4cf-4979-875f-0a5d34b6c121" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:47:38 user nova-compute[82479]: DEBUG nova.compute.manager [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Starting instance... {{(pid=82479) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 00:47:38 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:47:38 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:47:38 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82479) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 00:47:38 user nova-compute[82479]: INFO nova.compute.claims [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Claim successful on node user
Apr 14 00:47:39 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:47:39 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:47:39 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.223s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:47:39 user nova-compute[82479]: DEBUG nova.compute.manager [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Start building networks asynchronously for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 00:47:39 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 00:47:39 user nova-compute[82479]: DEBUG nova.compute.manager [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Allocating IP information in the background. {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 00:47:39 user nova-compute[82479]: DEBUG nova.network.neutron [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] allocate_for_instance() {{(pid=82479) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 00:47:39 user nova-compute[82479]: DEBUG nova.compute.manager [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Start building block device mappings for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 00:47:39 user nova-compute[82479]: INFO nova.virt.block_device [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Booting with volume snapshot fecef658-19bb-4067-83f9-27e3c2e3f0d7 at /dev/vda
Apr 14 00:47:39 user nova-compute[82479]: DEBUG nova.policy [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cfb66031fcf84659a3b80cdb76ffddc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934526a2dfa45f4bd5df4edee11d98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82479) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 00:47:40 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:47:40 user nova-compute[82479]: DEBUG nova.network.neutron [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Successfully created port: 6053af7f-223a-471f-9738-c6335cd621c0 {{(pid=82479) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 00:47:40 user nova-compute[82479]: DEBUG nova.network.neutron [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Successfully updated port: 6053af7f-223a-471f-9738-c6335cd621c0 {{(pid=82479) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 00:47:40 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "refresh_cache-1aa2f565-f4cf-4979-875f-0a5d34b6c121" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:47:40 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquired lock "refresh_cache-1aa2f565-f4cf-4979-875f-0a5d34b6c121" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:47:40 user nova-compute[82479]: DEBUG nova.network.neutron [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 00:47:40 user nova-compute[82479]: DEBUG nova.compute.manager [req-0af6aec8-b569-4dd2-ae55-6d566b371de5 req-afa19a30-0346-4628-a51d-2584329ea7dd service nova] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Received event network-changed-6053af7f-223a-471f-9738-c6335cd621c0 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:47:40 user nova-compute[82479]: DEBUG nova.compute.manager [req-0af6aec8-b569-4dd2-ae55-6d566b371de5 req-afa19a30-0346-4628-a51d-2584329ea7dd service nova] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Refreshing instance network info cache due to event network-changed-6053af7f-223a-471f-9738-c6335cd621c0. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:47:40 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0af6aec8-b569-4dd2-ae55-6d566b371de5 req-afa19a30-0346-4628-a51d-2584329ea7dd service nova] Acquiring lock "refresh_cache-1aa2f565-f4cf-4979-875f-0a5d34b6c121" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:47:40 user nova-compute[82479]: DEBUG nova.network.neutron [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Instance cache missing network info. {{(pid=82479) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 00:47:41 user nova-compute[82479]: DEBUG nova.network.neutron [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Updating instance_info_cache with network_info: [{"id": "6053af7f-223a-471f-9738-c6335cd621c0", "address": "fa:16:3e:27:55:ac", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6053af7f-22", "ovs_interfaceid": "6053af7f-223a-471f-9738-c6335cd621c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:47:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Releasing lock "refresh_cache-1aa2f565-f4cf-4979-875f-0a5d34b6c121" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:47:41 user nova-compute[82479]: DEBUG nova.compute.manager [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Instance network_info: |[{"id": "6053af7f-223a-471f-9738-c6335cd621c0", "address": "fa:16:3e:27:55:ac", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6053af7f-22", "ovs_interfaceid": "6053af7f-223a-471f-9738-c6335cd621c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 00:47:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0af6aec8-b569-4dd2-ae55-6d566b371de5 req-afa19a30-0346-4628-a51d-2584329ea7dd service nova] Acquired lock "refresh_cache-1aa2f565-f4cf-4979-875f-0a5d34b6c121" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:47:41 user nova-compute[82479]: DEBUG nova.network.neutron [req-0af6aec8-b569-4dd2-ae55-6d566b371de5 req-afa19a30-0346-4628-a51d-2584329ea7dd service nova] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Refreshing network info cache for port 6053af7f-223a-471f-9738-c6335cd621c0 {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:47:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:47:41 user nova-compute[82479]: DEBUG nova.network.neutron [req-0af6aec8-b569-4dd2-ae55-6d566b371de5 req-afa19a30-0346-4628-a51d-2584329ea7dd service nova] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Updated VIF entry in instance network info cache for port 6053af7f-223a-471f-9738-c6335cd621c0. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:47:41 user nova-compute[82479]: DEBUG nova.network.neutron [req-0af6aec8-b569-4dd2-ae55-6d566b371de5 req-afa19a30-0346-4628-a51d-2584329ea7dd service nova] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Updating instance_info_cache with network_info: [{"id": "6053af7f-223a-471f-9738-c6335cd621c0", "address": "fa:16:3e:27:55:ac", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6053af7f-22", "ovs_interfaceid": "6053af7f-223a-471f-9738-c6335cd621c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:47:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0af6aec8-b569-4dd2-ae55-6d566b371de5 req-afa19a30-0346-4628-a51d-2584329ea7dd service nova] Releasing lock "refresh_cache-1aa2f565-f4cf-4979-875f-0a5d34b6c121" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:47:45 user nova-compute[82479]: DEBUG os_brick.utils [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:47:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:47:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:47:45 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[237b9d8c-447b-4b15-948f-7c5002fb6ff3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fec92fcfdd3\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:47:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:47:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:47:45 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a315cb-06c8-434c-bf98-7566924d5ab8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:47:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:47:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:47:45 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cef01a1-9876-4b50-815c-553446a3ae10]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:47:45 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d86295-080e-4c68-8c66-634d4c97a5bf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:47:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Running cmd (subprocess): nvme version {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:47:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] 'nvme version' failed. Not Retrying. {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:47:45 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] nvme not present on system {{(pid=82479) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 00:47:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:47:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:47:45 user nova-compute[82479]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 00:47:45 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a03d510-9df9-436c-b825-5d0465e5c351]: (4, '') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:47:45 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82479) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 00:47:45 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 00:47:45 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] LIGHTOS: no hostnqn found. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 00:47:45 user nova-compute[82479]: DEBUG os_brick.utils [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fec92fcfdd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:47:45 user nova-compute[82479]: DEBUG nova.virt.block_device [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Updating existing volume attachment record: 405a207a-3f6f-466b-bb56-510496666cd4 {{(pid=82479) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 00:47:46 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:47:49 user nova-compute[82479]: DEBUG nova.compute.manager [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Start spawning the instance on the hypervisor. {{(pid=82479) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 00:47:49 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Creating instance directory {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 00:47:49 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Creating image(s)
Apr 14 00:47:49 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Did not create local disks {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 00:47:49 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Ensure instance console log exists: /opt/stack/data/nova/instances/1aa2f565-f4cf-4979-875f-0a5d34b6c121/console.log {{(pid=82479) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 00:47:49 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:47:49 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:47:49 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:47:49 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Start _get_guest_xml network_info=[{"id": "6053af7f-223a-471f-9738-c6335cd621c0", "address": "fa:16:3e:27:55:ac", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6053af7f-22", "ovs_interfaceid": "6053af7f-223a-471f-9738-c6335cd621c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-04-14T00:47:36Z,direct_url=<?>,disk_format='qcow2',id=723c5f4e-00ac-49cc-8038-c025741dcb57,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-2041946704',owner='0934526a2dfa45f4bd5df4edee11d98a',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-04-14T00:47:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': True, 'attachment_id': '405a207a-3f6f-466b-bb56-510496666cd4', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DQOlTxXw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1aa2f565-f4cf-4979-875f-0a5d34b6c121', 'attached_at': '', 'detached_at': '', 'volume_id': '85461f29-04e3-4204-8171-9893ac35c973', 'serial': '85461f29-04e3-4204-8171-9893ac35c973'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 00:47:49 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:47:49 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:47:49 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82479) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 00:47:49 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T00:02:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-04-14T00:47:36Z,direct_url=<?>,disk_format='qcow2',id=723c5f4e-00ac-49cc-8038-c025741dcb57,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-2041946704',owner='0934526a2dfa45f4bd5df4edee11d98a',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-04-14T00:47:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 00:47:49 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Flavor limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 00:47:49 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Image limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 00:47:49 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Flavor pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 00:47:49 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Image pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 00:47:49 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 00:47:49 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 00:47:49 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 00:47:49 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Got 1 possible topologies {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 00:47:49 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 00:47:49 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 00:47:49 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Calling os-brick to attach iSCSI Volume {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 00:47:49 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DQOlTxXw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:47:49 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:47:49 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:47:49 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:47:49 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:47:49 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:47:49 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:47:49 user nova-compute[82479]: INFO os_brick.initiator.connectors.iscsi [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 00:47:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973 -p 172.16.0.220:3260 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:47:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:47:49 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[9deb7f96-b3bd-4ea0-abf9-efb08bca0857]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:47:49 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 00:47:49 user nova-compute[82479]:  {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:47:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973 -p 172.16.0.220:3260 --interface default --op new {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:47:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:47:49 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[258d5580-7e8d-4465-a2ca-5bf42edde4af]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973] added\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:47:49 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973] added
Apr 14 00:47:49 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:47:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:47:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:47:49 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[2961df84-61eb-4166-a022-604bc627a537]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:47:49 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:47:49 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:47:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:47:50 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e4e53eb-22da-4e8a-bf2a-cf6b8c3a715e]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:47:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:47:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DQOlTxXw {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:47:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DQOlTxXw" returned: 0 in 0.082s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:47:50 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9247be-2537-4057-b910-9062e9a7c8ee]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:47:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DQOlTxXw'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:47:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:47:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:47:50 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[23165409-435e-4176-9e7d-28426f3d9f43]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:47:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:47:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:47:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:47:50 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[53cc40f9-6b08-4c2e-a951-4af3791f566a]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:47:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9 (non-flash)
Apr 14 00:47:50 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:47:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9 (non-flash)
Apr 14 00:47:50 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:47:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973 -p 172.16.0.220:3260 --login {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:47:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:47:50 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[a96993d8-70fe-45d0-8b2f-71e884d96efd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:47:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973, portal: 172.16.0.220,3260]
Apr 14 00:47:50 user nova-compute[82479]: Login to [iface: default, target: iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973, portal: 172.16.0.220,3260] successful.
Apr 14 00:47:50 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:47:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:47:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:47:50 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffdfa66c-1d60-4e39-b35d-9b21ab3a5e34]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:47:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:47:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:47:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:47:50 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f3b564-8138-420c-9159-77425f13cdd1]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:47:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9 (non-flash)
Apr 14 00:47:50 user nova-compute[82479]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973 (non-flash)
Apr 14 00:47:50 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:47:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9 (non-flash)
Apr 14 00:47:50 user nova-compute[82479]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973 (non-flash)
Apr 14 00:47:50 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:47:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.332s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:47:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Connected to 172.16.0.220:3260 {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 00:47:50 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] HCTL ('34', '-', '-', 0) found on session 44 with lun 0 {{(pid=82479) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 00:47:50 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=82479) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 00:47:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:47:50 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:47:50 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[442d58c7-1007-4c74-8513-bc1f74d5f82d]: (4, ('- - 0', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:47:50 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=82479) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 00:47:50 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DQOlTxXw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 00:47:51 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:47:51 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] <== connect_volume: return (1366ms) {'type': 'block', 'scsi_wwn': '23638336630623735', 'path': '/dev/sdc'} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:47:51 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23638336630623735', 'path': '/dev/sdc'} {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 00:47:51 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:47:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-2057599137',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-2057599137',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-2057599137',id=42,image_ref='723c5f4e-00ac-49cc-8038-c025741dcb57',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0934526a2dfa45f4bd5df4edee11d98a',ramdisk_id='',reservation_id='r-naafjxwe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-260409128',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-260409128-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-260409128',owner_user_name='tempest-TestVolumeBootPattern-260409128-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:47:39Z,user_data=None,user_id='cfb66031fcf84659a3b80cdb76ffddc0',uuid=1aa2f565-f4cf-4979-875f-0a5d34b6c121,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6053af7f-223a-471f-9738-c6335cd621c0", "address": "fa:16:3e:27:55:ac", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6053af7f-22", "ovs_interfaceid": "6053af7f-223a-471f-9738-c6335cd621c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82479) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 00:47:51 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Converting VIF {"id": "6053af7f-223a-471f-9738-c6335cd621c0", "address": "fa:16:3e:27:55:ac", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6053af7f-22", "ovs_interfaceid": "6053af7f-223a-471f-9738-c6335cd621c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:47:51 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:55:ac,bridge_name='br-int',has_traffic_filtering=True,id=6053af7f-223a-471f-9738-c6335cd621c0,network=Network(6dec18bc-e73b-450e-b0d2-e36653017f20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6053af7f-22') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:47:51 user nova-compute[82479]: DEBUG nova.objects.instance [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lazy-loading 'pci_devices' on Instance uuid 1aa2f565-f4cf-4979-875f-0a5d34b6c121 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:47:51 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] End _get_guest_xml xml=<domain type="kvm">
Apr 14 00:47:51 user nova-compute[82479]:   <uuid>1aa2f565-f4cf-4979-875f-0a5d34b6c121</uuid>
Apr 14 00:47:51 user nova-compute[82479]:   <name>instance-0000002a</name>
Apr 14 00:47:51 user nova-compute[82479]:   <memory>131072</memory>
Apr 14 00:47:51 user nova-compute[82479]:   <vcpu>1</vcpu>
Apr 14 00:47:51 user nova-compute[82479]:   <metadata>
Apr 14 00:47:51 user nova-compute[82479]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 00:47:51 user nova-compute[82479]:       <nova:package version="0.0.0"/>
Apr 14 00:47:51 user nova-compute[82479]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-2057599137</nova:name>
Apr 14 00:47:51 user nova-compute[82479]:       <nova:creationTime>2023-04-14 00:47:49</nova:creationTime>
Apr 14 00:47:51 user nova-compute[82479]:       <nova:flavor name="m1.nano">
Apr 14 00:47:51 user nova-compute[82479]:         <nova:memory>128</nova:memory>
Apr 14 00:47:51 user nova-compute[82479]:         <nova:disk>1</nova:disk>
Apr 14 00:47:51 user nova-compute[82479]:         <nova:swap>0</nova:swap>
Apr 14 00:47:51 user nova-compute[82479]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 00:47:51 user nova-compute[82479]:         <nova:vcpus>1</nova:vcpus>
Apr 14 00:47:51 user nova-compute[82479]:       </nova:flavor>
Apr 14 00:47:51 user nova-compute[82479]:       <nova:owner>
Apr 14 00:47:51 user nova-compute[82479]:         <nova:user uuid="cfb66031fcf84659a3b80cdb76ffddc0">tempest-TestVolumeBootPattern-260409128-project-member</nova:user>
Apr 14 00:47:51 user nova-compute[82479]:         <nova:project uuid="0934526a2dfa45f4bd5df4edee11d98a">tempest-TestVolumeBootPattern-260409128</nova:project>
Apr 14 00:47:51 user nova-compute[82479]:       </nova:owner>
Apr 14 00:47:51 user nova-compute[82479]:       <nova:root type="image" uuid="723c5f4e-00ac-49cc-8038-c025741dcb57"/>
Apr 14 00:47:51 user nova-compute[82479]:       <nova:ports>
Apr 14 00:47:51 user nova-compute[82479]:         <nova:port uuid="6053af7f-223a-471f-9738-c6335cd621c0">
Apr 14 00:47:51 user nova-compute[82479]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 00:47:51 user nova-compute[82479]:         </nova:port>
Apr 14 00:47:51 user nova-compute[82479]:       </nova:ports>
Apr 14 00:47:51 user nova-compute[82479]:     </nova:instance>
Apr 14 00:47:51 user nova-compute[82479]:   </metadata>
Apr 14 00:47:51 user nova-compute[82479]:   <sysinfo type="smbios">
Apr 14 00:47:51 user nova-compute[82479]:     <system>
Apr 14 00:47:51 user nova-compute[82479]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 00:47:51 user nova-compute[82479]:       <entry name="product">OpenStack Nova</entry>
Apr 14 00:47:51 user nova-compute[82479]:       <entry name="version">0.0.0</entry>
Apr 14 00:47:51 user nova-compute[82479]:       <entry name="serial">1aa2f565-f4cf-4979-875f-0a5d34b6c121</entry>
Apr 14 00:47:51 user nova-compute[82479]:       <entry name="uuid">1aa2f565-f4cf-4979-875f-0a5d34b6c121</entry>
Apr 14 00:47:51 user nova-compute[82479]:       <entry name="family">Virtual Machine</entry>
Apr 14 00:47:51 user nova-compute[82479]:     </system>
Apr 14 00:47:51 user nova-compute[82479]:   </sysinfo>
Apr 14 00:47:51 user nova-compute[82479]:   <os>
Apr 14 00:47:51 user nova-compute[82479]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 00:47:51 user nova-compute[82479]:     <boot dev="hd"/>
Apr 14 00:47:51 user nova-compute[82479]:     <smbios mode="sysinfo"/>
Apr 14 00:47:51 user nova-compute[82479]:   </os>
Apr 14 00:47:51 user nova-compute[82479]:   <features>
Apr 14 00:47:51 user nova-compute[82479]:     <acpi/>
Apr 14 00:47:51 user nova-compute[82479]:     <apic/>
Apr 14 00:47:51 user nova-compute[82479]:     <vmcoreinfo/>
Apr 14 00:47:51 user nova-compute[82479]:   </features>
Apr 14 00:47:51 user nova-compute[82479]:   <clock offset="utc">
Apr 14 00:47:51 user nova-compute[82479]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 00:47:51 user nova-compute[82479]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 00:47:51 user nova-compute[82479]:     <timer name="hpet" present="no"/>
Apr 14 00:47:51 user nova-compute[82479]:   </clock>
Apr 14 00:47:51 user nova-compute[82479]:   <cpu mode="custom" match="exact">
Apr 14 00:47:51 user nova-compute[82479]:     <model>Nehalem</model>
Apr 14 00:47:51 user nova-compute[82479]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 00:47:51 user nova-compute[82479]:   </cpu>
Apr 14 00:47:51 user nova-compute[82479]:   <devices>
Apr 14 00:47:51 user nova-compute[82479]:     <disk type="block" device="disk">
Apr 14 00:47:51 user nova-compute[82479]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:47:51 user nova-compute[82479]:       <source dev="/dev/sdc"/>
Apr 14 00:47:51 user nova-compute[82479]:       <target dev="vda" bus="virtio"/>
Apr 14 00:47:51 user nova-compute[82479]:       <serial>85461f29-04e3-4204-8171-9893ac35c973</serial>
Apr 14 00:47:51 user nova-compute[82479]:     </disk>
Apr 14 00:47:51 user nova-compute[82479]:     <interface type="ethernet">
Apr 14 00:47:51 user nova-compute[82479]:       <mac address="fa:16:3e:27:55:ac"/>
Apr 14 00:47:51 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:47:51 user nova-compute[82479]:       <mtu size="1442"/>
Apr 14 00:47:51 user nova-compute[82479]:       <target dev="tap6053af7f-22"/>
Apr 14 00:47:51 user nova-compute[82479]:     </interface>
Apr 14 00:47:51 user nova-compute[82479]:     <serial type="pty">
Apr 14 00:47:51 user nova-compute[82479]:       <log file="/opt/stack/data/nova/instances/1aa2f565-f4cf-4979-875f-0a5d34b6c121/console.log" append="off"/>
Apr 14 00:47:51 user nova-compute[82479]:     </serial>
Apr 14 00:47:51 user nova-compute[82479]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 00:47:51 user nova-compute[82479]:     <video>
Apr 14 00:47:51 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:47:51 user nova-compute[82479]:     </video>
Apr 14 00:47:51 user nova-compute[82479]:     <rng model="virtio">
Apr 14 00:47:51 user nova-compute[82479]:       <backend model="random">/dev/urandom</backend>
Apr 14 00:47:51 user nova-compute[82479]:     </rng>
Apr 14 00:47:51 user nova-compute[82479]:     <controller type="usb" index="0" model="none"/>
Apr 14 00:47:51 user nova-compute[82479]:     <memballoon model="virtio">
Apr 14 00:47:51 user nova-compute[82479]:       <stats period="10"/>
Apr 14 00:47:51 user nova-compute[82479]:     </memballoon>
Apr 14 00:47:51 user nova-compute[82479]:   </devices>
Apr 14 00:47:51 user nova-compute[82479]: </domain>
Apr 14 00:47:51 user nova-compute[82479]:  {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 00:47:51 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:47:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-2057599137',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-2057599137',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-2057599137',id=42,image_ref='723c5f4e-00ac-49cc-8038-c025741dcb57',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0934526a2dfa45f4bd5df4edee11d98a',ramdisk_id='',reservation_id='r-naafjxwe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-260409128',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-260409128-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-260409128',owner_user_name='tempest-TestVolumeBootPattern-260409128-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:47:39Z,user_data=None,user_id='cfb66031fcf84659a3b80cdb76ffddc0',uuid=1aa2f565-f4cf-4979-875f-0a5d34b6c121,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6053af7f-223a-471f-9738-c6335cd621c0", "address": "fa:16:3e:27:55:ac", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6053af7f-22", "ovs_interfaceid": "6053af7f-223a-471f-9738-c6335cd621c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 00:47:51 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Converting VIF {"id": "6053af7f-223a-471f-9738-c6335cd621c0", "address": "fa:16:3e:27:55:ac", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6053af7f-22", "ovs_interfaceid": "6053af7f-223a-471f-9738-c6335cd621c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:47:51 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:55:ac,bridge_name='br-int',has_traffic_filtering=True,id=6053af7f-223a-471f-9738-c6335cd621c0,network=Network(6dec18bc-e73b-450e-b0d2-e36653017f20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6053af7f-22') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:47:51 user nova-compute[82479]: DEBUG os_vif [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:55:ac,bridge_name='br-int',has_traffic_filtering=True,id=6053af7f-223a-471f-9738-c6335cd621c0,network=Network(6dec18bc-e73b-450e-b0d2-e36653017f20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6053af7f-22') {{(pid=82479) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 00:47:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:47:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:47:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 00:47:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:47:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6053af7f-22, may_exist=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:47:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6053af7f-22, col_values=(('external_ids', {'iface-id': '6053af7f-223a-471f-9738-c6335cd621c0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:55:ac', 'vm-uuid': '1aa2f565-f4cf-4979-875f-0a5d34b6c121'}),)) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:47:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:47:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:47:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:47:51 user nova-compute[82479]: INFO os_vif [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:55:ac,bridge_name='br-int',has_traffic_filtering=True,id=6053af7f-223a-471f-9738-c6335cd621c0,network=Network(6dec18bc-e73b-450e-b0d2-e36653017f20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6053af7f-22')
Apr 14 00:47:51 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:47:51 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] No VIF found with MAC fa:16:3e:27:55:ac, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:47:52 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:47:52 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:47:52 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:47:52 user nova-compute[82479]: DEBUG nova.compute.manager [req-55f43bdb-55c1-488a-b65f-a4d11fca8267 req-75779881-6b4f-4668-b9ec-5bbb1800d2fd service nova] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Received event network-vif-plugged-6053af7f-223a-471f-9738-c6335cd621c0 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:47:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-55f43bdb-55c1-488a-b65f-a4d11fca8267 req-75779881-6b4f-4668-b9ec-5bbb1800d2fd service nova] Acquiring lock "1aa2f565-f4cf-4979-875f-0a5d34b6c121-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:47:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-55f43bdb-55c1-488a-b65f-a4d11fca8267 req-75779881-6b4f-4668-b9ec-5bbb1800d2fd service nova] Lock "1aa2f565-f4cf-4979-875f-0a5d34b6c121-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:47:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-55f43bdb-55c1-488a-b65f-a4d11fca8267 req-75779881-6b4f-4668-b9ec-5bbb1800d2fd service nova] Lock "1aa2f565-f4cf-4979-875f-0a5d34b6c121-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:47:52 user nova-compute[82479]: DEBUG nova.compute.manager [req-55f43bdb-55c1-488a-b65f-a4d11fca8267 req-75779881-6b4f-4668-b9ec-5bbb1800d2fd service nova] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] No waiting events found dispatching network-vif-plugged-6053af7f-223a-471f-9738-c6335cd621c0 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:47:52 user nova-compute[82479]: WARNING nova.compute.manager [req-55f43bdb-55c1-488a-b65f-a4d11fca8267 req-75779881-6b4f-4668-b9ec-5bbb1800d2fd service nova] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Received unexpected event network-vif-plugged-6053af7f-223a-471f-9738-c6335cd621c0 for instance with vm_state building and task_state spawning.
Apr 14 00:47:52 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:47:54 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681433274.684999, 1aa2f565-f4cf-4979-875f-0a5d34b6c121 => Resumed> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:47:54 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] VM Resumed (Lifecycle Event)
Apr 14 00:47:54 user nova-compute[82479]: DEBUG nova.compute.manager [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Instance event wait completed in 0 seconds for  {{(pid=82479) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 00:47:54 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Guest created on hypervisor {{(pid=82479) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 00:47:54 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Instance spawned successfully.
Apr 14 00:47:54 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 00:47:54 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Found default for hw_input_bus of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:47:54 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Found default for hw_pointer_model of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:47:54 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:47:54 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:47:54 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:47:54 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681433274.6890273, 1aa2f565-f4cf-4979-875f-0a5d34b6c121 => Started> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:47:54 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] VM Started (Lifecycle Event)
Apr 14 00:47:54 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:47:54 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:47:54 user nova-compute[82479]: INFO nova.compute.manager [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Took 4.93 seconds to spawn the instance on the hypervisor.
Apr 14 00:47:54 user nova-compute[82479]: DEBUG nova.compute.manager [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:47:54 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:47:54 user nova-compute[82479]: INFO nova.compute.manager [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Took 15.99 seconds to build instance.
Apr 14 00:47:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "1aa2f565-f4cf-4979-875f-0a5d34b6c121" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.093s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:47:54 user nova-compute[82479]: DEBUG nova.compute.manager [req-04b41527-7ccc-4777-b707-1c2e046be157 req-19adbefc-e1c3-4dbd-8e6a-4bc8906a6281 service nova] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Received event network-vif-plugged-6053af7f-223a-471f-9738-c6335cd621c0 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:47:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-04b41527-7ccc-4777-b707-1c2e046be157 req-19adbefc-e1c3-4dbd-8e6a-4bc8906a6281 service nova] Acquiring lock "1aa2f565-f4cf-4979-875f-0a5d34b6c121-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:47:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-04b41527-7ccc-4777-b707-1c2e046be157 req-19adbefc-e1c3-4dbd-8e6a-4bc8906a6281 service nova] Lock "1aa2f565-f4cf-4979-875f-0a5d34b6c121-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:47:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-04b41527-7ccc-4777-b707-1c2e046be157 req-19adbefc-e1c3-4dbd-8e6a-4bc8906a6281 service nova] Lock "1aa2f565-f4cf-4979-875f-0a5d34b6c121-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:47:54 user nova-compute[82479]: DEBUG nova.compute.manager [req-04b41527-7ccc-4777-b707-1c2e046be157 req-19adbefc-e1c3-4dbd-8e6a-4bc8906a6281 service nova] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] No waiting events found dispatching network-vif-plugged-6053af7f-223a-471f-9738-c6335cd621c0 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:47:54 user nova-compute[82479]: WARNING nova.compute.manager [req-04b41527-7ccc-4777-b707-1c2e046be157 req-19adbefc-e1c3-4dbd-8e6a-4bc8906a6281 service nova] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Received unexpected event network-vif-plugged-6053af7f-223a-471f-9738-c6335cd621c0 for instance with vm_state active and task_state None.
Apr 14 00:47:56 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:47:56 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:48:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:48:06 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:48:06 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:48:11 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:48:11 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:48:15 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:48:15 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Starting heal instance info cache {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 00:48:15 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Rebuilding the list of instances to heal {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 00:48:15 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "refresh_cache-b80a7b33-5a5f-4db3-8d3a-0a9e9946aace" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:48:15 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquired lock "refresh_cache-b80a7b33-5a5f-4db3-8d3a-0a9e9946aace" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:48:15 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Forcefully refreshing network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 00:48:15 user nova-compute[82479]: DEBUG nova.objects.instance [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lazy-loading 'info_cache' on Instance uuid b80a7b33-5a5f-4db3-8d3a-0a9e9946aace {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:48:16 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Updating instance_info_cache with network_info: [{"id": "b7e5db2e-9e0c-47a3-9d0d-e1b310dcf77b", "address": "fa:16:3e:17:ec:b0", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7e5db2e-9e", "ovs_interfaceid": "b7e5db2e-9e0c-47a3-9d0d-e1b310dcf77b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:48:16 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Releasing lock "refresh_cache-b80a7b33-5a5f-4db3-8d3a-0a9e9946aace" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:48:16 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Updated the network info_cache for instance {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 00:48:16 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:48:16 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:48:19 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:48:19 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:48:21 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:48:21 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:48:21 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:48:23 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:48:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:48:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:48:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:48:23 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Auditing locally available compute resources for user (node: user) {{(pid=82479) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 00:48:23 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:48:23 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:48:24 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:48:24 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:48:24 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Hypervisor/Node resource view: name=user free_ram=8714MB free_disk=26.169113159179688GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82479) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 00:48:24 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:48:24 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:48:24 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance b80a7b33-5a5f-4db3-8d3a-0a9e9946aace actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:48:24 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 1aa2f565-f4cf-4979-875f-0a5d34b6c121 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:48:24 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 00:48:24 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 00:48:24 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:48:24 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:48:24 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Compute_service record updated for user:user {{(pid=82479) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 00:48:24 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.214s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:48:26 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:48:26 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82479) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 00:48:26 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:48:26 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:48:30 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:48:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:48:31 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:48:36 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:48:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:48:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:48:46 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:48:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:48:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:48:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:48:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:48:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:48:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:48:56 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:49:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:49:06 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:49:11 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:49:15 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:49:15 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Starting heal instance info cache {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 00:49:15 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "refresh_cache-1aa2f565-f4cf-4979-875f-0a5d34b6c121" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:49:15 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquired lock "refresh_cache-1aa2f565-f4cf-4979-875f-0a5d34b6c121" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:49:15 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Forcefully refreshing network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 00:49:16 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Updating instance_info_cache with network_info: [{"id": "6053af7f-223a-471f-9738-c6335cd621c0", "address": "fa:16:3e:27:55:ac", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6053af7f-22", "ovs_interfaceid": "6053af7f-223a-471f-9738-c6335cd621c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:49:16 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Releasing lock "refresh_cache-1aa2f565-f4cf-4979-875f-0a5d34b6c121" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:49:16 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Updated the network info_cache for instance {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 00:49:16 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:49:16 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:49:16 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:49:16 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:49:16 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:49:16 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:49:16 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:49:18 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:49:19 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:49:19 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:49:21 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:49:22 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:49:24 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:49:24 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:49:24 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:49:24 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:49:24 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Auditing locally available compute resources for user (node: user) {{(pid=82479) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 00:49:24 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:49:24 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:49:25 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:49:25 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:49:25 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Hypervisor/Node resource view: name=user free_ram=8769MB free_disk=26.168540954589844GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82479) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 00:49:25 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:49:25 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:49:25 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance b80a7b33-5a5f-4db3-8d3a-0a9e9946aace actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:49:25 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 1aa2f565-f4cf-4979-875f-0a5d34b6c121 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:49:25 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 00:49:25 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 00:49:25 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:49:25 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:49:25 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Compute_service record updated for user:user {{(pid=82479) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 00:49:25 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.179s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:49:26 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:49:27 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:49:27 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82479) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 00:49:28 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:49:29 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d39e8b1d-59e7-4393-a738-2147ecb02c3d tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "1aa2f565-f4cf-4979-875f-0a5d34b6c121" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:49:29 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d39e8b1d-59e7-4393-a738-2147ecb02c3d tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "1aa2f565-f4cf-4979-875f-0a5d34b6c121" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:49:29 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d39e8b1d-59e7-4393-a738-2147ecb02c3d tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "1aa2f565-f4cf-4979-875f-0a5d34b6c121-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:49:29 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d39e8b1d-59e7-4393-a738-2147ecb02c3d tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "1aa2f565-f4cf-4979-875f-0a5d34b6c121-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:49:29 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d39e8b1d-59e7-4393-a738-2147ecb02c3d tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "1aa2f565-f4cf-4979-875f-0a5d34b6c121-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:49:29 user nova-compute[82479]: INFO nova.compute.manager [None req-d39e8b1d-59e7-4393-a738-2147ecb02c3d tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Terminating instance
Apr 14 00:49:29 user nova-compute[82479]: DEBUG nova.compute.manager [None req-d39e8b1d-59e7-4393-a738-2147ecb02c3d tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Start destroying the instance on the hypervisor. {{(pid=82479) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 00:49:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:49:29 user nova-compute[82479]: DEBUG nova.compute.manager [req-f4feeae3-258e-4f35-98af-55f5063691e4 req-db6fe71c-5a84-434b-a6b1-08c461bc5a9a service nova] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Received event network-vif-unplugged-6053af7f-223a-471f-9738-c6335cd621c0 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:49:29 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-f4feeae3-258e-4f35-98af-55f5063691e4 req-db6fe71c-5a84-434b-a6b1-08c461bc5a9a service nova] Acquiring lock "1aa2f565-f4cf-4979-875f-0a5d34b6c121-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:49:29 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-f4feeae3-258e-4f35-98af-55f5063691e4 req-db6fe71c-5a84-434b-a6b1-08c461bc5a9a service nova] Lock "1aa2f565-f4cf-4979-875f-0a5d34b6c121-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:49:29 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-f4feeae3-258e-4f35-98af-55f5063691e4 req-db6fe71c-5a84-434b-a6b1-08c461bc5a9a service nova] Lock "1aa2f565-f4cf-4979-875f-0a5d34b6c121-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:49:29 user nova-compute[82479]: DEBUG nova.compute.manager [req-f4feeae3-258e-4f35-98af-55f5063691e4 req-db6fe71c-5a84-434b-a6b1-08c461bc5a9a service nova] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] No waiting events found dispatching network-vif-unplugged-6053af7f-223a-471f-9738-c6335cd621c0 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:49:29 user nova-compute[82479]: DEBUG nova.compute.manager [req-f4feeae3-258e-4f35-98af-55f5063691e4 req-db6fe71c-5a84-434b-a6b1-08c461bc5a9a service nova] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Received event network-vif-unplugged-6053af7f-223a-471f-9738-c6335cd621c0 for instance with task_state deleting. {{(pid=82479) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 00:49:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:49:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:49:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:49:30 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:49:30 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:49:30 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Instance destroyed successfully.
Apr 14 00:49:30 user nova-compute[82479]: DEBUG nova.objects.instance [None req-d39e8b1d-59e7-4393-a738-2147ecb02c3d tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lazy-loading 'resources' on Instance uuid 1aa2f565-f4cf-4979-875f-0a5d34b6c121 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:49:30 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:49:30 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-d39e8b1d-59e7-4393-a738-2147ecb02c3d tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:47:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-2057599137',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-2057599137',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-2057599137',id=42,image_ref='723c5f4e-00ac-49cc-8038-c025741dcb57',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:47:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0934526a2dfa45f4bd5df4edee11d98a',ramdisk_id='',reservation_id='r-naafjxwe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-260409128',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-260409128-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-260409128',owner_user_name='tempest-TestVolumeBootPattern-260409128-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T00:47:55Z,user_data=None,user_id='cfb66031fcf84659a3b80cdb76ffddc0',uuid=1aa2f565-f4cf-4979-875f-0a5d34b6c121,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6053af7f-223a-471f-9738-c6335cd621c0", "address": "fa:16:3e:27:55:ac", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6053af7f-22", "ovs_interfaceid": "6053af7f-223a-471f-9738-c6335cd621c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 00:49:30 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-d39e8b1d-59e7-4393-a738-2147ecb02c3d tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Converting VIF {"id": "6053af7f-223a-471f-9738-c6335cd621c0", "address": "fa:16:3e:27:55:ac", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6053af7f-22", "ovs_interfaceid": "6053af7f-223a-471f-9738-c6335cd621c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:49:30 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-d39e8b1d-59e7-4393-a738-2147ecb02c3d tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:27:55:ac,bridge_name='br-int',has_traffic_filtering=True,id=6053af7f-223a-471f-9738-c6335cd621c0,network=Network(6dec18bc-e73b-450e-b0d2-e36653017f20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6053af7f-22') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:49:30 user nova-compute[82479]: DEBUG os_vif [None req-d39e8b1d-59e7-4393-a738-2147ecb02c3d tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:55:ac,bridge_name='br-int',has_traffic_filtering=True,id=6053af7f-223a-471f-9738-c6335cd621c0,network=Network(6dec18bc-e73b-450e-b0d2-e36653017f20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6053af7f-22') {{(pid=82479) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 00:49:30 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:49:30 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6053af7f-22, bridge=br-int, if_exists=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:49:30 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:49:30 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:49:30 user nova-compute[82479]: INFO os_vif [None req-d39e8b1d-59e7-4393-a738-2147ecb02c3d tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:55:ac,bridge_name='br-int',has_traffic_filtering=True,id=6053af7f-223a-471f-9738-c6335cd621c0,network=Network(6dec18bc-e73b-450e-b0d2-e36653017f20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6053af7f-22')
Apr 14 00:49:30 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d39e8b1d-59e7-4393-a738-2147ecb02c3d tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] calling os-brick to detach iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 00:49:30 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39e8b1d-59e7-4393-a738-2147ecb02c3d tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, {'target_iqn': 'iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DQOlTxXw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:49:30 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-d39e8b1d-59e7-4393-a738-2147ecb02c3d tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:49:30 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-d39e8b1d-59e7-4393-a738-2147ecb02c3d tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:49:30 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-d39e8b1d-59e7-4393-a738-2147ecb02c3d tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:49:30 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:49:30 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:49:30 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[69988c1d-c384-4d10-b685-8ad0426fa54a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:49:30 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39e8b1d-59e7-4393-a738-2147ecb02c3d tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 00:49:30 user nova-compute[82479]: No targets found.
Apr 14 00:49:30 user nova-compute[82479]: iSNS:
Apr 14 00:49:30 user nova-compute[82479]: No targets found.
Apr 14 00:49:30 user nova-compute[82479]: STATIC:
Apr 14 00:49:30 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973
Apr 14 00:49:30 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:49:30 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:49:30 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9
Apr 14 00:49:30 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:49:30 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:49:30 user nova-compute[82479]: FIRMWARE:
Apr 14 00:49:30 user nova-compute[82479]: No targets found.
Apr 14 00:49:30 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:49:30 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39e8b1d-59e7-4393-a738-2147ecb02c3d tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 00:49:30 user nova-compute[82479]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 00:49:30 user nova-compute[82479]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82479) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 00:49:30 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39e8b1d-59e7-4393-a738-2147ecb02c3d tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973', 0)] {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 00:49:30 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:49:30 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:49:30 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a46898e-8f75-4c99-9332-f7e1b5bf09f9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:49:30 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:49:30 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:49:30 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[03abc857-c2e2-4dfd-bf42-7b730f56179b]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:49:30 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39e8b1d-59e7-4393-a738-2147ecb02c3d tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9 (non-flash)
Apr 14 00:49:30 user nova-compute[82479]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973 (non-flash)
Apr 14 00:49:30 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:49:30 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39e8b1d-59e7-4393-a738-2147ecb02c3d tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9 (non-flash)
Apr 14 00:49:30 user nova-compute[82479]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973 (non-flash)
Apr 14 00:49:30 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:49:30 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39e8b1d-59e7-4393-a738-2147ecb02c3d tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f33380fc280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973'): ({'sdc'}, set())}) {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 00:49:30 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-d39e8b1d-59e7-4393-a738-2147ecb02c3d tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Removing single pathed devices sdc {{(pid=82479) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 00:49:30 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:49:30 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:49:30 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9f0293-036f-4517-9bb3-f2776fa71206]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:49:30 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:49:30 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:49:30 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c0ea50-75df-4a3e-9c5f-14a0bf5bfe49]: (4, ('ok\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:49:30 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-d39e8b1d-59e7-4393-a738-2147ecb02c3d tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Flushing IO for device /dev/sdc {{(pid=82479) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 00:49:30 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:49:30 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:49:30 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea0febaa-6519-4a38-b796-3634d1f24b84]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:49:30 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-d39e8b1d-59e7-4393-a738-2147ecb02c3d tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=82479) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 00:49:30 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:49:30 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:49:30 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a02260-8f62-4fab-b207-4915f858ae3f]: (4, ('1', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:49:30 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-d39e8b1d-59e7-4393-a738-2147ecb02c3d tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 00:49:30 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-d39e8b1d-59e7-4393-a738-2147ecb02c3d tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] SCSI volumes sdc have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 00:49:30 user nova-compute[82479]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_1be44af5', '/dev/disk/by-id/scsi-1SCST_BIO1be44af5-683f0b7503027a5d', '/dev/disk/by-id/scsi-23638336630623735') {{(pid=93289) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 14 00:49:30 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[85749678-4cc4-443d-9459-08290e15f21a]: (4, None) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:49:30 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39e8b1d-59e7-4393-a738-2147ecb02c3d tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973')] {{(pid=82479) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 00:49:30 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:49:30 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:49:30 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:49:30 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:49:30 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eee4a7b-d472-41a6-970d-31d09160d77a]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:49:30 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39e8b1d-59e7-4393-a738-2147ecb02c3d tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:49:30 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973 -p 172.16.0.220:3260 --logout {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:49:30 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:49:30 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[469d5dc8-2e0a-4134-91da-5a69a442fc4b]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:49:30 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39e8b1d-59e7-4393-a738-2147ecb02c3d tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973, portal: 172.16.0.220,3260]
Apr 14 00:49:30 user nova-compute[82479]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973, portal: 172.16.0.220,3260] successful.
Apr 14 00:49:30 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:49:30 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973 -p 172.16.0.220:3260 --op delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:49:30 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:49:30 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9885e9-39fd-483e-a852-0bcd7ad288af]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:49:30 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39e8b1d-59e7-4393-a738-2147ecb02c3d tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:49:30 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-d39e8b1d-59e7-4393-a738-2147ecb02c3d tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:49:30 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-d39e8b1d-59e7-4393-a738-2147ecb02c3d tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] <== disconnect_volume: return (335ms) None {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:49:30 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d39e8b1d-59e7-4393-a738-2147ecb02c3d tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Disconnected iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 00:49:30 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-d39e8b1d-59e7-4393-a738-2147ecb02c3d tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Deleting instance files /opt/stack/data/nova/instances/1aa2f565-f4cf-4979-875f-0a5d34b6c121_del
Apr 14 00:49:30 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-d39e8b1d-59e7-4393-a738-2147ecb02c3d tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Deletion of /opt/stack/data/nova/instances/1aa2f565-f4cf-4979-875f-0a5d34b6c121_del complete
Apr 14 00:49:30 user nova-compute[82479]: INFO nova.compute.manager [None req-d39e8b1d-59e7-4393-a738-2147ecb02c3d tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Took 1.20 seconds to destroy the instance on the hypervisor.
Apr 14 00:49:30 user nova-compute[82479]: DEBUG oslo.service.loopingcall [None req-d39e8b1d-59e7-4393-a738-2147ecb02c3d tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82479) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 00:49:30 user nova-compute[82479]: DEBUG nova.compute.manager [-] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Deallocating network for instance {{(pid=82479) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 00:49:30 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] deallocate_for_instance() {{(pid=82479) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 00:49:30 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:49:31 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Updating instance_info_cache with network_info: [] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:49:31 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Took 0.54 seconds to deallocate network for instance.
Apr 14 00:49:31 user nova-compute[82479]: DEBUG nova.compute.manager [req-e524709b-41e3-4a28-be2d-808181d15767 req-8503dbaa-4518-4929-a820-8370f1906e1c service nova] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Received event network-vif-deleted-6053af7f-223a-471f-9738-c6335cd621c0 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:49:31 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:49:31 user nova-compute[82479]: DEBUG nova.compute.manager [req-0cd220f6-97b6-47f6-9753-df7ce43f2cd9 req-39a0cfe4-1018-4ff0-978a-cec418909f1e service nova] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Received event network-vif-plugged-6053af7f-223a-471f-9738-c6335cd621c0 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:49:31 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0cd220f6-97b6-47f6-9753-df7ce43f2cd9 req-39a0cfe4-1018-4ff0-978a-cec418909f1e service nova] Acquiring lock "1aa2f565-f4cf-4979-875f-0a5d34b6c121-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:49:31 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0cd220f6-97b6-47f6-9753-df7ce43f2cd9 req-39a0cfe4-1018-4ff0-978a-cec418909f1e service nova] Lock "1aa2f565-f4cf-4979-875f-0a5d34b6c121-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:49:31 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0cd220f6-97b6-47f6-9753-df7ce43f2cd9 req-39a0cfe4-1018-4ff0-978a-cec418909f1e service nova] Lock "1aa2f565-f4cf-4979-875f-0a5d34b6c121-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:49:31 user nova-compute[82479]: DEBUG nova.compute.manager [req-0cd220f6-97b6-47f6-9753-df7ce43f2cd9 req-39a0cfe4-1018-4ff0-978a-cec418909f1e service nova] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] No waiting events found dispatching network-vif-plugged-6053af7f-223a-471f-9738-c6335cd621c0 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:49:31 user nova-compute[82479]: WARNING nova.compute.manager [req-0cd220f6-97b6-47f6-9753-df7ce43f2cd9 req-39a0cfe4-1018-4ff0-978a-cec418909f1e service nova] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Received unexpected event network-vif-plugged-6053af7f-223a-471f-9738-c6335cd621c0 for instance with vm_state active and task_state deleting.
Apr 14 00:49:31 user nova-compute[82479]: DEBUG nova.compute.manager [req-0cd220f6-97b6-47f6-9753-df7ce43f2cd9 req-39a0cfe4-1018-4ff0-978a-cec418909f1e service nova] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Received event network-vif-plugged-6053af7f-223a-471f-9738-c6335cd621c0 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:49:31 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0cd220f6-97b6-47f6-9753-df7ce43f2cd9 req-39a0cfe4-1018-4ff0-978a-cec418909f1e service nova] Acquiring lock "1aa2f565-f4cf-4979-875f-0a5d34b6c121-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:49:31 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0cd220f6-97b6-47f6-9753-df7ce43f2cd9 req-39a0cfe4-1018-4ff0-978a-cec418909f1e service nova] Lock "1aa2f565-f4cf-4979-875f-0a5d34b6c121-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:49:31 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0cd220f6-97b6-47f6-9753-df7ce43f2cd9 req-39a0cfe4-1018-4ff0-978a-cec418909f1e service nova] Lock "1aa2f565-f4cf-4979-875f-0a5d34b6c121-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:49:31 user nova-compute[82479]: DEBUG nova.compute.manager [req-0cd220f6-97b6-47f6-9753-df7ce43f2cd9 req-39a0cfe4-1018-4ff0-978a-cec418909f1e service nova] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] No waiting events found dispatching network-vif-plugged-6053af7f-223a-471f-9738-c6335cd621c0 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:49:31 user nova-compute[82479]: WARNING nova.compute.manager [req-0cd220f6-97b6-47f6-9753-df7ce43f2cd9 req-39a0cfe4-1018-4ff0-978a-cec418909f1e service nova] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Received unexpected event network-vif-plugged-6053af7f-223a-471f-9738-c6335cd621c0 for instance with vm_state active and task_state deleting.
Apr 14 00:49:31 user nova-compute[82479]: DEBUG nova.compute.manager [req-0cd220f6-97b6-47f6-9753-df7ce43f2cd9 req-39a0cfe4-1018-4ff0-978a-cec418909f1e service nova] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Received event network-vif-plugged-6053af7f-223a-471f-9738-c6335cd621c0 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:49:31 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0cd220f6-97b6-47f6-9753-df7ce43f2cd9 req-39a0cfe4-1018-4ff0-978a-cec418909f1e service nova] Acquiring lock "1aa2f565-f4cf-4979-875f-0a5d34b6c121-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:49:31 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0cd220f6-97b6-47f6-9753-df7ce43f2cd9 req-39a0cfe4-1018-4ff0-978a-cec418909f1e service nova] Lock "1aa2f565-f4cf-4979-875f-0a5d34b6c121-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:49:31 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0cd220f6-97b6-47f6-9753-df7ce43f2cd9 req-39a0cfe4-1018-4ff0-978a-cec418909f1e service nova] Lock "1aa2f565-f4cf-4979-875f-0a5d34b6c121-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:49:31 user nova-compute[82479]: DEBUG nova.compute.manager [req-0cd220f6-97b6-47f6-9753-df7ce43f2cd9 req-39a0cfe4-1018-4ff0-978a-cec418909f1e service nova] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] No waiting events found dispatching network-vif-plugged-6053af7f-223a-471f-9738-c6335cd621c0 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:49:31 user nova-compute[82479]: WARNING nova.compute.manager [req-0cd220f6-97b6-47f6-9753-df7ce43f2cd9 req-39a0cfe4-1018-4ff0-978a-cec418909f1e service nova] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Received unexpected event network-vif-plugged-6053af7f-223a-471f-9738-c6335cd621c0 for instance with vm_state active and task_state deleting.
Apr 14 00:49:31 user nova-compute[82479]: DEBUG nova.compute.manager [req-0cd220f6-97b6-47f6-9753-df7ce43f2cd9 req-39a0cfe4-1018-4ff0-978a-cec418909f1e service nova] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Received event network-vif-unplugged-6053af7f-223a-471f-9738-c6335cd621c0 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:49:31 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0cd220f6-97b6-47f6-9753-df7ce43f2cd9 req-39a0cfe4-1018-4ff0-978a-cec418909f1e service nova] Acquiring lock "1aa2f565-f4cf-4979-875f-0a5d34b6c121-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:49:31 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0cd220f6-97b6-47f6-9753-df7ce43f2cd9 req-39a0cfe4-1018-4ff0-978a-cec418909f1e service nova] Lock "1aa2f565-f4cf-4979-875f-0a5d34b6c121-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:49:31 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0cd220f6-97b6-47f6-9753-df7ce43f2cd9 req-39a0cfe4-1018-4ff0-978a-cec418909f1e service nova] Lock "1aa2f565-f4cf-4979-875f-0a5d34b6c121-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:49:31 user nova-compute[82479]: DEBUG nova.compute.manager [req-0cd220f6-97b6-47f6-9753-df7ce43f2cd9 req-39a0cfe4-1018-4ff0-978a-cec418909f1e service nova] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] No waiting events found dispatching network-vif-unplugged-6053af7f-223a-471f-9738-c6335cd621c0 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:49:31 user nova-compute[82479]: DEBUG nova.compute.manager [req-0cd220f6-97b6-47f6-9753-df7ce43f2cd9 req-39a0cfe4-1018-4ff0-978a-cec418909f1e service nova] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Received event network-vif-unplugged-6053af7f-223a-471f-9738-c6335cd621c0 for instance with task_state deleting. {{(pid=82479) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 00:49:31 user nova-compute[82479]: DEBUG nova.compute.manager [req-0cd220f6-97b6-47f6-9753-df7ce43f2cd9 req-39a0cfe4-1018-4ff0-978a-cec418909f1e service nova] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Received event network-vif-plugged-6053af7f-223a-471f-9738-c6335cd621c0 {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:49:31 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0cd220f6-97b6-47f6-9753-df7ce43f2cd9 req-39a0cfe4-1018-4ff0-978a-cec418909f1e service nova] Acquiring lock "1aa2f565-f4cf-4979-875f-0a5d34b6c121-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:49:31 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0cd220f6-97b6-47f6-9753-df7ce43f2cd9 req-39a0cfe4-1018-4ff0-978a-cec418909f1e service nova] Lock "1aa2f565-f4cf-4979-875f-0a5d34b6c121-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:49:31 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0cd220f6-97b6-47f6-9753-df7ce43f2cd9 req-39a0cfe4-1018-4ff0-978a-cec418909f1e service nova] Lock "1aa2f565-f4cf-4979-875f-0a5d34b6c121-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:49:31 user nova-compute[82479]: DEBUG nova.compute.manager [req-0cd220f6-97b6-47f6-9753-df7ce43f2cd9 req-39a0cfe4-1018-4ff0-978a-cec418909f1e service nova] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] No waiting events found dispatching network-vif-plugged-6053af7f-223a-471f-9738-c6335cd621c0 {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:49:31 user nova-compute[82479]: WARNING nova.compute.manager [req-0cd220f6-97b6-47f6-9753-df7ce43f2cd9 req-39a0cfe4-1018-4ff0-978a-cec418909f1e service nova] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Received unexpected event network-vif-plugged-6053af7f-223a-471f-9738-c6335cd621c0 for instance with vm_state active and task_state deleting.
Apr 14 00:49:31 user nova-compute[82479]: INFO nova.compute.manager [None req-d39e8b1d-59e7-4393-a738-2147ecb02c3d tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Took 0.82 seconds to detach 1 volumes for instance.
Apr 14 00:49:31 user nova-compute[82479]: DEBUG nova.compute.manager [None req-d39e8b1d-59e7-4393-a738-2147ecb02c3d tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Deleting volume: 85461f29-04e3-4204-8171-9893ac35c973 {{(pid=82479) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 14 00:49:32 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d39e8b1d-59e7-4393-a738-2147ecb02c3d tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:49:32 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d39e8b1d-59e7-4393-a738-2147ecb02c3d tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:49:32 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-d39e8b1d-59e7-4393-a738-2147ecb02c3d tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:49:32 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-d39e8b1d-59e7-4393-a738-2147ecb02c3d tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:49:32 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d39e8b1d-59e7-4393-a738-2147ecb02c3d tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.195s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:49:32 user nova-compute[82479]: INFO nova.scheduler.client.report [None req-d39e8b1d-59e7-4393-a738-2147ecb02c3d tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Deleted allocations for instance 1aa2f565-f4cf-4979-875f-0a5d34b6c121
Apr 14 00:49:32 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-d39e8b1d-59e7-4393-a738-2147ecb02c3d tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "1aa2f565-f4cf-4979-875f-0a5d34b6c121" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.102s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:49:32 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:49:35 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:49:40 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:49:45 user nova-compute[82479]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681433370.060967, 1aa2f565-f4cf-4979-875f-0a5d34b6c121 => Stopped> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:49:45 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] VM Stopped (Lifecycle Event)
Apr 14 00:49:45 user nova-compute[82479]: DEBUG nova.compute.manager [None req-092ad22a-82c8-4271-a59b-788c8f81de59 None None] [instance: 1aa2f565-f4cf-4979-875f-0a5d34b6c121] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:49:45 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:49:45 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:49:45 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:49:45 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:49:45 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:49:45 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:49:50 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:49:50 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:49:50 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:49:50 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:49:50 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:49:50 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:49:55 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:49:55 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:49:55 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:49:55 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:49:55 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:49:55 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:50:00 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:50:00 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:50:00 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:50:00 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:50:00 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:50:00 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:50:05 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:50:10 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:50:15 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:50:17 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:50:17 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Starting heal instance info cache {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 00:50:17 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Rebuilding the list of instances to heal {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 00:50:17 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "refresh_cache-b80a7b33-5a5f-4db3-8d3a-0a9e9946aace" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:50:17 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquired lock "refresh_cache-b80a7b33-5a5f-4db3-8d3a-0a9e9946aace" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:50:17 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Forcefully refreshing network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 00:50:17 user nova-compute[82479]: DEBUG nova.objects.instance [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lazy-loading 'info_cache' on Instance uuid b80a7b33-5a5f-4db3-8d3a-0a9e9946aace {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:50:18 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Updating instance_info_cache with network_info: [{"id": "b7e5db2e-9e0c-47a3-9d0d-e1b310dcf77b", "address": "fa:16:3e:17:ec:b0", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7e5db2e-9e", "ovs_interfaceid": "b7e5db2e-9e0c-47a3-9d0d-e1b310dcf77b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:50:18 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Releasing lock "refresh_cache-b80a7b33-5a5f-4db3-8d3a-0a9e9946aace" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:50:18 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Updated the network info_cache for instance {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 00:50:20 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:50:20 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:50:20 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:50:22 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "b80a7b33-5a5f-4db3-8d3a-0a9e9946aace" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:50:22 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "b80a7b33-5a5f-4db3-8d3a-0a9e9946aace" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:50:22 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "b80a7b33-5a5f-4db3-8d3a-0a9e9946aace-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:50:22 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "b80a7b33-5a5f-4db3-8d3a-0a9e9946aace-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:50:22 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "b80a7b33-5a5f-4db3-8d3a-0a9e9946aace-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:50:22 user nova-compute[82479]: INFO nova.compute.manager [None req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Terminating instance
Apr 14 00:50:22 user nova-compute[82479]: DEBUG nova.compute.manager [None req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Start destroying the instance on the hypervisor. {{(pid=82479) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 00:50:22 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:50:22 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:50:22 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:50:22 user nova-compute[82479]: DEBUG nova.compute.manager [req-8bb33e00-7698-4e4f-b475-2b7cfcb4b68d req-66ab1528-a8f6-4e21-85de-7f954687f1d7 service nova] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Received event network-vif-unplugged-b7e5db2e-9e0c-47a3-9d0d-e1b310dcf77b {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:50:22 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-8bb33e00-7698-4e4f-b475-2b7cfcb4b68d req-66ab1528-a8f6-4e21-85de-7f954687f1d7 service nova] Acquiring lock "b80a7b33-5a5f-4db3-8d3a-0a9e9946aace-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:50:22 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-8bb33e00-7698-4e4f-b475-2b7cfcb4b68d req-66ab1528-a8f6-4e21-85de-7f954687f1d7 service nova] Lock "b80a7b33-5a5f-4db3-8d3a-0a9e9946aace-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:50:22 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-8bb33e00-7698-4e4f-b475-2b7cfcb4b68d req-66ab1528-a8f6-4e21-85de-7f954687f1d7 service nova] Lock "b80a7b33-5a5f-4db3-8d3a-0a9e9946aace-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:50:22 user nova-compute[82479]: DEBUG nova.compute.manager [req-8bb33e00-7698-4e4f-b475-2b7cfcb4b68d req-66ab1528-a8f6-4e21-85de-7f954687f1d7 service nova] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] No waiting events found dispatching network-vif-unplugged-b7e5db2e-9e0c-47a3-9d0d-e1b310dcf77b {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:50:22 user nova-compute[82479]: DEBUG nova.compute.manager [req-8bb33e00-7698-4e4f-b475-2b7cfcb4b68d req-66ab1528-a8f6-4e21-85de-7f954687f1d7 service nova] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Received event network-vif-unplugged-b7e5db2e-9e0c-47a3-9d0d-e1b310dcf77b for instance with task_state deleting. {{(pid=82479) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 00:50:22 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Instance destroyed successfully.
Apr 14 00:50:22 user nova-compute[82479]: DEBUG nova.objects.instance [None req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lazy-loading 'resources' on Instance uuid b80a7b33-5a5f-4db3-8d3a-0a9e9946aace {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:50:22 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:45:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-425557895',display_name='tempest-TestVolumeBootPattern-volume-backed-server-425557895',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-425557895',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:45:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0934526a2dfa45f4bd5df4edee11d98a',ramdisk_id='',reservation_id='r-polg3ri7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-260409128',owner_user_name='tempest-TestVolumeBootPattern-260409128-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T00:45:55Z,user_data=None,user_id='cfb66031fcf84659a3b80cdb76ffddc0',uuid=b80a7b33-5a5f-4db3-8d3a-0a9e9946aace,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b7e5db2e-9e0c-47a3-9d0d-e1b310dcf77b", "address": "fa:16:3e:17:ec:b0", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7e5db2e-9e", "ovs_interfaceid": "b7e5db2e-9e0c-47a3-9d0d-e1b310dcf77b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 00:50:22 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Converting VIF {"id": "b7e5db2e-9e0c-47a3-9d0d-e1b310dcf77b", "address": "fa:16:3e:17:ec:b0", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7e5db2e-9e", "ovs_interfaceid": "b7e5db2e-9e0c-47a3-9d0d-e1b310dcf77b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:50:22 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:17:ec:b0,bridge_name='br-int',has_traffic_filtering=True,id=b7e5db2e-9e0c-47a3-9d0d-e1b310dcf77b,network=Network(6dec18bc-e73b-450e-b0d2-e36653017f20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7e5db2e-9e') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:50:22 user nova-compute[82479]: DEBUG os_vif [None req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:ec:b0,bridge_name='br-int',has_traffic_filtering=True,id=b7e5db2e-9e0c-47a3-9d0d-e1b310dcf77b,network=Network(6dec18bc-e73b-450e-b0d2-e36653017f20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7e5db2e-9e') {{(pid=82479) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 00:50:22 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:50:22 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb7e5db2e-9e, bridge=br-int, if_exists=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:50:22 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:50:22 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:50:22 user nova-compute[82479]: INFO os_vif [None req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:ec:b0,bridge_name='br-int',has_traffic_filtering=True,id=b7e5db2e-9e0c-47a3-9d0d-e1b310dcf77b,network=Network(6dec18bc-e73b-450e-b0d2-e36653017f20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7e5db2e-9e')
Apr 14 00:50:22 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] calling os-brick to detach iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 00:50:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, {'target_iqn': 'iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SjFWIcAx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:50:22 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:50:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:50:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:50:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:50:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:50:22 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[896fe73c-1116-4076-b8cc-20258e4a89d0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:50:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 00:50:22 user nova-compute[82479]: No targets found.
Apr 14 00:50:22 user nova-compute[82479]: iSNS:
Apr 14 00:50:22 user nova-compute[82479]: No targets found.
Apr 14 00:50:22 user nova-compute[82479]: STATIC:
Apr 14 00:50:22 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9
Apr 14 00:50:22 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:50:22 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:50:22 user nova-compute[82479]: FIRMWARE:
Apr 14 00:50:22 user nova-compute[82479]: No targets found.
Apr 14 00:50:22 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:50:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 00:50:22 user nova-compute[82479]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 00:50:22 user nova-compute[82479]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82479) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 00:50:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9', 0)] {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 00:50:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:50:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:50:22 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[1052664d-ed43-4102-8f16-b7b12e01ec39]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:50:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:50:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:50:22 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85385a6-ee2b-4c8b-82a5-4f8fa99427bd]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:50:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9 (non-flash)
Apr 14 00:50:22 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:50:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9 (non-flash)
Apr 14 00:50:22 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:50:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f33385cd000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9'): ({'sdb'}, set())}) {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 00:50:22 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Removing single pathed devices sdb {{(pid=82479) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 00:50:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:50:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:50:22 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ca369f-35c6-41c8-bc72-c87679da0947]: (4, ('path checker states:\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:50:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:50:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:50:22 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[554d1ff9-971d-4a8b-b3c4-7720959bf1a5]: (4, ('ok\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:50:22 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Flushing IO for device /dev/sdb {{(pid=82479) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 00:50:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:50:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:50:22 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[7726066b-8188-4946-a34d-9f7e441640cd]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:50:22 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82479) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 00:50:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:50:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.057s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:50:22 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[4560abed-608a-49a7-80f5-ca3c99b96dbc]: (4, ('1', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:50:22 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 00:50:22 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] SCSI volumes sdb have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 00:50:22 user nova-compute[82479]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_4bdcf2ac', '/dev/disk/by-id/scsi-26163633363333437', '/dev/disk/by-id/scsi-1SCST_BIO4bdcf2ac-acc3c34717461e98') {{(pid=93289) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 14 00:50:22 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[9423eb48-dd27-45a7-bd76-51f12e531623]: (4, None) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:50:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9')] {{(pid=82479) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 00:50:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:50:23 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:50:23 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[c893673c-fce1-466f-94b8-fc86a4faa90a]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:50:23 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:50:23 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9 -p 172.16.0.220:3260 --logout {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:50:23 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:50:23 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[80cec590-d976-4f0f-85b0-9a2f44c9d159]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:50:23 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9, portal: 172.16.0.220,3260]
Apr 14 00:50:23 user nova-compute[82479]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9, portal: 172.16.0.220,3260] successful.
Apr 14 00:50:23 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:50:23 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9 -p 172.16.0.220:3260 --op delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:50:23 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:50:23 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ae8a2e-1e9c-4a41-b891-c6fe7f40653a]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:50:23 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:50:23 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:50:23 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] <== disconnect_volume: return (311ms) None {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:50:23 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Disconnected iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 00:50:23 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Deleting instance files /opt/stack/data/nova/instances/b80a7b33-5a5f-4db3-8d3a-0a9e9946aace_del
Apr 14 00:50:23 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Deletion of /opt/stack/data/nova/instances/b80a7b33-5a5f-4db3-8d3a-0a9e9946aace_del complete
Apr 14 00:50:23 user nova-compute[82479]: INFO nova.compute.manager [None req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Took 1.13 seconds to destroy the instance on the hypervisor.
Apr 14 00:50:23 user nova-compute[82479]: DEBUG oslo.service.loopingcall [None req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82479) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 00:50:23 user nova-compute[82479]: DEBUG nova.compute.manager [-] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Deallocating network for instance {{(pid=82479) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 00:50:23 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] deallocate_for_instance() {{(pid=82479) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 00:50:23 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Updating instance_info_cache with network_info: [] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:50:23 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Took 0.45 seconds to deallocate network for instance.
Apr 14 00:50:23 user nova-compute[82479]: DEBUG nova.compute.manager [req-ccf960b1-9adb-427a-8aa5-701c3e174455 req-aa0edfb1-c0b8-4544-8cf9-21e9cd48f0ad service nova] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Received event network-vif-deleted-b7e5db2e-9e0c-47a3-9d0d-e1b310dcf77b {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:50:24 user nova-compute[82479]: INFO nova.compute.manager [None req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Took 0.74 seconds to detach 1 volumes for instance.
Apr 14 00:50:24 user nova-compute[82479]: DEBUG nova.compute.manager [None req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Deleting volume: 12bc0a58-041c-488e-a961-6c37f530e1b9 {{(pid=82479) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 14 00:50:24 user nova-compute[82479]: DEBUG nova.compute.manager [req-bdb83094-ca97-4e73-aaeb-2a9b1283098d req-fb705454-61bf-4a4e-9a8d-f8b6af4a624e service nova] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Received event network-vif-plugged-b7e5db2e-9e0c-47a3-9d0d-e1b310dcf77b {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:50:24 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-bdb83094-ca97-4e73-aaeb-2a9b1283098d req-fb705454-61bf-4a4e-9a8d-f8b6af4a624e service nova] Acquiring lock "b80a7b33-5a5f-4db3-8d3a-0a9e9946aace-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:50:24 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-bdb83094-ca97-4e73-aaeb-2a9b1283098d req-fb705454-61bf-4a4e-9a8d-f8b6af4a624e service nova] Lock "b80a7b33-5a5f-4db3-8d3a-0a9e9946aace-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:50:24 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-bdb83094-ca97-4e73-aaeb-2a9b1283098d req-fb705454-61bf-4a4e-9a8d-f8b6af4a624e service nova] Lock "b80a7b33-5a5f-4db3-8d3a-0a9e9946aace-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:50:24 user nova-compute[82479]: DEBUG nova.compute.manager [req-bdb83094-ca97-4e73-aaeb-2a9b1283098d req-fb705454-61bf-4a4e-9a8d-f8b6af4a624e service nova] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] No waiting events found dispatching network-vif-plugged-b7e5db2e-9e0c-47a3-9d0d-e1b310dcf77b {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:50:24 user nova-compute[82479]: WARNING nova.compute.manager [req-bdb83094-ca97-4e73-aaeb-2a9b1283098d req-fb705454-61bf-4a4e-9a8d-f8b6af4a624e service nova] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Received unexpected event network-vif-plugged-b7e5db2e-9e0c-47a3-9d0d-e1b310dcf77b for instance with vm_state active and task_state deleting.
Apr 14 00:50:24 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:50:24 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:50:24 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:50:24 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:50:24 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.110s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:50:24 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:50:24 user nova-compute[82479]: INFO nova.scheduler.client.report [None req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Deleted allocations for instance b80a7b33-5a5f-4db3-8d3a-0a9e9946aace
Apr 14 00:50:24 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "b80a7b33-5a5f-4db3-8d3a-0a9e9946aace" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.690s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:50:25 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:50:25 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:50:25 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:50:25 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:50:25 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Auditing locally available compute resources for user (node: user) {{(pid=82479) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 00:50:26 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:50:26 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:50:26 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Hypervisor/Node resource view: name=user free_ram=8893MB free_disk=26.159557342529297GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82479) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 00:50:26 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:50:26 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:50:26 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 00:50:26 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 00:50:26 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:50:26 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:50:26 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Compute_service record updated for user:user {{(pid=82479) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 00:50:26 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.138s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:50:27 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:50:28 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:50:28 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82479) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 00:50:29 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:50:32 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:50:32 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:50:34 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:50:37 user nova-compute[82479]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681433422.7465096, b80a7b33-5a5f-4db3-8d3a-0a9e9946aace => Stopped> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:50:37 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] VM Stopped (Lifecycle Event)
Apr 14 00:50:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:50:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:50:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:50:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:50:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:50:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:50:37 user nova-compute[82479]: DEBUG nova.compute.manager [None req-6ead5c25-3270-465e-927f-c11781bb5aab None None] [instance: b80a7b33-5a5f-4db3-8d3a-0a9e9946aace] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:50:42 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:50:47 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:50:52 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:50:52 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:50:52 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:50:52 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:50:52 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:50:52 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:50:57 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:51:02 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:51:02 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:51:02 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:51:02 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:51:02 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:51:02 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:51:07 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:51:12 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:51:12 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:51:17 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:51:19 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:51:19 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Starting heal instance info cache {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 00:51:19 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Rebuilding the list of instances to heal {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 00:51:19 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "782ea87f-f55e-4aab-8501-ac17f3bc59af" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:51:19 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "782ea87f-f55e-4aab-8501-ac17f3bc59af" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:51:19 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Didn't find any instances for network info cache update. {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 00:51:19 user nova-compute[82479]: DEBUG nova.compute.manager [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Starting instance... {{(pid=82479) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 00:51:19 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:51:19 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:51:19 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82479) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 00:51:19 user nova-compute[82479]: INFO nova.compute.claims [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Claim successful on node user
Apr 14 00:51:19 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:51:19 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:51:19 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.192s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:51:19 user nova-compute[82479]: DEBUG nova.compute.manager [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Start building networks asynchronously for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 00:51:19 user nova-compute[82479]: DEBUG nova.compute.manager [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Allocating IP information in the background. {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 00:51:19 user nova-compute[82479]: DEBUG nova.network.neutron [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] allocate_for_instance() {{(pid=82479) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 00:51:19 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 00:51:20 user nova-compute[82479]: DEBUG nova.compute.manager [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Start building block device mappings for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 00:51:20 user nova-compute[82479]: INFO nova.virt.block_device [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Booting with volume 8a7edaa8-f67a-4251-8117-62a322c53de7 at /dev/vda
Apr 14 00:51:20 user nova-compute[82479]: DEBUG nova.policy [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cfb66031fcf84659a3b80cdb76ffddc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934526a2dfa45f4bd5df4edee11d98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82479) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 00:51:20 user nova-compute[82479]: DEBUG os_brick.utils [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:51:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:51:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:51:20 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d37430-aa8b-41e3-8c87-9fbd06dc4e88]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fec92fcfdd3\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:51:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:51:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:51:20 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e7a0622-055c-471f-9773-15e466764b10]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:51:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:51:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:51:20 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e76ad6c-f77a-4714-acc0-267b920aea5b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:51:20 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f39ab94-f47d-433f-80d6-0ec43b7a13a8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:51:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Running cmd (subprocess): nvme version {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:51:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] 'nvme version' failed. Not Retrying. {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:51:20 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] nvme not present on system {{(pid=82479) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 00:51:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:51:20 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:51:20 user nova-compute[82479]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 00:51:20 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[288637e4-4819-41b1-9d3d-cc8f895b0893]: (4, '') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:51:20 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82479) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 00:51:20 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 00:51:20 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] LIGHTOS: no hostnqn found. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 00:51:20 user nova-compute[82479]: DEBUG os_brick.utils [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fec92fcfdd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:51:20 user nova-compute[82479]: DEBUG nova.virt.block_device [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Updating existing volume attachment record: 0541f1d7-d085-4748-b500-6118bac24162 {{(pid=82479) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 00:51:20 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:51:20 user nova-compute[82479]: DEBUG nova.network.neutron [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Successfully created port: d261fca7-16e0-4d71-acff-7ae3017459ae {{(pid=82479) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 00:51:21 user nova-compute[82479]: DEBUG nova.network.neutron [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Successfully updated port: d261fca7-16e0-4d71-acff-7ae3017459ae {{(pid=82479) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 00:51:21 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "refresh_cache-782ea87f-f55e-4aab-8501-ac17f3bc59af" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:51:21 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquired lock "refresh_cache-782ea87f-f55e-4aab-8501-ac17f3bc59af" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:51:21 user nova-compute[82479]: DEBUG nova.network.neutron [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 00:51:21 user nova-compute[82479]: DEBUG nova.compute.manager [req-da9b2daa-9d0c-497d-91da-a9ddbcd71ca2 req-fe025545-6e52-44ba-9c1d-ff971b33c019 service nova] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Received event network-changed-d261fca7-16e0-4d71-acff-7ae3017459ae {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:51:21 user nova-compute[82479]: DEBUG nova.compute.manager [req-da9b2daa-9d0c-497d-91da-a9ddbcd71ca2 req-fe025545-6e52-44ba-9c1d-ff971b33c019 service nova] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Refreshing instance network info cache due to event network-changed-d261fca7-16e0-4d71-acff-7ae3017459ae. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:51:21 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-da9b2daa-9d0c-497d-91da-a9ddbcd71ca2 req-fe025545-6e52-44ba-9c1d-ff971b33c019 service nova] Acquiring lock "refresh_cache-782ea87f-f55e-4aab-8501-ac17f3bc59af" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:51:21 user nova-compute[82479]: DEBUG nova.network.neutron [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Instance cache missing network info. {{(pid=82479) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 00:51:21 user nova-compute[82479]: DEBUG nova.network.neutron [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Updating instance_info_cache with network_info: [{"id": "d261fca7-16e0-4d71-acff-7ae3017459ae", "address": "fa:16:3e:01:2f:bf", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd261fca7-16", "ovs_interfaceid": "d261fca7-16e0-4d71-acff-7ae3017459ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:51:21 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Releasing lock "refresh_cache-782ea87f-f55e-4aab-8501-ac17f3bc59af" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:51:21 user nova-compute[82479]: DEBUG nova.compute.manager [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Instance network_info: |[{"id": "d261fca7-16e0-4d71-acff-7ae3017459ae", "address": "fa:16:3e:01:2f:bf", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd261fca7-16", "ovs_interfaceid": "d261fca7-16e0-4d71-acff-7ae3017459ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 00:51:21 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-da9b2daa-9d0c-497d-91da-a9ddbcd71ca2 req-fe025545-6e52-44ba-9c1d-ff971b33c019 service nova] Acquired lock "refresh_cache-782ea87f-f55e-4aab-8501-ac17f3bc59af" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:51:21 user nova-compute[82479]: DEBUG nova.network.neutron [req-da9b2daa-9d0c-497d-91da-a9ddbcd71ca2 req-fe025545-6e52-44ba-9c1d-ff971b33c019 service nova] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Refreshing network info cache for port d261fca7-16e0-4d71-acff-7ae3017459ae {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:51:22 user nova-compute[82479]: DEBUG nova.network.neutron [req-da9b2daa-9d0c-497d-91da-a9ddbcd71ca2 req-fe025545-6e52-44ba-9c1d-ff971b33c019 service nova] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Updated VIF entry in instance network info cache for port d261fca7-16e0-4d71-acff-7ae3017459ae. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:51:22 user nova-compute[82479]: DEBUG nova.network.neutron [req-da9b2daa-9d0c-497d-91da-a9ddbcd71ca2 req-fe025545-6e52-44ba-9c1d-ff971b33c019 service nova] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Updating instance_info_cache with network_info: [{"id": "d261fca7-16e0-4d71-acff-7ae3017459ae", "address": "fa:16:3e:01:2f:bf", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd261fca7-16", "ovs_interfaceid": "d261fca7-16e0-4d71-acff-7ae3017459ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:51:22 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-da9b2daa-9d0c-497d-91da-a9ddbcd71ca2 req-fe025545-6e52-44ba-9c1d-ff971b33c019 service nova] Releasing lock "refresh_cache-782ea87f-f55e-4aab-8501-ac17f3bc59af" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:51:22 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:51:22 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:51:22 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:51:22 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:51:22 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:51:22 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:51:22 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:51:22 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:51:24 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:51:26 user nova-compute[82479]: DEBUG nova.compute.manager [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Start spawning the instance on the hypervisor. {{(pid=82479) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 00:51:26 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Creating instance directory {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 00:51:26 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Creating image(s)
Apr 14 00:51:26 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Did not create local disks {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 00:51:26 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Ensure instance console log exists: /opt/stack/data/nova/instances/782ea87f-f55e-4aab-8501-ac17f3bc59af/console.log {{(pid=82479) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 00:51:26 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:51:26 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:51:26 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:51:26 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Start _get_guest_xml network_info=[{"id": "d261fca7-16e0-4d71-acff-7ae3017459ae", "address": "fa:16:3e:01:2f:bf", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd261fca7-16", "ovs_interfaceid": "d261fca7-16e0-4d71-acff-7ae3017459ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': False, 'attachment_id': '0541f1d7-d085-4748-b500-6118bac24162', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gvTuEZAX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '782ea87f-f55e-4aab-8501-ac17f3bc59af', 'attached_at': '', 'detached_at': '', 'volume_id': '8a7edaa8-f67a-4251-8117-62a322c53de7', 'serial': '8a7edaa8-f67a-4251-8117-62a322c53de7'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 00:51:26 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:51:26 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:51:26 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82479) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 00:51:26 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T00:02:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 00:51:26 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Flavor limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 00:51:26 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Image limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 00:51:26 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Flavor pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 00:51:26 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Image pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 00:51:26 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 00:51:26 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 00:51:26 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 00:51:26 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Got 1 possible topologies {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 00:51:26 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 00:51:26 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 00:51:26 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Calling os-brick to attach iSCSI Volume {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 00:51:26 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gvTuEZAX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:51:26 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:51:26 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:51:26 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:51:26 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:51:26 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:51:26 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:51:26 user nova-compute[82479]: INFO os_brick.initiator.connectors.iscsi [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 00:51:26 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 -p 172.16.0.220:3260 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:51:26 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:51:26 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d4dced-fba7-4e1c-83fe-aa1d9ea48355]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:51:26 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 00:51:26 user nova-compute[82479]:  {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:51:26 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 -p 172.16.0.220:3260 --interface default --op new {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:51:26 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:51:26 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d5a714-a282-4aba-8ddd-4b090bd9942c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7] added\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:51:26 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7] added
Apr 14 00:51:26 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:51:26 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:51:26 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:51:26 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[083dbe93-4722-4def-b163-2eb712ca5153]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:51:26 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:51:26 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:51:26 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:51:26 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[22cc146d-2a33-4de9-b58e-2d0597a1c07d]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:51:26 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:51:26 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gvTuEZAX {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:51:26 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:51:26 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gvTuEZAX" returned: 0 in 0.017s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:51:26 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f34a6e7-52a6-4c71-8078-90565aa77ddc]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:51:26 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gvTuEZAX'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:51:26 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:51:26 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:51:26 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:51:26 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:51:26 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Auditing locally available compute resources for user (node: user) {{(pid=82479) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 00:51:26 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:51:26 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d01aff-6d92-44ac-98c1-9995fc0bde1c]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:51:26 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:51:26 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:51:26 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:51:26 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe99727-0538-40da-a966-7ec3c710ff98]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:51:26 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 00:51:26 user nova-compute[82479]:  {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:51:26 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 00:51:26 user nova-compute[82479]:  {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:51:26 user nova-compute[82479]: WARNING os_brick.initiator.connectors.iscsi [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 00:51:26 user nova-compute[82479]: 
Apr 14 00:51:26 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 -p 172.16.0.220:3260 --login {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:51:27 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:51:27 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[9578cf81-67f1-4fab-a8a3-46cc6837f789]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:51:27 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7, portal: 172.16.0.220,3260]
Apr 14 00:51:27 user nova-compute[82479]: Login to [iface: default, target: iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7, portal: 172.16.0.220,3260] successful.
Apr 14 00:51:27 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:51:27 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:51:27 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:51:27 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:51:27 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Hypervisor/Node resource view: name=user free_ram=8916MB free_disk=26.158153533935547GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82479) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 00:51:27 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:51:27 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:51:27 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:51:27 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c715a61-c3de-4878-be35-8186edabf56a]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:51:27 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:51:27 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:51:27 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:51:27 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec63f591-a533-4763-bc75-98b88d8a4014]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:51:27 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 (non-flash)
Apr 14 00:51:27 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:51:27 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 (non-flash)
Apr 14 00:51:27 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:51:27 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.560s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:51:27 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Connected to 172.16.0.220:3260 {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 00:51:27 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=82479) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 00:51:27 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82479) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 00:51:27 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:51:27 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:51:27 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c6455e-06be-4edc-ad35-70d3b5b3d870]: (4, ('- - 0', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:51:27 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82479) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 00:51:27 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gvTuEZAX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 00:51:27 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 782ea87f-f55e-4aab-8501-ac17f3bc59af actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:51:27 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 00:51:27 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 00:51:27 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Refreshing inventories for resource provider 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 00:51:27 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Updating ProviderTree inventory for provider 3847975a-19aa-4b27-9180-14b5cc49044a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 00:51:27 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Updating inventory in ProviderTree for provider 3847975a-19aa-4b27-9180-14b5cc49044a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 00:51:27 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Refreshing aggregate associations for resource provider 3847975a-19aa-4b27-9180-14b5cc49044a, aggregates: None {{(pid=82479) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 00:51:27 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Refreshing trait associations for resource provider 3847975a-19aa-4b27-9180-14b5cc49044a, traits: COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,HW_CPU_X86_SSE42,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO {{(pid=82479) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 00:51:27 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:51:27 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:51:27 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Compute_service record updated for user:user {{(pid=82479) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 00:51:27 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.360s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:51:27 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:51:27 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Cleaning up deleted instances {{(pid=82479) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 00:51:27 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] There are 0 instances to clean {{(pid=82479) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 00:51:27 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:51:28 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.589s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:51:28 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] <== connect_volume: return (1591ms) {'type': 'block', 'scsi_wwn': '23934303234633762', 'path': '/dev/sdb'} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:51:28 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23934303234633762', 'path': '/dev/sdb'} {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 00:51:28 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:51:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-67870164',display_name='tempest-TestVolumeBootPattern-server-67870164',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-67870164',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA04fSpZPZehkhB9f0sYv7pWCpEF+0Af0ha1AxWnn4wafUNVzRts+po3Hz8WLNc1o5rlWHs8ARX3jM/G2geverCNDjLTFUEFq/SUwWxk6uiLBWzBveljr9LVk4guW/E4ew==',key_name='tempest-TestVolumeBootPattern-128892553',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0934526a2dfa45f4bd5df4edee11d98a',ramdisk_id='',reservation_id='r-7bajvly0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-260409128',owner_user_name='tempest-TestVolumeBootPattern-260409128-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:51:20Z,user_data=None,user_id='cfb66031fcf84659a3b80cdb76ffddc0',uuid=782ea87f-f55e-4aab-8501-ac17f3bc59af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d261fca7-16e0-4d71-acff-7ae3017459ae", "address": "fa:16:3e:01:2f:bf", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd261fca7-16", "ovs_interfaceid": "d261fca7-16e0-4d71-acff-7ae3017459ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82479) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 00:51:28 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Converting VIF {"id": "d261fca7-16e0-4d71-acff-7ae3017459ae", "address": "fa:16:3e:01:2f:bf", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd261fca7-16", "ovs_interfaceid": "d261fca7-16e0-4d71-acff-7ae3017459ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:51:28 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:2f:bf,bridge_name='br-int',has_traffic_filtering=True,id=d261fca7-16e0-4d71-acff-7ae3017459ae,network=Network(6dec18bc-e73b-450e-b0d2-e36653017f20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd261fca7-16') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:51:28 user nova-compute[82479]: DEBUG nova.objects.instance [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lazy-loading 'pci_devices' on Instance uuid 782ea87f-f55e-4aab-8501-ac17f3bc59af {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:51:28 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] End _get_guest_xml xml=<domain type="kvm">
Apr 14 00:51:28 user nova-compute[82479]:   <uuid>782ea87f-f55e-4aab-8501-ac17f3bc59af</uuid>
Apr 14 00:51:28 user nova-compute[82479]:   <name>instance-0000002b</name>
Apr 14 00:51:28 user nova-compute[82479]:   <memory>131072</memory>
Apr 14 00:51:28 user nova-compute[82479]:   <vcpu>1</vcpu>
Apr 14 00:51:28 user nova-compute[82479]:   <metadata>
Apr 14 00:51:28 user nova-compute[82479]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 00:51:28 user nova-compute[82479]:       <nova:package version="0.0.0"/>
Apr 14 00:51:28 user nova-compute[82479]:       <nova:name>tempest-TestVolumeBootPattern-server-67870164</nova:name>
Apr 14 00:51:28 user nova-compute[82479]:       <nova:creationTime>2023-04-14 00:51:26</nova:creationTime>
Apr 14 00:51:28 user nova-compute[82479]:       <nova:flavor name="m1.nano">
Apr 14 00:51:28 user nova-compute[82479]:         <nova:memory>128</nova:memory>
Apr 14 00:51:28 user nova-compute[82479]:         <nova:disk>1</nova:disk>
Apr 14 00:51:28 user nova-compute[82479]:         <nova:swap>0</nova:swap>
Apr 14 00:51:28 user nova-compute[82479]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 00:51:28 user nova-compute[82479]:         <nova:vcpus>1</nova:vcpus>
Apr 14 00:51:28 user nova-compute[82479]:       </nova:flavor>
Apr 14 00:51:28 user nova-compute[82479]:       <nova:owner>
Apr 14 00:51:28 user nova-compute[82479]:         <nova:user uuid="cfb66031fcf84659a3b80cdb76ffddc0">tempest-TestVolumeBootPattern-260409128-project-member</nova:user>
Apr 14 00:51:28 user nova-compute[82479]:         <nova:project uuid="0934526a2dfa45f4bd5df4edee11d98a">tempest-TestVolumeBootPattern-260409128</nova:project>
Apr 14 00:51:28 user nova-compute[82479]:       </nova:owner>
Apr 14 00:51:28 user nova-compute[82479]:       <nova:ports>
Apr 14 00:51:28 user nova-compute[82479]:         <nova:port uuid="d261fca7-16e0-4d71-acff-7ae3017459ae">
Apr 14 00:51:28 user nova-compute[82479]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 14 00:51:28 user nova-compute[82479]:         </nova:port>
Apr 14 00:51:28 user nova-compute[82479]:       </nova:ports>
Apr 14 00:51:28 user nova-compute[82479]:     </nova:instance>
Apr 14 00:51:28 user nova-compute[82479]:   </metadata>
Apr 14 00:51:28 user nova-compute[82479]:   <sysinfo type="smbios">
Apr 14 00:51:28 user nova-compute[82479]:     <system>
Apr 14 00:51:28 user nova-compute[82479]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 00:51:28 user nova-compute[82479]:       <entry name="product">OpenStack Nova</entry>
Apr 14 00:51:28 user nova-compute[82479]:       <entry name="version">0.0.0</entry>
Apr 14 00:51:28 user nova-compute[82479]:       <entry name="serial">782ea87f-f55e-4aab-8501-ac17f3bc59af</entry>
Apr 14 00:51:28 user nova-compute[82479]:       <entry name="uuid">782ea87f-f55e-4aab-8501-ac17f3bc59af</entry>
Apr 14 00:51:28 user nova-compute[82479]:       <entry name="family">Virtual Machine</entry>
Apr 14 00:51:28 user nova-compute[82479]:     </system>
Apr 14 00:51:28 user nova-compute[82479]:   </sysinfo>
Apr 14 00:51:28 user nova-compute[82479]:   <os>
Apr 14 00:51:28 user nova-compute[82479]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 00:51:28 user nova-compute[82479]:     <boot dev="hd"/>
Apr 14 00:51:28 user nova-compute[82479]:     <smbios mode="sysinfo"/>
Apr 14 00:51:28 user nova-compute[82479]:   </os>
Apr 14 00:51:28 user nova-compute[82479]:   <features>
Apr 14 00:51:28 user nova-compute[82479]:     <acpi/>
Apr 14 00:51:28 user nova-compute[82479]:     <apic/>
Apr 14 00:51:28 user nova-compute[82479]:     <vmcoreinfo/>
Apr 14 00:51:28 user nova-compute[82479]:   </features>
Apr 14 00:51:28 user nova-compute[82479]:   <clock offset="utc">
Apr 14 00:51:28 user nova-compute[82479]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 00:51:28 user nova-compute[82479]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 00:51:28 user nova-compute[82479]:     <timer name="hpet" present="no"/>
Apr 14 00:51:28 user nova-compute[82479]:   </clock>
Apr 14 00:51:28 user nova-compute[82479]:   <cpu mode="custom" match="exact">
Apr 14 00:51:28 user nova-compute[82479]:     <model>Nehalem</model>
Apr 14 00:51:28 user nova-compute[82479]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 00:51:28 user nova-compute[82479]:   </cpu>
Apr 14 00:51:28 user nova-compute[82479]:   <devices>
Apr 14 00:51:28 user nova-compute[82479]:     <disk type="block" device="disk">
Apr 14 00:51:28 user nova-compute[82479]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:51:28 user nova-compute[82479]:       <source dev="/dev/sdb"/>
Apr 14 00:51:28 user nova-compute[82479]:       <target dev="vda" bus="virtio"/>
Apr 14 00:51:28 user nova-compute[82479]:       <serial>8a7edaa8-f67a-4251-8117-62a322c53de7</serial>
Apr 14 00:51:28 user nova-compute[82479]:     </disk>
Apr 14 00:51:28 user nova-compute[82479]:     <interface type="ethernet">
Apr 14 00:51:28 user nova-compute[82479]:       <mac address="fa:16:3e:01:2f:bf"/>
Apr 14 00:51:28 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:51:28 user nova-compute[82479]:       <mtu size="1442"/>
Apr 14 00:51:28 user nova-compute[82479]:       <target dev="tapd261fca7-16"/>
Apr 14 00:51:28 user nova-compute[82479]:     </interface>
Apr 14 00:51:28 user nova-compute[82479]:     <serial type="pty">
Apr 14 00:51:28 user nova-compute[82479]:       <log file="/opt/stack/data/nova/instances/782ea87f-f55e-4aab-8501-ac17f3bc59af/console.log" append="off"/>
Apr 14 00:51:28 user nova-compute[82479]:     </serial>
Apr 14 00:51:28 user nova-compute[82479]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 00:51:28 user nova-compute[82479]:     <video>
Apr 14 00:51:28 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:51:28 user nova-compute[82479]:     </video>
Apr 14 00:51:28 user nova-compute[82479]:     <rng model="virtio">
Apr 14 00:51:28 user nova-compute[82479]:       <backend model="random">/dev/urandom</backend>
Apr 14 00:51:28 user nova-compute[82479]:     </rng>
Apr 14 00:51:28 user nova-compute[82479]:     <controller type="usb" index="0" model="none"/>
Apr 14 00:51:28 user nova-compute[82479]:     <memballoon model="virtio">
Apr 14 00:51:28 user nova-compute[82479]:       <stats period="10"/>
Apr 14 00:51:28 user nova-compute[82479]:     </memballoon>
Apr 14 00:51:28 user nova-compute[82479]:   </devices>
Apr 14 00:51:28 user nova-compute[82479]: </domain>
Apr 14 00:51:28 user nova-compute[82479]:  {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 00:51:28 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:51:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-67870164',display_name='tempest-TestVolumeBootPattern-server-67870164',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-67870164',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA04fSpZPZehkhB9f0sYv7pWCpEF+0Af0ha1AxWnn4wafUNVzRts+po3Hz8WLNc1o5rlWHs8ARX3jM/G2geverCNDjLTFUEFq/SUwWxk6uiLBWzBveljr9LVk4guW/E4ew==',key_name='tempest-TestVolumeBootPattern-128892553',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0934526a2dfa45f4bd5df4edee11d98a',ramdisk_id='',reservation_id='r-7bajvly0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-260409128',owner_user_name='tempest-TestVolumeBootPattern-260409128-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:51:20Z,user_data=None,user_id='cfb66031fcf84659a3b80cdb76ffddc0',uuid=782ea87f-f55e-4aab-8501-ac17f3bc59af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d261fca7-16e0-4d71-acff-7ae3017459ae", "address": "fa:16:3e:01:2f:bf", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd261fca7-16", "ovs_interfaceid": "d261fca7-16e0-4d71-acff-7ae3017459ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 00:51:28 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Converting VIF {"id": "d261fca7-16e0-4d71-acff-7ae3017459ae", "address": "fa:16:3e:01:2f:bf", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd261fca7-16", "ovs_interfaceid": "d261fca7-16e0-4d71-acff-7ae3017459ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:51:28 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:2f:bf,bridge_name='br-int',has_traffic_filtering=True,id=d261fca7-16e0-4d71-acff-7ae3017459ae,network=Network(6dec18bc-e73b-450e-b0d2-e36653017f20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd261fca7-16') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:51:28 user nova-compute[82479]: DEBUG os_vif [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:2f:bf,bridge_name='br-int',has_traffic_filtering=True,id=d261fca7-16e0-4d71-acff-7ae3017459ae,network=Network(6dec18bc-e73b-450e-b0d2-e36653017f20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd261fca7-16') {{(pid=82479) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 00:51:28 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:51:28 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:51:28 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 00:51:28 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:51:28 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd261fca7-16, may_exist=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:51:28 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd261fca7-16, col_values=(('external_ids', {'iface-id': 'd261fca7-16e0-4d71-acff-7ae3017459ae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:2f:bf', 'vm-uuid': '782ea87f-f55e-4aab-8501-ac17f3bc59af'}),)) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:51:28 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:51:28 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:51:28 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:51:28 user nova-compute[82479]: INFO os_vif [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:2f:bf,bridge_name='br-int',has_traffic_filtering=True,id=d261fca7-16e0-4d71-acff-7ae3017459ae,network=Network(6dec18bc-e73b-450e-b0d2-e36653017f20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd261fca7-16')
Apr 14 00:51:28 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:51:28 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] No VIF found with MAC fa:16:3e:01:2f:bf, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:51:28 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:51:28 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82479) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 00:51:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:51:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:51:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:51:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:51:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:51:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:51:30 user nova-compute[82479]: DEBUG nova.compute.manager [req-e85ef3ba-5b11-4521-9f1f-77bd67a57ae3 req-f3a1cced-b3c9-41c8-92a7-21fead271dd4 service nova] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Received event network-vif-plugged-d261fca7-16e0-4d71-acff-7ae3017459ae {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:51:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-e85ef3ba-5b11-4521-9f1f-77bd67a57ae3 req-f3a1cced-b3c9-41c8-92a7-21fead271dd4 service nova] Acquiring lock "782ea87f-f55e-4aab-8501-ac17f3bc59af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:51:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-e85ef3ba-5b11-4521-9f1f-77bd67a57ae3 req-f3a1cced-b3c9-41c8-92a7-21fead271dd4 service nova] Lock "782ea87f-f55e-4aab-8501-ac17f3bc59af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:51:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-e85ef3ba-5b11-4521-9f1f-77bd67a57ae3 req-f3a1cced-b3c9-41c8-92a7-21fead271dd4 service nova] Lock "782ea87f-f55e-4aab-8501-ac17f3bc59af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:51:30 user nova-compute[82479]: DEBUG nova.compute.manager [req-e85ef3ba-5b11-4521-9f1f-77bd67a57ae3 req-f3a1cced-b3c9-41c8-92a7-21fead271dd4 service nova] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] No waiting events found dispatching network-vif-plugged-d261fca7-16e0-4d71-acff-7ae3017459ae {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:51:30 user nova-compute[82479]: WARNING nova.compute.manager [req-e85ef3ba-5b11-4521-9f1f-77bd67a57ae3 req-f3a1cced-b3c9-41c8-92a7-21fead271dd4 service nova] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Received unexpected event network-vif-plugged-d261fca7-16e0-4d71-acff-7ae3017459ae for instance with vm_state building and task_state spawning.
Apr 14 00:51:31 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681433491.51965, 782ea87f-f55e-4aab-8501-ac17f3bc59af => Resumed> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:51:31 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] VM Resumed (Lifecycle Event)
Apr 14 00:51:31 user nova-compute[82479]: DEBUG nova.compute.manager [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Instance event wait completed in 0 seconds for  {{(pid=82479) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 00:51:31 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Guest created on hypervisor {{(pid=82479) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 00:51:31 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Instance spawned successfully.
Apr 14 00:51:31 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 00:51:31 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:51:31 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:51:31 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Found default for hw_cdrom_bus of ide {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:51:31 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Found default for hw_disk_bus of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:51:31 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Found default for hw_input_bus of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:51:31 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Found default for hw_pointer_model of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:51:31 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Found default for hw_video_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:51:31 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Found default for hw_vif_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:51:31 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:51:31 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681433491.5218494, 782ea87f-f55e-4aab-8501-ac17f3bc59af => Started> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:51:31 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] VM Started (Lifecycle Event)
Apr 14 00:51:31 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:51:31 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:51:31 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:51:31 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:51:31 user nova-compute[82479]: INFO nova.compute.manager [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Took 5.24 seconds to spawn the instance on the hypervisor.
Apr 14 00:51:31 user nova-compute[82479]: DEBUG nova.compute.manager [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:51:31 user nova-compute[82479]: INFO nova.compute.manager [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Took 12.11 seconds to build instance.
Apr 14 00:51:31 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-5014db0e-a074-4cdb-b074-6c376bdaa209 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "782ea87f-f55e-4aab-8501-ac17f3bc59af" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.209s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:51:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:51:32 user nova-compute[82479]: DEBUG nova.compute.manager [req-9f4f8ff4-7461-4710-8289-9578d5563bdd req-78886985-ae17-4d7b-b227-f43d6b85c8cf service nova] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Received event network-vif-plugged-d261fca7-16e0-4d71-acff-7ae3017459ae {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:51:32 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-9f4f8ff4-7461-4710-8289-9578d5563bdd req-78886985-ae17-4d7b-b227-f43d6b85c8cf service nova] Acquiring lock "782ea87f-f55e-4aab-8501-ac17f3bc59af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:51:32 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-9f4f8ff4-7461-4710-8289-9578d5563bdd req-78886985-ae17-4d7b-b227-f43d6b85c8cf service nova] Lock "782ea87f-f55e-4aab-8501-ac17f3bc59af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:51:32 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-9f4f8ff4-7461-4710-8289-9578d5563bdd req-78886985-ae17-4d7b-b227-f43d6b85c8cf service nova] Lock "782ea87f-f55e-4aab-8501-ac17f3bc59af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:51:32 user nova-compute[82479]: DEBUG nova.compute.manager [req-9f4f8ff4-7461-4710-8289-9578d5563bdd req-78886985-ae17-4d7b-b227-f43d6b85c8cf service nova] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] No waiting events found dispatching network-vif-plugged-d261fca7-16e0-4d71-acff-7ae3017459ae {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:51:32 user nova-compute[82479]: WARNING nova.compute.manager [req-9f4f8ff4-7461-4710-8289-9578d5563bdd req-78886985-ae17-4d7b-b227-f43d6b85c8cf service nova] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Received unexpected event network-vif-plugged-d261fca7-16e0-4d71-acff-7ae3017459ae for instance with vm_state active and task_state None.
Apr 14 00:51:33 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:51:34 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:51:36 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:51:38 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:51:38 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:51:38 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:51:38 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:51:38 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:51:38 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:51:42 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:51:42 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Cleaning up deleted instances with incomplete migration  {{(pid=82479) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 00:51:43 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:51:43 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:51:43 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:51:43 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:51:43 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:51:43 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:51:46 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:51:48 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:51:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:51:53 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:51:54 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:51:58 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:51:58 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:51:58 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:51:58 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:51:58 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:51:58 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:52:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:52:03 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:52:08 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:52:13 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:52:13 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:52:13 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:52:13 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:52:13 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:52:13 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:52:16 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._sync_power_states {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:52:16 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Triggering sync for uuid 782ea87f-f55e-4aab-8501-ac17f3bc59af {{(pid=82479) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 00:52:16 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "782ea87f-f55e-4aab-8501-ac17f3bc59af" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:52:16 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "782ea87f-f55e-4aab-8501-ac17f3bc59af" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:52:16 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "782ea87f-f55e-4aab-8501-ac17f3bc59af" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.023s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:52:16 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:52:18 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:52:21 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:52:21 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Starting heal instance info cache {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 00:52:21 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Rebuilding the list of instances to heal {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 00:52:21 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "refresh_cache-782ea87f-f55e-4aab-8501-ac17f3bc59af" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:52:21 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquired lock "refresh_cache-782ea87f-f55e-4aab-8501-ac17f3bc59af" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:52:21 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Forcefully refreshing network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 00:52:21 user nova-compute[82479]: DEBUG nova.objects.instance [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lazy-loading 'info_cache' on Instance uuid 782ea87f-f55e-4aab-8501-ac17f3bc59af {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:52:22 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Updating instance_info_cache with network_info: [{"id": "d261fca7-16e0-4d71-acff-7ae3017459ae", "address": "fa:16:3e:01:2f:bf", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd261fca7-16", "ovs_interfaceid": "d261fca7-16e0-4d71-acff-7ae3017459ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:52:22 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Releasing lock "refresh_cache-782ea87f-f55e-4aab-8501-ac17f3bc59af" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:52:22 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Updated the network info_cache for instance {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 00:52:22 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:52:23 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:52:23 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:52:23 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:52:23 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:52:23 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:52:23 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:52:23 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:52:24 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:52:28 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:52:28 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:52:28 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:52:28 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:52:28 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:52:28 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:52:28 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:52:28 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:52:28 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:52:28 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:52:28 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Auditing locally available compute resources for user (node: user) {{(pid=82479) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 00:52:28 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:52:29 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:52:29 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:52:29 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Hypervisor/Node resource view: name=user free_ram=8817MB free_disk=26.15680694580078GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82479) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 00:52:29 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:52:29 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:52:29 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 782ea87f-f55e-4aab-8501-ac17f3bc59af actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:52:29 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 00:52:29 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 00:52:29 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:52:29 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:52:29 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Compute_service record updated for user:user {{(pid=82479) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 00:52:29 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.191s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:52:30 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:52:30 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82479) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 00:52:32 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:52:33 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:52:33 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:52:33 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:52:33 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:52:33 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:52:33 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:52:36 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:52:36 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:52:38 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:52:38 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:52:38 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:52:38 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:52:38 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:52:38 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:52:43 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:52:43 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:52:43 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:52:43 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:52:43 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:52:43 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:52:46 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:52:48 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:52:53 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:52:53 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:52:53 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:52:53 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:52:53 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:52:53 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:52:58 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:52:58 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:52:58 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:52:58 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:52:58 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:52:58 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:53:03 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:53:03 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:53:03 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:53:03 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:53:03 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:53:03 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:53:08 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:53:10 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:53:11 user nova-compute[82479]: DEBUG nova.compute.manager [req-16640440-713a-4b0f-b925-5d3a6dfc4e86 req-936838c2-d953-4df1-bcb1-458070f6bc43 service nova] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Received event network-changed-d261fca7-16e0-4d71-acff-7ae3017459ae {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:53:11 user nova-compute[82479]: DEBUG nova.compute.manager [req-16640440-713a-4b0f-b925-5d3a6dfc4e86 req-936838c2-d953-4df1-bcb1-458070f6bc43 service nova] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Refreshing instance network info cache due to event network-changed-d261fca7-16e0-4d71-acff-7ae3017459ae. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:53:11 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-16640440-713a-4b0f-b925-5d3a6dfc4e86 req-936838c2-d953-4df1-bcb1-458070f6bc43 service nova] Acquiring lock "refresh_cache-782ea87f-f55e-4aab-8501-ac17f3bc59af" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:53:11 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-16640440-713a-4b0f-b925-5d3a6dfc4e86 req-936838c2-d953-4df1-bcb1-458070f6bc43 service nova] Acquired lock "refresh_cache-782ea87f-f55e-4aab-8501-ac17f3bc59af" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:53:11 user nova-compute[82479]: DEBUG nova.network.neutron [req-16640440-713a-4b0f-b925-5d3a6dfc4e86 req-936838c2-d953-4df1-bcb1-458070f6bc43 service nova] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Refreshing network info cache for port d261fca7-16e0-4d71-acff-7ae3017459ae {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:53:11 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:53:12 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a51449de-0f52-45de-9b4f-402659e7a295 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "782ea87f-f55e-4aab-8501-ac17f3bc59af" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:53:12 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a51449de-0f52-45de-9b4f-402659e7a295 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "782ea87f-f55e-4aab-8501-ac17f3bc59af" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:53:12 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a51449de-0f52-45de-9b4f-402659e7a295 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "782ea87f-f55e-4aab-8501-ac17f3bc59af-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:53:12 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a51449de-0f52-45de-9b4f-402659e7a295 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "782ea87f-f55e-4aab-8501-ac17f3bc59af-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:53:12 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a51449de-0f52-45de-9b4f-402659e7a295 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "782ea87f-f55e-4aab-8501-ac17f3bc59af-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:53:12 user nova-compute[82479]: INFO nova.compute.manager [None req-a51449de-0f52-45de-9b4f-402659e7a295 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Terminating instance
Apr 14 00:53:12 user nova-compute[82479]: DEBUG nova.compute.manager [None req-a51449de-0f52-45de-9b4f-402659e7a295 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Start destroying the instance on the hypervisor. {{(pid=82479) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 00:53:12 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:53:12 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:53:12 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:53:12 user nova-compute[82479]: DEBUG nova.network.neutron [req-16640440-713a-4b0f-b925-5d3a6dfc4e86 req-936838c2-d953-4df1-bcb1-458070f6bc43 service nova] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Updated VIF entry in instance network info cache for port d261fca7-16e0-4d71-acff-7ae3017459ae. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:53:12 user nova-compute[82479]: DEBUG nova.network.neutron [req-16640440-713a-4b0f-b925-5d3a6dfc4e86 req-936838c2-d953-4df1-bcb1-458070f6bc43 service nova] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Updating instance_info_cache with network_info: [{"id": "d261fca7-16e0-4d71-acff-7ae3017459ae", "address": "fa:16:3e:01:2f:bf", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd261fca7-16", "ovs_interfaceid": "d261fca7-16e0-4d71-acff-7ae3017459ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:53:12 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-16640440-713a-4b0f-b925-5d3a6dfc4e86 req-936838c2-d953-4df1-bcb1-458070f6bc43 service nova] Releasing lock "refresh_cache-782ea87f-f55e-4aab-8501-ac17f3bc59af" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:53:12 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Instance destroyed successfully.
Apr 14 00:53:12 user nova-compute[82479]: DEBUG nova.objects.instance [None req-a51449de-0f52-45de-9b4f-402659e7a295 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lazy-loading 'resources' on Instance uuid 782ea87f-f55e-4aab-8501-ac17f3bc59af {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:53:12 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-a51449de-0f52-45de-9b4f-402659e7a295 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:51:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-67870164',display_name='tempest-TestVolumeBootPattern-server-67870164',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-67870164',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA04fSpZPZehkhB9f0sYv7pWCpEF+0Af0ha1AxWnn4wafUNVzRts+po3Hz8WLNc1o5rlWHs8ARX3jM/G2geverCNDjLTFUEFq/SUwWxk6uiLBWzBveljr9LVk4guW/E4ew==',key_name='tempest-TestVolumeBootPattern-128892553',keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:51:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0934526a2dfa45f4bd5df4edee11d98a',ramdisk_id='',reservation_id='r-7bajvly0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-260409128',owner_user_name='tempest-TestVolumeBootPattern-260409128-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T00:51:32Z,user_data=None,user_id='cfb66031fcf84659a3b80cdb76ffddc0',uuid=782ea87f-f55e-4aab-8501-ac17f3bc59af,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d261fca7-16e0-4d71-acff-7ae3017459ae", "address": "fa:16:3e:01:2f:bf", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd261fca7-16", "ovs_interfaceid": "d261fca7-16e0-4d71-acff-7ae3017459ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 00:53:12 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-a51449de-0f52-45de-9b4f-402659e7a295 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Converting VIF {"id": "d261fca7-16e0-4d71-acff-7ae3017459ae", "address": "fa:16:3e:01:2f:bf", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd261fca7-16", "ovs_interfaceid": "d261fca7-16e0-4d71-acff-7ae3017459ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:53:12 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-a51449de-0f52-45de-9b4f-402659e7a295 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:01:2f:bf,bridge_name='br-int',has_traffic_filtering=True,id=d261fca7-16e0-4d71-acff-7ae3017459ae,network=Network(6dec18bc-e73b-450e-b0d2-e36653017f20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd261fca7-16') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:53:12 user nova-compute[82479]: DEBUG os_vif [None req-a51449de-0f52-45de-9b4f-402659e7a295 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:2f:bf,bridge_name='br-int',has_traffic_filtering=True,id=d261fca7-16e0-4d71-acff-7ae3017459ae,network=Network(6dec18bc-e73b-450e-b0d2-e36653017f20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd261fca7-16') {{(pid=82479) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 00:53:12 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:53:12 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd261fca7-16, bridge=br-int, if_exists=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:53:12 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:53:12 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:53:12 user nova-compute[82479]: INFO os_vif [None req-a51449de-0f52-45de-9b4f-402659e7a295 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:2f:bf,bridge_name='br-int',has_traffic_filtering=True,id=d261fca7-16e0-4d71-acff-7ae3017459ae,network=Network(6dec18bc-e73b-450e-b0d2-e36653017f20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd261fca7-16')
Apr 14 00:53:12 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a51449de-0f52-45de-9b4f-402659e7a295 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] calling os-brick to detach iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 00:53:12 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a51449de-0f52-45de-9b4f-402659e7a295 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, {'target_iqn': 'iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gvTuEZAX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:53:12 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-a51449de-0f52-45de-9b4f-402659e7a295 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:53:12 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-a51449de-0f52-45de-9b4f-402659e7a295 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:53:12 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-a51449de-0f52-45de-9b4f-402659e7a295 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:53:12 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:53:12 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:53:12 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[efff675f-100a-4878-ae2b-9b4f153e3f2c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:53:12 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a51449de-0f52-45de-9b4f-402659e7a295 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 00:53:12 user nova-compute[82479]: No targets found.
Apr 14 00:53:12 user nova-compute[82479]: iSNS:
Apr 14 00:53:12 user nova-compute[82479]: No targets found.
Apr 14 00:53:12 user nova-compute[82479]: STATIC:
Apr 14 00:53:12 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7
Apr 14 00:53:12 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:53:12 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:53:12 user nova-compute[82479]: FIRMWARE:
Apr 14 00:53:12 user nova-compute[82479]: No targets found.
Apr 14 00:53:12 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:53:12 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a51449de-0f52-45de-9b4f-402659e7a295 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 00:53:12 user nova-compute[82479]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 00:53:12 user nova-compute[82479]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82479) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 00:53:12 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a51449de-0f52-45de-9b4f-402659e7a295 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7', 0)] {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 00:53:12 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:53:12 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:53:12 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4eefa69-fcf5-494a-8df8-9cc5b4ab7c84]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:53:12 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:53:12 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:53:12 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d103a0d-64ed-46fa-9d69-fec110937c58]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:53:12 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a51449de-0f52-45de-9b4f-402659e7a295 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 (non-flash)
Apr 14 00:53:12 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:53:12 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a51449de-0f52-45de-9b4f-402659e7a295 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 (non-flash)
Apr 14 00:53:12 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:53:12 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a51449de-0f52-45de-9b4f-402659e7a295 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f3344bd6d40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7'): ({'sdb'}, set())}) {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 00:53:12 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-a51449de-0f52-45de-9b4f-402659e7a295 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Removing single pathed devices sdb {{(pid=82479) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 00:53:12 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:53:12 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:53:12 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54bebf7-7569-49cf-bf93-60acce4223fd]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:53:12 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:53:13 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:53:13 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1cecc1c-651c-4192-9aff-e30259af632d]: (4, ('ok\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:53:13 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-a51449de-0f52-45de-9b4f-402659e7a295 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Flushing IO for device /dev/sdb {{(pid=82479) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 00:53:13 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:53:13 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:53:13 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9024eeb-ec51-4130-9a5c-fdb7b1816bb8]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:53:13 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-a51449de-0f52-45de-9b4f-402659e7a295 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82479) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 00:53:13 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:53:13 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:53:13 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f942fe-a215-4b16-a22a-22992d85e945]: (4, ('1', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:53:13 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-a51449de-0f52-45de-9b4f-402659e7a295 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 00:53:13 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-a51449de-0f52-45de-9b4f-402659e7a295 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] SCSI volumes sdb have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 00:53:13 user nova-compute[82479]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO756f51f0-94024c7bcdf6175c', '/dev/disk/by-id/scsi-23934303234633762', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_756f51f0') {{(pid=93289) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 14 00:53:13 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[c315a953-2665-4cd8-b11a-7067cb675d23]: (4, None) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:53:13 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a51449de-0f52-45de-9b4f-402659e7a295 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7')] {{(pid=82479) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 00:53:13 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:53:13 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:53:13 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f8ca24b-9c48-49bb-a444-7c04124b422c]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:53:13 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a51449de-0f52-45de-9b4f-402659e7a295 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:53:13 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 -p 172.16.0.220:3260 --logout {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:53:13 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:53:13 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[e818cac3-3d4f-42c6-bcbb-1f9c0084923e]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:53:13 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a51449de-0f52-45de-9b4f-402659e7a295 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7, portal: 172.16.0.220,3260]
Apr 14 00:53:13 user nova-compute[82479]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7, portal: 172.16.0.220,3260] successful.
Apr 14 00:53:13 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:53:13 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 -p 172.16.0.220:3260 --op delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:53:13 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:53:13 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[6441b39a-6660-4470-9b49-10c2e3bbcac2]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:53:13 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a51449de-0f52-45de-9b4f-402659e7a295 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:53:13 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-a51449de-0f52-45de-9b4f-402659e7a295 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:53:13 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a51449de-0f52-45de-9b4f-402659e7a295 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] <== disconnect_volume: return (301ms) None {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:53:13 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a51449de-0f52-45de-9b4f-402659e7a295 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Disconnected iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 00:53:13 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-a51449de-0f52-45de-9b4f-402659e7a295 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Deleting instance files /opt/stack/data/nova/instances/782ea87f-f55e-4aab-8501-ac17f3bc59af_del
Apr 14 00:53:13 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-a51449de-0f52-45de-9b4f-402659e7a295 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Deletion of /opt/stack/data/nova/instances/782ea87f-f55e-4aab-8501-ac17f3bc59af_del complete
Apr 14 00:53:13 user nova-compute[82479]: INFO nova.compute.manager [None req-a51449de-0f52-45de-9b4f-402659e7a295 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Took 1.13 seconds to destroy the instance on the hypervisor.
Apr 14 00:53:13 user nova-compute[82479]: DEBUG oslo.service.loopingcall [None req-a51449de-0f52-45de-9b4f-402659e7a295 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82479) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 00:53:13 user nova-compute[82479]: DEBUG nova.compute.manager [-] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Deallocating network for instance {{(pid=82479) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 00:53:13 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] deallocate_for_instance() {{(pid=82479) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 00:53:13 user nova-compute[82479]: DEBUG nova.compute.manager [req-48940633-7d63-406a-817c-166078988b84 req-8d4f5e74-f55b-4c74-b759-c63299fc795e service nova] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Received event network-vif-unplugged-d261fca7-16e0-4d71-acff-7ae3017459ae {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:53:13 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-48940633-7d63-406a-817c-166078988b84 req-8d4f5e74-f55b-4c74-b759-c63299fc795e service nova] Acquiring lock "782ea87f-f55e-4aab-8501-ac17f3bc59af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:53:13 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-48940633-7d63-406a-817c-166078988b84 req-8d4f5e74-f55b-4c74-b759-c63299fc795e service nova] Lock "782ea87f-f55e-4aab-8501-ac17f3bc59af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:53:13 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-48940633-7d63-406a-817c-166078988b84 req-8d4f5e74-f55b-4c74-b759-c63299fc795e service nova] Lock "782ea87f-f55e-4aab-8501-ac17f3bc59af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:53:13 user nova-compute[82479]: DEBUG nova.compute.manager [req-48940633-7d63-406a-817c-166078988b84 req-8d4f5e74-f55b-4c74-b759-c63299fc795e service nova] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] No waiting events found dispatching network-vif-unplugged-d261fca7-16e0-4d71-acff-7ae3017459ae {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:53:13 user nova-compute[82479]: DEBUG nova.compute.manager [req-48940633-7d63-406a-817c-166078988b84 req-8d4f5e74-f55b-4c74-b759-c63299fc795e service nova] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Received event network-vif-unplugged-d261fca7-16e0-4d71-acff-7ae3017459ae for instance with task_state deleting. {{(pid=82479) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 00:53:13 user nova-compute[82479]: DEBUG nova.compute.manager [req-48940633-7d63-406a-817c-166078988b84 req-8d4f5e74-f55b-4c74-b759-c63299fc795e service nova] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Received event network-vif-plugged-d261fca7-16e0-4d71-acff-7ae3017459ae {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:53:13 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-48940633-7d63-406a-817c-166078988b84 req-8d4f5e74-f55b-4c74-b759-c63299fc795e service nova] Acquiring lock "782ea87f-f55e-4aab-8501-ac17f3bc59af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:53:13 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-48940633-7d63-406a-817c-166078988b84 req-8d4f5e74-f55b-4c74-b759-c63299fc795e service nova] Lock "782ea87f-f55e-4aab-8501-ac17f3bc59af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:53:13 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-48940633-7d63-406a-817c-166078988b84 req-8d4f5e74-f55b-4c74-b759-c63299fc795e service nova] Lock "782ea87f-f55e-4aab-8501-ac17f3bc59af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:53:13 user nova-compute[82479]: DEBUG nova.compute.manager [req-48940633-7d63-406a-817c-166078988b84 req-8d4f5e74-f55b-4c74-b759-c63299fc795e service nova] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] No waiting events found dispatching network-vif-plugged-d261fca7-16e0-4d71-acff-7ae3017459ae {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:53:13 user nova-compute[82479]: WARNING nova.compute.manager [req-48940633-7d63-406a-817c-166078988b84 req-8d4f5e74-f55b-4c74-b759-c63299fc795e service nova] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Received unexpected event network-vif-plugged-d261fca7-16e0-4d71-acff-7ae3017459ae for instance with vm_state active and task_state deleting.
Apr 14 00:53:14 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Updating instance_info_cache with network_info: [] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:53:14 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Took 0.96 seconds to deallocate network for instance.
Apr 14 00:53:14 user nova-compute[82479]: DEBUG nova.compute.manager [req-656c52e8-b7df-42a9-8bdf-20008f5a1674 req-2d732415-c585-4bb0-9cc4-fbabfbb3f665 service nova] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Received event network-vif-deleted-d261fca7-16e0-4d71-acff-7ae3017459ae {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:53:14 user nova-compute[82479]: INFO nova.compute.manager [None req-a51449de-0f52-45de-9b4f-402659e7a295 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Took 0.79 seconds to detach 1 volumes for instance.
Apr 14 00:53:15 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a51449de-0f52-45de-9b4f-402659e7a295 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:53:15 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a51449de-0f52-45de-9b4f-402659e7a295 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:53:15 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-a51449de-0f52-45de-9b4f-402659e7a295 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:53:15 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-a51449de-0f52-45de-9b4f-402659e7a295 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:53:15 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a51449de-0f52-45de-9b4f-402659e7a295 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.106s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:53:15 user nova-compute[82479]: INFO nova.scheduler.client.report [None req-a51449de-0f52-45de-9b4f-402659e7a295 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Deleted allocations for instance 782ea87f-f55e-4aab-8501-ac17f3bc59af
Apr 14 00:53:15 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a51449de-0f52-45de-9b4f-402659e7a295 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "782ea87f-f55e-4aab-8501-ac17f3bc59af" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.155s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:53:16 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:53:17 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:53:21 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:53:22 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:53:22 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Starting heal instance info cache {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 00:53:22 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Rebuilding the list of instances to heal {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 00:53:22 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Didn't find any instances for network info cache update. {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 00:53:22 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:53:24 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:53:24 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:53:24 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:53:27 user nova-compute[82479]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681433592.8487804, 782ea87f-f55e-4aab-8501-ac17f3bc59af => Stopped> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:53:27 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] VM Stopped (Lifecycle Event)
Apr 14 00:53:27 user nova-compute[82479]: DEBUG nova.compute.manager [None req-193e899f-1607-4462-8204-890f26451e77 None None] [instance: 782ea87f-f55e-4aab-8501-ac17f3bc59af] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:53:27 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:53:27 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:53:27 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:53:27 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:53:27 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:53:27 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:53:29 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:53:29 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82479) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 00:53:29 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:53:29 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:53:29 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:53:29 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:53:29 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Auditing locally available compute resources for user (node: user) {{(pid=82479) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 00:53:30 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:53:30 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:53:30 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Hypervisor/Node resource view: name=user free_ram=8920MB free_disk=26.155948638916016GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82479) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 00:53:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:53:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:53:30 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 00:53:30 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 00:53:30 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:53:30 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:53:30 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Compute_service record updated for user:user {{(pid=82479) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 00:53:30 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.149s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:53:32 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:53:33 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:53:37 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:53:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:53:38 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:53:42 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:53:47 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:53:47 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:53:47 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:53:47 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:53:47 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:53:47 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:53:52 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:53:57 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:54:02 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:54:03 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "98479cbe-09c7-40ee-a5cc-1b872dd9fbf7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:54:03 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "98479cbe-09c7-40ee-a5cc-1b872dd9fbf7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:54:03 user nova-compute[82479]: DEBUG nova.compute.manager [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Starting instance... {{(pid=82479) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 00:54:03 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:54:03 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:54:03 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82479) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 00:54:03 user nova-compute[82479]: INFO nova.compute.claims [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Claim successful on node user
Apr 14 00:54:04 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:54:04 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:54:04 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.197s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:54:04 user nova-compute[82479]: DEBUG nova.compute.manager [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Start building networks asynchronously for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 00:54:04 user nova-compute[82479]: DEBUG nova.compute.manager [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Allocating IP information in the background. {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 00:54:04 user nova-compute[82479]: DEBUG nova.network.neutron [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] allocate_for_instance() {{(pid=82479) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 00:54:04 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 00:54:04 user nova-compute[82479]: DEBUG nova.compute.manager [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Start building block device mappings for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 00:54:04 user nova-compute[82479]: INFO nova.virt.block_device [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Booting with volume 8a7edaa8-f67a-4251-8117-62a322c53de7 at /dev/vda
Apr 14 00:54:04 user nova-compute[82479]: DEBUG os_brick.utils [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:54:04 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:54:04 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:54:04 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff87541-f0d5-41a4-8359-7be14d789a0e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fec92fcfdd3\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:54:04 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:54:04 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:54:04 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1537b91-fb80-43d1-94d5-439395680512]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:54:04 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:54:04 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:54:04 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e6f09fa-1d36-4c15-8878-fd5ea7dd6ded]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:54:04 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[d439a587-8b12-4386-93b6-9aa6c54dc07e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:54:04 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Running cmd (subprocess): nvme version {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:54:04 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] 'nvme version' failed. Not Retrying. {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:54:04 user nova-compute[82479]: DEBUG nova.policy [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cfb66031fcf84659a3b80cdb76ffddc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934526a2dfa45f4bd5df4edee11d98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82479) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 00:54:04 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] nvme not present on system {{(pid=82479) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 00:54:04 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:54:04 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:54:04 user nova-compute[82479]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 00:54:04 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba092ad8-dc75-438c-98ce-a803742394b8]: (4, '') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:54:04 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82479) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 00:54:04 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 00:54:04 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] LIGHTOS: no hostnqn found. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 00:54:04 user nova-compute[82479]: DEBUG os_brick.utils [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fec92fcfdd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:54:04 user nova-compute[82479]: DEBUG nova.virt.block_device [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Updating existing volume attachment record: 77614d82-8bef-4d0b-8643-dbb9e44620e9 {{(pid=82479) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 00:54:05 user nova-compute[82479]: DEBUG nova.network.neutron [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Successfully created port: d339fae5-6ce4-49ea-85eb-45933ebf36eb {{(pid=82479) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 00:54:05 user nova-compute[82479]: DEBUG nova.network.neutron [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Successfully updated port: d339fae5-6ce4-49ea-85eb-45933ebf36eb {{(pid=82479) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 00:54:05 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "refresh_cache-98479cbe-09c7-40ee-a5cc-1b872dd9fbf7" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:54:05 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquired lock "refresh_cache-98479cbe-09c7-40ee-a5cc-1b872dd9fbf7" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:54:05 user nova-compute[82479]: DEBUG nova.network.neutron [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 00:54:06 user nova-compute[82479]: DEBUG nova.compute.manager [req-83903450-cd6b-43ee-9c6b-9473ac5667f8 req-2a4c48c3-8e1b-472f-95c0-a1f6c7fdd0b3 service nova] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Received event network-changed-d339fae5-6ce4-49ea-85eb-45933ebf36eb {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:54:06 user nova-compute[82479]: DEBUG nova.compute.manager [req-83903450-cd6b-43ee-9c6b-9473ac5667f8 req-2a4c48c3-8e1b-472f-95c0-a1f6c7fdd0b3 service nova] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Refreshing instance network info cache due to event network-changed-d339fae5-6ce4-49ea-85eb-45933ebf36eb. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:54:06 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-83903450-cd6b-43ee-9c6b-9473ac5667f8 req-2a4c48c3-8e1b-472f-95c0-a1f6c7fdd0b3 service nova] Acquiring lock "refresh_cache-98479cbe-09c7-40ee-a5cc-1b872dd9fbf7" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:54:06 user nova-compute[82479]: DEBUG nova.network.neutron [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Instance cache missing network info. {{(pid=82479) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 00:54:06 user nova-compute[82479]: DEBUG nova.network.neutron [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Updating instance_info_cache with network_info: [{"id": "d339fae5-6ce4-49ea-85eb-45933ebf36eb", "address": "fa:16:3e:58:99:ac", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd339fae5-6c", "ovs_interfaceid": "d339fae5-6ce4-49ea-85eb-45933ebf36eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:54:06 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Releasing lock "refresh_cache-98479cbe-09c7-40ee-a5cc-1b872dd9fbf7" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:54:06 user nova-compute[82479]: DEBUG nova.compute.manager [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Instance network_info: |[{"id": "d339fae5-6ce4-49ea-85eb-45933ebf36eb", "address": "fa:16:3e:58:99:ac", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd339fae5-6c", "ovs_interfaceid": "d339fae5-6ce4-49ea-85eb-45933ebf36eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 00:54:06 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-83903450-cd6b-43ee-9c6b-9473ac5667f8 req-2a4c48c3-8e1b-472f-95c0-a1f6c7fdd0b3 service nova] Acquired lock "refresh_cache-98479cbe-09c7-40ee-a5cc-1b872dd9fbf7" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:54:06 user nova-compute[82479]: DEBUG nova.network.neutron [req-83903450-cd6b-43ee-9c6b-9473ac5667f8 req-2a4c48c3-8e1b-472f-95c0-a1f6c7fdd0b3 service nova] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Refreshing network info cache for port d339fae5-6ce4-49ea-85eb-45933ebf36eb {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:54:07 user nova-compute[82479]: DEBUG nova.network.neutron [req-83903450-cd6b-43ee-9c6b-9473ac5667f8 req-2a4c48c3-8e1b-472f-95c0-a1f6c7fdd0b3 service nova] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Updated VIF entry in instance network info cache for port d339fae5-6ce4-49ea-85eb-45933ebf36eb. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:54:07 user nova-compute[82479]: DEBUG nova.network.neutron [req-83903450-cd6b-43ee-9c6b-9473ac5667f8 req-2a4c48c3-8e1b-472f-95c0-a1f6c7fdd0b3 service nova] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Updating instance_info_cache with network_info: [{"id": "d339fae5-6ce4-49ea-85eb-45933ebf36eb", "address": "fa:16:3e:58:99:ac", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd339fae5-6c", "ovs_interfaceid": "d339fae5-6ce4-49ea-85eb-45933ebf36eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:54:07 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-83903450-cd6b-43ee-9c6b-9473ac5667f8 req-2a4c48c3-8e1b-472f-95c0-a1f6c7fdd0b3 service nova] Releasing lock "refresh_cache-98479cbe-09c7-40ee-a5cc-1b872dd9fbf7" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:54:07 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:54:09 user nova-compute[82479]: DEBUG nova.compute.manager [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Start spawning the instance on the hypervisor. {{(pid=82479) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 00:54:09 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Creating instance directory {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 00:54:09 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Creating image(s)
Apr 14 00:54:09 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Did not create local disks {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 00:54:09 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Ensure instance console log exists: /opt/stack/data/nova/instances/98479cbe-09c7-40ee-a5cc-1b872dd9fbf7/console.log {{(pid=82479) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 00:54:09 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:54:09 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:54:09 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:54:09 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Start _get_guest_xml network_info=[{"id": "d339fae5-6ce4-49ea-85eb-45933ebf36eb", "address": "fa:16:3e:58:99:ac", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd339fae5-6c", "ovs_interfaceid": "d339fae5-6ce4-49ea-85eb-45933ebf36eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': False, 'attachment_id': '77614d82-8bef-4d0b-8643-dbb9e44620e9', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gvTuEZAX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '98479cbe-09c7-40ee-a5cc-1b872dd9fbf7', 'attached_at': '', 'detached_at': '', 'volume_id': '8a7edaa8-f67a-4251-8117-62a322c53de7', 'serial': '8a7edaa8-f67a-4251-8117-62a322c53de7'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 00:54:09 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:54:09 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:54:09 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82479) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 00:54:09 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T00:02:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 00:54:09 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Flavor limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 00:54:09 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Image limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 00:54:09 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Flavor pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 00:54:09 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Image pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 00:54:09 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 00:54:09 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 00:54:09 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 00:54:09 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Got 1 possible topologies {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 00:54:09 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 00:54:09 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 00:54:09 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Calling os-brick to attach iSCSI Volume {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 00:54:09 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gvTuEZAX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:54:09 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:54:09 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:54:09 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:54:09 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:54:09 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:54:09 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:54:09 user nova-compute[82479]: INFO os_brick.initiator.connectors.iscsi [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 00:54:09 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 -p 172.16.0.220:3260 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:54:09 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:54:09 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[247d7993-4610-485e-9bc7-380e208d6816]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:54:09 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 00:54:09 user nova-compute[82479]:  {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:54:09 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 -p 172.16.0.220:3260 --interface default --op new {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:54:09 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:54:09 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e5d83d-319c-4ab5-b10e-b58a7e4d09dd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7] added\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:54:09 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7] added
Apr 14 00:54:09 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:54:09 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:54:09 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:54:09 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e440a43-6f6b-4d8f-9d64-2550e5ee576e]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:54:09 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:54:09 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:54:09 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:54:09 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75cb020-b6b4-43df-92b6-0c3a7773602a]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:54:09 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:54:09 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gvTuEZAX {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:54:09 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gvTuEZAX" returned: 0 in 0.017s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:54:09 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e6e51c-bd38-40cd-b11b-40d6485b2de0]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:54:09 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gvTuEZAX'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:54:09 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:54:09 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:54:09 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e758269-55f2-45da-81f9-f9c3df1308ad]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:54:09 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:54:09 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:54:09 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:54:09 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b028525-4ddc-49e6-80ab-88df6c5e301b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:54:09 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 00:54:09 user nova-compute[82479]:  {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:54:09 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 00:54:09 user nova-compute[82479]:  {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:54:09 user nova-compute[82479]: WARNING os_brick.initiator.connectors.iscsi [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 00:54:09 user nova-compute[82479]: 
Apr 14 00:54:09 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 -p 172.16.0.220:3260 --login {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:54:09 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:54:09 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05e758b-38a3-461c-ac21-30b4f84893b9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:54:09 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7, portal: 172.16.0.220,3260]
Apr 14 00:54:09 user nova-compute[82479]: Login to [iface: default, target: iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7, portal: 172.16.0.220,3260] successful.
Apr 14 00:54:09 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:54:09 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:54:09 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:54:09 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c183569-f353-4993-a720-a400d3e27403]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:54:09 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:54:09 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:54:09 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:54:09 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db016e1-ebfa-4713-833a-9231efecaeed]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:54:09 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 (non-flash)
Apr 14 00:54:09 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:54:09 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 (non-flash)
Apr 14 00:54:09 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:54:09 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.246s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:54:09 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Connected to 172.16.0.220:3260 {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 00:54:09 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=82479) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 00:54:09 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82479) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 00:54:09 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:54:09 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:54:09 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7c49fd-d8fa-4e9d-ba47-ef4f40540ad5]: (4, ('- - 0', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:54:09 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: None {{(pid=82479) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 00:54:10 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82479) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 00:54:10 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gvTuEZAX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 00:54:10 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.273s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:54:10 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] <== connect_volume: return (1274ms) {'type': 'block', 'scsi_wwn': '23934303234633762', 'path': '/dev/sdb'} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:54:10 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23934303234633762', 'path': '/dev/sdb'} {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 00:54:10 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:54:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1369633049',display_name='tempest-TestVolumeBootPattern-server-1369633049',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1369633049',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA04fSpZPZehkhB9f0sYv7pWCpEF+0Af0ha1AxWnn4wafUNVzRts+po3Hz8WLNc1o5rlWHs8ARX3jM/G2geverCNDjLTFUEFq/SUwWxk6uiLBWzBveljr9LVk4guW/E4ew==',key_name='tempest-TestVolumeBootPattern-128892553',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0934526a2dfa45f4bd5df4edee11d98a',ramdisk_id='',reservation_id='r-jsjlsq9u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-260409128',owner_user_name='tempest-TestVolumeBootPattern-260409128-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:54:04Z,user_data=None,user_id='cfb66031fcf84659a3b80cdb76ffddc0',uuid=98479cbe-09c7-40ee-a5cc-1b872dd9fbf7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d339fae5-6ce4-49ea-85eb-45933ebf36eb", "address": "fa:16:3e:58:99:ac", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd339fae5-6c", "ovs_interfaceid": "d339fae5-6ce4-49ea-85eb-45933ebf36eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82479) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 00:54:10 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Converting VIF {"id": "d339fae5-6ce4-49ea-85eb-45933ebf36eb", "address": "fa:16:3e:58:99:ac", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd339fae5-6c", "ovs_interfaceid": "d339fae5-6ce4-49ea-85eb-45933ebf36eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:54:10 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:99:ac,bridge_name='br-int',has_traffic_filtering=True,id=d339fae5-6ce4-49ea-85eb-45933ebf36eb,network=Network(6dec18bc-e73b-450e-b0d2-e36653017f20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd339fae5-6c') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:54:10 user nova-compute[82479]: DEBUG nova.objects.instance [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lazy-loading 'pci_devices' on Instance uuid 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:54:10 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] End _get_guest_xml xml=<domain type="kvm">
Apr 14 00:54:10 user nova-compute[82479]:   <uuid>98479cbe-09c7-40ee-a5cc-1b872dd9fbf7</uuid>
Apr 14 00:54:10 user nova-compute[82479]:   <name>instance-0000002c</name>
Apr 14 00:54:10 user nova-compute[82479]:   <memory>131072</memory>
Apr 14 00:54:10 user nova-compute[82479]:   <vcpu>1</vcpu>
Apr 14 00:54:10 user nova-compute[82479]:   <metadata>
Apr 14 00:54:10 user nova-compute[82479]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 00:54:10 user nova-compute[82479]:       <nova:package version="0.0.0"/>
Apr 14 00:54:10 user nova-compute[82479]:       <nova:name>tempest-TestVolumeBootPattern-server-1369633049</nova:name>
Apr 14 00:54:10 user nova-compute[82479]:       <nova:creationTime>2023-04-14 00:54:09</nova:creationTime>
Apr 14 00:54:10 user nova-compute[82479]:       <nova:flavor name="m1.nano">
Apr 14 00:54:10 user nova-compute[82479]:         <nova:memory>128</nova:memory>
Apr 14 00:54:10 user nova-compute[82479]:         <nova:disk>1</nova:disk>
Apr 14 00:54:10 user nova-compute[82479]:         <nova:swap>0</nova:swap>
Apr 14 00:54:10 user nova-compute[82479]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 00:54:10 user nova-compute[82479]:         <nova:vcpus>1</nova:vcpus>
Apr 14 00:54:10 user nova-compute[82479]:       </nova:flavor>
Apr 14 00:54:10 user nova-compute[82479]:       <nova:owner>
Apr 14 00:54:10 user nova-compute[82479]:         <nova:user uuid="cfb66031fcf84659a3b80cdb76ffddc0">tempest-TestVolumeBootPattern-260409128-project-member</nova:user>
Apr 14 00:54:10 user nova-compute[82479]:         <nova:project uuid="0934526a2dfa45f4bd5df4edee11d98a">tempest-TestVolumeBootPattern-260409128</nova:project>
Apr 14 00:54:10 user nova-compute[82479]:       </nova:owner>
Apr 14 00:54:10 user nova-compute[82479]:       <nova:ports>
Apr 14 00:54:10 user nova-compute[82479]:         <nova:port uuid="d339fae5-6ce4-49ea-85eb-45933ebf36eb">
Apr 14 00:54:10 user nova-compute[82479]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 14 00:54:10 user nova-compute[82479]:         </nova:port>
Apr 14 00:54:10 user nova-compute[82479]:       </nova:ports>
Apr 14 00:54:10 user nova-compute[82479]:     </nova:instance>
Apr 14 00:54:10 user nova-compute[82479]:   </metadata>
Apr 14 00:54:10 user nova-compute[82479]:   <sysinfo type="smbios">
Apr 14 00:54:10 user nova-compute[82479]:     <system>
Apr 14 00:54:10 user nova-compute[82479]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 00:54:10 user nova-compute[82479]:       <entry name="product">OpenStack Nova</entry>
Apr 14 00:54:10 user nova-compute[82479]:       <entry name="version">0.0.0</entry>
Apr 14 00:54:10 user nova-compute[82479]:       <entry name="serial">98479cbe-09c7-40ee-a5cc-1b872dd9fbf7</entry>
Apr 14 00:54:10 user nova-compute[82479]:       <entry name="uuid">98479cbe-09c7-40ee-a5cc-1b872dd9fbf7</entry>
Apr 14 00:54:10 user nova-compute[82479]:       <entry name="family">Virtual Machine</entry>
Apr 14 00:54:10 user nova-compute[82479]:     </system>
Apr 14 00:54:10 user nova-compute[82479]:   </sysinfo>
Apr 14 00:54:10 user nova-compute[82479]:   <os>
Apr 14 00:54:10 user nova-compute[82479]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 00:54:10 user nova-compute[82479]:     <boot dev="hd"/>
Apr 14 00:54:10 user nova-compute[82479]:     <smbios mode="sysinfo"/>
Apr 14 00:54:10 user nova-compute[82479]:   </os>
Apr 14 00:54:10 user nova-compute[82479]:   <features>
Apr 14 00:54:10 user nova-compute[82479]:     <acpi/>
Apr 14 00:54:10 user nova-compute[82479]:     <apic/>
Apr 14 00:54:10 user nova-compute[82479]:     <vmcoreinfo/>
Apr 14 00:54:10 user nova-compute[82479]:   </features>
Apr 14 00:54:10 user nova-compute[82479]:   <clock offset="utc">
Apr 14 00:54:10 user nova-compute[82479]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 00:54:10 user nova-compute[82479]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 00:54:10 user nova-compute[82479]:     <timer name="hpet" present="no"/>
Apr 14 00:54:10 user nova-compute[82479]:   </clock>
Apr 14 00:54:10 user nova-compute[82479]:   <cpu mode="custom" match="exact">
Apr 14 00:54:10 user nova-compute[82479]:     <model>Nehalem</model>
Apr 14 00:54:10 user nova-compute[82479]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 00:54:10 user nova-compute[82479]:   </cpu>
Apr 14 00:54:10 user nova-compute[82479]:   <devices>
Apr 14 00:54:10 user nova-compute[82479]:     <disk type="block" device="disk">
Apr 14 00:54:10 user nova-compute[82479]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:54:10 user nova-compute[82479]:       <source dev="/dev/sdb"/>
Apr 14 00:54:10 user nova-compute[82479]:       <target dev="vda" bus="virtio"/>
Apr 14 00:54:10 user nova-compute[82479]:       <serial>8a7edaa8-f67a-4251-8117-62a322c53de7</serial>
Apr 14 00:54:10 user nova-compute[82479]:     </disk>
Apr 14 00:54:10 user nova-compute[82479]:     <interface type="ethernet">
Apr 14 00:54:10 user nova-compute[82479]:       <mac address="fa:16:3e:58:99:ac"/>
Apr 14 00:54:10 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:54:10 user nova-compute[82479]:       <mtu size="1442"/>
Apr 14 00:54:10 user nova-compute[82479]:       <target dev="tapd339fae5-6c"/>
Apr 14 00:54:10 user nova-compute[82479]:     </interface>
Apr 14 00:54:10 user nova-compute[82479]:     <serial type="pty">
Apr 14 00:54:10 user nova-compute[82479]:       <log file="/opt/stack/data/nova/instances/98479cbe-09c7-40ee-a5cc-1b872dd9fbf7/console.log" append="off"/>
Apr 14 00:54:10 user nova-compute[82479]:     </serial>
Apr 14 00:54:10 user nova-compute[82479]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 00:54:10 user nova-compute[82479]:     <video>
Apr 14 00:54:10 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:54:10 user nova-compute[82479]:     </video>
Apr 14 00:54:10 user nova-compute[82479]:     <rng model="virtio">
Apr 14 00:54:10 user nova-compute[82479]:       <backend model="random">/dev/urandom</backend>
Apr 14 00:54:10 user nova-compute[82479]:     </rng>
Apr 14 00:54:10 user nova-compute[82479]:     <controller type="usb" index="0" model="none"/>
Apr 14 00:54:10 user nova-compute[82479]:     <memballoon model="virtio">
Apr 14 00:54:10 user nova-compute[82479]:       <stats period="10"/>
Apr 14 00:54:10 user nova-compute[82479]:     </memballoon>
Apr 14 00:54:10 user nova-compute[82479]:   </devices>
Apr 14 00:54:10 user nova-compute[82479]: </domain>
Apr 14 00:54:10 user nova-compute[82479]:  {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 00:54:10 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:54:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1369633049',display_name='tempest-TestVolumeBootPattern-server-1369633049',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1369633049',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA04fSpZPZehkhB9f0sYv7pWCpEF+0Af0ha1AxWnn4wafUNVzRts+po3Hz8WLNc1o5rlWHs8ARX3jM/G2geverCNDjLTFUEFq/SUwWxk6uiLBWzBveljr9LVk4guW/E4ew==',key_name='tempest-TestVolumeBootPattern-128892553',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0934526a2dfa45f4bd5df4edee11d98a',ramdisk_id='',reservation_id='r-jsjlsq9u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-260409128',owner_user_name='tempest-TestVolumeBootPattern-260409128-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:54:04Z,user_data=None,user_id='cfb66031fcf84659a3b80cdb76ffddc0',uuid=98479cbe-09c7-40ee-a5cc-1b872dd9fbf7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d339fae5-6ce4-49ea-85eb-45933ebf36eb", "address": "fa:16:3e:58:99:ac", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd339fae5-6c", "ovs_interfaceid": "d339fae5-6ce4-49ea-85eb-45933ebf36eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 00:54:10 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Converting VIF {"id": "d339fae5-6ce4-49ea-85eb-45933ebf36eb", "address": "fa:16:3e:58:99:ac", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd339fae5-6c", "ovs_interfaceid": "d339fae5-6ce4-49ea-85eb-45933ebf36eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:54:10 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:99:ac,bridge_name='br-int',has_traffic_filtering=True,id=d339fae5-6ce4-49ea-85eb-45933ebf36eb,network=Network(6dec18bc-e73b-450e-b0d2-e36653017f20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd339fae5-6c') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:54:10 user nova-compute[82479]: DEBUG os_vif [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:99:ac,bridge_name='br-int',has_traffic_filtering=True,id=d339fae5-6ce4-49ea-85eb-45933ebf36eb,network=Network(6dec18bc-e73b-450e-b0d2-e36653017f20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd339fae5-6c') {{(pid=82479) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 00:54:10 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:54:10 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:54:10 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 00:54:10 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:54:10 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd339fae5-6c, may_exist=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:54:10 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd339fae5-6c, col_values=(('external_ids', {'iface-id': 'd339fae5-6ce4-49ea-85eb-45933ebf36eb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:99:ac', 'vm-uuid': '98479cbe-09c7-40ee-a5cc-1b872dd9fbf7'}),)) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:54:10 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:54:10 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:54:10 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:54:10 user nova-compute[82479]: INFO os_vif [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:99:ac,bridge_name='br-int',has_traffic_filtering=True,id=d339fae5-6ce4-49ea-85eb-45933ebf36eb,network=Network(6dec18bc-e73b-450e-b0d2-e36653017f20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd339fae5-6c')
Apr 14 00:54:10 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:54:10 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] No VIF found with MAC fa:16:3e:58:99:ac, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:54:11 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:54:11 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:54:11 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:54:11 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:54:11 user nova-compute[82479]: DEBUG nova.compute.manager [req-c06ebaf4-772d-4b99-8a14-b373abede180 req-274e1508-aac4-4588-91e9-dac8dbdc17a8 service nova] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Received event network-vif-plugged-d339fae5-6ce4-49ea-85eb-45933ebf36eb {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:54:11 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-c06ebaf4-772d-4b99-8a14-b373abede180 req-274e1508-aac4-4588-91e9-dac8dbdc17a8 service nova] Acquiring lock "98479cbe-09c7-40ee-a5cc-1b872dd9fbf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:54:11 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-c06ebaf4-772d-4b99-8a14-b373abede180 req-274e1508-aac4-4588-91e9-dac8dbdc17a8 service nova] Lock "98479cbe-09c7-40ee-a5cc-1b872dd9fbf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:54:11 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-c06ebaf4-772d-4b99-8a14-b373abede180 req-274e1508-aac4-4588-91e9-dac8dbdc17a8 service nova] Lock "98479cbe-09c7-40ee-a5cc-1b872dd9fbf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:54:11 user nova-compute[82479]: DEBUG nova.compute.manager [req-c06ebaf4-772d-4b99-8a14-b373abede180 req-274e1508-aac4-4588-91e9-dac8dbdc17a8 service nova] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] No waiting events found dispatching network-vif-plugged-d339fae5-6ce4-49ea-85eb-45933ebf36eb {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:54:11 user nova-compute[82479]: WARNING nova.compute.manager [req-c06ebaf4-772d-4b99-8a14-b373abede180 req-274e1508-aac4-4588-91e9-dac8dbdc17a8 service nova] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Received unexpected event network-vif-plugged-d339fae5-6ce4-49ea-85eb-45933ebf36eb for instance with vm_state building and task_state spawning.
Apr 14 00:54:12 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:54:12 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:54:12 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:54:13 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681433653.8336446, 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7 => Resumed> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:54:13 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] VM Resumed (Lifecycle Event)
Apr 14 00:54:13 user nova-compute[82479]: DEBUG nova.compute.manager [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Instance event wait completed in 0 seconds for  {{(pid=82479) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 00:54:13 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Guest created on hypervisor {{(pid=82479) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 00:54:13 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Instance spawned successfully.
Apr 14 00:54:13 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 00:54:13 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:54:13 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:54:13 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Found default for hw_cdrom_bus of ide {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:54:13 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Found default for hw_disk_bus of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:54:13 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Found default for hw_input_bus of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:54:13 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Found default for hw_pointer_model of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:54:13 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Found default for hw_video_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:54:13 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Found default for hw_vif_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:54:13 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:54:13 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681433653.8357892, 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7 => Started> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:54:13 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] VM Started (Lifecycle Event)
Apr 14 00:54:13 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:54:13 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:54:13 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:54:13 user nova-compute[82479]: INFO nova.compute.manager [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Took 4.92 seconds to spawn the instance on the hypervisor.
Apr 14 00:54:13 user nova-compute[82479]: DEBUG nova.compute.manager [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:54:13 user nova-compute[82479]: DEBUG nova.compute.manager [req-0e0afd75-9157-47a3-a623-57d8b94437d5 req-050c0e03-b8be-4915-8cce-e7e6375107fb service nova] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Received event network-vif-plugged-d339fae5-6ce4-49ea-85eb-45933ebf36eb {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:54:13 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0e0afd75-9157-47a3-a623-57d8b94437d5 req-050c0e03-b8be-4915-8cce-e7e6375107fb service nova] Acquiring lock "98479cbe-09c7-40ee-a5cc-1b872dd9fbf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:54:13 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0e0afd75-9157-47a3-a623-57d8b94437d5 req-050c0e03-b8be-4915-8cce-e7e6375107fb service nova] Lock "98479cbe-09c7-40ee-a5cc-1b872dd9fbf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:54:13 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0e0afd75-9157-47a3-a623-57d8b94437d5 req-050c0e03-b8be-4915-8cce-e7e6375107fb service nova] Lock "98479cbe-09c7-40ee-a5cc-1b872dd9fbf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:54:13 user nova-compute[82479]: DEBUG nova.compute.manager [req-0e0afd75-9157-47a3-a623-57d8b94437d5 req-050c0e03-b8be-4915-8cce-e7e6375107fb service nova] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] No waiting events found dispatching network-vif-plugged-d339fae5-6ce4-49ea-85eb-45933ebf36eb {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:54:13 user nova-compute[82479]: WARNING nova.compute.manager [req-0e0afd75-9157-47a3-a623-57d8b94437d5 req-050c0e03-b8be-4915-8cce-e7e6375107fb service nova] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Received unexpected event network-vif-plugged-d339fae5-6ce4-49ea-85eb-45933ebf36eb for instance with vm_state building and task_state spawning.
Apr 14 00:54:14 user nova-compute[82479]: INFO nova.compute.manager [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Took 10.10 seconds to build instance.
Apr 14 00:54:14 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "98479cbe-09c7-40ee-a5cc-1b872dd9fbf7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.203s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:54:15 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:54:16 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:54:20 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:54:21 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:54:22 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:54:22 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Starting heal instance info cache {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 00:54:22 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Rebuilding the list of instances to heal {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 00:54:22 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "refresh_cache-98479cbe-09c7-40ee-a5cc-1b872dd9fbf7" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:54:22 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquired lock "refresh_cache-98479cbe-09c7-40ee-a5cc-1b872dd9fbf7" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:54:22 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Forcefully refreshing network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 00:54:22 user nova-compute[82479]: DEBUG nova.objects.instance [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lazy-loading 'info_cache' on Instance uuid 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:54:23 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Updating instance_info_cache with network_info: [{"id": "d339fae5-6ce4-49ea-85eb-45933ebf36eb", "address": "fa:16:3e:58:99:ac", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd339fae5-6c", "ovs_interfaceid": "d339fae5-6ce4-49ea-85eb-45933ebf36eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:54:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Releasing lock "refresh_cache-98479cbe-09c7-40ee-a5cc-1b872dd9fbf7" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:54:23 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Updated the network info_cache for instance {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 00:54:24 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:54:25 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:54:26 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:54:26 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:54:30 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:54:31 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:54:31 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82479) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 00:54:31 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:54:31 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:54:31 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:54:31 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:54:31 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Auditing locally available compute resources for user (node: user) {{(pid=82479) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 00:54:31 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:54:32 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:54:32 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:54:32 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:54:32 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Hypervisor/Node resource view: name=user free_ram=8763MB free_disk=26.154251098632812GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82479) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 00:54:32 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:54:32 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:54:32 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:54:32 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 00:54:32 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 00:54:32 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:54:32 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:54:32 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Compute_service record updated for user:user {{(pid=82479) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 00:54:32 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.236s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:54:35 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:54:35 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:54:38 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:54:39 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:54:40 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:54:40 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:54:40 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:54:40 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:54:40 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:54:40 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:54:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:54:45 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:54:50 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:54:50 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:54:50 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:54:50 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:54:50 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:54:50 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:54:55 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:55:00 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:55:00 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:55:00 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:55:00 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:55:00 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:55:00 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:55:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:55:05 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:55:10 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:55:10 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:55:10 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:55:10 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:55:10 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:55:10 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:55:15 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:55:15 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:55:15 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:55:15 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:55:15 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:55:15 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:55:20 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:55:21 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:55:24 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:55:24 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Starting heal instance info cache {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 00:55:24 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Rebuilding the list of instances to heal {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 00:55:24 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "refresh_cache-98479cbe-09c7-40ee-a5cc-1b872dd9fbf7" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:55:24 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquired lock "refresh_cache-98479cbe-09c7-40ee-a5cc-1b872dd9fbf7" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:55:24 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Forcefully refreshing network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 00:55:24 user nova-compute[82479]: DEBUG nova.objects.instance [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lazy-loading 'info_cache' on Instance uuid 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:55:25 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Updating instance_info_cache with network_info: [{"id": "d339fae5-6ce4-49ea-85eb-45933ebf36eb", "address": "fa:16:3e:58:99:ac", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd339fae5-6c", "ovs_interfaceid": "d339fae5-6ce4-49ea-85eb-45933ebf36eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:55:25 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Releasing lock "refresh_cache-98479cbe-09c7-40ee-a5cc-1b872dd9fbf7" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:55:25 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Updated the network info_cache for instance {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 00:55:25 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:55:25 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:55:25 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:55:25 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:55:25 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:55:25 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:55:26 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:55:26 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:55:26 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:55:30 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:55:32 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:55:32 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82479) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 00:55:33 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:55:33 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:55:33 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:55:33 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:55:33 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Auditing locally available compute resources for user (node: user) {{(pid=82479) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 00:55:33 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:55:34 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:55:34 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:55:34 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Hypervisor/Node resource view: name=user free_ram=8809MB free_disk=26.153644561767578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82479) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 00:55:34 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:55:34 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:55:34 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:55:34 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 00:55:34 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 00:55:34 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:55:34 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:55:34 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Compute_service record updated for user:user {{(pid=82479) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 00:55:34 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.170s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:55:35 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:55:35 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:55:35 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:55:35 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:55:35 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:55:35 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:55:36 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:55:36 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:55:40 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:55:40 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:55:41 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:55:45 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:55:45 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:55:45 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:55:45 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:55:45 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:55:45 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:55:50 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:55:54 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:55:55 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:55:55 user nova-compute[82479]: DEBUG nova.compute.manager [req-861b08ee-4a60-474e-869d-8273f950ee93 req-731dc6e0-3f65-4915-8caf-7077dfd059d3 service nova] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Received event network-changed-d339fae5-6ce4-49ea-85eb-45933ebf36eb {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:55:55 user nova-compute[82479]: DEBUG nova.compute.manager [req-861b08ee-4a60-474e-869d-8273f950ee93 req-731dc6e0-3f65-4915-8caf-7077dfd059d3 service nova] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Refreshing instance network info cache due to event network-changed-d339fae5-6ce4-49ea-85eb-45933ebf36eb. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:55:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-861b08ee-4a60-474e-869d-8273f950ee93 req-731dc6e0-3f65-4915-8caf-7077dfd059d3 service nova] Acquiring lock "refresh_cache-98479cbe-09c7-40ee-a5cc-1b872dd9fbf7" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:55:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-861b08ee-4a60-474e-869d-8273f950ee93 req-731dc6e0-3f65-4915-8caf-7077dfd059d3 service nova] Acquired lock "refresh_cache-98479cbe-09c7-40ee-a5cc-1b872dd9fbf7" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:55:55 user nova-compute[82479]: DEBUG nova.network.neutron [req-861b08ee-4a60-474e-869d-8273f950ee93 req-731dc6e0-3f65-4915-8caf-7077dfd059d3 service nova] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Refreshing network info cache for port d339fae5-6ce4-49ea-85eb-45933ebf36eb {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:55:56 user nova-compute[82479]: DEBUG nova.network.neutron [req-861b08ee-4a60-474e-869d-8273f950ee93 req-731dc6e0-3f65-4915-8caf-7077dfd059d3 service nova] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Updated VIF entry in instance network info cache for port d339fae5-6ce4-49ea-85eb-45933ebf36eb. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:55:56 user nova-compute[82479]: DEBUG nova.network.neutron [req-861b08ee-4a60-474e-869d-8273f950ee93 req-731dc6e0-3f65-4915-8caf-7077dfd059d3 service nova] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Updating instance_info_cache with network_info: [{"id": "d339fae5-6ce4-49ea-85eb-45933ebf36eb", "address": "fa:16:3e:58:99:ac", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd339fae5-6c", "ovs_interfaceid": "d339fae5-6ce4-49ea-85eb-45933ebf36eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:55:56 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-861b08ee-4a60-474e-869d-8273f950ee93 req-731dc6e0-3f65-4915-8caf-7077dfd059d3 service nova] Releasing lock "refresh_cache-98479cbe-09c7-40ee-a5cc-1b872dd9fbf7" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:55:56 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:56:00 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:56:02 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:56:02 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "a5054773-9558-4f36-8230-aa37370f4f67" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:56:02 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "a5054773-9558-4f36-8230-aa37370f4f67" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:56:02 user nova-compute[82479]: DEBUG nova.compute.manager [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Starting instance... {{(pid=82479) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 00:56:02 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:56:02 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:56:02 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82479) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 00:56:02 user nova-compute[82479]: INFO nova.compute.claims [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Claim successful on node user
Apr 14 00:56:02 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:56:02 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:56:02 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.204s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:56:02 user nova-compute[82479]: DEBUG nova.compute.manager [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Start building networks asynchronously for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 00:56:02 user nova-compute[82479]: DEBUG nova.compute.manager [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Allocating IP information in the background. {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 00:56:02 user nova-compute[82479]: DEBUG nova.network.neutron [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: a5054773-9558-4f36-8230-aa37370f4f67] allocate_for_instance() {{(pid=82479) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 00:56:02 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 00:56:02 user nova-compute[82479]: DEBUG nova.compute.manager [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Start building block device mappings for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 00:56:02 user nova-compute[82479]: DEBUG nova.policy [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cfb66031fcf84659a3b80cdb76ffddc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0934526a2dfa45f4bd5df4edee11d98a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82479) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 00:56:02 user nova-compute[82479]: INFO nova.virt.block_device [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Booting with volume 5f9b46b9-9e36-44ab-a556-a4e4360bc408 at /dev/vda
Apr 14 00:56:03 user nova-compute[82479]: DEBUG os_brick.utils [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:56:03 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:56:03 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:56:03 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3569e38-becd-4bdc-a74a-da37215858fc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fec92fcfdd3\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:56:03 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:56:03 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:56:03 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd74ea3-e917-4a99-9771-d4a4e58a6db8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:56:03 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:56:03 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:56:03 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23e55b7-c3e8-4e45-82c6-0872e521f5e8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:56:03 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[543f6bec-f872-4b12-b757-218fc688f60a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:56:03 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Running cmd (subprocess): nvme version {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:56:03 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] 'nvme version' failed. Not Retrying. {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:56:03 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] nvme not present on system {{(pid=82479) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 00:56:03 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:56:03 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 00:56:03 user nova-compute[82479]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 00:56:03 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa651ca-aea8-42da-b67f-6877ce1af79d]: (4, '') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:56:03 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82479) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 00:56:03 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 00:56:03 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] LIGHTOS: no hostnqn found. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 00:56:03 user nova-compute[82479]: DEBUG os_brick.utils [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fec92fcfdd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:56:03 user nova-compute[82479]: DEBUG nova.virt.block_device [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Updating existing volume attachment record: f83ae752-6ab4-459a-94d2-12016e33e413 {{(pid=82479) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 00:56:03 user nova-compute[82479]: DEBUG nova.network.neutron [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Successfully created port: 168aba6c-5b08-4df4-8d0b-d9d847bb80ca {{(pid=82479) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 00:56:04 user nova-compute[82479]: DEBUG nova.network.neutron [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Successfully updated port: 168aba6c-5b08-4df4-8d0b-d9d847bb80ca {{(pid=82479) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 00:56:04 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "refresh_cache-a5054773-9558-4f36-8230-aa37370f4f67" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:56:04 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquired lock "refresh_cache-a5054773-9558-4f36-8230-aa37370f4f67" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:56:04 user nova-compute[82479]: DEBUG nova.network.neutron [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 00:56:04 user nova-compute[82479]: DEBUG nova.compute.manager [req-2faa8560-dda2-4d0b-acef-c9fd6d86ac8a req-f9062df7-172f-4b10-8c5f-0d76e8b44c19 service nova] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Received event network-changed-168aba6c-5b08-4df4-8d0b-d9d847bb80ca {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:56:04 user nova-compute[82479]: DEBUG nova.compute.manager [req-2faa8560-dda2-4d0b-acef-c9fd6d86ac8a req-f9062df7-172f-4b10-8c5f-0d76e8b44c19 service nova] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Refreshing instance network info cache due to event network-changed-168aba6c-5b08-4df4-8d0b-d9d847bb80ca. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:56:04 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-2faa8560-dda2-4d0b-acef-c9fd6d86ac8a req-f9062df7-172f-4b10-8c5f-0d76e8b44c19 service nova] Acquiring lock "refresh_cache-a5054773-9558-4f36-8230-aa37370f4f67" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:56:04 user nova-compute[82479]: DEBUG nova.network.neutron [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Instance cache missing network info. {{(pid=82479) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 00:56:05 user nova-compute[82479]: DEBUG nova.network.neutron [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Updating instance_info_cache with network_info: [{"id": "168aba6c-5b08-4df4-8d0b-d9d847bb80ca", "address": "fa:16:3e:0d:f3:72", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap168aba6c-5b", "ovs_interfaceid": "168aba6c-5b08-4df4-8d0b-d9d847bb80ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:56:05 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Releasing lock "refresh_cache-a5054773-9558-4f36-8230-aa37370f4f67" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:56:05 user nova-compute[82479]: DEBUG nova.compute.manager [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Instance network_info: |[{"id": "168aba6c-5b08-4df4-8d0b-d9d847bb80ca", "address": "fa:16:3e:0d:f3:72", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap168aba6c-5b", "ovs_interfaceid": "168aba6c-5b08-4df4-8d0b-d9d847bb80ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 00:56:05 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-2faa8560-dda2-4d0b-acef-c9fd6d86ac8a req-f9062df7-172f-4b10-8c5f-0d76e8b44c19 service nova] Acquired lock "refresh_cache-a5054773-9558-4f36-8230-aa37370f4f67" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:56:05 user nova-compute[82479]: DEBUG nova.network.neutron [req-2faa8560-dda2-4d0b-acef-c9fd6d86ac8a req-f9062df7-172f-4b10-8c5f-0d76e8b44c19 service nova] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Refreshing network info cache for port 168aba6c-5b08-4df4-8d0b-d9d847bb80ca {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:56:05 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:56:05 user nova-compute[82479]: DEBUG nova.network.neutron [req-2faa8560-dda2-4d0b-acef-c9fd6d86ac8a req-f9062df7-172f-4b10-8c5f-0d76e8b44c19 service nova] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Updated VIF entry in instance network info cache for port 168aba6c-5b08-4df4-8d0b-d9d847bb80ca. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:56:05 user nova-compute[82479]: DEBUG nova.network.neutron [req-2faa8560-dda2-4d0b-acef-c9fd6d86ac8a req-f9062df7-172f-4b10-8c5f-0d76e8b44c19 service nova] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Updating instance_info_cache with network_info: [{"id": "168aba6c-5b08-4df4-8d0b-d9d847bb80ca", "address": "fa:16:3e:0d:f3:72", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap168aba6c-5b", "ovs_interfaceid": "168aba6c-5b08-4df4-8d0b-d9d847bb80ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:56:05 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-2faa8560-dda2-4d0b-acef-c9fd6d86ac8a req-f9062df7-172f-4b10-8c5f-0d76e8b44c19 service nova] Releasing lock "refresh_cache-a5054773-9558-4f36-8230-aa37370f4f67" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:56:07 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:56:07 user nova-compute[82479]: DEBUG nova.compute.manager [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Start spawning the instance on the hypervisor. {{(pid=82479) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 00:56:07 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Creating instance directory {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 00:56:07 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Creating image(s)
Apr 14 00:56:07 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Did not create local disks {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 00:56:07 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Ensure instance console log exists: /opt/stack/data/nova/instances/a5054773-9558-4f36-8230-aa37370f4f67/console.log {{(pid=82479) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 00:56:07 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:56:07 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:56:07 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:56:07 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Start _get_guest_xml network_info=[{"id": "168aba6c-5b08-4df4-8d0b-d9d847bb80ca", "address": "fa:16:3e:0d:f3:72", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap168aba6c-5b", "ovs_interfaceid": "168aba6c-5b08-4df4-8d0b-d9d847bb80ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'delete_on_termination': False, 'attachment_id': 'f83ae752-6ab4-459a-94d2-12016e33e413', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QnZXrEdu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a5054773-9558-4f36-8230-aa37370f4f67', 'attached_at': '', 'detached_at': '', 'volume_id': '5f9b46b9-9e36-44ab-a556-a4e4360bc408', 'serial': '5f9b46b9-9e36-44ab-a556-a4e4360bc408'}, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 00:56:07 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:56:07 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:56:07 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82479) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 00:56:07 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T00:02:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 00:56:07 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Flavor limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 00:56:07 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Image limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 00:56:07 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Flavor pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 00:56:07 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Image pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 00:56:07 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 00:56:07 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 00:56:07 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 00:56:07 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Got 1 possible topologies {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 00:56:07 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 00:56:07 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 00:56:07 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Calling os-brick to attach iSCSI Volume {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 00:56:07 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QnZXrEdu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:56:07 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:56:07 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:56:07 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:56:07 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:56:07 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:56:07 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:56:07 user nova-compute[82479]: INFO os_brick.initiator.connectors.iscsi [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 00:56:07 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408 -p 172.16.0.220:3260 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:56:07 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:56:07 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[0103db90-e077-4426-8ff5-f1bb04316d77]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:56:07 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 00:56:07 user nova-compute[82479]:  {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:56:07 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408 -p 172.16.0.220:3260 --interface default --op new {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:56:07 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:56:07 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[17fd5bd2-0d0e-42f6-92f7-29f3ac2e1f50]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408] added\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:56:07 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408] added
Apr 14 00:56:07 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:56:07 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:56:07 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:56:07 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[81332dbb-4392-4723-884b-c47c59436c24]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:56:07 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:56:07 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:56:07 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:56:07 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb52ebf-1870-4263-8c96-858eb8cda83f]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:56:07 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:56:07 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QnZXrEdu {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:56:07 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QnZXrEdu" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:56:07 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[27bc9089-361f-40c5-a53b-60bf764b6109]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:56:07 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QnZXrEdu'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:56:07 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:56:07 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:56:07 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[88fe13ca-7c47-431d-a180-51e9e40950c6]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:56:07 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:56:07 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:56:08 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:56:08 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c97ea5f-a993-4a41-b3de-725b72d57c91]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:56:08 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 (non-flash)
Apr 14 00:56:08 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:56:08 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 (non-flash)
Apr 14 00:56:08 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:56:08 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408 -p 172.16.0.220:3260 --login {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:56:08 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:56:08 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6d20ac-9666-4f34-8515-5711e345886d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:56:08 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408, portal: 172.16.0.220,3260]
Apr 14 00:56:08 user nova-compute[82479]: Login to [iface: default, target: iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408, portal: 172.16.0.220,3260] successful.
Apr 14 00:56:08 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:56:08 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:56:08 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:56:08 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7be1391-ce84-4052-9bf7-5b9040fd1a60]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:56:08 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:56:08 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:56:08 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:56:08 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74b21e3-823a-40d2-9b68-7e26336ca8fd]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:56:08 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 (non-flash)
Apr 14 00:56:08 user nova-compute[82479]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408 (non-flash)
Apr 14 00:56:08 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:56:08 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 (non-flash)
Apr 14 00:56:08 user nova-compute[82479]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408 (non-flash)
Apr 14 00:56:08 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:56:08 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:56:08 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Connected to 172.16.0.220:3260 {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 00:56:08 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] HCTL ('34', '-', '-', 0) found on session 47 with lun 0 {{(pid=82479) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 00:56:08 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=82479) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 00:56:08 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:56:08 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:56:08 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c7082f-cbc6-459f-a600-82ae5f5d43a5]: (4, ('- - 0', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:56:08 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: None {{(pid=82479) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 00:56:09 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=82479) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 00:56:09 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QnZXrEdu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 00:56:09 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:56:09 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '23666616239386139', 'path': '/dev/sdc'} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:56:09 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23666616239386139', 'path': '/dev/sdc'} {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 00:56:09 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:56:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-907038285',display_name='tempest-TestVolumeBootPattern-server-907038285',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-907038285',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA04fSpZPZehkhB9f0sYv7pWCpEF+0Af0ha1AxWnn4wafUNVzRts+po3Hz8WLNc1o5rlWHs8ARX3jM/G2geverCNDjLTFUEFq/SUwWxk6uiLBWzBveljr9LVk4guW/E4ew==',key_name='tempest-TestVolumeBootPattern-128892553',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0934526a2dfa45f4bd5df4edee11d98a',ramdisk_id='',reservation_id='r-o6tu5cba',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-260409128',owner_user_name='tempest-TestVolumeBootPattern-260409128-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:56:03Z,user_data=None,user_id='cfb66031fcf84659a3b80cdb76ffddc0',uuid=a5054773-9558-4f36-8230-aa37370f4f67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "168aba6c-5b08-4df4-8d0b-d9d847bb80ca", "address": "fa:16:3e:0d:f3:72", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap168aba6c-5b", "ovs_interfaceid": "168aba6c-5b08-4df4-8d0b-d9d847bb80ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82479) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 00:56:09 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Converting VIF {"id": "168aba6c-5b08-4df4-8d0b-d9d847bb80ca", "address": "fa:16:3e:0d:f3:72", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap168aba6c-5b", "ovs_interfaceid": "168aba6c-5b08-4df4-8d0b-d9d847bb80ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:56:09 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:f3:72,bridge_name='br-int',has_traffic_filtering=True,id=168aba6c-5b08-4df4-8d0b-d9d847bb80ca,network=Network(6dec18bc-e73b-450e-b0d2-e36653017f20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap168aba6c-5b') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:56:09 user nova-compute[82479]: DEBUG nova.objects.instance [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lazy-loading 'pci_devices' on Instance uuid a5054773-9558-4f36-8230-aa37370f4f67 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:56:09 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: a5054773-9558-4f36-8230-aa37370f4f67] End _get_guest_xml xml=<domain type="kvm">
Apr 14 00:56:09 user nova-compute[82479]:   <uuid>a5054773-9558-4f36-8230-aa37370f4f67</uuid>
Apr 14 00:56:09 user nova-compute[82479]:   <name>instance-0000002d</name>
Apr 14 00:56:09 user nova-compute[82479]:   <memory>131072</memory>
Apr 14 00:56:09 user nova-compute[82479]:   <vcpu>1</vcpu>
Apr 14 00:56:09 user nova-compute[82479]:   <metadata>
Apr 14 00:56:09 user nova-compute[82479]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 00:56:09 user nova-compute[82479]:       <nova:package version="0.0.0"/>
Apr 14 00:56:09 user nova-compute[82479]:       <nova:name>tempest-TestVolumeBootPattern-server-907038285</nova:name>
Apr 14 00:56:09 user nova-compute[82479]:       <nova:creationTime>2023-04-14 00:56:07</nova:creationTime>
Apr 14 00:56:09 user nova-compute[82479]:       <nova:flavor name="m1.nano">
Apr 14 00:56:09 user nova-compute[82479]:         <nova:memory>128</nova:memory>
Apr 14 00:56:09 user nova-compute[82479]:         <nova:disk>1</nova:disk>
Apr 14 00:56:09 user nova-compute[82479]:         <nova:swap>0</nova:swap>
Apr 14 00:56:09 user nova-compute[82479]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 00:56:09 user nova-compute[82479]:         <nova:vcpus>1</nova:vcpus>
Apr 14 00:56:09 user nova-compute[82479]:       </nova:flavor>
Apr 14 00:56:09 user nova-compute[82479]:       <nova:owner>
Apr 14 00:56:09 user nova-compute[82479]:         <nova:user uuid="cfb66031fcf84659a3b80cdb76ffddc0">tempest-TestVolumeBootPattern-260409128-project-member</nova:user>
Apr 14 00:56:09 user nova-compute[82479]:         <nova:project uuid="0934526a2dfa45f4bd5df4edee11d98a">tempest-TestVolumeBootPattern-260409128</nova:project>
Apr 14 00:56:09 user nova-compute[82479]:       </nova:owner>
Apr 14 00:56:09 user nova-compute[82479]:       <nova:ports>
Apr 14 00:56:09 user nova-compute[82479]:         <nova:port uuid="168aba6c-5b08-4df4-8d0b-d9d847bb80ca">
Apr 14 00:56:09 user nova-compute[82479]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 14 00:56:09 user nova-compute[82479]:         </nova:port>
Apr 14 00:56:09 user nova-compute[82479]:       </nova:ports>
Apr 14 00:56:09 user nova-compute[82479]:     </nova:instance>
Apr 14 00:56:09 user nova-compute[82479]:   </metadata>
Apr 14 00:56:09 user nova-compute[82479]:   <sysinfo type="smbios">
Apr 14 00:56:09 user nova-compute[82479]:     <system>
Apr 14 00:56:09 user nova-compute[82479]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 00:56:09 user nova-compute[82479]:       <entry name="product">OpenStack Nova</entry>
Apr 14 00:56:09 user nova-compute[82479]:       <entry name="version">0.0.0</entry>
Apr 14 00:56:09 user nova-compute[82479]:       <entry name="serial">a5054773-9558-4f36-8230-aa37370f4f67</entry>
Apr 14 00:56:09 user nova-compute[82479]:       <entry name="uuid">a5054773-9558-4f36-8230-aa37370f4f67</entry>
Apr 14 00:56:09 user nova-compute[82479]:       <entry name="family">Virtual Machine</entry>
Apr 14 00:56:09 user nova-compute[82479]:     </system>
Apr 14 00:56:09 user nova-compute[82479]:   </sysinfo>
Apr 14 00:56:09 user nova-compute[82479]:   <os>
Apr 14 00:56:09 user nova-compute[82479]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 00:56:09 user nova-compute[82479]:     <boot dev="hd"/>
Apr 14 00:56:09 user nova-compute[82479]:     <smbios mode="sysinfo"/>
Apr 14 00:56:09 user nova-compute[82479]:   </os>
Apr 14 00:56:09 user nova-compute[82479]:   <features>
Apr 14 00:56:09 user nova-compute[82479]:     <acpi/>
Apr 14 00:56:09 user nova-compute[82479]:     <apic/>
Apr 14 00:56:09 user nova-compute[82479]:     <vmcoreinfo/>
Apr 14 00:56:09 user nova-compute[82479]:   </features>
Apr 14 00:56:09 user nova-compute[82479]:   <clock offset="utc">
Apr 14 00:56:09 user nova-compute[82479]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 00:56:09 user nova-compute[82479]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 00:56:09 user nova-compute[82479]:     <timer name="hpet" present="no"/>
Apr 14 00:56:09 user nova-compute[82479]:   </clock>
Apr 14 00:56:09 user nova-compute[82479]:   <cpu mode="custom" match="exact">
Apr 14 00:56:09 user nova-compute[82479]:     <model>Nehalem</model>
Apr 14 00:56:09 user nova-compute[82479]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 00:56:09 user nova-compute[82479]:   </cpu>
Apr 14 00:56:09 user nova-compute[82479]:   <devices>
Apr 14 00:56:09 user nova-compute[82479]:     <disk type="block" device="disk">
Apr 14 00:56:09 user nova-compute[82479]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 00:56:09 user nova-compute[82479]:       <source dev="/dev/sdc"/>
Apr 14 00:56:09 user nova-compute[82479]:       <target dev="vda" bus="virtio"/>
Apr 14 00:56:09 user nova-compute[82479]:       <serial>5f9b46b9-9e36-44ab-a556-a4e4360bc408</serial>
Apr 14 00:56:09 user nova-compute[82479]:     </disk>
Apr 14 00:56:09 user nova-compute[82479]:     <interface type="ethernet">
Apr 14 00:56:09 user nova-compute[82479]:       <mac address="fa:16:3e:0d:f3:72"/>
Apr 14 00:56:09 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:56:09 user nova-compute[82479]:       <mtu size="1442"/>
Apr 14 00:56:09 user nova-compute[82479]:       <target dev="tap168aba6c-5b"/>
Apr 14 00:56:09 user nova-compute[82479]:     </interface>
Apr 14 00:56:09 user nova-compute[82479]:     <serial type="pty">
Apr 14 00:56:09 user nova-compute[82479]:       <log file="/opt/stack/data/nova/instances/a5054773-9558-4f36-8230-aa37370f4f67/console.log" append="off"/>
Apr 14 00:56:09 user nova-compute[82479]:     </serial>
Apr 14 00:56:09 user nova-compute[82479]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 00:56:09 user nova-compute[82479]:     <video>
Apr 14 00:56:09 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 00:56:09 user nova-compute[82479]:     </video>
Apr 14 00:56:09 user nova-compute[82479]:     <rng model="virtio">
Apr 14 00:56:09 user nova-compute[82479]:       <backend model="random">/dev/urandom</backend>
Apr 14 00:56:09 user nova-compute[82479]:     </rng>
Apr 14 00:56:09 user nova-compute[82479]:     <controller type="usb" index="0" model="none"/>
Apr 14 00:56:09 user nova-compute[82479]:     <memballoon model="virtio">
Apr 14 00:56:09 user nova-compute[82479]:       <stats period="10"/>
Apr 14 00:56:09 user nova-compute[82479]:     </memballoon>
Apr 14 00:56:09 user nova-compute[82479]:   </devices>
Apr 14 00:56:09 user nova-compute[82479]: </domain>
Apr 14 00:56:09 user nova-compute[82479]:  {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 00:56:09 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:56:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-907038285',display_name='tempest-TestVolumeBootPattern-server-907038285',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-907038285',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA04fSpZPZehkhB9f0sYv7pWCpEF+0Af0ha1AxWnn4wafUNVzRts+po3Hz8WLNc1o5rlWHs8ARX3jM/G2geverCNDjLTFUEFq/SUwWxk6uiLBWzBveljr9LVk4guW/E4ew==',key_name='tempest-TestVolumeBootPattern-128892553',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0934526a2dfa45f4bd5df4edee11d98a',ramdisk_id='',reservation_id='r-o6tu5cba',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-260409128',owner_user_name='tempest-TestVolumeBootPattern-260409128-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T00:56:03Z,user_data=None,user_id='cfb66031fcf84659a3b80cdb76ffddc0',uuid=a5054773-9558-4f36-8230-aa37370f4f67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "168aba6c-5b08-4df4-8d0b-d9d847bb80ca", "address": "fa:16:3e:0d:f3:72", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap168aba6c-5b", "ovs_interfaceid": "168aba6c-5b08-4df4-8d0b-d9d847bb80ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 00:56:09 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Converting VIF {"id": "168aba6c-5b08-4df4-8d0b-d9d847bb80ca", "address": "fa:16:3e:0d:f3:72", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap168aba6c-5b", "ovs_interfaceid": "168aba6c-5b08-4df4-8d0b-d9d847bb80ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:56:09 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:f3:72,bridge_name='br-int',has_traffic_filtering=True,id=168aba6c-5b08-4df4-8d0b-d9d847bb80ca,network=Network(6dec18bc-e73b-450e-b0d2-e36653017f20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap168aba6c-5b') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:56:09 user nova-compute[82479]: DEBUG os_vif [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:f3:72,bridge_name='br-int',has_traffic_filtering=True,id=168aba6c-5b08-4df4-8d0b-d9d847bb80ca,network=Network(6dec18bc-e73b-450e-b0d2-e36653017f20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap168aba6c-5b') {{(pid=82479) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 00:56:09 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:56:09 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:56:09 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 00:56:09 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:56:09 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap168aba6c-5b, may_exist=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:56:09 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap168aba6c-5b, col_values=(('external_ids', {'iface-id': '168aba6c-5b08-4df4-8d0b-d9d847bb80ca', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:f3:72', 'vm-uuid': 'a5054773-9558-4f36-8230-aa37370f4f67'}),)) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:56:09 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:56:09 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:56:09 user nova-compute[82479]: INFO os_vif [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:f3:72,bridge_name='br-int',has_traffic_filtering=True,id=168aba6c-5b08-4df4-8d0b-d9d847bb80ca,network=Network(6dec18bc-e73b-450e-b0d2-e36653017f20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap168aba6c-5b')
Apr 14 00:56:09 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 00:56:09 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] No VIF found with MAC fa:16:3e:0d:f3:72, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 00:56:10 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:56:10 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:56:10 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:56:10 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:56:10 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:56:10 user nova-compute[82479]: DEBUG nova.compute.manager [req-0ca4d51e-4946-4986-9dcb-d44021780309 req-062b9963-39fd-4355-9e49-a99e08569be2 service nova] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Received event network-vif-plugged-168aba6c-5b08-4df4-8d0b-d9d847bb80ca {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:56:10 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0ca4d51e-4946-4986-9dcb-d44021780309 req-062b9963-39fd-4355-9e49-a99e08569be2 service nova] Acquiring lock "a5054773-9558-4f36-8230-aa37370f4f67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:56:10 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0ca4d51e-4946-4986-9dcb-d44021780309 req-062b9963-39fd-4355-9e49-a99e08569be2 service nova] Lock "a5054773-9558-4f36-8230-aa37370f4f67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:56:10 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-0ca4d51e-4946-4986-9dcb-d44021780309 req-062b9963-39fd-4355-9e49-a99e08569be2 service nova] Lock "a5054773-9558-4f36-8230-aa37370f4f67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:56:10 user nova-compute[82479]: DEBUG nova.compute.manager [req-0ca4d51e-4946-4986-9dcb-d44021780309 req-062b9963-39fd-4355-9e49-a99e08569be2 service nova] [instance: a5054773-9558-4f36-8230-aa37370f4f67] No waiting events found dispatching network-vif-plugged-168aba6c-5b08-4df4-8d0b-d9d847bb80ca {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:56:10 user nova-compute[82479]: WARNING nova.compute.manager [req-0ca4d51e-4946-4986-9dcb-d44021780309 req-062b9963-39fd-4355-9e49-a99e08569be2 service nova] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Received unexpected event network-vif-plugged-168aba6c-5b08-4df4-8d0b-d9d847bb80ca for instance with vm_state building and task_state spawning.
Apr 14 00:56:12 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:56:12 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681433772.5856643, a5054773-9558-4f36-8230-aa37370f4f67 => Resumed> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:56:12 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: a5054773-9558-4f36-8230-aa37370f4f67] VM Resumed (Lifecycle Event)
Apr 14 00:56:12 user nova-compute[82479]: DEBUG nova.compute.manager [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Instance event wait completed in 0 seconds for  {{(pid=82479) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 00:56:12 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Guest created on hypervisor {{(pid=82479) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 00:56:12 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Instance spawned successfully.
Apr 14 00:56:12 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 00:56:12 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:56:12 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:56:12 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Found default for hw_cdrom_bus of ide {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:56:12 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Found default for hw_disk_bus of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:56:12 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Found default for hw_input_bus of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:56:12 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Found default for hw_pointer_model of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:56:12 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Found default for hw_video_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:56:12 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Found default for hw_vif_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 00:56:12 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: a5054773-9558-4f36-8230-aa37370f4f67] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:56:12 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681433772.588245, a5054773-9558-4f36-8230-aa37370f4f67 => Started> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:56:12 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: a5054773-9558-4f36-8230-aa37370f4f67] VM Started (Lifecycle Event)
Apr 14 00:56:12 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:56:12 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 00:56:12 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: a5054773-9558-4f36-8230-aa37370f4f67] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 00:56:12 user nova-compute[82479]: INFO nova.compute.manager [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Took 4.91 seconds to spawn the instance on the hypervisor.
Apr 14 00:56:12 user nova-compute[82479]: DEBUG nova.compute.manager [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:56:12 user nova-compute[82479]: INFO nova.compute.manager [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Took 10.20 seconds to build instance.
Apr 14 00:56:12 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a0654322-1487-4019-bb81-13bff8e9efe5 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "a5054773-9558-4f36-8230-aa37370f4f67" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.292s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:56:12 user nova-compute[82479]: DEBUG nova.compute.manager [req-3f26bb7f-aa72-45da-97c3-3bf23c936d7e req-f982f894-951d-4039-8ec6-aaa73df7f0c1 service nova] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Received event network-vif-plugged-168aba6c-5b08-4df4-8d0b-d9d847bb80ca {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:56:12 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-3f26bb7f-aa72-45da-97c3-3bf23c936d7e req-f982f894-951d-4039-8ec6-aaa73df7f0c1 service nova] Acquiring lock "a5054773-9558-4f36-8230-aa37370f4f67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:56:12 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-3f26bb7f-aa72-45da-97c3-3bf23c936d7e req-f982f894-951d-4039-8ec6-aaa73df7f0c1 service nova] Lock "a5054773-9558-4f36-8230-aa37370f4f67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:56:12 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-3f26bb7f-aa72-45da-97c3-3bf23c936d7e req-f982f894-951d-4039-8ec6-aaa73df7f0c1 service nova] Lock "a5054773-9558-4f36-8230-aa37370f4f67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:56:12 user nova-compute[82479]: DEBUG nova.compute.manager [req-3f26bb7f-aa72-45da-97c3-3bf23c936d7e req-f982f894-951d-4039-8ec6-aaa73df7f0c1 service nova] [instance: a5054773-9558-4f36-8230-aa37370f4f67] No waiting events found dispatching network-vif-plugged-168aba6c-5b08-4df4-8d0b-d9d847bb80ca {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:56:12 user nova-compute[82479]: WARNING nova.compute.manager [req-3f26bb7f-aa72-45da-97c3-3bf23c936d7e req-f982f894-951d-4039-8ec6-aaa73df7f0c1 service nova] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Received unexpected event network-vif-plugged-168aba6c-5b08-4df4-8d0b-d9d847bb80ca for instance with vm_state active and task_state None.
Apr 14 00:56:14 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:56:19 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:56:21 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:56:24 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:56:25 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:56:25 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Starting heal instance info cache {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 00:56:25 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Rebuilding the list of instances to heal {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 00:56:25 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "refresh_cache-98479cbe-09c7-40ee-a5cc-1b872dd9fbf7" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:56:25 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquired lock "refresh_cache-98479cbe-09c7-40ee-a5cc-1b872dd9fbf7" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:56:25 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Forcefully refreshing network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 00:56:25 user nova-compute[82479]: DEBUG nova.objects.instance [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lazy-loading 'info_cache' on Instance uuid 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:56:26 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Updating instance_info_cache with network_info: [{"id": "d339fae5-6ce4-49ea-85eb-45933ebf36eb", "address": "fa:16:3e:58:99:ac", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd339fae5-6c", "ovs_interfaceid": "d339fae5-6ce4-49ea-85eb-45933ebf36eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:56:26 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Releasing lock "refresh_cache-98479cbe-09c7-40ee-a5cc-1b872dd9fbf7" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:56:26 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Updated the network info_cache for instance {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 00:56:27 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:56:28 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:56:28 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:56:28 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:56:28 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Cleaning up deleted instances {{(pid=82479) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 00:56:28 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] There are 0 instances to clean {{(pid=82479) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 00:56:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:56:32 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:56:33 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:56:33 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82479) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 00:56:33 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:56:33 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:56:33 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:56:33 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:56:33 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Auditing locally available compute resources for user (node: user) {{(pid=82479) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 00:56:33 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:56:33 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:56:34 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:56:34 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:56:34 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Hypervisor/Node resource view: name=user free_ram=8641MB free_disk=26.15176010131836GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82479) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 00:56:34 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:56:34 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:56:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:56:34 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:56:34 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance a5054773-9558-4f36-8230-aa37370f4f67 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:56:34 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 00:56:34 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 00:56:34 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Refreshing inventories for resource provider 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 00:56:34 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Updating ProviderTree inventory for provider 3847975a-19aa-4b27-9180-14b5cc49044a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 00:56:34 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Updating inventory in ProviderTree for provider 3847975a-19aa-4b27-9180-14b5cc49044a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 00:56:34 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Refreshing aggregate associations for resource provider 3847975a-19aa-4b27-9180-14b5cc49044a, aggregates: None {{(pid=82479) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 00:56:34 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Refreshing trait associations for resource provider 3847975a-19aa-4b27-9180-14b5cc49044a, traits: COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,HW_CPU_X86_SSE42,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO {{(pid=82479) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 00:56:34 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:56:34 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:56:34 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Compute_service record updated for user:user {{(pid=82479) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 00:56:34 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.530s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:56:38 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:56:39 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:56:39 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:56:39 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:56:39 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:56:39 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:56:39 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:56:42 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:56:42 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:56:43 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:56:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:56:47 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:56:48 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:56:48 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Cleaning up deleted instances with incomplete migration  {{(pid=82479) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 00:56:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:56:54 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:56:59 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:57:02 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:57:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:57:08 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:57:09 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:57:14 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:57:19 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:57:21 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:57:24 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:57:27 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:57:27 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:57:27 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Starting heal instance info cache {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 00:57:27 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "refresh_cache-a5054773-9558-4f36-8230-aa37370f4f67" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:57:27 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquired lock "refresh_cache-a5054773-9558-4f36-8230-aa37370f4f67" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:57:27 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Forcefully refreshing network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 00:57:28 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Updating instance_info_cache with network_info: [{"id": "168aba6c-5b08-4df4-8d0b-d9d847bb80ca", "address": "fa:16:3e:0d:f3:72", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap168aba6c-5b", "ovs_interfaceid": "168aba6c-5b08-4df4-8d0b-d9d847bb80ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:57:28 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Releasing lock "refresh_cache-a5054773-9558-4f36-8230-aa37370f4f67" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:57:28 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Updated the network info_cache for instance {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 00:57:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:57:30 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:57:31 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:57:33 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:57:33 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82479) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 00:57:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:57:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:57:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:57:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:57:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:57:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:57:35 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:57:35 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:57:35 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:57:35 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:57:35 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Auditing locally available compute resources for user (node: user) {{(pid=82479) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 00:57:35 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:57:35 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:57:36 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:57:36 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:57:36 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Hypervisor/Node resource view: name=user free_ram=8737MB free_disk=26.151153564453125GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82479) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 00:57:36 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:57:36 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:57:36 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:57:36 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance a5054773-9558-4f36-8230-aa37370f4f67 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:57:36 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 00:57:36 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 00:57:36 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:57:36 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:57:36 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Compute_service record updated for user:user {{(pid=82479) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 00:57:36 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.195s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:57:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:57:39 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:57:40 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:57:43 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:57:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:57:44 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:57:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:57:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:57:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:57:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:57:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:57:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:57:53 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:57:54 user nova-compute[82479]: DEBUG nova.compute.manager [req-a74bffa1-f767-4a87-8c7b-db6368cca5bf req-033e7768-f3a4-4476-9f67-0fc9a9546082 service nova] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Received event network-changed-168aba6c-5b08-4df4-8d0b-d9d847bb80ca {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:57:54 user nova-compute[82479]: DEBUG nova.compute.manager [req-a74bffa1-f767-4a87-8c7b-db6368cca5bf req-033e7768-f3a4-4476-9f67-0fc9a9546082 service nova] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Refreshing instance network info cache due to event network-changed-168aba6c-5b08-4df4-8d0b-d9d847bb80ca. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:57:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-a74bffa1-f767-4a87-8c7b-db6368cca5bf req-033e7768-f3a4-4476-9f67-0fc9a9546082 service nova] Acquiring lock "refresh_cache-a5054773-9558-4f36-8230-aa37370f4f67" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:57:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-a74bffa1-f767-4a87-8c7b-db6368cca5bf req-033e7768-f3a4-4476-9f67-0fc9a9546082 service nova] Acquired lock "refresh_cache-a5054773-9558-4f36-8230-aa37370f4f67" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:57:54 user nova-compute[82479]: DEBUG nova.network.neutron [req-a74bffa1-f767-4a87-8c7b-db6368cca5bf req-033e7768-f3a4-4476-9f67-0fc9a9546082 service nova] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Refreshing network info cache for port 168aba6c-5b08-4df4-8d0b-d9d847bb80ca {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:57:54 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:57:54 user nova-compute[82479]: DEBUG nova.network.neutron [req-a74bffa1-f767-4a87-8c7b-db6368cca5bf req-033e7768-f3a4-4476-9f67-0fc9a9546082 service nova] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Updated VIF entry in instance network info cache for port 168aba6c-5b08-4df4-8d0b-d9d847bb80ca. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:57:54 user nova-compute[82479]: DEBUG nova.network.neutron [req-a74bffa1-f767-4a87-8c7b-db6368cca5bf req-033e7768-f3a4-4476-9f67-0fc9a9546082 service nova] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Updating instance_info_cache with network_info: [{"id": "168aba6c-5b08-4df4-8d0b-d9d847bb80ca", "address": "fa:16:3e:0d:f3:72", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap168aba6c-5b", "ovs_interfaceid": "168aba6c-5b08-4df4-8d0b-d9d847bb80ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:57:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-a74bffa1-f767-4a87-8c7b-db6368cca5bf req-033e7768-f3a4-4476-9f67-0fc9a9546082 service nova] Releasing lock "refresh_cache-a5054773-9558-4f36-8230-aa37370f4f67" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:57:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f5a3bc02-8c78-4694-91ef-c7df6ec19d87 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "a5054773-9558-4f36-8230-aa37370f4f67" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:57:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f5a3bc02-8c78-4694-91ef-c7df6ec19d87 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "a5054773-9558-4f36-8230-aa37370f4f67" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:57:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f5a3bc02-8c78-4694-91ef-c7df6ec19d87 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "a5054773-9558-4f36-8230-aa37370f4f67-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:57:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f5a3bc02-8c78-4694-91ef-c7df6ec19d87 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "a5054773-9558-4f36-8230-aa37370f4f67-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:57:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f5a3bc02-8c78-4694-91ef-c7df6ec19d87 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "a5054773-9558-4f36-8230-aa37370f4f67-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:57:55 user nova-compute[82479]: INFO nova.compute.manager [None req-f5a3bc02-8c78-4694-91ef-c7df6ec19d87 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Terminating instance
Apr 14 00:57:55 user nova-compute[82479]: DEBUG nova.compute.manager [None req-f5a3bc02-8c78-4694-91ef-c7df6ec19d87 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Start destroying the instance on the hypervisor. {{(pid=82479) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 00:57:55 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:57:55 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:57:56 user nova-compute[82479]: DEBUG nova.compute.manager [req-7feb08d4-f569-4d92-a21d-7412e2a151a1 req-438ce058-8162-47cf-808e-8de9dba09dcd service nova] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Received event network-changed-168aba6c-5b08-4df4-8d0b-d9d847bb80ca {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:57:56 user nova-compute[82479]: DEBUG nova.compute.manager [req-7feb08d4-f569-4d92-a21d-7412e2a151a1 req-438ce058-8162-47cf-808e-8de9dba09dcd service nova] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Refreshing instance network info cache due to event network-changed-168aba6c-5b08-4df4-8d0b-d9d847bb80ca. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:57:56 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-7feb08d4-f569-4d92-a21d-7412e2a151a1 req-438ce058-8162-47cf-808e-8de9dba09dcd service nova] Acquiring lock "refresh_cache-a5054773-9558-4f36-8230-aa37370f4f67" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:57:56 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-7feb08d4-f569-4d92-a21d-7412e2a151a1 req-438ce058-8162-47cf-808e-8de9dba09dcd service nova] Acquired lock "refresh_cache-a5054773-9558-4f36-8230-aa37370f4f67" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:57:56 user nova-compute[82479]: DEBUG nova.network.neutron [req-7feb08d4-f569-4d92-a21d-7412e2a151a1 req-438ce058-8162-47cf-808e-8de9dba09dcd service nova] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Refreshing network info cache for port 168aba6c-5b08-4df4-8d0b-d9d847bb80ca {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:57:56 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:57:56 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:57:56 user nova-compute[82479]: DEBUG nova.compute.manager [req-b6fa76e7-7b2f-46df-90a1-8acf95b2b0d7 req-4b26aacd-2a88-4910-ac8e-330cf48a5310 service nova] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Received event network-vif-unplugged-168aba6c-5b08-4df4-8d0b-d9d847bb80ca {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:57:56 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-b6fa76e7-7b2f-46df-90a1-8acf95b2b0d7 req-4b26aacd-2a88-4910-ac8e-330cf48a5310 service nova] Acquiring lock "a5054773-9558-4f36-8230-aa37370f4f67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:57:56 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-b6fa76e7-7b2f-46df-90a1-8acf95b2b0d7 req-4b26aacd-2a88-4910-ac8e-330cf48a5310 service nova] Lock "a5054773-9558-4f36-8230-aa37370f4f67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:57:56 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-b6fa76e7-7b2f-46df-90a1-8acf95b2b0d7 req-4b26aacd-2a88-4910-ac8e-330cf48a5310 service nova] Lock "a5054773-9558-4f36-8230-aa37370f4f67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:57:56 user nova-compute[82479]: DEBUG nova.compute.manager [req-b6fa76e7-7b2f-46df-90a1-8acf95b2b0d7 req-4b26aacd-2a88-4910-ac8e-330cf48a5310 service nova] [instance: a5054773-9558-4f36-8230-aa37370f4f67] No waiting events found dispatching network-vif-unplugged-168aba6c-5b08-4df4-8d0b-d9d847bb80ca {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:57:56 user nova-compute[82479]: DEBUG nova.compute.manager [req-b6fa76e7-7b2f-46df-90a1-8acf95b2b0d7 req-4b26aacd-2a88-4910-ac8e-330cf48a5310 service nova] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Received event network-vif-unplugged-168aba6c-5b08-4df4-8d0b-d9d847bb80ca for instance with task_state deleting. {{(pid=82479) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 00:57:56 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Instance destroyed successfully.
Apr 14 00:57:56 user nova-compute[82479]: DEBUG nova.objects.instance [None req-f5a3bc02-8c78-4694-91ef-c7df6ec19d87 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lazy-loading 'resources' on Instance uuid a5054773-9558-4f36-8230-aa37370f4f67 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:57:56 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-f5a3bc02-8c78-4694-91ef-c7df6ec19d87 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:56:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-907038285',display_name='tempest-TestVolumeBootPattern-server-907038285',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-907038285',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA04fSpZPZehkhB9f0sYv7pWCpEF+0Af0ha1AxWnn4wafUNVzRts+po3Hz8WLNc1o5rlWHs8ARX3jM/G2geverCNDjLTFUEFq/SUwWxk6uiLBWzBveljr9LVk4guW/E4ew==',key_name='tempest-TestVolumeBootPattern-128892553',keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:56:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0934526a2dfa45f4bd5df4edee11d98a',ramdisk_id='',reservation_id='r-o6tu5cba',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-260409128',owner_user_name='tempest-TestVolumeBootPattern-260409128-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T00:56:13Z,user_data=None,user_id='cfb66031fcf84659a3b80cdb76ffddc0',uuid=a5054773-9558-4f36-8230-aa37370f4f67,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "168aba6c-5b08-4df4-8d0b-d9d847bb80ca", "address": "fa:16:3e:0d:f3:72", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap168aba6c-5b", "ovs_interfaceid": "168aba6c-5b08-4df4-8d0b-d9d847bb80ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 00:57:56 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-f5a3bc02-8c78-4694-91ef-c7df6ec19d87 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Converting VIF {"id": "168aba6c-5b08-4df4-8d0b-d9d847bb80ca", "address": "fa:16:3e:0d:f3:72", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap168aba6c-5b", "ovs_interfaceid": "168aba6c-5b08-4df4-8d0b-d9d847bb80ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:57:56 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-f5a3bc02-8c78-4694-91ef-c7df6ec19d87 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0d:f3:72,bridge_name='br-int',has_traffic_filtering=True,id=168aba6c-5b08-4df4-8d0b-d9d847bb80ca,network=Network(6dec18bc-e73b-450e-b0d2-e36653017f20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap168aba6c-5b') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:57:56 user nova-compute[82479]: DEBUG os_vif [None req-f5a3bc02-8c78-4694-91ef-c7df6ec19d87 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:f3:72,bridge_name='br-int',has_traffic_filtering=True,id=168aba6c-5b08-4df4-8d0b-d9d847bb80ca,network=Network(6dec18bc-e73b-450e-b0d2-e36653017f20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap168aba6c-5b') {{(pid=82479) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 00:57:56 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:57:56 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap168aba6c-5b, bridge=br-int, if_exists=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:57:56 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:57:56 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:57:56 user nova-compute[82479]: INFO os_vif [None req-f5a3bc02-8c78-4694-91ef-c7df6ec19d87 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:f3:72,bridge_name='br-int',has_traffic_filtering=True,id=168aba6c-5b08-4df4-8d0b-d9d847bb80ca,network=Network(6dec18bc-e73b-450e-b0d2-e36653017f20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap168aba6c-5b')
Apr 14 00:57:56 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5a3bc02-8c78-4694-91ef-c7df6ec19d87 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: a5054773-9558-4f36-8230-aa37370f4f67] calling os-brick to detach iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 00:57:56 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a3bc02-8c78-4694-91ef-c7df6ec19d87 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, {'target_iqn': 'iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QnZXrEdu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:57:56 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-f5a3bc02-8c78-4694-91ef-c7df6ec19d87 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:57:56 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-f5a3bc02-8c78-4694-91ef-c7df6ec19d87 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:57:56 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-f5a3bc02-8c78-4694-91ef-c7df6ec19d87 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:57:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:57:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:57:56 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[a362f22e-3eb0-4452-8b39-da7516665da7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:57:56 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a3bc02-8c78-4694-91ef-c7df6ec19d87 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 00:57:56 user nova-compute[82479]: No targets found.
Apr 14 00:57:56 user nova-compute[82479]: iSNS:
Apr 14 00:57:56 user nova-compute[82479]: No targets found.
Apr 14 00:57:56 user nova-compute[82479]: STATIC:
Apr 14 00:57:56 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7
Apr 14 00:57:56 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:57:56 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:57:56 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408
Apr 14 00:57:56 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:57:56 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:57:56 user nova-compute[82479]: FIRMWARE:
Apr 14 00:57:56 user nova-compute[82479]: No targets found.
Apr 14 00:57:56 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:57:56 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a3bc02-8c78-4694-91ef-c7df6ec19d87 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 00:57:56 user nova-compute[82479]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 00:57:56 user nova-compute[82479]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82479) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 00:57:56 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a3bc02-8c78-4694-91ef-c7df6ec19d87 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408', 0)] {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 00:57:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:57:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:57:56 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e38b7f-7b06-4c8c-9966-91b4c8e74335]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:57:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:57:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:57:56 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a5fcc1-b032-45b0-82c2-1d5372350b16]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:57:56 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a3bc02-8c78-4694-91ef-c7df6ec19d87 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 (non-flash)
Apr 14 00:57:56 user nova-compute[82479]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408 (non-flash)
Apr 14 00:57:56 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:57:56 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a3bc02-8c78-4694-91ef-c7df6ec19d87 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 (non-flash)
Apr 14 00:57:56 user nova-compute[82479]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408 (non-flash)
Apr 14 00:57:56 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:57:56 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a3bc02-8c78-4694-91ef-c7df6ec19d87 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f330c64a5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408'): ({'sdc'}, set())}) {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 00:57:56 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-f5a3bc02-8c78-4694-91ef-c7df6ec19d87 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Removing single pathed devices sdc {{(pid=82479) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 00:57:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:57:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:57:56 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19b4551-dc25-4104-a7f5-d8cccd6b761c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:57:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:57:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:57:56 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[390e1105-34a7-4ca7-9eae-a22dda27b196]: (4, ('ok\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:57:56 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-f5a3bc02-8c78-4694-91ef-c7df6ec19d87 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Flushing IO for device /dev/sdc {{(pid=82479) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 00:57:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:57:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:57:56 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8f7a10-23db-4da8-b344-291b8c543d48]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:57:56 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-f5a3bc02-8c78-4694-91ef-c7df6ec19d87 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=82479) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 00:57:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:57:56 user nova-compute[82479]: DEBUG nova.network.neutron [req-7feb08d4-f569-4d92-a21d-7412e2a151a1 req-438ce058-8162-47cf-808e-8de9dba09dcd service nova] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Updated VIF entry in instance network info cache for port 168aba6c-5b08-4df4-8d0b-d9d847bb80ca. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:57:56 user nova-compute[82479]: DEBUG nova.network.neutron [req-7feb08d4-f569-4d92-a21d-7412e2a151a1 req-438ce058-8162-47cf-808e-8de9dba09dcd service nova] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Updating instance_info_cache with network_info: [{"id": "168aba6c-5b08-4df4-8d0b-d9d847bb80ca", "address": "fa:16:3e:0d:f3:72", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap168aba6c-5b", "ovs_interfaceid": "168aba6c-5b08-4df4-8d0b-d9d847bb80ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:57:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:57:56 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb97896-2edb-4305-a8aa-3a09ac07f8f7]: (4, ('1', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:57:56 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-f5a3bc02-8c78-4694-91ef-c7df6ec19d87 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 00:57:56 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-f5a3bc02-8c78-4694-91ef-c7df6ec19d87 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] SCSI volumes sdc have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 00:57:56 user nova-compute[82479]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23666616239386139', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_9a8692af', '/dev/disk/by-id/scsi-1SCST_BIO9a8692af-6fab98a9a55af27f') {{(pid=93289) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 14 00:57:56 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[56281f5f-0dc1-45ab-90d7-0284519ecbde]: (4, None) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:57:56 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a3bc02-8c78-4694-91ef-c7df6ec19d87 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408')] {{(pid=82479) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 00:57:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:57:56 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-7feb08d4-f569-4d92-a21d-7412e2a151a1 req-438ce058-8162-47cf-808e-8de9dba09dcd service nova] Releasing lock "refresh_cache-a5054773-9558-4f36-8230-aa37370f4f67" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:57:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:57:56 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e31a18-3110-4721-b136-cc4c120332dd]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:57:56 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a3bc02-8c78-4694-91ef-c7df6ec19d87 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:57:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408 -p 172.16.0.220:3260 --logout {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:57:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:57:56 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[f907ed57-5532-4a84-a140-995f229f1417]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:57:56 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a3bc02-8c78-4694-91ef-c7df6ec19d87 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408, portal: 172.16.0.220,3260]
Apr 14 00:57:56 user nova-compute[82479]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408, portal: 172.16.0.220,3260] successful.
Apr 14 00:57:56 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:57:56 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408 -p 172.16.0.220:3260 --op delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:57:57 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:57:57 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[315f62a7-40d9-4027-be55-0a9406811b8b]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:57:57 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a3bc02-8c78-4694-91ef-c7df6ec19d87 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:57:57 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-f5a3bc02-8c78-4694-91ef-c7df6ec19d87 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:57:57 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a3bc02-8c78-4694-91ef-c7df6ec19d87 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] <== disconnect_volume: return (330ms) None {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:57:57 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5a3bc02-8c78-4694-91ef-c7df6ec19d87 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Disconnected iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 00:57:57 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-f5a3bc02-8c78-4694-91ef-c7df6ec19d87 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Deleting instance files /opt/stack/data/nova/instances/a5054773-9558-4f36-8230-aa37370f4f67_del
Apr 14 00:57:57 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-f5a3bc02-8c78-4694-91ef-c7df6ec19d87 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Deletion of /opt/stack/data/nova/instances/a5054773-9558-4f36-8230-aa37370f4f67_del complete
Apr 14 00:57:57 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:57:57 user nova-compute[82479]: INFO nova.compute.manager [None req-f5a3bc02-8c78-4694-91ef-c7df6ec19d87 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Took 1.19 seconds to destroy the instance on the hypervisor.
Apr 14 00:57:57 user nova-compute[82479]: DEBUG oslo.service.loopingcall [None req-f5a3bc02-8c78-4694-91ef-c7df6ec19d87 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82479) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 00:57:57 user nova-compute[82479]: DEBUG nova.compute.manager [-] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Deallocating network for instance {{(pid=82479) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 00:57:57 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: a5054773-9558-4f36-8230-aa37370f4f67] deallocate_for_instance() {{(pid=82479) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 00:57:57 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Updating instance_info_cache with network_info: [] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:57:57 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Took 0.42 seconds to deallocate network for instance.
Apr 14 00:57:58 user nova-compute[82479]: DEBUG nova.compute.manager [req-816bd809-1660-4ec2-b8a5-92874e98d46b req-186535ab-7bec-4ad8-9438-0ee4bfec902f service nova] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Received event network-vif-deleted-168aba6c-5b08-4df4-8d0b-d9d847bb80ca {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:57:58 user nova-compute[82479]: DEBUG nova.compute.manager [req-871dc35e-7d6b-4998-8207-0f0b3a91235d req-432aeb0c-6582-4866-94c9-657f36c38d56 service nova] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Received event network-vif-plugged-168aba6c-5b08-4df4-8d0b-d9d847bb80ca {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:57:58 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-871dc35e-7d6b-4998-8207-0f0b3a91235d req-432aeb0c-6582-4866-94c9-657f36c38d56 service nova] Acquiring lock "a5054773-9558-4f36-8230-aa37370f4f67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:57:58 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-871dc35e-7d6b-4998-8207-0f0b3a91235d req-432aeb0c-6582-4866-94c9-657f36c38d56 service nova] Lock "a5054773-9558-4f36-8230-aa37370f4f67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:57:58 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-871dc35e-7d6b-4998-8207-0f0b3a91235d req-432aeb0c-6582-4866-94c9-657f36c38d56 service nova] Lock "a5054773-9558-4f36-8230-aa37370f4f67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:57:58 user nova-compute[82479]: DEBUG nova.compute.manager [req-871dc35e-7d6b-4998-8207-0f0b3a91235d req-432aeb0c-6582-4866-94c9-657f36c38d56 service nova] [instance: a5054773-9558-4f36-8230-aa37370f4f67] No waiting events found dispatching network-vif-plugged-168aba6c-5b08-4df4-8d0b-d9d847bb80ca {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:57:58 user nova-compute[82479]: WARNING nova.compute.manager [req-871dc35e-7d6b-4998-8207-0f0b3a91235d req-432aeb0c-6582-4866-94c9-657f36c38d56 service nova] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Received unexpected event network-vif-plugged-168aba6c-5b08-4df4-8d0b-d9d847bb80ca for instance with vm_state active and task_state deleting.
Apr 14 00:57:58 user nova-compute[82479]: INFO nova.compute.manager [None req-f5a3bc02-8c78-4694-91ef-c7df6ec19d87 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Took 1.01 seconds to detach 1 volumes for instance.
Apr 14 00:57:58 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f5a3bc02-8c78-4694-91ef-c7df6ec19d87 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:57:58 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f5a3bc02-8c78-4694-91ef-c7df6ec19d87 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:57:58 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-f5a3bc02-8c78-4694-91ef-c7df6ec19d87 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:57:58 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-f5a3bc02-8c78-4694-91ef-c7df6ec19d87 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:57:58 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f5a3bc02-8c78-4694-91ef-c7df6ec19d87 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.130s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:57:58 user nova-compute[82479]: INFO nova.scheduler.client.report [None req-f5a3bc02-8c78-4694-91ef-c7df6ec19d87 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Deleted allocations for instance a5054773-9558-4f36-8230-aa37370f4f67
Apr 14 00:57:58 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f5a3bc02-8c78-4694-91ef-c7df6ec19d87 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "a5054773-9558-4f36-8230-aa37370f4f67" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.962s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:58:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:58:06 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:58:11 user nova-compute[82479]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681433876.632174, a5054773-9558-4f36-8230-aa37370f4f67 => Stopped> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:58:11 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: a5054773-9558-4f36-8230-aa37370f4f67] VM Stopped (Lifecycle Event)
Apr 14 00:58:11 user nova-compute[82479]: DEBUG nova.compute.manager [None req-97a68dde-b7ed-40a0-87e2-f46d98ee9ea4 None None] [instance: a5054773-9558-4f36-8230-aa37370f4f67] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:58:11 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:58:11 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:58:11 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:58:11 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:58:11 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:58:11 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:58:16 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:58:21 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:58:22 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:58:26 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:58:26 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:58:26 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:58:26 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:58:26 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:58:26 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:58:28 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:58:28 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Starting heal instance info cache {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 00:58:28 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Rebuilding the list of instances to heal {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 00:58:28 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "refresh_cache-98479cbe-09c7-40ee-a5cc-1b872dd9fbf7" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:58:28 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquired lock "refresh_cache-98479cbe-09c7-40ee-a5cc-1b872dd9fbf7" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:58:28 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Forcefully refreshing network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 00:58:28 user nova-compute[82479]: DEBUG nova.objects.instance [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lazy-loading 'info_cache' on Instance uuid 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:58:29 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Updating instance_info_cache with network_info: [{"id": "d339fae5-6ce4-49ea-85eb-45933ebf36eb", "address": "fa:16:3e:58:99:ac", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd339fae5-6c", "ovs_interfaceid": "d339fae5-6ce4-49ea-85eb-45933ebf36eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:58:29 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Releasing lock "refresh_cache-98479cbe-09c7-40ee-a5cc-1b872dd9fbf7" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:58:29 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Updated the network info_cache for instance {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 00:58:30 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:58:30 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:58:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:58:33 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:58:33 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82479) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 00:58:36 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:58:37 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:58:37 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:58:37 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:58:37 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:58:37 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Auditing locally available compute resources for user (node: user) {{(pid=82479) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 00:58:37 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=82479) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 00:58:38 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:58:38 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:58:38 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Hypervisor/Node resource view: name=user free_ram=8807MB free_disk=26.142425537109375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82479) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 00:58:38 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:58:38 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:58:38 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 00:58:38 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 00:58:38 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 00:58:38 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:58:38 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:58:38 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Compute_service record updated for user:user {{(pid=82479) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 00:58:38 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.379s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:58:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:58:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:58:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:58:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:58:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:58:41 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:58:42 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:58:44 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:58:44 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:58:46 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:58:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:58:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:58:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:58:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:58:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:58:51 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:58:52 user nova-compute[82479]: DEBUG nova.compute.manager [req-1c505550-4f74-4fc2-8e5f-b8452b89f0a8 req-289946a0-0583-454b-897e-cc3a6cb047ee service nova] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Received event network-changed-d339fae5-6ce4-49ea-85eb-45933ebf36eb {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:58:52 user nova-compute[82479]: DEBUG nova.compute.manager [req-1c505550-4f74-4fc2-8e5f-b8452b89f0a8 req-289946a0-0583-454b-897e-cc3a6cb047ee service nova] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Refreshing instance network info cache due to event network-changed-d339fae5-6ce4-49ea-85eb-45933ebf36eb. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 00:58:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-1c505550-4f74-4fc2-8e5f-b8452b89f0a8 req-289946a0-0583-454b-897e-cc3a6cb047ee service nova] Acquiring lock "refresh_cache-98479cbe-09c7-40ee-a5cc-1b872dd9fbf7" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 00:58:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-1c505550-4f74-4fc2-8e5f-b8452b89f0a8 req-289946a0-0583-454b-897e-cc3a6cb047ee service nova] Acquired lock "refresh_cache-98479cbe-09c7-40ee-a5cc-1b872dd9fbf7" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 00:58:52 user nova-compute[82479]: DEBUG nova.network.neutron [req-1c505550-4f74-4fc2-8e5f-b8452b89f0a8 req-289946a0-0583-454b-897e-cc3a6cb047ee service nova] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Refreshing network info cache for port d339fae5-6ce4-49ea-85eb-45933ebf36eb {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 00:58:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-524569e3-9c24-4e19-99f7-0be0a0339009 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "98479cbe-09c7-40ee-a5cc-1b872dd9fbf7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:58:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-524569e3-9c24-4e19-99f7-0be0a0339009 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "98479cbe-09c7-40ee-a5cc-1b872dd9fbf7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:58:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-524569e3-9c24-4e19-99f7-0be0a0339009 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "98479cbe-09c7-40ee-a5cc-1b872dd9fbf7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:58:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-524569e3-9c24-4e19-99f7-0be0a0339009 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "98479cbe-09c7-40ee-a5cc-1b872dd9fbf7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:58:52 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-524569e3-9c24-4e19-99f7-0be0a0339009 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "98479cbe-09c7-40ee-a5cc-1b872dd9fbf7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:58:52 user nova-compute[82479]: INFO nova.compute.manager [None req-524569e3-9c24-4e19-99f7-0be0a0339009 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Terminating instance
Apr 14 00:58:52 user nova-compute[82479]: DEBUG nova.compute.manager [None req-524569e3-9c24-4e19-99f7-0be0a0339009 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Start destroying the instance on the hypervisor. {{(pid=82479) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 00:58:52 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:58:52 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:58:52 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:58:53 user nova-compute[82479]: DEBUG nova.network.neutron [req-1c505550-4f74-4fc2-8e5f-b8452b89f0a8 req-289946a0-0583-454b-897e-cc3a6cb047ee service nova] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Updated VIF entry in instance network info cache for port d339fae5-6ce4-49ea-85eb-45933ebf36eb. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 00:58:53 user nova-compute[82479]: DEBUG nova.network.neutron [req-1c505550-4f74-4fc2-8e5f-b8452b89f0a8 req-289946a0-0583-454b-897e-cc3a6cb047ee service nova] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Updating instance_info_cache with network_info: [{"id": "d339fae5-6ce4-49ea-85eb-45933ebf36eb", "address": "fa:16:3e:58:99:ac", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd339fae5-6c", "ovs_interfaceid": "d339fae5-6ce4-49ea-85eb-45933ebf36eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:58:53 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-1c505550-4f74-4fc2-8e5f-b8452b89f0a8 req-289946a0-0583-454b-897e-cc3a6cb047ee service nova] Releasing lock "refresh_cache-98479cbe-09c7-40ee-a5cc-1b872dd9fbf7" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 00:58:53 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Instance destroyed successfully.
Apr 14 00:58:53 user nova-compute[82479]: DEBUG nova.objects.instance [None req-524569e3-9c24-4e19-99f7-0be0a0339009 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lazy-loading 'resources' on Instance uuid 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 00:58:53 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-524569e3-9c24-4e19-99f7-0be0a0339009 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T00:54:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1369633049',display_name='tempest-TestVolumeBootPattern-server-1369633049',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1369633049',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA04fSpZPZehkhB9f0sYv7pWCpEF+0Af0ha1AxWnn4wafUNVzRts+po3Hz8WLNc1o5rlWHs8ARX3jM/G2geverCNDjLTFUEFq/SUwWxk6uiLBWzBveljr9LVk4guW/E4ew==',key_name='tempest-TestVolumeBootPattern-128892553',keypairs=<?>,launch_index=0,launched_at=2023-04-14T00:54:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0934526a2dfa45f4bd5df4edee11d98a',ramdisk_id='',reservation_id='r-jsjlsq9u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-260409128',owner_user_name='tempest-TestVolumeBootPattern-260409128-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T00:54:14Z,user_data=None,user_id='cfb66031fcf84659a3b80cdb76ffddc0',uuid=98479cbe-09c7-40ee-a5cc-1b872dd9fbf7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d339fae5-6ce4-49ea-85eb-45933ebf36eb", "address": "fa:16:3e:58:99:ac", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd339fae5-6c", "ovs_interfaceid": "d339fae5-6ce4-49ea-85eb-45933ebf36eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 00:58:53 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-524569e3-9c24-4e19-99f7-0be0a0339009 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Converting VIF {"id": "d339fae5-6ce4-49ea-85eb-45933ebf36eb", "address": "fa:16:3e:58:99:ac", "network": {"id": "6dec18bc-e73b-450e-b0d2-e36653017f20", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1896712310-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0934526a2dfa45f4bd5df4edee11d98a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd339fae5-6c", "ovs_interfaceid": "d339fae5-6ce4-49ea-85eb-45933ebf36eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 00:58:53 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-524569e3-9c24-4e19-99f7-0be0a0339009 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:58:99:ac,bridge_name='br-int',has_traffic_filtering=True,id=d339fae5-6ce4-49ea-85eb-45933ebf36eb,network=Network(6dec18bc-e73b-450e-b0d2-e36653017f20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd339fae5-6c') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 00:58:53 user nova-compute[82479]: DEBUG os_vif [None req-524569e3-9c24-4e19-99f7-0be0a0339009 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:99:ac,bridge_name='br-int',has_traffic_filtering=True,id=d339fae5-6ce4-49ea-85eb-45933ebf36eb,network=Network(6dec18bc-e73b-450e-b0d2-e36653017f20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd339fae5-6c') {{(pid=82479) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 00:58:53 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:58:53 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd339fae5-6c, bridge=br-int, if_exists=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 00:58:53 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:58:53 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:58:53 user nova-compute[82479]: INFO os_vif [None req-524569e3-9c24-4e19-99f7-0be0a0339009 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:99:ac,bridge_name='br-int',has_traffic_filtering=True,id=d339fae5-6ce4-49ea-85eb-45933ebf36eb,network=Network(6dec18bc-e73b-450e-b0d2-e36653017f20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd339fae5-6c')
Apr 14 00:58:53 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:58:53 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-524569e3-9c24-4e19-99f7-0be0a0339009 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] calling os-brick to detach iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 00:58:53 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-524569e3-9c24-4e19-99f7-0be0a0339009 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, {'target_iqn': 'iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gvTuEZAX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 00:58:53 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-524569e3-9c24-4e19-99f7-0be0a0339009 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 00:58:53 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-524569e3-9c24-4e19-99f7-0be0a0339009 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 00:58:53 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-524569e3-9c24-4e19-99f7-0be0a0339009 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 00:58:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:58:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:58:53 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[f984752b-1737-4660-8146-7e4b0102414f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:58:53 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-524569e3-9c24-4e19-99f7-0be0a0339009 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 00:58:53 user nova-compute[82479]: No targets found.
Apr 14 00:58:53 user nova-compute[82479]: iSNS:
Apr 14 00:58:53 user nova-compute[82479]: No targets found.
Apr 14 00:58:53 user nova-compute[82479]: STATIC:
Apr 14 00:58:53 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7
Apr 14 00:58:53 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 00:58:53 user nova-compute[82479]:                 Iface Name: default
Apr 14 00:58:53 user nova-compute[82479]: FIRMWARE:
Apr 14 00:58:53 user nova-compute[82479]: No targets found.
Apr 14 00:58:53 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:58:53 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-524569e3-9c24-4e19-99f7-0be0a0339009 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 00:58:53 user nova-compute[82479]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 00:58:53 user nova-compute[82479]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82479) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 00:58:53 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-524569e3-9c24-4e19-99f7-0be0a0339009 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7', 0)] {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 00:58:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:58:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:58:53 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[5333298b-0113-42ec-a056-9e49f892cd4c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:58:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:58:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:58:53 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca52d3d8-a74e-4522-953e-774b8de1a360]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:58:53 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-524569e3-9c24-4e19-99f7-0be0a0339009 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 (non-flash)
Apr 14 00:58:53 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 00:58:53 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-524569e3-9c24-4e19-99f7-0be0a0339009 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 (non-flash)
Apr 14 00:58:53 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 00:58:53 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-524569e3-9c24-4e19-99f7-0be0a0339009 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f330c6781f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7'): ({'sdb'}, set())}) {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 00:58:53 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-524569e3-9c24-4e19-99f7-0be0a0339009 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Removing single pathed devices sdb {{(pid=82479) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 00:58:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:58:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:58:53 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[130a4fc1-b6c2-43b4-950c-3d06f7772047]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:58:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:58:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:58:53 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[48067854-c5f2-4437-92ca-4a0790953fca]: (4, ('ok\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:58:53 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-524569e3-9c24-4e19-99f7-0be0a0339009 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Flushing IO for device /dev/sdb {{(pid=82479) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 00:58:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:58:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:58:53 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[4189346e-3eb9-4d27-90cf-cee933e5c847]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:58:53 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-524569e3-9c24-4e19-99f7-0be0a0339009 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82479) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 00:58:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:58:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:58:53 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[499c6ced-8881-4f6b-8197-0800a5cb1ae8]: (4, ('1', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:58:53 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-524569e3-9c24-4e19-99f7-0be0a0339009 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 00:58:53 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-524569e3-9c24-4e19-99f7-0be0a0339009 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] SCSI volumes sdb have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 00:58:53 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-524569e3-9c24-4e19-99f7-0be0a0339009 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7')] {{(pid=82479) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 00:58:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:58:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:58:53 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1aa531b-6829-4d0f-9a3b-657f4ab5477a]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:58:53 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-524569e3-9c24-4e19-99f7-0be0a0339009 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:58:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 -p 172.16.0.220:3260 --logout {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:58:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:58:53 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91bd6f9-3ab9-4652-aac3-6662103ff763]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:58:53 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-524569e3-9c24-4e19-99f7-0be0a0339009 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7, portal: 172.16.0.220,3260]
Apr 14 00:58:53 user nova-compute[82479]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7, portal: 172.16.0.220,3260] successful.
Apr 14 00:58:53 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:58:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 -p 172.16.0.220:3260 --op delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 00:58:53 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 00:58:53 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e0b62c-dc48-4d50-a04f-0e7f05bb638d]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 00:58:53 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-524569e3-9c24-4e19-99f7-0be0a0339009 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 00:58:53 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-524569e3-9c24-4e19-99f7-0be0a0339009 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 00:58:53 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-524569e3-9c24-4e19-99f7-0be0a0339009 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] <== disconnect_volume: return (291ms) None {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 00:58:53 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-524569e3-9c24-4e19-99f7-0be0a0339009 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Disconnected iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 00:58:53 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-524569e3-9c24-4e19-99f7-0be0a0339009 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Deleting instance files /opt/stack/data/nova/instances/98479cbe-09c7-40ee-a5cc-1b872dd9fbf7_del
Apr 14 00:58:53 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-524569e3-9c24-4e19-99f7-0be0a0339009 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Deletion of /opt/stack/data/nova/instances/98479cbe-09c7-40ee-a5cc-1b872dd9fbf7_del complete
Apr 14 00:58:53 user nova-compute[82479]: INFO nova.compute.manager [None req-524569e3-9c24-4e19-99f7-0be0a0339009 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Took 1.12 seconds to destroy the instance on the hypervisor.
Apr 14 00:58:53 user nova-compute[82479]: DEBUG oslo.service.loopingcall [None req-524569e3-9c24-4e19-99f7-0be0a0339009 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82479) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 00:58:53 user nova-compute[82479]: DEBUG nova.compute.manager [-] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Deallocating network for instance {{(pid=82479) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 00:58:53 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] deallocate_for_instance() {{(pid=82479) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 00:58:54 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Updating instance_info_cache with network_info: [] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 00:58:54 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Took 0.54 seconds to deallocate network for instance.
Apr 14 00:58:54 user nova-compute[82479]: DEBUG nova.compute.manager [req-fdc37f11-dcf0-43d4-a792-6a4cc0472a36 req-410c4f50-e359-4efd-9e1a-66d304721759 service nova] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Received event network-vif-unplugged-d339fae5-6ce4-49ea-85eb-45933ebf36eb {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:58:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-fdc37f11-dcf0-43d4-a792-6a4cc0472a36 req-410c4f50-e359-4efd-9e1a-66d304721759 service nova] Acquiring lock "98479cbe-09c7-40ee-a5cc-1b872dd9fbf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:58:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-fdc37f11-dcf0-43d4-a792-6a4cc0472a36 req-410c4f50-e359-4efd-9e1a-66d304721759 service nova] Lock "98479cbe-09c7-40ee-a5cc-1b872dd9fbf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:58:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-fdc37f11-dcf0-43d4-a792-6a4cc0472a36 req-410c4f50-e359-4efd-9e1a-66d304721759 service nova] Lock "98479cbe-09c7-40ee-a5cc-1b872dd9fbf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:58:54 user nova-compute[82479]: DEBUG nova.compute.manager [req-fdc37f11-dcf0-43d4-a792-6a4cc0472a36 req-410c4f50-e359-4efd-9e1a-66d304721759 service nova] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] No waiting events found dispatching network-vif-unplugged-d339fae5-6ce4-49ea-85eb-45933ebf36eb {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:58:54 user nova-compute[82479]: DEBUG nova.compute.manager [req-fdc37f11-dcf0-43d4-a792-6a4cc0472a36 req-410c4f50-e359-4efd-9e1a-66d304721759 service nova] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Received event network-vif-unplugged-d339fae5-6ce4-49ea-85eb-45933ebf36eb for instance with task_state deleting. {{(pid=82479) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 00:58:54 user nova-compute[82479]: DEBUG nova.compute.manager [req-fdc37f11-dcf0-43d4-a792-6a4cc0472a36 req-410c4f50-e359-4efd-9e1a-66d304721759 service nova] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Received event network-vif-plugged-d339fae5-6ce4-49ea-85eb-45933ebf36eb {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:58:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-fdc37f11-dcf0-43d4-a792-6a4cc0472a36 req-410c4f50-e359-4efd-9e1a-66d304721759 service nova] Acquiring lock "98479cbe-09c7-40ee-a5cc-1b872dd9fbf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:58:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-fdc37f11-dcf0-43d4-a792-6a4cc0472a36 req-410c4f50-e359-4efd-9e1a-66d304721759 service nova] Lock "98479cbe-09c7-40ee-a5cc-1b872dd9fbf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:58:54 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-fdc37f11-dcf0-43d4-a792-6a4cc0472a36 req-410c4f50-e359-4efd-9e1a-66d304721759 service nova] Lock "98479cbe-09c7-40ee-a5cc-1b872dd9fbf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:58:54 user nova-compute[82479]: DEBUG nova.compute.manager [req-fdc37f11-dcf0-43d4-a792-6a4cc0472a36 req-410c4f50-e359-4efd-9e1a-66d304721759 service nova] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] No waiting events found dispatching network-vif-plugged-d339fae5-6ce4-49ea-85eb-45933ebf36eb {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 00:58:54 user nova-compute[82479]: WARNING nova.compute.manager [req-fdc37f11-dcf0-43d4-a792-6a4cc0472a36 req-410c4f50-e359-4efd-9e1a-66d304721759 service nova] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Received unexpected event network-vif-plugged-d339fae5-6ce4-49ea-85eb-45933ebf36eb for instance with vm_state active and task_state deleting.
Apr 14 00:58:54 user nova-compute[82479]: DEBUG nova.compute.manager [req-fdc37f11-dcf0-43d4-a792-6a4cc0472a36 req-410c4f50-e359-4efd-9e1a-66d304721759 service nova] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Received event network-vif-deleted-d339fae5-6ce4-49ea-85eb-45933ebf36eb {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 00:58:54 user nova-compute[82479]: INFO nova.compute.manager [None req-524569e3-9c24-4e19-99f7-0be0a0339009 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Took 0.77 seconds to detach 1 volumes for instance.
Apr 14 00:58:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-524569e3-9c24-4e19-99f7-0be0a0339009 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:58:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-524569e3-9c24-4e19-99f7-0be0a0339009 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:58:55 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-524569e3-9c24-4e19-99f7-0be0a0339009 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:58:55 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-524569e3-9c24-4e19-99f7-0be0a0339009 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:58:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-524569e3-9c24-4e19-99f7-0be0a0339009 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.122s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:58:55 user nova-compute[82479]: INFO nova.scheduler.client.report [None req-524569e3-9c24-4e19-99f7-0be0a0339009 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Deleted allocations for instance 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7
Apr 14 00:58:55 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-524569e3-9c24-4e19-99f7-0be0a0339009 tempest-TestVolumeBootPattern-260409128 tempest-TestVolumeBootPattern-260409128-project-member] Lock "98479cbe-09c7-40ee-a5cc-1b872dd9fbf7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.743s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:58:58 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:59:03 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:59:03 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:59:03 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 00:59:03 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:59:03 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 00:59:03 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:59:08 user nova-compute[82479]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681433933.2576032, 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7 => Stopped> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 00:59:08 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] VM Stopped (Lifecycle Event)
Apr 14 00:59:08 user nova-compute[82479]: DEBUG nova.compute.manager [None req-9f940020-71aa-46d6-8984-711108a24cce None None] [instance: 98479cbe-09c7-40ee-a5cc-1b872dd9fbf7] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 00:59:08 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:59:13 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:59:18 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:59:23 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:59:23 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:59:28 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:59:30 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:59:30 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Starting heal instance info cache {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 00:59:30 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Rebuilding the list of instances to heal {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 00:59:30 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Didn't find any instances for network info cache update. {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 00:59:31 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:59:32 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:59:33 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:59:34 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:59:34 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82479) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 00:59:35 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:59:38 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:59:38 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:59:38 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:59:38 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:59:38 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:59:38 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Auditing locally available compute resources for user (node: user) {{(pid=82479) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 00:59:39 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:59:39 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 00:59:39 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Hypervisor/Node resource view: name=user free_ram=8902MB free_disk=26.141498565673828GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82479) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 00:59:39 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 00:59:39 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 00:59:39 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 00:59:39 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 00:59:39 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 00:59:39 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 00:59:39 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Compute_service record updated for user:user {{(pid=82479) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 00:59:39 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.150s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 00:59:42 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:59:43 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:59:43 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:59:45 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:59:46 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 00:59:48 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:59:48 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:59:52 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:59:53 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 00:59:58 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 00:59:59 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:00:01 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:00:02 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:00:03 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:00:05 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:00:07 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:00:08 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:00:08 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:00:11 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "7d067330-8745-4e21-b93c-60c0902012c7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:00:11 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "7d067330-8745-4e21-b93c-60c0902012c7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:00:11 user nova-compute[82479]: DEBUG nova.compute.manager [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Starting instance... {{(pid=82479) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 01:00:12 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:00:12 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:00:12 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=82479) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 01:00:12 user nova-compute[82479]: INFO nova.compute.claims [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Claim successful on node user
Apr 14 01:00:12 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:00:12 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:00:12 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:00:12 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.242s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:00:12 user nova-compute[82479]: DEBUG nova.compute.manager [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Start building networks asynchronously for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 01:00:12 user nova-compute[82479]: DEBUG nova.compute.manager [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Allocating IP information in the background. {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 01:00:12 user nova-compute[82479]: DEBUG nova.network.neutron [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] allocate_for_instance() {{(pid=82479) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 01:00:12 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 01:00:12 user nova-compute[82479]: DEBUG nova.compute.manager [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Start building block device mappings for instance. {{(pid=82479) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 01:00:12 user nova-compute[82479]: DEBUG nova.policy [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1c8816bdfcab4ebca17b0c7ca90e5d39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed63b19014f048f5bf3f9938a151d30c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=82479) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 01:00:12 user nova-compute[82479]: DEBUG nova.compute.manager [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Start spawning the instance on the hypervisor. {{(pid=82479) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 01:00:12 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Creating instance directory {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 01:00:12 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Creating image(s)
Apr 14 01:00:12 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "/opt/stack/data/nova/instances/7d067330-8745-4e21-b93c-60c0902012c7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:00:12 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "/opt/stack/data/nova/instances/7d067330-8745-4e21-b93c-60c0902012c7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:00:12 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "/opt/stack/data/nova/instances/7d067330-8745-4e21-b93c-60c0902012c7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:00:12 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:00:12 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.139s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:00:12 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "3e200e101633f2016e569ae4c0a352380507d1e4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:00:12 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "3e200e101633f2016e569ae4c0a352380507d1e4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:00:12 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:00:12 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.139s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:00:12 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/7d067330-8745-4e21-b93c-60c0902012c7/disk 1073741824 {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:00:12 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4,backing_fmt=raw /opt/stack/data/nova/instances/7d067330-8745-4e21-b93c-60c0902012c7/disk 1073741824" returned: 0 in 0.059s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:00:12 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "3e200e101633f2016e569ae4c0a352380507d1e4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.208s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:00:12 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:00:12 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3e200e101633f2016e569ae4c0a352380507d1e4 --force-share --output=json" returned: 0 in 0.148s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:00:12 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7d067330-8745-4e21-b93c-60c0902012c7/disk. size=1073741824 {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 01:00:12 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d067330-8745-4e21-b93c-60c0902012c7/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:00:13 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d067330-8745-4e21-b93c-60c0902012c7/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:00:13 user nova-compute[82479]: DEBUG nova.virt.disk.api [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Cannot resize image /opt/stack/data/nova/instances/7d067330-8745-4e21-b93c-60c0902012c7/disk to a smaller size. {{(pid=82479) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 01:00:13 user nova-compute[82479]: DEBUG nova.objects.instance [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lazy-loading 'migration_context' on Instance uuid 7d067330-8745-4e21-b93c-60c0902012c7 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:00:13 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Created local disks {{(pid=82479) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 01:00:13 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Ensure instance console log exists: /opt/stack/data/nova/instances/7d067330-8745-4e21-b93c-60c0902012c7/console.log {{(pid=82479) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 01:00:13 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:00:13 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:00:13 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:00:13 user nova-compute[82479]: DEBUG nova.network.neutron [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Successfully created port: 4f9eadfb-1571-4235-85ba-05511a343c4d {{(pid=82479) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 01:00:13 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:00:14 user nova-compute[82479]: DEBUG nova.network.neutron [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Successfully updated port: 4f9eadfb-1571-4235-85ba-05511a343c4d {{(pid=82479) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 01:00:14 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "refresh_cache-7d067330-8745-4e21-b93c-60c0902012c7" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:00:14 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquired lock "refresh_cache-7d067330-8745-4e21-b93c-60c0902012c7" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:00:14 user nova-compute[82479]: DEBUG nova.network.neutron [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Building network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 01:00:14 user nova-compute[82479]: DEBUG nova.compute.manager [req-eb644d9e-1a79-4657-8d9a-fcf8afd5f892 req-e1953939-6a39-4ee2-a8c1-c904129b0dfb service nova] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Received event network-changed-4f9eadfb-1571-4235-85ba-05511a343c4d {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:00:14 user nova-compute[82479]: DEBUG nova.compute.manager [req-eb644d9e-1a79-4657-8d9a-fcf8afd5f892 req-e1953939-6a39-4ee2-a8c1-c904129b0dfb service nova] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Refreshing instance network info cache due to event network-changed-4f9eadfb-1571-4235-85ba-05511a343c4d. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:00:14 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-eb644d9e-1a79-4657-8d9a-fcf8afd5f892 req-e1953939-6a39-4ee2-a8c1-c904129b0dfb service nova] Acquiring lock "refresh_cache-7d067330-8745-4e21-b93c-60c0902012c7" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:00:14 user nova-compute[82479]: DEBUG nova.network.neutron [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Instance cache missing network info. {{(pid=82479) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 01:00:14 user nova-compute[82479]: DEBUG nova.network.neutron [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Updating instance_info_cache with network_info: [{"id": "4f9eadfb-1571-4235-85ba-05511a343c4d", "address": "fa:16:3e:66:d8:ca", "network": {"id": "c6603c41-74dd-4b44-952c-0df4228a8b77", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2088791125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed63b19014f048f5bf3f9938a151d30c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9eadfb-15", "ovs_interfaceid": "4f9eadfb-1571-4235-85ba-05511a343c4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:00:14 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Releasing lock "refresh_cache-7d067330-8745-4e21-b93c-60c0902012c7" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:00:14 user nova-compute[82479]: DEBUG nova.compute.manager [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Instance network_info: |[{"id": "4f9eadfb-1571-4235-85ba-05511a343c4d", "address": "fa:16:3e:66:d8:ca", "network": {"id": "c6603c41-74dd-4b44-952c-0df4228a8b77", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2088791125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed63b19014f048f5bf3f9938a151d30c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9eadfb-15", "ovs_interfaceid": "4f9eadfb-1571-4235-85ba-05511a343c4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=82479) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 01:00:14 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-eb644d9e-1a79-4657-8d9a-fcf8afd5f892 req-e1953939-6a39-4ee2-a8c1-c904129b0dfb service nova] Acquired lock "refresh_cache-7d067330-8745-4e21-b93c-60c0902012c7" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:00:14 user nova-compute[82479]: DEBUG nova.network.neutron [req-eb644d9e-1a79-4657-8d9a-fcf8afd5f892 req-e1953939-6a39-4ee2-a8c1-c904129b0dfb service nova] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Refreshing network info cache for port 4f9eadfb-1571-4235-85ba-05511a343c4d {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:00:14 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Start _get_guest_xml network_info=[{"id": "4f9eadfb-1571-4235-85ba-05511a343c4d", "address": "fa:16:3e:66:d8:ca", "network": {"id": "c6603c41-74dd-4b44-952c-0df4228a8b77", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2088791125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed63b19014f048f5bf3f9938a151d30c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9eadfb-15", "ovs_interfaceid": "4f9eadfb-1571-4235-85ba-05511a343c4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'encrypted': False, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 01:00:14 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:00:14 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:00:14 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=82479) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 01:00:14 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T00:02:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T00:01:04Z,direct_url=<?>,disk_format='qcow2',id=6db62068-7278-4cd8-b41f-d0140d89e199,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='ccfc655ef7b947398980b9772e4864df',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T00:01:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 01:00:14 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Flavor limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 01:00:14 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Image limits 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 01:00:14 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Flavor pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 01:00:14 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Image pref 0:0:0 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 01:00:14 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=82479) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 01:00:14 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 01:00:14 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 01:00:14 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Got 1 possible topologies {{(pid=82479) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 01:00:14 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 01:00:14 user nova-compute[82479]: DEBUG nova.virt.hardware [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=82479) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 01:00:14 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:00:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-944954764',display_name='tempest-SnapshotDataIntegrityTests-server-944954764',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-944954764',id=46,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtF7w2+KjkkyJvNhd0vZprUfWYDPfNpaHTuDIX2lnLWSf6LX0U1r92inKRclfrXIDyWHz54xSsmhgtoY5GgciU/WUNeudS1fxVYXH4mrtpL0yTxtyHmVWIHfvCWuegCjw==',key_name='tempest-SnapshotDataIntegrityTests-920739646',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed63b19014f048f5bf3f9938a151d30c',ramdisk_id='',reservation_id='r-zcywk9qk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-212903653',owner_user_name='tempest-SnapshotDataIntegrityTests-212903653-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:00:12Z,user_data=None,user_id='1c8816bdfcab4ebca17b0c7ca90e5d39',uuid=7d067330-8745-4e21-b93c-60c0902012c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f9eadfb-1571-4235-85ba-05511a343c4d", "address": "fa:16:3e:66:d8:ca", "network": {"id": "c6603c41-74dd-4b44-952c-0df4228a8b77", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2088791125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed63b19014f048f5bf3f9938a151d30c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9eadfb-15", "ovs_interfaceid": "4f9eadfb-1571-4235-85ba-05511a343c4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=82479) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 01:00:14 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Converting VIF {"id": "4f9eadfb-1571-4235-85ba-05511a343c4d", "address": "fa:16:3e:66:d8:ca", "network": {"id": "c6603c41-74dd-4b44-952c-0df4228a8b77", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2088791125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed63b19014f048f5bf3f9938a151d30c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9eadfb-15", "ovs_interfaceid": "4f9eadfb-1571-4235-85ba-05511a343c4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:00:14 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:d8:ca,bridge_name='br-int',has_traffic_filtering=True,id=4f9eadfb-1571-4235-85ba-05511a343c4d,network=Network(c6603c41-74dd-4b44-952c-0df4228a8b77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f9eadfb-15') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:00:14 user nova-compute[82479]: DEBUG nova.objects.instance [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lazy-loading 'pci_devices' on Instance uuid 7d067330-8745-4e21-b93c-60c0902012c7 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:00:14 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] End _get_guest_xml xml=<domain type="kvm">
Apr 14 01:00:14 user nova-compute[82479]:   <uuid>7d067330-8745-4e21-b93c-60c0902012c7</uuid>
Apr 14 01:00:14 user nova-compute[82479]:   <name>instance-0000002e</name>
Apr 14 01:00:14 user nova-compute[82479]:   <memory>131072</memory>
Apr 14 01:00:14 user nova-compute[82479]:   <vcpu>1</vcpu>
Apr 14 01:00:14 user nova-compute[82479]:   <metadata>
Apr 14 01:00:14 user nova-compute[82479]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 01:00:14 user nova-compute[82479]:       <nova:package version="0.0.0"/>
Apr 14 01:00:14 user nova-compute[82479]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-944954764</nova:name>
Apr 14 01:00:14 user nova-compute[82479]:       <nova:creationTime>2023-04-14 01:00:14</nova:creationTime>
Apr 14 01:00:14 user nova-compute[82479]:       <nova:flavor name="m1.nano">
Apr 14 01:00:14 user nova-compute[82479]:         <nova:memory>128</nova:memory>
Apr 14 01:00:14 user nova-compute[82479]:         <nova:disk>1</nova:disk>
Apr 14 01:00:14 user nova-compute[82479]:         <nova:swap>0</nova:swap>
Apr 14 01:00:14 user nova-compute[82479]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 01:00:14 user nova-compute[82479]:         <nova:vcpus>1</nova:vcpus>
Apr 14 01:00:14 user nova-compute[82479]:       </nova:flavor>
Apr 14 01:00:14 user nova-compute[82479]:       <nova:owner>
Apr 14 01:00:14 user nova-compute[82479]:         <nova:user uuid="1c8816bdfcab4ebca17b0c7ca90e5d39">tempest-SnapshotDataIntegrityTests-212903653-project-member</nova:user>
Apr 14 01:00:14 user nova-compute[82479]:         <nova:project uuid="ed63b19014f048f5bf3f9938a151d30c">tempest-SnapshotDataIntegrityTests-212903653</nova:project>
Apr 14 01:00:14 user nova-compute[82479]:       </nova:owner>
Apr 14 01:00:14 user nova-compute[82479]:       <nova:root type="image" uuid="6db62068-7278-4cd8-b41f-d0140d89e199"/>
Apr 14 01:00:14 user nova-compute[82479]:       <nova:ports>
Apr 14 01:00:14 user nova-compute[82479]:         <nova:port uuid="4f9eadfb-1571-4235-85ba-05511a343c4d">
Apr 14 01:00:14 user nova-compute[82479]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 14 01:00:14 user nova-compute[82479]:         </nova:port>
Apr 14 01:00:14 user nova-compute[82479]:       </nova:ports>
Apr 14 01:00:14 user nova-compute[82479]:     </nova:instance>
Apr 14 01:00:14 user nova-compute[82479]:   </metadata>
Apr 14 01:00:14 user nova-compute[82479]:   <sysinfo type="smbios">
Apr 14 01:00:14 user nova-compute[82479]:     <system>
Apr 14 01:00:14 user nova-compute[82479]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 01:00:14 user nova-compute[82479]:       <entry name="product">OpenStack Nova</entry>
Apr 14 01:00:14 user nova-compute[82479]:       <entry name="version">0.0.0</entry>
Apr 14 01:00:14 user nova-compute[82479]:       <entry name="serial">7d067330-8745-4e21-b93c-60c0902012c7</entry>
Apr 14 01:00:14 user nova-compute[82479]:       <entry name="uuid">7d067330-8745-4e21-b93c-60c0902012c7</entry>
Apr 14 01:00:14 user nova-compute[82479]:       <entry name="family">Virtual Machine</entry>
Apr 14 01:00:14 user nova-compute[82479]:     </system>
Apr 14 01:00:14 user nova-compute[82479]:   </sysinfo>
Apr 14 01:00:14 user nova-compute[82479]:   <os>
Apr 14 01:00:14 user nova-compute[82479]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 01:00:14 user nova-compute[82479]:     <boot dev="hd"/>
Apr 14 01:00:14 user nova-compute[82479]:     <smbios mode="sysinfo"/>
Apr 14 01:00:14 user nova-compute[82479]:   </os>
Apr 14 01:00:14 user nova-compute[82479]:   <features>
Apr 14 01:00:14 user nova-compute[82479]:     <acpi/>
Apr 14 01:00:14 user nova-compute[82479]:     <apic/>
Apr 14 01:00:14 user nova-compute[82479]:     <vmcoreinfo/>
Apr 14 01:00:14 user nova-compute[82479]:   </features>
Apr 14 01:00:14 user nova-compute[82479]:   <clock offset="utc">
Apr 14 01:00:14 user nova-compute[82479]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 01:00:14 user nova-compute[82479]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 01:00:14 user nova-compute[82479]:     <timer name="hpet" present="no"/>
Apr 14 01:00:14 user nova-compute[82479]:   </clock>
Apr 14 01:00:14 user nova-compute[82479]:   <cpu mode="custom" match="exact">
Apr 14 01:00:14 user nova-compute[82479]:     <model>Nehalem</model>
Apr 14 01:00:14 user nova-compute[82479]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 01:00:14 user nova-compute[82479]:   </cpu>
Apr 14 01:00:14 user nova-compute[82479]:   <devices>
Apr 14 01:00:14 user nova-compute[82479]:     <disk type="file" device="disk">
Apr 14 01:00:14 user nova-compute[82479]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 01:00:14 user nova-compute[82479]:       <source file="/opt/stack/data/nova/instances/7d067330-8745-4e21-b93c-60c0902012c7/disk"/>
Apr 14 01:00:14 user nova-compute[82479]:       <target dev="vda" bus="virtio"/>
Apr 14 01:00:14 user nova-compute[82479]:     </disk>
Apr 14 01:00:14 user nova-compute[82479]:     <interface type="ethernet">
Apr 14 01:00:14 user nova-compute[82479]:       <mac address="fa:16:3e:66:d8:ca"/>
Apr 14 01:00:14 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 01:00:14 user nova-compute[82479]:       <mtu size="1442"/>
Apr 14 01:00:14 user nova-compute[82479]:       <target dev="tap4f9eadfb-15"/>
Apr 14 01:00:14 user nova-compute[82479]:     </interface>
Apr 14 01:00:14 user nova-compute[82479]:     <serial type="pty">
Apr 14 01:00:14 user nova-compute[82479]:       <log file="/opt/stack/data/nova/instances/7d067330-8745-4e21-b93c-60c0902012c7/console.log" append="off"/>
Apr 14 01:00:14 user nova-compute[82479]:     </serial>
Apr 14 01:00:14 user nova-compute[82479]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 01:00:14 user nova-compute[82479]:     <video>
Apr 14 01:00:14 user nova-compute[82479]:       <model type="virtio"/>
Apr 14 01:00:14 user nova-compute[82479]:     </video>
Apr 14 01:00:14 user nova-compute[82479]:     <rng model="virtio">
Apr 14 01:00:14 user nova-compute[82479]:       <backend model="random">/dev/urandom</backend>
Apr 14 01:00:14 user nova-compute[82479]:     </rng>
Apr 14 01:00:14 user nova-compute[82479]:     <controller type="usb" index="0" model="none"/>
Apr 14 01:00:14 user nova-compute[82479]:     <memballoon model="virtio">
Apr 14 01:00:14 user nova-compute[82479]:       <stats period="10"/>
Apr 14 01:00:14 user nova-compute[82479]:     </memballoon>
Apr 14 01:00:14 user nova-compute[82479]:   </devices>
Apr 14 01:00:14 user nova-compute[82479]: </domain>
Apr 14 01:00:14 user nova-compute[82479]:  {{(pid=82479) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 01:00:14 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:00:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-944954764',display_name='tempest-SnapshotDataIntegrityTests-server-944954764',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-944954764',id=46,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtF7w2+KjkkyJvNhd0vZprUfWYDPfNpaHTuDIX2lnLWSf6LX0U1r92inKRclfrXIDyWHz54xSsmhgtoY5GgciU/WUNeudS1fxVYXH4mrtpL0yTxtyHmVWIHfvCWuegCjw==',key_name='tempest-SnapshotDataIntegrityTests-920739646',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed63b19014f048f5bf3f9938a151d30c',ramdisk_id='',reservation_id='r-zcywk9qk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-212903653',owner_user_name='tempest-SnapshotDataIntegrityTests-212903653-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T01:00:12Z,user_data=None,user_id='1c8816bdfcab4ebca17b0c7ca90e5d39',uuid=7d067330-8745-4e21-b93c-60c0902012c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f9eadfb-1571-4235-85ba-05511a343c4d", "address": "fa:16:3e:66:d8:ca", "network": {"id": "c6603c41-74dd-4b44-952c-0df4228a8b77", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2088791125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed63b19014f048f5bf3f9938a151d30c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9eadfb-15", "ovs_interfaceid": "4f9eadfb-1571-4235-85ba-05511a343c4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 01:00:14 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Converting VIF {"id": "4f9eadfb-1571-4235-85ba-05511a343c4d", "address": "fa:16:3e:66:d8:ca", "network": {"id": "c6603c41-74dd-4b44-952c-0df4228a8b77", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2088791125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed63b19014f048f5bf3f9938a151d30c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9eadfb-15", "ovs_interfaceid": "4f9eadfb-1571-4235-85ba-05511a343c4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:00:14 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:d8:ca,bridge_name='br-int',has_traffic_filtering=True,id=4f9eadfb-1571-4235-85ba-05511a343c4d,network=Network(c6603c41-74dd-4b44-952c-0df4228a8b77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f9eadfb-15') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:00:14 user nova-compute[82479]: DEBUG os_vif [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:d8:ca,bridge_name='br-int',has_traffic_filtering=True,id=4f9eadfb-1571-4235-85ba-05511a343c4d,network=Network(c6603c41-74dd-4b44-952c-0df4228a8b77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f9eadfb-15') {{(pid=82479) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 01:00:14 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:00:14 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:00:14 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 01:00:14 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:00:14 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4f9eadfb-15, may_exist=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:00:14 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4f9eadfb-15, col_values=(('external_ids', {'iface-id': '4f9eadfb-1571-4235-85ba-05511a343c4d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:d8:ca', 'vm-uuid': '7d067330-8745-4e21-b93c-60c0902012c7'}),)) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:00:14 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:00:14 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:00:14 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:00:14 user nova-compute[82479]: INFO os_vif [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:d8:ca,bridge_name='br-int',has_traffic_filtering=True,id=4f9eadfb-1571-4235-85ba-05511a343c4d,network=Network(c6603c41-74dd-4b44-952c-0df4228a8b77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f9eadfb-15')
Apr 14 01:00:14 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:00:14 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] No VIF found with MAC fa:16:3e:66:d8:ca, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 01:00:14 user nova-compute[82479]: DEBUG nova.network.neutron [req-eb644d9e-1a79-4657-8d9a-fcf8afd5f892 req-e1953939-6a39-4ee2-a8c1-c904129b0dfb service nova] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Updated VIF entry in instance network info cache for port 4f9eadfb-1571-4235-85ba-05511a343c4d. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 01:00:14 user nova-compute[82479]: DEBUG nova.network.neutron [req-eb644d9e-1a79-4657-8d9a-fcf8afd5f892 req-e1953939-6a39-4ee2-a8c1-c904129b0dfb service nova] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Updating instance_info_cache with network_info: [{"id": "4f9eadfb-1571-4235-85ba-05511a343c4d", "address": "fa:16:3e:66:d8:ca", "network": {"id": "c6603c41-74dd-4b44-952c-0df4228a8b77", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2088791125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed63b19014f048f5bf3f9938a151d30c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9eadfb-15", "ovs_interfaceid": "4f9eadfb-1571-4235-85ba-05511a343c4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:00:14 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-eb644d9e-1a79-4657-8d9a-fcf8afd5f892 req-e1953939-6a39-4ee2-a8c1-c904129b0dfb service nova] Releasing lock "refresh_cache-7d067330-8745-4e21-b93c-60c0902012c7" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:00:15 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:00:15 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:00:15 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:00:16 user nova-compute[82479]: DEBUG nova.compute.manager [req-86d837e2-55c1-4061-8622-536a664adc88 req-62eb2374-4f49-4d47-8ab1-3d5bbef8bd97 service nova] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Received event network-vif-plugged-4f9eadfb-1571-4235-85ba-05511a343c4d {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:00:16 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-86d837e2-55c1-4061-8622-536a664adc88 req-62eb2374-4f49-4d47-8ab1-3d5bbef8bd97 service nova] Acquiring lock "7d067330-8745-4e21-b93c-60c0902012c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:00:16 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-86d837e2-55c1-4061-8622-536a664adc88 req-62eb2374-4f49-4d47-8ab1-3d5bbef8bd97 service nova] Lock "7d067330-8745-4e21-b93c-60c0902012c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:00:16 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-86d837e2-55c1-4061-8622-536a664adc88 req-62eb2374-4f49-4d47-8ab1-3d5bbef8bd97 service nova] Lock "7d067330-8745-4e21-b93c-60c0902012c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:00:16 user nova-compute[82479]: DEBUG nova.compute.manager [req-86d837e2-55c1-4061-8622-536a664adc88 req-62eb2374-4f49-4d47-8ab1-3d5bbef8bd97 service nova] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] No waiting events found dispatching network-vif-plugged-4f9eadfb-1571-4235-85ba-05511a343c4d {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:00:16 user nova-compute[82479]: WARNING nova.compute.manager [req-86d837e2-55c1-4061-8622-536a664adc88 req-62eb2374-4f49-4d47-8ab1-3d5bbef8bd97 service nova] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Received unexpected event network-vif-plugged-4f9eadfb-1571-4235-85ba-05511a343c4d for instance with vm_state building and task_state spawning.
Apr 14 01:00:16 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:00:16 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:00:16 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:00:17 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:00:18 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681434018.0034945, 7d067330-8745-4e21-b93c-60c0902012c7 => Resumed> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:00:18 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] VM Resumed (Lifecycle Event)
Apr 14 01:00:18 user nova-compute[82479]: DEBUG nova.compute.manager [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Instance event wait completed in 0 seconds for  {{(pid=82479) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 01:00:18 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Guest created on hypervisor {{(pid=82479) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 01:00:18 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Instance spawned successfully.
Apr 14 01:00:18 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 01:00:18 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:00:18 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:00:18 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Found default for hw_cdrom_bus of ide {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:00:18 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Found default for hw_disk_bus of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:00:18 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Found default for hw_input_bus of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:00:18 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Found default for hw_pointer_model of None {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:00:18 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Found default for hw_video_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:00:18 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Found default for hw_vif_model of virtio {{(pid=82479) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 01:00:18 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 01:00:18 user nova-compute[82479]: DEBUG nova.virt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Emitting event <LifecycleEvent: 1681434018.00767, 7d067330-8745-4e21-b93c-60c0902012c7 => Started> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:00:18 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] VM Started (Lifecycle Event)
Apr 14 01:00:18 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:00:18 user nova-compute[82479]: DEBUG nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=82479) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 01:00:18 user nova-compute[82479]: INFO nova.compute.manager [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 01:00:18 user nova-compute[82479]: INFO nova.compute.manager [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Took 5.66 seconds to spawn the instance on the hypervisor.
Apr 14 01:00:18 user nova-compute[82479]: DEBUG nova.compute.manager [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:00:18 user nova-compute[82479]: INFO nova.compute.manager [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Took 6.21 seconds to build instance.
Apr 14 01:00:18 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-95ae463b-1532-4393-9e31-0358e967d991 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "7d067330-8745-4e21-b93c-60c0902012c7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.314s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:00:18 user nova-compute[82479]: DEBUG nova.compute.manager [req-8e4c112c-8b67-4b75-b5e7-d4b09d7dd9ad req-c42fa8ea-b1fa-4bf6-bc11-6d6e80fec430 service nova] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Received event network-vif-plugged-4f9eadfb-1571-4235-85ba-05511a343c4d {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:00:18 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-8e4c112c-8b67-4b75-b5e7-d4b09d7dd9ad req-c42fa8ea-b1fa-4bf6-bc11-6d6e80fec430 service nova] Acquiring lock "7d067330-8745-4e21-b93c-60c0902012c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:00:18 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-8e4c112c-8b67-4b75-b5e7-d4b09d7dd9ad req-c42fa8ea-b1fa-4bf6-bc11-6d6e80fec430 service nova] Lock "7d067330-8745-4e21-b93c-60c0902012c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:00:18 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-8e4c112c-8b67-4b75-b5e7-d4b09d7dd9ad req-c42fa8ea-b1fa-4bf6-bc11-6d6e80fec430 service nova] Lock "7d067330-8745-4e21-b93c-60c0902012c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:00:18 user nova-compute[82479]: DEBUG nova.compute.manager [req-8e4c112c-8b67-4b75-b5e7-d4b09d7dd9ad req-c42fa8ea-b1fa-4bf6-bc11-6d6e80fec430 service nova] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] No waiting events found dispatching network-vif-plugged-4f9eadfb-1571-4235-85ba-05511a343c4d {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:00:18 user nova-compute[82479]: WARNING nova.compute.manager [req-8e4c112c-8b67-4b75-b5e7-d4b09d7dd9ad req-c42fa8ea-b1fa-4bf6-bc11-6d6e80fec430 service nova] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Received unexpected event network-vif-plugged-4f9eadfb-1571-4235-85ba-05511a343c4d for instance with vm_state active and task_state None.
Apr 14 01:00:19 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:00:22 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:00:24 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:00:24 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:00:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:00:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:00:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 01:00:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 01:00:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 01:00:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:00:32 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:00:32 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:00:32 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Starting heal instance info cache {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 01:00:32 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Rebuilding the list of instances to heal {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 01:00:32 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "refresh_cache-7d067330-8745-4e21-b93c-60c0902012c7" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:00:32 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquired lock "refresh_cache-7d067330-8745-4e21-b93c-60c0902012c7" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:00:32 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Forcefully refreshing network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 01:00:32 user nova-compute[82479]: DEBUG nova.objects.instance [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lazy-loading 'info_cache' on Instance uuid 7d067330-8745-4e21-b93c-60c0902012c7 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:00:33 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Updating instance_info_cache with network_info: [{"id": "4f9eadfb-1571-4235-85ba-05511a343c4d", "address": "fa:16:3e:66:d8:ca", "network": {"id": "c6603c41-74dd-4b44-952c-0df4228a8b77", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2088791125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed63b19014f048f5bf3f9938a151d30c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9eadfb-15", "ovs_interfaceid": "4f9eadfb-1571-4235-85ba-05511a343c4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:00:33 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Releasing lock "refresh_cache-7d067330-8745-4e21-b93c-60c0902012c7" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:00:33 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Updated the network info_cache for instance {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 01:00:33 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:00:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:00:34 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:00:36 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:00:36 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:00:36 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82479) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 01:00:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:00:39 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:00:39 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:00:39 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:00:39 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:00:39 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:00:39 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Auditing locally available compute resources for user (node: user) {{(pid=82479) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 01:00:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d067330-8745-4e21-b93c-60c0902012c7/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:00:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d067330-8745-4e21-b93c-60c0902012c7/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:00:39 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d067330-8745-4e21-b93c-60c0902012c7/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:00:40 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d067330-8745-4e21-b93c-60c0902012c7/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:00:40 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:00:40 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:00:40 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Hypervisor/Node resource view: name=user free_ram=8757MB free_disk=26.118446350097656GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82479) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 01:00:40 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:00:40 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:00:40 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 7d067330-8745-4e21-b93c-60c0902012c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:00:40 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 01:00:40 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 01:00:40 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:00:40 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:00:40 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Compute_service record updated for user:user {{(pid=82479) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 01:00:40 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.192s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:00:43 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:00:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:00:46 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:00:47 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:00:48 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:00:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:00:54 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:00:57 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:00:59 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:01:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:01:09 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:01:14 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:01:14 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:01:14 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 01:01:14 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 01:01:14 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 01:01:14 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:01:19 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:01:24 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:01:26 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:01:27 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:01:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:01:30 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:01:30 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Cleaning up deleted instances {{(pid=82479) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 01:01:30 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] There are 0 instances to clean {{(pid=82479) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 01:01:33 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:01:33 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Starting heal instance info cache {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 01:01:33 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Rebuilding the list of instances to heal {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 01:01:33 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "refresh_cache-7d067330-8745-4e21-b93c-60c0902012c7" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:01:33 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquired lock "refresh_cache-7d067330-8745-4e21-b93c-60c0902012c7" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:01:33 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Forcefully refreshing network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 01:01:33 user nova-compute[82479]: DEBUG nova.objects.instance [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lazy-loading 'info_cache' on Instance uuid 7d067330-8745-4e21-b93c-60c0902012c7 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:01:34 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Updating instance_info_cache with network_info: [{"id": "4f9eadfb-1571-4235-85ba-05511a343c4d", "address": "fa:16:3e:66:d8:ca", "network": {"id": "c6603c41-74dd-4b44-952c-0df4228a8b77", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2088791125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed63b19014f048f5bf3f9938a151d30c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9eadfb-15", "ovs_interfaceid": "4f9eadfb-1571-4235-85ba-05511a343c4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:01:34 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Releasing lock "refresh_cache-7d067330-8745-4e21-b93c-60c0902012c7" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:01:34 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Updated the network info_cache for instance {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 01:01:34 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:01:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:01:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:01:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 01:01:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 01:01:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 01:01:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:01:35 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:01:35 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:01:37 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:01:37 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82479) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 01:01:39 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:01:41 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:01:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:01:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:01:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:01:41 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Auditing locally available compute resources for user (node: user) {{(pid=82479) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 01:01:41 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d067330-8745-4e21-b93c-60c0902012c7/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:01:41 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d067330-8745-4e21-b93c-60c0902012c7/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:01:41 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d067330-8745-4e21-b93c-60c0902012c7/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:01:41 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d067330-8745-4e21-b93c-60c0902012c7/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:01:42 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:01:42 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:01:42 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Hypervisor/Node resource view: name=user free_ram=8787MB free_disk=26.117877960205078GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82479) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 01:01:42 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:01:42 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:01:42 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 7d067330-8745-4e21-b93c-60c0902012c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:01:42 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 01:01:42 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 01:01:42 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Refreshing inventories for resource provider 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 01:01:42 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Updating ProviderTree inventory for provider 3847975a-19aa-4b27-9180-14b5cc49044a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 01:01:42 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Updating inventory in ProviderTree for provider 3847975a-19aa-4b27-9180-14b5cc49044a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 01:01:42 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Refreshing aggregate associations for resource provider 3847975a-19aa-4b27-9180-14b5cc49044a, aggregates: None {{(pid=82479) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 01:01:42 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Refreshing trait associations for resource provider 3847975a-19aa-4b27-9180-14b5cc49044a, traits: COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,HW_CPU_X86_SSE42,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO {{(pid=82479) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 01:01:42 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:01:42 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:01:42 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Compute_service record updated for user:user {{(pid=82479) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 01:01:42 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.276s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:01:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:01:44 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:01:46 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:01:47 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:01:48 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:01:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:01:54 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:01:54 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:01:54 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 01:01:54 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 01:01:54 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 01:01:54 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:01:58 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:01:58 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Cleaning up deleted instances with incomplete migration  {{(pid=82479) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 01:01:59 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:02:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:02:05 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:02:06 user nova-compute[82479]: DEBUG nova.compute.manager [req-c8b1551f-fc6f-4926-827e-e2edf835ade0 req-2679af66-c5ba-4e05-8849-07dbf646e4cf service nova] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Received event network-changed-4f9eadfb-1571-4235-85ba-05511a343c4d {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:02:06 user nova-compute[82479]: DEBUG nova.compute.manager [req-c8b1551f-fc6f-4926-827e-e2edf835ade0 req-2679af66-c5ba-4e05-8849-07dbf646e4cf service nova] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Refreshing instance network info cache due to event network-changed-4f9eadfb-1571-4235-85ba-05511a343c4d. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:02:06 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-c8b1551f-fc6f-4926-827e-e2edf835ade0 req-2679af66-c5ba-4e05-8849-07dbf646e4cf service nova] Acquiring lock "refresh_cache-7d067330-8745-4e21-b93c-60c0902012c7" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:02:06 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-c8b1551f-fc6f-4926-827e-e2edf835ade0 req-2679af66-c5ba-4e05-8849-07dbf646e4cf service nova] Acquired lock "refresh_cache-7d067330-8745-4e21-b93c-60c0902012c7" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:02:06 user nova-compute[82479]: DEBUG nova.network.neutron [req-c8b1551f-fc6f-4926-827e-e2edf835ade0 req-2679af66-c5ba-4e05-8849-07dbf646e4cf service nova] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Refreshing network info cache for port 4f9eadfb-1571-4235-85ba-05511a343c4d {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:02:06 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-de25f916-2b09-4e34-8f98-7f827e22d812 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "7d067330-8745-4e21-b93c-60c0902012c7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:02:06 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-de25f916-2b09-4e34-8f98-7f827e22d812 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "7d067330-8745-4e21-b93c-60c0902012c7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:02:06 user nova-compute[82479]: DEBUG nova.objects.instance [None req-de25f916-2b09-4e34-8f98-7f827e22d812 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lazy-loading 'flavor' on Instance uuid 7d067330-8745-4e21-b93c-60c0902012c7 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:02:06 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-de25f916-2b09-4e34-8f98-7f827e22d812 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "7d067330-8745-4e21-b93c-60c0902012c7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:02:06 user nova-compute[82479]: DEBUG nova.network.neutron [req-c8b1551f-fc6f-4926-827e-e2edf835ade0 req-2679af66-c5ba-4e05-8849-07dbf646e4cf service nova] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Updated VIF entry in instance network info cache for port 4f9eadfb-1571-4235-85ba-05511a343c4d. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 01:02:06 user nova-compute[82479]: DEBUG nova.network.neutron [req-c8b1551f-fc6f-4926-827e-e2edf835ade0 req-2679af66-c5ba-4e05-8849-07dbf646e4cf service nova] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Updating instance_info_cache with network_info: [{"id": "4f9eadfb-1571-4235-85ba-05511a343c4d", "address": "fa:16:3e:66:d8:ca", "network": {"id": "c6603c41-74dd-4b44-952c-0df4228a8b77", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2088791125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed63b19014f048f5bf3f9938a151d30c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9eadfb-15", "ovs_interfaceid": "4f9eadfb-1571-4235-85ba-05511a343c4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:02:06 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-c8b1551f-fc6f-4926-827e-e2edf835ade0 req-2679af66-c5ba-4e05-8849-07dbf646e4cf service nova] Releasing lock "refresh_cache-7d067330-8745-4e21-b93c-60c0902012c7" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:02:06 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-de25f916-2b09-4e34-8f98-7f827e22d812 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "7d067330-8745-4e21-b93c-60c0902012c7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:02:06 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-de25f916-2b09-4e34-8f98-7f827e22d812 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "7d067330-8745-4e21-b93c-60c0902012c7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:02:06 user nova-compute[82479]: INFO nova.compute.manager [None req-de25f916-2b09-4e34-8f98-7f827e22d812 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Attaching volume 741de32b-bc3e-4427-a231-40e54c136117 to /dev/vdb
Apr 14 01:02:06 user nova-compute[82479]: DEBUG os_brick.utils [None req-de25f916-2b09-4e34-8f98-7f827e22d812 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:02:06 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:02:06 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:02:06 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9a36cd-0e65-4bed-bdc9-695512569ddd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fec92fcfdd3\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:02:06 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:02:06 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:02:06 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08d66f8-6d53-4bf3-8f2e-dcd32bc465aa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:02:06 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:02:06 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:02:06 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[f95ae938-7c17-42e4-a0b0-ba620a416c4f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:02:06 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[0885ef2e-40b5-4e68-81dc-16323015f588]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:02:06 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-de25f916-2b09-4e34-8f98-7f827e22d812 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Running cmd (subprocess): nvme version {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:02:06 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-de25f916-2b09-4e34-8f98-7f827e22d812 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] 'nvme version' failed. Not Retrying. {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:02:06 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.nvmeof [None req-de25f916-2b09-4e34-8f98-7f827e22d812 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] nvme not present on system {{(pid=82479) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 01:02:06 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:02:06 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:02:06 user nova-compute[82479]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 01:02:06 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb6d7b7-528c-475d-a103-52bf8399420c]: (4, '') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:02:06 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-de25f916-2b09-4e34-8f98-7f827e22d812 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82479) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 01:02:06 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-de25f916-2b09-4e34-8f98-7f827e22d812 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 01:02:06 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-de25f916-2b09-4e34-8f98-7f827e22d812 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] LIGHTOS: no hostnqn found. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 01:02:06 user nova-compute[82479]: DEBUG os_brick.utils [None req-de25f916-2b09-4e34-8f98-7f827e22d812 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fec92fcfdd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:02:06 user nova-compute[82479]: DEBUG nova.virt.block_device [None req-de25f916-2b09-4e34-8f98-7f827e22d812 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Updating existing volume attachment record: 77033de1-738c-4a64-a37c-260e0742a881 {{(pid=82479) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 01:02:07 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:02:09 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:02:11 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de25f916-2b09-4e34-8f98-7f827e22d812 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Calling os-brick to attach iSCSI Volume {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 01:02:11 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-de25f916-2b09-4e34-8f98-7f827e22d812 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VKcXGqJg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:02:11 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-de25f916-2b09-4e34-8f98-7f827e22d812 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:02:11 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-de25f916-2b09-4e34-8f98-7f827e22d812 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:02:11 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-de25f916-2b09-4e34-8f98-7f827e22d812 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:02:11 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-de25f916-2b09-4e34-8f98-7f827e22d812 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:02:11 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-de25f916-2b09-4e34-8f98-7f827e22d812 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:02:11 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-de25f916-2b09-4e34-8f98-7f827e22d812 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:02:11 user nova-compute[82479]: INFO os_brick.initiator.connectors.iscsi [None req-de25f916-2b09-4e34-8f98-7f827e22d812 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 01:02:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117 -p 172.16.0.220:3260 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:02:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:02:11 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[81745597-bd5e-45b3-9655-4d385c2a33a9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:02:11 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-de25f916-2b09-4e34-8f98-7f827e22d812 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 01:02:11 user nova-compute[82479]:  {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:02:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117 -p 172.16.0.220:3260 --interface default --op new {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:02:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:02:11 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[96fb7678-cf19-474d-8336-ba4481a00b23]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117] added\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:02:11 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-de25f916-2b09-4e34-8f98-7f827e22d812 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117] added
Apr 14 01:02:11 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:02:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:02:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:02:11 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[d87d9b1c-52df-4307-bcd9-14c54a4c660e]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:02:11 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-de25f916-2b09-4e34-8f98-7f827e22d812 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:02:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:02:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:02:11 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[28010624-0151-4352-91bc-16306358b658]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:02:11 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-de25f916-2b09-4e34-8f98-7f827e22d812 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:02:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VKcXGqJg {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:02:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VKcXGqJg" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:02:11 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78f6da7-3c5d-4af9-919b-74e9487baffe]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:02:11 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-de25f916-2b09-4e34-8f98-7f827e22d812 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VKcXGqJg'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:02:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:02:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:02:11 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7a6eff-204c-4d41-85a5-c3c710a8dcc8]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:02:11 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-de25f916-2b09-4e34-8f98-7f827e22d812 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:02:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:02:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:02:11 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[2547f2c4-ddbc-4f86-b427-c5a39069e8b8]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:02:11 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-de25f916-2b09-4e34-8f98-7f827e22d812 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 01:02:11 user nova-compute[82479]:  {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:02:11 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-de25f916-2b09-4e34-8f98-7f827e22d812 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 01:02:11 user nova-compute[82479]:  {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:02:11 user nova-compute[82479]: WARNING os_brick.initiator.connectors.iscsi [None req-de25f916-2b09-4e34-8f98-7f827e22d812 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 01:02:11 user nova-compute[82479]: 
Apr 14 01:02:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117 -p 172.16.0.220:3260 --login {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:02:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:02:11 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6442968-da01-43a1-a53b-a8910af17a80]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:02:11 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-de25f916-2b09-4e34-8f98-7f827e22d812 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117, portal: 172.16.0.220,3260]
Apr 14 01:02:11 user nova-compute[82479]: Login to [iface: default, target: iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117, portal: 172.16.0.220,3260] successful.
Apr 14 01:02:11 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:02:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:02:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:02:11 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0af9786-2875-48f0-b900-c89e7d104ca7]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:02:11 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-de25f916-2b09-4e34-8f98-7f827e22d812 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:02:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:02:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:02:11 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ff4fb7-d572-42a5-9064-f88d65359892]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:02:11 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-de25f916-2b09-4e34-8f98-7f827e22d812 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117 (non-flash)
Apr 14 01:02:11 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:02:11 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-de25f916-2b09-4e34-8f98-7f827e22d812 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117 (non-flash)
Apr 14 01:02:11 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:02:11 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-de25f916-2b09-4e34-8f98-7f827e22d812 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:02:11 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-de25f916-2b09-4e34-8f98-7f827e22d812 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Connected to 172.16.0.220:3260 {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 01:02:11 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-de25f916-2b09-4e34-8f98-7f827e22d812 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=82479) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 01:02:11 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-de25f916-2b09-4e34-8f98-7f827e22d812 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82479) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 01:02:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:02:11 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:02:11 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e6dda6-3c6a-4ac1-bd70-d3c6ae04f90d]: (4, ('- - 0', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:02:11 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-de25f916-2b09-4e34-8f98-7f827e22d812 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82479) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 01:02:11 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-de25f916-2b09-4e34-8f98-7f827e22d812 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VKcXGqJg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 01:02:12 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:02:12 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-de25f916-2b09-4e34-8f98-7f827e22d812 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:02:12 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-de25f916-2b09-4e34-8f98-7f827e22d812 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '26634366636373863', 'path': '/dev/sdb'} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:02:12 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de25f916-2b09-4e34-8f98-7f827e22d812 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26634366636373863', 'path': '/dev/sdb'} {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 01:02:12 user nova-compute[82479]: DEBUG nova.objects.instance [None req-de25f916-2b09-4e34-8f98-7f827e22d812 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lazy-loading 'flavor' on Instance uuid 7d067330-8745-4e21-b93c-60c0902012c7 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:02:12 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-de25f916-2b09-4e34-8f98-7f827e22d812 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 01:02:12 user nova-compute[82479]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:02:12 user nova-compute[82479]:   <source dev="/dev/sdb"/>
Apr 14 01:02:12 user nova-compute[82479]:   <target dev="vdb" bus="virtio"/>
Apr 14 01:02:12 user nova-compute[82479]:   <serial>741de32b-bc3e-4427-a231-40e54c136117</serial>
Apr 14 01:02:12 user nova-compute[82479]: </disk>
Apr 14 01:02:12 user nova-compute[82479]:  {{(pid=82479) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 01:02:13 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-de25f916-2b09-4e34-8f98-7f827e22d812 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:02:13 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-de25f916-2b09-4e34-8f98-7f827e22d812 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:02:13 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-de25f916-2b09-4e34-8f98-7f827e22d812 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] No VIF found with MAC fa:16:3e:66:d8:ca, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 01:02:13 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-de25f916-2b09-4e34-8f98-7f827e22d812 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "7d067330-8745-4e21-b93c-60c0902012c7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.365s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:02:14 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:02:17 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:02:18 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._sync_power_states {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:02:18 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Triggering sync for uuid 7d067330-8745-4e21-b93c-60c0902012c7 {{(pid=82479) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 01:02:18 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "7d067330-8745-4e21-b93c-60c0902012c7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:02:18 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "7d067330-8745-4e21-b93c-60c0902012c7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:02:18 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "7d067330-8745-4e21-b93c-60c0902012c7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.023s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:02:19 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:02:21 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-65b5c058-d4d2-41bc-8794-ae7f6aaf1aa4 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "7d067330-8745-4e21-b93c-60c0902012c7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:02:21 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-65b5c058-d4d2-41bc-8794-ae7f6aaf1aa4 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "7d067330-8745-4e21-b93c-60c0902012c7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:02:21 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:02:21 user nova-compute[82479]: INFO nova.compute.manager [None req-65b5c058-d4d2-41bc-8794-ae7f6aaf1aa4 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Detaching volume 741de32b-bc3e-4427-a231-40e54c136117
Apr 14 01:02:21 user nova-compute[82479]: INFO nova.virt.block_device [None req-65b5c058-d4d2-41bc-8794-ae7f6aaf1aa4 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Attempting to driver detach volume 741de32b-bc3e-4427-a231-40e54c136117 from mountpoint /dev/vdb
Apr 14 01:02:21 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-65b5c058-d4d2-41bc-8794-ae7f6aaf1aa4 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Attempting to detach device vdb from instance 7d067330-8745-4e21-b93c-60c0902012c7 from the persistent domain config. {{(pid=82479) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 01:02:21 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-65b5c058-d4d2-41bc-8794-ae7f6aaf1aa4 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 01:02:21 user nova-compute[82479]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:02:21 user nova-compute[82479]:   <source dev="/dev/sdb"/>
Apr 14 01:02:21 user nova-compute[82479]:   <target dev="vdb" bus="virtio"/>
Apr 14 01:02:21 user nova-compute[82479]:   <serial>741de32b-bc3e-4427-a231-40e54c136117</serial>
Apr 14 01:02:21 user nova-compute[82479]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 01:02:21 user nova-compute[82479]: </disk>
Apr 14 01:02:21 user nova-compute[82479]:  {{(pid=82479) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 01:02:21 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-65b5c058-d4d2-41bc-8794-ae7f6aaf1aa4 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Successfully detached device vdb from instance 7d067330-8745-4e21-b93c-60c0902012c7 from the persistent domain config.
Apr 14 01:02:21 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-65b5c058-d4d2-41bc-8794-ae7f6aaf1aa4 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7d067330-8745-4e21-b93c-60c0902012c7 from the live domain config. {{(pid=82479) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 01:02:21 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-65b5c058-d4d2-41bc-8794-ae7f6aaf1aa4 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 01:02:21 user nova-compute[82479]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:02:21 user nova-compute[82479]:   <source dev="/dev/sdb"/>
Apr 14 01:02:21 user nova-compute[82479]:   <target dev="vdb" bus="virtio"/>
Apr 14 01:02:21 user nova-compute[82479]:   <serial>741de32b-bc3e-4427-a231-40e54c136117</serial>
Apr 14 01:02:21 user nova-compute[82479]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 01:02:21 user nova-compute[82479]: </disk>
Apr 14 01:02:21 user nova-compute[82479]:  {{(pid=82479) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 01:02:22 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:02:22 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Received event <DeviceRemovedEvent: 1681434142.1267097, 7d067330-8745-4e21-b93c-60c0902012c7 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82479) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 01:02:22 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-65b5c058-d4d2-41bc-8794-ae7f6aaf1aa4 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7d067330-8745-4e21-b93c-60c0902012c7 {{(pid=82479) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 01:02:22 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-65b5c058-d4d2-41bc-8794-ae7f6aaf1aa4 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Successfully detached device vdb from instance 7d067330-8745-4e21-b93c-60c0902012c7 from the live domain config.
Apr 14 01:02:22 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65b5c058-d4d2-41bc-8794-ae7f6aaf1aa4 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] calling os-brick to detach iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 01:02:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b5c058-d4d2-41bc-8794-ae7f6aaf1aa4 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, {'target_iqn': 'iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VKcXGqJg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:02:22 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-65b5c058-d4d2-41bc-8794-ae7f6aaf1aa4 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:02:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-65b5c058-d4d2-41bc-8794-ae7f6aaf1aa4 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:02:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-65b5c058-d4d2-41bc-8794-ae7f6aaf1aa4 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:02:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:02:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:02:22 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2cbd44f-8c43-4db6-92a0-ea1b8441872e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:02:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b5c058-d4d2-41bc-8794-ae7f6aaf1aa4 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 01:02:22 user nova-compute[82479]: No targets found.
Apr 14 01:02:22 user nova-compute[82479]: iSNS:
Apr 14 01:02:22 user nova-compute[82479]: No targets found.
Apr 14 01:02:22 user nova-compute[82479]: STATIC:
Apr 14 01:02:22 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117
Apr 14 01:02:22 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:02:22 user nova-compute[82479]:                 Iface Name: default
Apr 14 01:02:22 user nova-compute[82479]: FIRMWARE:
Apr 14 01:02:22 user nova-compute[82479]: No targets found.
Apr 14 01:02:22 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:02:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b5c058-d4d2-41bc-8794-ae7f6aaf1aa4 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 01:02:22 user nova-compute[82479]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 01:02:22 user nova-compute[82479]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82479) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 01:02:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b5c058-d4d2-41bc-8794-ae7f6aaf1aa4 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117', 0)] {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 01:02:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:02:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:02:22 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[75735b3c-80f1-4dba-9370-79189c05bfc5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:02:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:02:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:02:22 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[a271fc5c-55f9-4cf1-a86b-86846eb2677c]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:02:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b5c058-d4d2-41bc-8794-ae7f6aaf1aa4 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117 (non-flash)
Apr 14 01:02:22 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:02:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b5c058-d4d2-41bc-8794-ae7f6aaf1aa4 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117 (non-flash)
Apr 14 01:02:22 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:02:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b5c058-d4d2-41bc-8794-ae7f6aaf1aa4 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f330c685000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117'): ({'sdb'}, set())}) {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 01:02:22 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-65b5c058-d4d2-41bc-8794-ae7f6aaf1aa4 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Removing single pathed devices sdb {{(pid=82479) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 01:02:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:02:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:02:22 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d9ceaf-e3ff-4ec1-bc10-b440f11c017d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:02:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:02:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:02:22 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8de1a8-181d-46e2-a1ae-3bb71023c460]: (4, ('ok\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:02:22 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-65b5c058-d4d2-41bc-8794-ae7f6aaf1aa4 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Flushing IO for device /dev/sdb {{(pid=82479) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 01:02:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:02:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:02:22 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf079e43-3a3f-4658-b449-c2de82f550d0]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:02:22 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-65b5c058-d4d2-41bc-8794-ae7f6aaf1aa4 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82479) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 01:02:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:02:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:02:22 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f506475-7290-47fe-bd03-9ccf2f6f8bcf]: (4, ('1', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:02:22 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-65b5c058-d4d2-41bc-8794-ae7f6aaf1aa4 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 01:02:22 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-65b5c058-d4d2-41bc-8794-ae7f6aaf1aa4 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] SCSI volumes sdb have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 01:02:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b5c058-d4d2-41bc-8794-ae7f6aaf1aa4 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117')] {{(pid=82479) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 01:02:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:02:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:02:22 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aeac1cc-1edc-44bf-ba14-c0535c97486d]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:02:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b5c058-d4d2-41bc-8794-ae7f6aaf1aa4 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:02:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117 -p 172.16.0.220:3260 --logout {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:02:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:02:22 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae324186-6436-400c-a874-d789b57159b6]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:02:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b5c058-d4d2-41bc-8794-ae7f6aaf1aa4 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117, portal: 172.16.0.220,3260]
Apr 14 01:02:22 user nova-compute[82479]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117, portal: 172.16.0.220,3260] successful.
Apr 14 01:02:22 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:02:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117 -p 172.16.0.220:3260 --op delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:02:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:02:22 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a018dfd-1508-43d4-8dca-65d9b2d5ee01]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:02:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b5c058-d4d2-41bc-8794-ae7f6aaf1aa4 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:02:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-65b5c058-d4d2-41bc-8794-ae7f6aaf1aa4 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:02:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b5c058-d4d2-41bc-8794-ae7f6aaf1aa4 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] <== disconnect_volume: return (279ms) None {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:02:22 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65b5c058-d4d2-41bc-8794-ae7f6aaf1aa4 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Disconnected iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 01:02:23 user nova-compute[82479]: DEBUG nova.objects.instance [None req-65b5c058-d4d2-41bc-8794-ae7f6aaf1aa4 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lazy-loading 'flavor' on Instance uuid 7d067330-8745-4e21-b93c-60c0902012c7 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:02:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-65b5c058-d4d2-41bc-8794-ae7f6aaf1aa4 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "7d067330-8745-4e21-b93c-60c0902012c7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.625s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:02:24 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:02:27 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:02:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:02:33 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:02:33 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Starting heal instance info cache {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 01:02:33 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Rebuilding the list of instances to heal {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 01:02:33 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "refresh_cache-7d067330-8745-4e21-b93c-60c0902012c7" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:02:33 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquired lock "refresh_cache-7d067330-8745-4e21-b93c-60c0902012c7" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:02:33 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Forcefully refreshing network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 01:02:33 user nova-compute[82479]: DEBUG nova.objects.instance [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lazy-loading 'info_cache' on Instance uuid 7d067330-8745-4e21-b93c-60c0902012c7 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:02:34 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Updating instance_info_cache with network_info: [{"id": "4f9eadfb-1571-4235-85ba-05511a343c4d", "address": "fa:16:3e:66:d8:ca", "network": {"id": "c6603c41-74dd-4b44-952c-0df4228a8b77", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2088791125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed63b19014f048f5bf3f9938a151d30c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9eadfb-15", "ovs_interfaceid": "4f9eadfb-1571-4235-85ba-05511a343c4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:02:34 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Releasing lock "refresh_cache-7d067330-8745-4e21-b93c-60c0902012c7" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:02:34 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Updated the network info_cache for instance {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 01:02:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:02:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:02:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 01:02:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 01:02:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 01:02:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:02:35 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:02:35 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:02:37 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:02:39 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:02:39 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82479) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 01:02:39 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:02:43 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:02:43 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:02:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:02:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:02:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:02:43 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Auditing locally available compute resources for user (node: user) {{(pid=82479) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 01:02:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d067330-8745-4e21-b93c-60c0902012c7/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:02:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d067330-8745-4e21-b93c-60c0902012c7/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:02:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d067330-8745-4e21-b93c-60c0902012c7/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:02:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d067330-8745-4e21-b93c-60c0902012c7/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:02:44 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:02:44 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:02:44 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Hypervisor/Node resource view: name=user free_ram=8773MB free_disk=26.11661148071289GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82479) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 01:02:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:02:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:02:44 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 7d067330-8745-4e21-b93c-60c0902012c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:02:44 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 01:02:44 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 01:02:44 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:02:44 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:02:44 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Compute_service record updated for user:user {{(pid=82479) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 01:02:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.166s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:02:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:02:47 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:02:49 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:02:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:02:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:02:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 01:02:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 01:02:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 01:02:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:02:54 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:02:59 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:03:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:03:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:03:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 01:03:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 01:03:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 01:03:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:03:09 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:03:09 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:03:09 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 01:03:09 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 01:03:09 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 01:03:09 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:03:14 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:03:14 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a7fa3bf5-abfe-4453-9673-1a53d953673f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "7d067330-8745-4e21-b93c-60c0902012c7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:03:14 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a7fa3bf5-abfe-4453-9673-1a53d953673f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "7d067330-8745-4e21-b93c-60c0902012c7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:03:14 user nova-compute[82479]: DEBUG nova.objects.instance [None req-a7fa3bf5-abfe-4453-9673-1a53d953673f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lazy-loading 'flavor' on Instance uuid 7d067330-8745-4e21-b93c-60c0902012c7 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:03:14 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a7fa3bf5-abfe-4453-9673-1a53d953673f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "7d067330-8745-4e21-b93c-60c0902012c7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:03:14 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a7fa3bf5-abfe-4453-9673-1a53d953673f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "7d067330-8745-4e21-b93c-60c0902012c7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:03:14 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a7fa3bf5-abfe-4453-9673-1a53d953673f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "7d067330-8745-4e21-b93c-60c0902012c7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:03:14 user nova-compute[82479]: INFO nova.compute.manager [None req-a7fa3bf5-abfe-4453-9673-1a53d953673f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Attaching volume 2c7f118b-fbc9-4f79-8d22-e15c5677aed5 to /dev/vdb
Apr 14 01:03:15 user nova-compute[82479]: DEBUG os_brick.utils [None req-a7fa3bf5-abfe-4453-9673-1a53d953673f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:03:15 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:03:15 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:03:15 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[071388ae-5683-4bf1-9fd0-0cdd8c0d55ae]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fec92fcfdd3\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:03:15 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:03:15 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:03:15 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e04a51-4b57-4708-9de9-8210ec708b25]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:03:15 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:03:15 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:03:15 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[a257fd3f-92f1-432d-b3b7-b725c8f52e7e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:03:15 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[3344740e-2479-4827-afeb-f3e6e782ebcd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:03:15 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-a7fa3bf5-abfe-4453-9673-1a53d953673f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Running cmd (subprocess): nvme version {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:03:15 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-a7fa3bf5-abfe-4453-9673-1a53d953673f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] 'nvme version' failed. Not Retrying. {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:03:15 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a7fa3bf5-abfe-4453-9673-1a53d953673f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] nvme not present on system {{(pid=82479) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 01:03:15 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:03:15 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:03:15 user nova-compute[82479]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 01:03:15 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d01200b-28c5-4f86-98fe-3d3a8f1be5df]: (4, '') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:03:15 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-a7fa3bf5-abfe-4453-9673-1a53d953673f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82479) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 01:03:15 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-a7fa3bf5-abfe-4453-9673-1a53d953673f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 01:03:15 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-a7fa3bf5-abfe-4453-9673-1a53d953673f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] LIGHTOS: no hostnqn found. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 01:03:15 user nova-compute[82479]: DEBUG os_brick.utils [None req-a7fa3bf5-abfe-4453-9673-1a53d953673f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fec92fcfdd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:03:15 user nova-compute[82479]: DEBUG nova.virt.block_device [None req-a7fa3bf5-abfe-4453-9673-1a53d953673f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Updating existing volume attachment record: 24b4abc0-23cd-402e-b23e-75c37e028c6a {{(pid=82479) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 01:03:17 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:03:19 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7fa3bf5-abfe-4453-9673-1a53d953673f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Calling os-brick to attach iSCSI Volume {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 01:03:19 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fa3bf5-abfe-4453-9673-1a53d953673f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nejNuvOC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:03:19 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-a7fa3bf5-abfe-4453-9673-1a53d953673f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:03:19 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-a7fa3bf5-abfe-4453-9673-1a53d953673f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:03:19 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-a7fa3bf5-abfe-4453-9673-1a53d953673f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:03:19 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-a7fa3bf5-abfe-4453-9673-1a53d953673f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:03:19 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-a7fa3bf5-abfe-4453-9673-1a53d953673f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:03:19 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-a7fa3bf5-abfe-4453-9673-1a53d953673f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:03:19 user nova-compute[82479]: INFO os_brick.initiator.connectors.iscsi [None req-a7fa3bf5-abfe-4453-9673-1a53d953673f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 01:03:19 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5 -p 172.16.0.220:3260 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:03:19 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:03:19 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe9b4f05-c3b5-479d-9f91-e8622196a0cb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:03:19 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fa3bf5-abfe-4453-9673-1a53d953673f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 01:03:19 user nova-compute[82479]:  {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:03:19 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5 -p 172.16.0.220:3260 --interface default --op new {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:03:19 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:03:19 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c30c4d9-3d06-43d0-9bcf-81a0bcf79ca5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5] added\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:03:19 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fa3bf5-abfe-4453-9673-1a53d953673f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5] added
Apr 14 01:03:19 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:03:19 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:03:19 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:03:19 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:03:19 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf4b29d-0766-4b6f-ac0f-4c4e6ccfde25]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:03:19 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fa3bf5-abfe-4453-9673-1a53d953673f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:03:19 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:03:19 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:03:19 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ebf2d8-368f-4405-b9dc-57342d2be48a]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:03:19 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fa3bf5-abfe-4453-9673-1a53d953673f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:03:19 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nejNuvOC {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:03:19 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nejNuvOC" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:03:19 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[2063ce8e-ed3a-4814-93cc-da063547c02a]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:03:19 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fa3bf5-abfe-4453-9673-1a53d953673f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nejNuvOC'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:03:19 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:03:19 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:03:19 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[112f9e78-3065-4a0c-89ba-5ff8b3719f82]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:03:19 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fa3bf5-abfe-4453-9673-1a53d953673f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:03:19 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:03:19 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:03:19 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[0662e4ee-5d70-44d6-853f-dc7fd84d7b82]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:03:19 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fa3bf5-abfe-4453-9673-1a53d953673f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 01:03:19 user nova-compute[82479]:  {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:03:19 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fa3bf5-abfe-4453-9673-1a53d953673f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 01:03:19 user nova-compute[82479]:  {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:03:19 user nova-compute[82479]: WARNING os_brick.initiator.connectors.iscsi [None req-a7fa3bf5-abfe-4453-9673-1a53d953673f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 01:03:19 user nova-compute[82479]: 
Apr 14 01:03:19 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5 -p 172.16.0.220:3260 --login {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:03:19 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:03:19 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbeb9889-234e-4a22-98fb-1061b4030974]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:03:19 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fa3bf5-abfe-4453-9673-1a53d953673f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5, portal: 172.16.0.220,3260]
Apr 14 01:03:19 user nova-compute[82479]: Login to [iface: default, target: iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5, portal: 172.16.0.220,3260] successful.
Apr 14 01:03:19 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:03:19 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:03:19 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:03:19 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef90461-9861-4fbf-8eea-4b2a2a747f6f]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:03:19 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fa3bf5-abfe-4453-9673-1a53d953673f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:03:19 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:03:19 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:03:19 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fdf41dd-62f9-498e-a02f-4b1773a52ccb]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:03:19 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fa3bf5-abfe-4453-9673-1a53d953673f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5 (non-flash)
Apr 14 01:03:19 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:03:19 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fa3bf5-abfe-4453-9673-1a53d953673f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5 (non-flash)
Apr 14 01:03:19 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:03:19 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-a7fa3bf5-abfe-4453-9673-1a53d953673f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:03:19 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fa3bf5-abfe-4453-9673-1a53d953673f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Connected to 172.16.0.220:3260 {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 01:03:19 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-a7fa3bf5-abfe-4453-9673-1a53d953673f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=82479) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 01:03:19 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-a7fa3bf5-abfe-4453-9673-1a53d953673f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82479) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 01:03:19 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:03:19 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:03:19 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[935b9abc-bae7-4259-9b15-b014df6d03ee]: (4, ('- - 0', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:03:19 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-a7fa3bf5-abfe-4453-9673-1a53d953673f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82479) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 01:03:19 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fa3bf5-abfe-4453-9673-1a53d953673f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nejNuvOC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 01:03:20 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-a7fa3bf5-abfe-4453-9673-1a53d953673f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:03:20 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7fa3bf5-abfe-4453-9673-1a53d953673f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '23337636634343532', 'path': '/dev/sdb'} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:03:20 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7fa3bf5-abfe-4453-9673-1a53d953673f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337636634343532', 'path': '/dev/sdb'} {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 01:03:20 user nova-compute[82479]: DEBUG nova.objects.instance [None req-a7fa3bf5-abfe-4453-9673-1a53d953673f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lazy-loading 'flavor' on Instance uuid 7d067330-8745-4e21-b93c-60c0902012c7 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:03:20 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-a7fa3bf5-abfe-4453-9673-1a53d953673f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 01:03:20 user nova-compute[82479]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:03:20 user nova-compute[82479]:   <source dev="/dev/sdb"/>
Apr 14 01:03:20 user nova-compute[82479]:   <target dev="vdb" bus="virtio"/>
Apr 14 01:03:20 user nova-compute[82479]:   <serial>2c7f118b-fbc9-4f79-8d22-e15c5677aed5</serial>
Apr 14 01:03:20 user nova-compute[82479]: </disk>
Apr 14 01:03:20 user nova-compute[82479]:  {{(pid=82479) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 01:03:21 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-a7fa3bf5-abfe-4453-9673-1a53d953673f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:03:21 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-a7fa3bf5-abfe-4453-9673-1a53d953673f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:03:21 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-a7fa3bf5-abfe-4453-9673-1a53d953673f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] No VIF found with MAC fa:16:3e:66:d8:ca, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 01:03:21 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-a7fa3bf5-abfe-4453-9673-1a53d953673f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "7d067330-8745-4e21-b93c-60c0902012c7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.456s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:03:22 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:03:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-2471f735-9a5d-4f5e-854f-890946816550 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "7d067330-8745-4e21-b93c-60c0902012c7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:03:23 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-2471f735-9a5d-4f5e-854f-890946816550 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "7d067330-8745-4e21-b93c-60c0902012c7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:03:23 user nova-compute[82479]: INFO nova.compute.manager [None req-2471f735-9a5d-4f5e-854f-890946816550 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Detaching volume 2c7f118b-fbc9-4f79-8d22-e15c5677aed5
Apr 14 01:03:23 user nova-compute[82479]: INFO nova.virt.block_device [None req-2471f735-9a5d-4f5e-854f-890946816550 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Attempting to driver detach volume 2c7f118b-fbc9-4f79-8d22-e15c5677aed5 from mountpoint /dev/vdb
Apr 14 01:03:23 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-2471f735-9a5d-4f5e-854f-890946816550 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Attempting to detach device vdb from instance 7d067330-8745-4e21-b93c-60c0902012c7 from the persistent domain config. {{(pid=82479) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 01:03:23 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-2471f735-9a5d-4f5e-854f-890946816550 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 01:03:23 user nova-compute[82479]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:03:23 user nova-compute[82479]:   <source dev="/dev/sdb"/>
Apr 14 01:03:23 user nova-compute[82479]:   <target dev="vdb" bus="virtio"/>
Apr 14 01:03:23 user nova-compute[82479]:   <serial>2c7f118b-fbc9-4f79-8d22-e15c5677aed5</serial>
Apr 14 01:03:23 user nova-compute[82479]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 01:03:23 user nova-compute[82479]: </disk>
Apr 14 01:03:23 user nova-compute[82479]:  {{(pid=82479) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 01:03:23 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-2471f735-9a5d-4f5e-854f-890946816550 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Successfully detached device vdb from instance 7d067330-8745-4e21-b93c-60c0902012c7 from the persistent domain config.
Apr 14 01:03:23 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-2471f735-9a5d-4f5e-854f-890946816550 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7d067330-8745-4e21-b93c-60c0902012c7 from the live domain config. {{(pid=82479) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 01:03:23 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-2471f735-9a5d-4f5e-854f-890946816550 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 01:03:23 user nova-compute[82479]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:03:23 user nova-compute[82479]:   <source dev="/dev/sdb"/>
Apr 14 01:03:23 user nova-compute[82479]:   <target dev="vdb" bus="virtio"/>
Apr 14 01:03:23 user nova-compute[82479]:   <serial>2c7f118b-fbc9-4f79-8d22-e15c5677aed5</serial>
Apr 14 01:03:23 user nova-compute[82479]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 01:03:23 user nova-compute[82479]: </disk>
Apr 14 01:03:23 user nova-compute[82479]:  {{(pid=82479) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 01:03:24 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Received event <DeviceRemovedEvent: 1681434204.006962, 7d067330-8745-4e21-b93c-60c0902012c7 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82479) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 01:03:24 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-2471f735-9a5d-4f5e-854f-890946816550 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7d067330-8745-4e21-b93c-60c0902012c7 {{(pid=82479) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 01:03:24 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-2471f735-9a5d-4f5e-854f-890946816550 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Successfully detached device vdb from instance 7d067330-8745-4e21-b93c-60c0902012c7 from the live domain config.
Apr 14 01:03:24 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2471f735-9a5d-4f5e-854f-890946816550 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] calling os-brick to detach iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 01:03:24 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-2471f735-9a5d-4f5e-854f-890946816550 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, {'target_iqn': 'iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nejNuvOC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:03:24 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-2471f735-9a5d-4f5e-854f-890946816550 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:03:24 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-2471f735-9a5d-4f5e-854f-890946816550 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:03:24 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-2471f735-9a5d-4f5e-854f-890946816550 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:03:24 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:03:24 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:03:24 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[e43d86e0-a1c2-4c90-8d1c-a3341e612c06]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:03:24 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-2471f735-9a5d-4f5e-854f-890946816550 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 01:03:24 user nova-compute[82479]: No targets found.
Apr 14 01:03:24 user nova-compute[82479]: iSNS:
Apr 14 01:03:24 user nova-compute[82479]: No targets found.
Apr 14 01:03:24 user nova-compute[82479]: STATIC:
Apr 14 01:03:24 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5
Apr 14 01:03:24 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:03:24 user nova-compute[82479]:                 Iface Name: default
Apr 14 01:03:24 user nova-compute[82479]: FIRMWARE:
Apr 14 01:03:24 user nova-compute[82479]: No targets found.
Apr 14 01:03:24 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:03:24 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-2471f735-9a5d-4f5e-854f-890946816550 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 01:03:24 user nova-compute[82479]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 01:03:24 user nova-compute[82479]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82479) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 01:03:24 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-2471f735-9a5d-4f5e-854f-890946816550 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5', 0)] {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 01:03:24 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:03:24 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:03:24 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2754212-66db-4ca3-83de-cf9d6dfa2cc6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:03:24 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:03:24 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:03:24 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc16a6b1-bf8f-475a-8bc5-8699c8179dbe]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5 (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:03:24 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-2471f735-9a5d-4f5e-854f-890946816550 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5 (non-flash)
Apr 14 01:03:24 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:03:24 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-2471f735-9a5d-4f5e-854f-890946816550 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5 (non-flash)
Apr 14 01:03:24 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:03:24 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-2471f735-9a5d-4f5e-854f-890946816550 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f330c64b7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5'): ({'sdb'}, set())}) {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 01:03:24 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-2471f735-9a5d-4f5e-854f-890946816550 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Removing single pathed devices sdb {{(pid=82479) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 01:03:24 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:03:24 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:03:24 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[8194ee74-af39-474f-9c36-0bc9ea67dd49]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:03:24 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:03:24 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:03:24 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ebaff7-b165-4c2a-9753-7778e4143479]: (4, ('ok\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:03:24 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-2471f735-9a5d-4f5e-854f-890946816550 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Flushing IO for device /dev/sdb {{(pid=82479) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 01:03:24 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:03:24 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:03:24 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd6f395-0e3e-4cc4-8b4e-1f001d7c09ad]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:03:24 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-2471f735-9a5d-4f5e-854f-890946816550 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82479) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 01:03:24 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:03:24 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:03:24 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0d4cff-b43f-42de-b3ff-46f673856a39]: (4, ('1', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:03:24 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-2471f735-9a5d-4f5e-854f-890946816550 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 01:03:24 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-2471f735-9a5d-4f5e-854f-890946816550 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] SCSI volumes sdb have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 01:03:24 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-2471f735-9a5d-4f5e-854f-890946816550 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5')] {{(pid=82479) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 01:03:24 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:03:24 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:03:24 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[5093f53c-c1c9-4df9-97f6-b51979a34748]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:03:24 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-2471f735-9a5d-4f5e-854f-890946816550 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:03:24 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5 -p 172.16.0.220:3260 --logout {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:03:24 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:03:24 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a296275-1c29-4127-bd27-224396f1aa44]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:03:24 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-2471f735-9a5d-4f5e-854f-890946816550 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5, portal: 172.16.0.220,3260]
Apr 14 01:03:24 user nova-compute[82479]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5, portal: 172.16.0.220,3260] successful.
Apr 14 01:03:24 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:03:24 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5 -p 172.16.0.220:3260 --op delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:03:24 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:03:24 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[08197560-2aa8-4dc0-9048-b0fe03849612]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:03:24 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-2471f735-9a5d-4f5e-854f-890946816550 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:03:24 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-2471f735-9a5d-4f5e-854f-890946816550 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.264s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:03:24 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-2471f735-9a5d-4f5e-854f-890946816550 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] <== disconnect_volume: return (265ms) None {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:03:24 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2471f735-9a5d-4f5e-854f-890946816550 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Disconnected iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 01:03:24 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:03:25 user nova-compute[82479]: DEBUG nova.objects.instance [None req-2471f735-9a5d-4f5e-854f-890946816550 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lazy-loading 'flavor' on Instance uuid 7d067330-8745-4e21-b93c-60c0902012c7 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:03:25 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-2471f735-9a5d-4f5e-854f-890946816550 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "7d067330-8745-4e21-b93c-60c0902012c7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.622s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:03:27 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:03:28 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:03:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:03:34 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:03:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:03:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:03:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 01:03:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 01:03:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 01:03:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:03:35 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:03:35 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Starting heal instance info cache {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 01:03:35 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Rebuilding the list of instances to heal {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 01:03:35 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "refresh_cache-7d067330-8745-4e21-b93c-60c0902012c7" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:03:35 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquired lock "refresh_cache-7d067330-8745-4e21-b93c-60c0902012c7" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:03:35 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Forcefully refreshing network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 01:03:35 user nova-compute[82479]: DEBUG nova.objects.instance [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lazy-loading 'info_cache' on Instance uuid 7d067330-8745-4e21-b93c-60c0902012c7 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:03:36 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Updating instance_info_cache with network_info: [{"id": "4f9eadfb-1571-4235-85ba-05511a343c4d", "address": "fa:16:3e:66:d8:ca", "network": {"id": "c6603c41-74dd-4b44-952c-0df4228a8b77", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2088791125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed63b19014f048f5bf3f9938a151d30c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9eadfb-15", "ovs_interfaceid": "4f9eadfb-1571-4235-85ba-05511a343c4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:03:36 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Releasing lock "refresh_cache-7d067330-8745-4e21-b93c-60c0902012c7" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:03:36 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Updated the network info_cache for instance {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 01:03:37 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:03:39 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:03:40 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:03:41 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:03:41 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82479) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 01:03:43 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:03:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:03:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:03:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:03:43 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Auditing locally available compute resources for user (node: user) {{(pid=82479) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 01:03:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d067330-8745-4e21-b93c-60c0902012c7/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:03:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d067330-8745-4e21-b93c-60c0902012c7/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:03:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d067330-8745-4e21-b93c-60c0902012c7/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:03:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d067330-8745-4e21-b93c-60c0902012c7/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:03:44 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:03:44 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:03:44 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Hypervisor/Node resource view: name=user free_ram=8770MB free_disk=26.115528106689453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82479) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 01:03:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:03:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:03:44 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 7d067330-8745-4e21-b93c-60c0902012c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:03:44 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 01:03:44 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 01:03:44 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:03:44 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:03:44 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Compute_service record updated for user:user {{(pid=82479) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 01:03:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.284s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:03:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:03:45 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:03:46 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:03:49 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:03:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:03:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:03:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 01:03:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 01:03:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 01:03:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:03:54 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:03:59 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:04:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:04:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:04:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 01:04:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 01:04:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 01:04:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:04:07 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:04:09 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:04:14 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:04:17 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-17d1f4e5-29d1-493a-b562-66fa2c30853e tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "7d067330-8745-4e21-b93c-60c0902012c7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:04:17 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-17d1f4e5-29d1-493a-b562-66fa2c30853e tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "7d067330-8745-4e21-b93c-60c0902012c7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:04:17 user nova-compute[82479]: DEBUG nova.objects.instance [None req-17d1f4e5-29d1-493a-b562-66fa2c30853e tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lazy-loading 'flavor' on Instance uuid 7d067330-8745-4e21-b93c-60c0902012c7 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:04:17 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-17d1f4e5-29d1-493a-b562-66fa2c30853e tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "7d067330-8745-4e21-b93c-60c0902012c7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:04:17 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-17d1f4e5-29d1-493a-b562-66fa2c30853e tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "7d067330-8745-4e21-b93c-60c0902012c7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:04:17 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-17d1f4e5-29d1-493a-b562-66fa2c30853e tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "7d067330-8745-4e21-b93c-60c0902012c7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:04:17 user nova-compute[82479]: INFO nova.compute.manager [None req-17d1f4e5-29d1-493a-b562-66fa2c30853e tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Attaching volume f94c5daf-01f1-4cd1-9137-28be67b2ef8e to /dev/vdb
Apr 14 01:04:17 user nova-compute[82479]: DEBUG os_brick.utils [None req-17d1f4e5-29d1-493a-b562-66fa2c30853e tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:04:17 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:04:17 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:04:17 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[8688a731-bcd7-40d7-8a8d-d3d3423ab319]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fec92fcfdd3\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:04:17 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:04:17 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:04:17 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[74efd7a2-7a0a-48e8-88aa-1fce1a69a6fe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:04:17 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:04:17 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:04:17 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dfdfbf9-99e3-45d9-a9a4-6d5bbccf17da]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:04:17 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[db101cf7-a081-4956-81a5-06f0a70ff204]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:04:17 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-17d1f4e5-29d1-493a-b562-66fa2c30853e tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Running cmd (subprocess): nvme version {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:04:17 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-17d1f4e5-29d1-493a-b562-66fa2c30853e tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] 'nvme version' failed. Not Retrying. {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:04:17 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.nvmeof [None req-17d1f4e5-29d1-493a-b562-66fa2c30853e tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] nvme not present on system {{(pid=82479) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 01:04:17 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:04:17 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:04:17 user nova-compute[82479]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 01:04:17 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d12c5dd-5928-48d3-a612-44799f9f51d1]: (4, '') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:04:17 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-17d1f4e5-29d1-493a-b562-66fa2c30853e tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82479) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 01:04:17 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-17d1f4e5-29d1-493a-b562-66fa2c30853e tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 01:04:17 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-17d1f4e5-29d1-493a-b562-66fa2c30853e tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] LIGHTOS: no hostnqn found. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 01:04:17 user nova-compute[82479]: DEBUG os_brick.utils [None req-17d1f4e5-29d1-493a-b562-66fa2c30853e tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fec92fcfdd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:04:17 user nova-compute[82479]: DEBUG nova.virt.block_device [None req-17d1f4e5-29d1-493a-b562-66fa2c30853e tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Updating existing volume attachment record: cda9b263-6fc2-4031-8f33-0008203e0b89 {{(pid=82479) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 01:04:19 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:04:22 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:04:22 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17d1f4e5-29d1-493a-b562-66fa2c30853e tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Calling os-brick to attach iSCSI Volume {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 01:04:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d1f4e5-29d1-493a-b562-66fa2c30853e tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iHsWocdl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:04:22 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-17d1f4e5-29d1-493a-b562-66fa2c30853e tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:04:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-17d1f4e5-29d1-493a-b562-66fa2c30853e tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:04:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-17d1f4e5-29d1-493a-b562-66fa2c30853e tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:04:22 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-17d1f4e5-29d1-493a-b562-66fa2c30853e tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:04:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-17d1f4e5-29d1-493a-b562-66fa2c30853e tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:04:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-17d1f4e5-29d1-493a-b562-66fa2c30853e tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:04:22 user nova-compute[82479]: INFO os_brick.initiator.connectors.iscsi [None req-17d1f4e5-29d1-493a-b562-66fa2c30853e tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 01:04:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e -p 172.16.0.220:3260 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:04:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:04:22 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[f942c75e-15eb-482c-a8ea-6ac532c56bca]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:04:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d1f4e5-29d1-493a-b562-66fa2c30853e tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 01:04:22 user nova-compute[82479]:  {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:04:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e -p 172.16.0.220:3260 --interface default --op new {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:04:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:04:22 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[673c48f2-8b89-4873-9d18-0038fa607f50]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e] added\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:04:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d1f4e5-29d1-493a-b562-66fa2c30853e tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e] added
Apr 14 01:04:22 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:04:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:04:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:04:22 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[469c31b4-a124-426f-8bae-a925d4cedd4d]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:04:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d1f4e5-29d1-493a-b562-66fa2c30853e tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:04:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:04:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:04:22 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e915498-26be-4d7b-8ac5-f06289314309]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:04:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d1f4e5-29d1-493a-b562-66fa2c30853e tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:04:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iHsWocdl {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:04:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iHsWocdl" returned: 0 in 0.020s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:04:22 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b27d06d-5953-444d-86ff-3336fc06f86b]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:04:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d1f4e5-29d1-493a-b562-66fa2c30853e tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iHsWocdl'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:04:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:04:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:04:22 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[1021b716-d658-464a-a172-acbbfc463d45]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:04:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d1f4e5-29d1-493a-b562-66fa2c30853e tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:04:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:04:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:04:22 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f9a359-0abe-4270-98b0-02509102e6c4]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:04:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d1f4e5-29d1-493a-b562-66fa2c30853e tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 01:04:22 user nova-compute[82479]:  {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:04:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d1f4e5-29d1-493a-b562-66fa2c30853e tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 01:04:22 user nova-compute[82479]:  {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:04:22 user nova-compute[82479]: WARNING os_brick.initiator.connectors.iscsi [None req-17d1f4e5-29d1-493a-b562-66fa2c30853e tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 01:04:22 user nova-compute[82479]: 
Apr 14 01:04:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e -p 172.16.0.220:3260 --login {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:04:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:04:22 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f1a29c-4b29-4eda-8c7c-3d3976bb3783]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:04:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d1f4e5-29d1-493a-b562-66fa2c30853e tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e, portal: 172.16.0.220,3260]
Apr 14 01:04:22 user nova-compute[82479]: Login to [iface: default, target: iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e, portal: 172.16.0.220,3260] successful.
Apr 14 01:04:22 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:04:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:04:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:04:22 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4bef471-7af4-4428-8f4b-e63a0f7a7c93]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:04:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d1f4e5-29d1-493a-b562-66fa2c30853e tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:04:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:04:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:04:22 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[b057e2e3-3fda-492d-879a-d53e775d8593]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:04:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d1f4e5-29d1-493a-b562-66fa2c30853e tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e (non-flash)
Apr 14 01:04:22 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:04:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d1f4e5-29d1-493a-b562-66fa2c30853e tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e (non-flash)
Apr 14 01:04:22 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:04:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-17d1f4e5-29d1-493a-b562-66fa2c30853e tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:04:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d1f4e5-29d1-493a-b562-66fa2c30853e tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Connected to 172.16.0.220:3260 {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 01:04:22 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-17d1f4e5-29d1-493a-b562-66fa2c30853e tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=82479) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 01:04:22 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-17d1f4e5-29d1-493a-b562-66fa2c30853e tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82479) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 01:04:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:04:22 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:04:22 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3915f6-95cb-45af-98c7-03f1cfd2e32f]: (4, ('- - 0', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:04:22 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-17d1f4e5-29d1-493a-b562-66fa2c30853e tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82479) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 01:04:22 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d1f4e5-29d1-493a-b562-66fa2c30853e tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iHsWocdl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 01:04:23 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-17d1f4e5-29d1-493a-b562-66fa2c30853e tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:04:23 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-17d1f4e5-29d1-493a-b562-66fa2c30853e tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '23366373933333032', 'path': '/dev/sdb'} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:04:23 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17d1f4e5-29d1-493a-b562-66fa2c30853e tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23366373933333032', 'path': '/dev/sdb'} {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 01:04:23 user nova-compute[82479]: DEBUG nova.objects.instance [None req-17d1f4e5-29d1-493a-b562-66fa2c30853e tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lazy-loading 'flavor' on Instance uuid 7d067330-8745-4e21-b93c-60c0902012c7 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:04:23 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-17d1f4e5-29d1-493a-b562-66fa2c30853e tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 01:04:23 user nova-compute[82479]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:04:23 user nova-compute[82479]:   <source dev="/dev/sdb"/>
Apr 14 01:04:23 user nova-compute[82479]:   <target dev="vdb" bus="virtio"/>
Apr 14 01:04:23 user nova-compute[82479]:   <serial>f94c5daf-01f1-4cd1-9137-28be67b2ef8e</serial>
Apr 14 01:04:23 user nova-compute[82479]: </disk>
Apr 14 01:04:23 user nova-compute[82479]:  {{(pid=82479) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 01:04:24 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-17d1f4e5-29d1-493a-b562-66fa2c30853e tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:04:24 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-17d1f4e5-29d1-493a-b562-66fa2c30853e tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:04:24 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-17d1f4e5-29d1-493a-b562-66fa2c30853e tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] No VIF found with MAC fa:16:3e:66:d8:ca, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 01:04:24 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-17d1f4e5-29d1-493a-b562-66fa2c30853e tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "7d067330-8745-4e21-b93c-60c0902012c7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.734s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:04:24 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:04:25 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-9cd53189-2454-41bd-91a2-5c4778b4aa8f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "7d067330-8745-4e21-b93c-60c0902012c7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:04:25 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-9cd53189-2454-41bd-91a2-5c4778b4aa8f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "7d067330-8745-4e21-b93c-60c0902012c7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:04:25 user nova-compute[82479]: INFO nova.compute.manager [None req-9cd53189-2454-41bd-91a2-5c4778b4aa8f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Detaching volume f94c5daf-01f1-4cd1-9137-28be67b2ef8e
Apr 14 01:04:26 user nova-compute[82479]: INFO nova.virt.block_device [None req-9cd53189-2454-41bd-91a2-5c4778b4aa8f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Attempting to driver detach volume f94c5daf-01f1-4cd1-9137-28be67b2ef8e from mountpoint /dev/vdb
Apr 14 01:04:26 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-9cd53189-2454-41bd-91a2-5c4778b4aa8f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Attempting to detach device vdb from instance 7d067330-8745-4e21-b93c-60c0902012c7 from the persistent domain config. {{(pid=82479) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 01:04:26 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-9cd53189-2454-41bd-91a2-5c4778b4aa8f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 01:04:26 user nova-compute[82479]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:04:26 user nova-compute[82479]:   <source dev="/dev/sdb"/>
Apr 14 01:04:26 user nova-compute[82479]:   <target dev="vdb" bus="virtio"/>
Apr 14 01:04:26 user nova-compute[82479]:   <serial>f94c5daf-01f1-4cd1-9137-28be67b2ef8e</serial>
Apr 14 01:04:26 user nova-compute[82479]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 01:04:26 user nova-compute[82479]: </disk>
Apr 14 01:04:26 user nova-compute[82479]:  {{(pid=82479) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 01:04:26 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-9cd53189-2454-41bd-91a2-5c4778b4aa8f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Successfully detached device vdb from instance 7d067330-8745-4e21-b93c-60c0902012c7 from the persistent domain config.
Apr 14 01:04:26 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-9cd53189-2454-41bd-91a2-5c4778b4aa8f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7d067330-8745-4e21-b93c-60c0902012c7 from the live domain config. {{(pid=82479) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 01:04:26 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-9cd53189-2454-41bd-91a2-5c4778b4aa8f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 01:04:26 user nova-compute[82479]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:04:26 user nova-compute[82479]:   <source dev="/dev/sdb"/>
Apr 14 01:04:26 user nova-compute[82479]:   <target dev="vdb" bus="virtio"/>
Apr 14 01:04:26 user nova-compute[82479]:   <serial>f94c5daf-01f1-4cd1-9137-28be67b2ef8e</serial>
Apr 14 01:04:26 user nova-compute[82479]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 01:04:26 user nova-compute[82479]: </disk>
Apr 14 01:04:26 user nova-compute[82479]:  {{(pid=82479) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 01:04:26 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Received event <DeviceRemovedEvent: 1681434266.4516227, 7d067330-8745-4e21-b93c-60c0902012c7 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82479) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 01:04:26 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-9cd53189-2454-41bd-91a2-5c4778b4aa8f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7d067330-8745-4e21-b93c-60c0902012c7 {{(pid=82479) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 01:04:26 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-9cd53189-2454-41bd-91a2-5c4778b4aa8f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Successfully detached device vdb from instance 7d067330-8745-4e21-b93c-60c0902012c7 from the live domain config.
Apr 14 01:04:26 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cd53189-2454-41bd-91a2-5c4778b4aa8f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] calling os-brick to detach iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 01:04:26 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cd53189-2454-41bd-91a2-5c4778b4aa8f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, {'target_iqn': 'iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iHsWocdl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:04:26 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-9cd53189-2454-41bd-91a2-5c4778b4aa8f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:04:26 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-9cd53189-2454-41bd-91a2-5c4778b4aa8f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:04:26 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-9cd53189-2454-41bd-91a2-5c4778b4aa8f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:04:26 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:04:26 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:04:26 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e68f88-f650-4421-a9e7-c406b3da7ccd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:04:26 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cd53189-2454-41bd-91a2-5c4778b4aa8f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 01:04:26 user nova-compute[82479]: No targets found.
Apr 14 01:04:26 user nova-compute[82479]: iSNS:
Apr 14 01:04:26 user nova-compute[82479]: No targets found.
Apr 14 01:04:26 user nova-compute[82479]: STATIC:
Apr 14 01:04:26 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e
Apr 14 01:04:26 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:04:26 user nova-compute[82479]:                 Iface Name: default
Apr 14 01:04:26 user nova-compute[82479]: FIRMWARE:
Apr 14 01:04:26 user nova-compute[82479]: No targets found.
Apr 14 01:04:26 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:04:26 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cd53189-2454-41bd-91a2-5c4778b4aa8f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 01:04:26 user nova-compute[82479]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 01:04:26 user nova-compute[82479]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82479) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 01:04:26 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cd53189-2454-41bd-91a2-5c4778b4aa8f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e', 0)] {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 01:04:26 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:04:26 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:04:26 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[1517515c-3492-4a53-9f9e-35c99e5fc543]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:04:26 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:04:26 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:04:26 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[5feaff5a-bde8-4ee3-8d75-038a3a236822]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:04:26 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cd53189-2454-41bd-91a2-5c4778b4aa8f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e (non-flash)
Apr 14 01:04:26 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:04:26 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cd53189-2454-41bd-91a2-5c4778b4aa8f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e (non-flash)
Apr 14 01:04:26 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:04:26 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cd53189-2454-41bd-91a2-5c4778b4aa8f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f33385d0ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e'): ({'sdb'}, set())}) {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 01:04:26 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-9cd53189-2454-41bd-91a2-5c4778b4aa8f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Removing single pathed devices sdb {{(pid=82479) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 01:04:26 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:04:26 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:04:26 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f3bdae-5871-4b14-90fc-f68b6e6896f8]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:04:26 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:04:26 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:04:26 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d36084f-a554-4a2d-96a5-4cb8f160b7f1]: (4, ('ok\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:04:26 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-9cd53189-2454-41bd-91a2-5c4778b4aa8f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Flushing IO for device /dev/sdb {{(pid=82479) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 01:04:26 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:04:26 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:04:26 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[b20c301d-d099-4223-b441-d416bd754bcd]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:04:26 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-9cd53189-2454-41bd-91a2-5c4778b4aa8f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82479) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 01:04:26 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:04:26 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:04:26 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[604d86bf-952b-43c1-a1b1-fe3662556369]: (4, ('1', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:04:26 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-9cd53189-2454-41bd-91a2-5c4778b4aa8f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 01:04:26 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-9cd53189-2454-41bd-91a2-5c4778b4aa8f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] SCSI volumes sdb have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 01:04:26 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cd53189-2454-41bd-91a2-5c4778b4aa8f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e')] {{(pid=82479) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 01:04:26 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:04:26 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:04:26 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[161f02e9-0ec6-475f-bd5e-1aa6bb6d3241]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:04:26 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cd53189-2454-41bd-91a2-5c4778b4aa8f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:04:26 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e -p 172.16.0.220:3260 --logout {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:04:26 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:04:26 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[049df467-3b99-4c84-89b3-1daa17dcf832]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:04:26 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cd53189-2454-41bd-91a2-5c4778b4aa8f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e, portal: 172.16.0.220,3260]
Apr 14 01:04:26 user nova-compute[82479]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e, portal: 172.16.0.220,3260] successful.
Apr 14 01:04:26 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:04:26 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e -p 172.16.0.220:3260 --op delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:04:26 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:04:26 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dddea67-ef8e-4d6e-9586-3891120320d6]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:04:26 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cd53189-2454-41bd-91a2-5c4778b4aa8f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:04:26 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-9cd53189-2454-41bd-91a2-5c4778b4aa8f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:04:26 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cd53189-2454-41bd-91a2-5c4778b4aa8f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] <== disconnect_volume: return (295ms) None {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:04:26 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cd53189-2454-41bd-91a2-5c4778b4aa8f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Disconnected iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 01:04:27 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:04:27 user nova-compute[82479]: DEBUG nova.objects.instance [None req-9cd53189-2454-41bd-91a2-5c4778b4aa8f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lazy-loading 'flavor' on Instance uuid 7d067330-8745-4e21-b93c-60c0902012c7 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:04:27 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-9cd53189-2454-41bd-91a2-5c4778b4aa8f tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "7d067330-8745-4e21-b93c-60c0902012c7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.646s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:04:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:04:30 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:04:34 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:04:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:04:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:04:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 01:04:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 01:04:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 01:04:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:04:35 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:04:35 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Starting heal instance info cache {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 01:04:35 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Rebuilding the list of instances to heal {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 01:04:35 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "refresh_cache-7d067330-8745-4e21-b93c-60c0902012c7" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:04:35 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquired lock "refresh_cache-7d067330-8745-4e21-b93c-60c0902012c7" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:04:35 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Forcefully refreshing network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 01:04:35 user nova-compute[82479]: DEBUG nova.objects.instance [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lazy-loading 'info_cache' on Instance uuid 7d067330-8745-4e21-b93c-60c0902012c7 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:04:36 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Updating instance_info_cache with network_info: [{"id": "4f9eadfb-1571-4235-85ba-05511a343c4d", "address": "fa:16:3e:66:d8:ca", "network": {"id": "c6603c41-74dd-4b44-952c-0df4228a8b77", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2088791125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed63b19014f048f5bf3f9938a151d30c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9eadfb-15", "ovs_interfaceid": "4f9eadfb-1571-4235-85ba-05511a343c4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:04:36 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Releasing lock "refresh_cache-7d067330-8745-4e21-b93c-60c0902012c7" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:04:36 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Updated the network info_cache for instance {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 01:04:37 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:04:39 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:04:41 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:04:41 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82479) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 01:04:43 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:04:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:04:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:04:43 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:04:43 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Auditing locally available compute resources for user (node: user) {{(pid=82479) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 01:04:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d067330-8745-4e21-b93c-60c0902012c7/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:04:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d067330-8745-4e21-b93c-60c0902012c7/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:04:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d067330-8745-4e21-b93c-60c0902012c7/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:04:43 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d067330-8745-4e21-b93c-60c0902012c7/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:04:44 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:04:44 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:04:44 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Hypervisor/Node resource view: name=user free_ram=8785MB free_disk=26.114521026611328GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82479) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 01:04:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:04:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:04:44 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 7d067330-8745-4e21-b93c-60c0902012c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:04:44 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 01:04:44 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 01:04:44 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:04:44 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:04:44 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Compute_service record updated for user:user {{(pid=82479) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 01:04:44 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.189s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:04:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:04:45 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:04:48 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:04:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:04:50 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:04:54 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:04:59 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:05:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:05:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:05:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 01:05:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 01:05:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 01:05:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:05:09 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:05:14 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:05:18 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-9ab3eda7-7155-4e6b-995e-551d748d81f8 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "7d067330-8745-4e21-b93c-60c0902012c7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:05:18 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-9ab3eda7-7155-4e6b-995e-551d748d81f8 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "7d067330-8745-4e21-b93c-60c0902012c7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:05:19 user nova-compute[82479]: DEBUG nova.objects.instance [None req-9ab3eda7-7155-4e6b-995e-551d748d81f8 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lazy-loading 'flavor' on Instance uuid 7d067330-8745-4e21-b93c-60c0902012c7 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:05:19 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-9ab3eda7-7155-4e6b-995e-551d748d81f8 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "7d067330-8745-4e21-b93c-60c0902012c7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:05:19 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-9ab3eda7-7155-4e6b-995e-551d748d81f8 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "7d067330-8745-4e21-b93c-60c0902012c7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:05:19 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-9ab3eda7-7155-4e6b-995e-551d748d81f8 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "7d067330-8745-4e21-b93c-60c0902012c7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:05:19 user nova-compute[82479]: INFO nova.compute.manager [None req-9ab3eda7-7155-4e6b-995e-551d748d81f8 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Attaching volume eb5808d3-0dee-4531-988a-5d464f60c87c to /dev/vdb
Apr 14 01:05:19 user nova-compute[82479]: DEBUG os_brick.utils [None req-9ab3eda7-7155-4e6b-995e-551d748d81f8 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:05:19 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:05:19 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:05:19 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[b975c091-9184-44f1-8675-960d51747053]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fec92fcfdd3\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:05:19 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:05:19 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:05:19 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[2684cc60-4678-487c-8673-bc33b198ac20]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:05:19 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:05:19 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:05:19 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[47475085-5ccd-451a-a058-8e49d72c2b43]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:05:19 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7fa5750-8e08-4ed4-bd68-9dd64ac9bdbc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:05:19 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-9ab3eda7-7155-4e6b-995e-551d748d81f8 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Running cmd (subprocess): nvme version {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:05:19 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-9ab3eda7-7155-4e6b-995e-551d748d81f8 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] 'nvme version' failed. Not Retrying. {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:05:19 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9ab3eda7-7155-4e6b-995e-551d748d81f8 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] nvme not present on system {{(pid=82479) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 01:05:19 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:05:19 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 01:05:19 user nova-compute[82479]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 01:05:19 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a81d479-a661-4824-a13c-1b4160b97ac7]: (4, '') {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:05:19 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-9ab3eda7-7155-4e6b-995e-551d748d81f8 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=82479) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 01:05:19 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-9ab3eda7-7155-4e6b-995e-551d748d81f8 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 01:05:19 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.lightos [None req-9ab3eda7-7155-4e6b-995e-551d748d81f8 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] LIGHTOS: no hostnqn found. {{(pid=82479) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 01:05:19 user nova-compute[82479]: DEBUG os_brick.utils [None req-9ab3eda7-7155-4e6b-995e-551d748d81f8 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fec92fcfdd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:05:19 user nova-compute[82479]: DEBUG nova.virt.block_device [None req-9ab3eda7-7155-4e6b-995e-551d748d81f8 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Updating existing volume attachment record: 102b4b10-a988-494c-9043-70b61ff6d4eb {{(pid=82479) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 01:05:19 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:05:22 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:05:23 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ab3eda7-7155-4e6b-995e-551d748d81f8 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Calling os-brick to attach iSCSI Volume {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 01:05:23 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab3eda7-7155-4e6b-995e-551d748d81f8 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'etTzHxuQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:05:23 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-9ab3eda7-7155-4e6b-995e-551d748d81f8 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:05:23 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-9ab3eda7-7155-4e6b-995e-551d748d81f8 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:05:23 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-9ab3eda7-7155-4e6b-995e-551d748d81f8 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:05:23 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-9ab3eda7-7155-4e6b-995e-551d748d81f8 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:05:23 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-9ab3eda7-7155-4e6b-995e-551d748d81f8 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:05:23 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-9ab3eda7-7155-4e6b-995e-551d748d81f8 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:05:23 user nova-compute[82479]: INFO os_brick.initiator.connectors.iscsi [None req-9ab3eda7-7155-4e6b-995e-551d748d81f8 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 01:05:23 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c -p 172.16.0.220:3260 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:05:23 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:05:23 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[88dadc6a-9c90-4852-8052-e711300623d2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:05:23 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab3eda7-7155-4e6b-995e-551d748d81f8 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 01:05:23 user nova-compute[82479]:  {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:05:23 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c -p 172.16.0.220:3260 --interface default --op new {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:05:23 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:05:23 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b8d168-812b-4054-bca4-01bc3fd6ed1c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c] added\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:05:23 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab3eda7-7155-4e6b-995e-551d748d81f8 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c] added
Apr 14 01:05:23 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:05:23 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:05:23 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:05:23 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[f587a8c0-a8df-4948-bb54-3d5b7113a3fe]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:05:23 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab3eda7-7155-4e6b-995e-551d748d81f8 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:05:23 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:05:23 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:05:23 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[6183b2bf-50a4-4e85-9137-11e8beed4c79]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:05:23 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab3eda7-7155-4e6b-995e-551d748d81f8 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:05:23 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v etTzHxuQ {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:05:23 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v etTzHxuQ" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:05:23 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[f631fc0b-91e4-431d-97ca-7b770f62868e]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:05:23 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab3eda7-7155-4e6b-995e-551d748d81f8 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'etTzHxuQ'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:05:23 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:05:23 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:05:23 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[2962d39b-5c1b-4ba2-8518-cbc22ce7fe94]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:05:23 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab3eda7-7155-4e6b-995e-551d748d81f8 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:05:23 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:05:23 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:05:23 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e8d6ab-87c2-4e62-860e-02745e80fa3c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:05:23 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab3eda7-7155-4e6b-995e-551d748d81f8 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 01:05:23 user nova-compute[82479]:  {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:05:23 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab3eda7-7155-4e6b-995e-551d748d81f8 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 01:05:23 user nova-compute[82479]:  {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:05:23 user nova-compute[82479]: WARNING os_brick.initiator.connectors.iscsi [None req-9ab3eda7-7155-4e6b-995e-551d748d81f8 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 01:05:23 user nova-compute[82479]: 
Apr 14 01:05:23 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c -p 172.16.0.220:3260 --login {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:05:23 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:05:23 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[591e0f28-14fc-4d7d-90de-db4903579718]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:05:23 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab3eda7-7155-4e6b-995e-551d748d81f8 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c, portal: 172.16.0.220,3260]
Apr 14 01:05:23 user nova-compute[82479]: Login to [iface: default, target: iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c, portal: 172.16.0.220,3260] successful.
Apr 14 01:05:23 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:05:23 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:05:23 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:05:23 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a56a95-1c0f-41de-8dda-7af1fc8ce5d6]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:05:23 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab3eda7-7155-4e6b-995e-551d748d81f8 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:05:23 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:05:23 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:05:23 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd560c15-36a1-4ea0-ae68-4f1e29a44c83]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:05:23 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab3eda7-7155-4e6b-995e-551d748d81f8 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c (non-flash)
Apr 14 01:05:23 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:05:23 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab3eda7-7155-4e6b-995e-551d748d81f8 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c (non-flash)
Apr 14 01:05:23 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:05:23 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-9ab3eda7-7155-4e6b-995e-551d748d81f8 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:05:23 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab3eda7-7155-4e6b-995e-551d748d81f8 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Connected to 172.16.0.220:3260 {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 01:05:23 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-9ab3eda7-7155-4e6b-995e-551d748d81f8 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=82479) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 01:05:23 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-9ab3eda7-7155-4e6b-995e-551d748d81f8 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=82479) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 01:05:23 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:05:23 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:05:23 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2cb930-b625-40d7-b2d7-c3e601d2fa2f]: (4, ('- - 0', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:05:23 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-9ab3eda7-7155-4e6b-995e-551d748d81f8 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=82479) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 01:05:23 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab3eda7-7155-4e6b-995e-551d748d81f8 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'etTzHxuQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=82479) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 01:05:24 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:05:24 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-9ab3eda7-7155-4e6b-995e-551d748d81f8 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:05:24 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ab3eda7-7155-4e6b-995e-551d748d81f8 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '26233336364663663', 'path': '/dev/sdb'} {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:05:24 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ab3eda7-7155-4e6b-995e-551d748d81f8 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233336364663663', 'path': '/dev/sdb'} {{(pid=82479) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 01:05:24 user nova-compute[82479]: DEBUG nova.objects.instance [None req-9ab3eda7-7155-4e6b-995e-551d748d81f8 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lazy-loading 'flavor' on Instance uuid 7d067330-8745-4e21-b93c-60c0902012c7 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:05:24 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-9ab3eda7-7155-4e6b-995e-551d748d81f8 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 01:05:24 user nova-compute[82479]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:05:24 user nova-compute[82479]:   <source dev="/dev/sdb"/>
Apr 14 01:05:24 user nova-compute[82479]:   <target dev="vdb" bus="virtio"/>
Apr 14 01:05:24 user nova-compute[82479]:   <serial>eb5808d3-0dee-4531-988a-5d464f60c87c</serial>
Apr 14 01:05:24 user nova-compute[82479]: </disk>
Apr 14 01:05:24 user nova-compute[82479]:  {{(pid=82479) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 01:05:25 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-9ab3eda7-7155-4e6b-995e-551d748d81f8 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] No BDM found with device name vda, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:05:25 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-9ab3eda7-7155-4e6b-995e-551d748d81f8 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] No BDM found with device name vdb, not building metadata. {{(pid=82479) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 01:05:25 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-9ab3eda7-7155-4e6b-995e-551d748d81f8 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] No VIF found with MAC fa:16:3e:66:d8:ca, not building metadata {{(pid=82479) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 01:05:25 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-9ab3eda7-7155-4e6b-995e-551d748d81f8 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "7d067330-8745-4e21-b93c-60c0902012c7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.378s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:05:26 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-db92366f-e8a6-41cf-a6c1-e7d940951a14 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "7d067330-8745-4e21-b93c-60c0902012c7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:05:26 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-db92366f-e8a6-41cf-a6c1-e7d940951a14 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "7d067330-8745-4e21-b93c-60c0902012c7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:05:26 user nova-compute[82479]: INFO nova.compute.manager [None req-db92366f-e8a6-41cf-a6c1-e7d940951a14 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Detaching volume eb5808d3-0dee-4531-988a-5d464f60c87c
Apr 14 01:05:26 user nova-compute[82479]: INFO nova.virt.block_device [None req-db92366f-e8a6-41cf-a6c1-e7d940951a14 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Attempting to driver detach volume eb5808d3-0dee-4531-988a-5d464f60c87c from mountpoint /dev/vdb
Apr 14 01:05:26 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-db92366f-e8a6-41cf-a6c1-e7d940951a14 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Attempting to detach device vdb from instance 7d067330-8745-4e21-b93c-60c0902012c7 from the persistent domain config. {{(pid=82479) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 01:05:26 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-db92366f-e8a6-41cf-a6c1-e7d940951a14 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 01:05:26 user nova-compute[82479]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:05:26 user nova-compute[82479]:   <source dev="/dev/sdb"/>
Apr 14 01:05:26 user nova-compute[82479]:   <target dev="vdb" bus="virtio"/>
Apr 14 01:05:26 user nova-compute[82479]:   <serial>eb5808d3-0dee-4531-988a-5d464f60c87c</serial>
Apr 14 01:05:26 user nova-compute[82479]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 01:05:26 user nova-compute[82479]: </disk>
Apr 14 01:05:26 user nova-compute[82479]:  {{(pid=82479) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 01:05:26 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-db92366f-e8a6-41cf-a6c1-e7d940951a14 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Successfully detached device vdb from instance 7d067330-8745-4e21-b93c-60c0902012c7 from the persistent domain config.
Apr 14 01:05:26 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-db92366f-e8a6-41cf-a6c1-e7d940951a14 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7d067330-8745-4e21-b93c-60c0902012c7 from the live domain config. {{(pid=82479) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 01:05:26 user nova-compute[82479]: DEBUG nova.virt.libvirt.guest [None req-db92366f-e8a6-41cf-a6c1-e7d940951a14 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 01:05:26 user nova-compute[82479]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 01:05:26 user nova-compute[82479]:   <source dev="/dev/sdb"/>
Apr 14 01:05:26 user nova-compute[82479]:   <target dev="vdb" bus="virtio"/>
Apr 14 01:05:26 user nova-compute[82479]:   <serial>eb5808d3-0dee-4531-988a-5d464f60c87c</serial>
Apr 14 01:05:26 user nova-compute[82479]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 01:05:26 user nova-compute[82479]: </disk>
Apr 14 01:05:26 user nova-compute[82479]:  {{(pid=82479) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 01:05:26 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-c013727f-d903-4635-8cfc-3d13e3aab52c None None] Received event <DeviceRemovedEvent: 1681434326.970626, 7d067330-8745-4e21-b93c-60c0902012c7 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=82479) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 01:05:26 user nova-compute[82479]: DEBUG nova.virt.libvirt.driver [None req-db92366f-e8a6-41cf-a6c1-e7d940951a14 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7d067330-8745-4e21-b93c-60c0902012c7 {{(pid=82479) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 01:05:26 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-db92366f-e8a6-41cf-a6c1-e7d940951a14 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Successfully detached device vdb from instance 7d067330-8745-4e21-b93c-60c0902012c7 from the live domain config.
Apr 14 01:05:26 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db92366f-e8a6-41cf-a6c1-e7d940951a14 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] calling os-brick to detach iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 01:05:26 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-db92366f-e8a6-41cf-a6c1-e7d940951a14 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f333822bb20>, {'target_iqn': 'iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'etTzHxuQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 01:05:26 user nova-compute[82479]: WARNING os_brick.initiator.connectors.base [None req-db92366f-e8a6-41cf-a6c1-e7d940951a14 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 01:05:26 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-db92366f-e8a6-41cf-a6c1-e7d940951a14 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 01:05:26 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-db92366f-e8a6-41cf-a6c1-e7d940951a14 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 01:05:26 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:05:27 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:05:27 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[2599d407-9ec2-4cca-ba7f-f4612428967d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:05:27 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-db92366f-e8a6-41cf-a6c1-e7d940951a14 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 01:05:27 user nova-compute[82479]: No targets found.
Apr 14 01:05:27 user nova-compute[82479]: iSNS:
Apr 14 01:05:27 user nova-compute[82479]: No targets found.
Apr 14 01:05:27 user nova-compute[82479]: STATIC:
Apr 14 01:05:27 user nova-compute[82479]: Target: iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c
Apr 14 01:05:27 user nova-compute[82479]:         Portal: 172.16.0.220:3260,-1
Apr 14 01:05:27 user nova-compute[82479]:                 Iface Name: default
Apr 14 01:05:27 user nova-compute[82479]: FIRMWARE:
Apr 14 01:05:27 user nova-compute[82479]: No targets found.
Apr 14 01:05:27 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:05:27 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-db92366f-e8a6-41cf-a6c1-e7d940951a14 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 01:05:27 user nova-compute[82479]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 01:05:27 user nova-compute[82479]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=82479) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 01:05:27 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-db92366f-e8a6-41cf-a6c1-e7d940951a14 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c', 0)] {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 01:05:27 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:05:27 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:05:27 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ebcf5b1-22b2-4ee8-b0d5-dc7c17ef6bc9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:05:27 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:05:27 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:05:27 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[b455dfbb-e4f7-4d9f-8c2a-cd36437f7662]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c (non-flash)\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:05:27 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-db92366f-e8a6-41cf-a6c1-e7d940951a14 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c (non-flash)
Apr 14 01:05:27 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 01:05:27 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-db92366f-e8a6-41cf-a6c1-e7d940951a14 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c (non-flash)
Apr 14 01:05:27 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 01:05:27 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-db92366f-e8a6-41cf-a6c1-e7d940951a14 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f330c6b85e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c'): ({'sdb'}, set())}) {{(pid=82479) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 01:05:27 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-db92366f-e8a6-41cf-a6c1-e7d940951a14 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Removing single pathed devices sdb {{(pid=82479) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 01:05:27 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:05:27 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:05:27 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29d8f47-2ab3-4fd7-82fb-f0c9ec3ca290]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:05:27 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:05:27 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:05:27 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a67f0d-fcee-4998-aab4-edccef98e1a9]: (4, ('ok\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:05:27 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-db92366f-e8a6-41cf-a6c1-e7d940951a14 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Flushing IO for device /dev/sdb {{(pid=82479) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 01:05:27 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:05:27 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:05:27 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[1691a5d1-96b3-48ac-b499-6ca334479aa4]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:05:27 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-db92366f-e8a6-41cf-a6c1-e7d940951a14 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=82479) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 01:05:27 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:05:27 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:05:27 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:05:27 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[48dd9e8f-96cc-4140-8fa0-26176979fa5b]: (4, ('1', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:05:27 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-db92366f-e8a6-41cf-a6c1-e7d940951a14 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 01:05:27 user nova-compute[82479]: DEBUG os_brick.initiator.linuxscsi [None req-db92366f-e8a6-41cf-a6c1-e7d940951a14 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] SCSI volumes sdb have been removed. {{(pid=82479) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 01:05:27 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-db92366f-e8a6-41cf-a6c1-e7d940951a14 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c')] {{(pid=82479) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 01:05:27 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:05:27 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.059s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:05:27 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43bc776-73e7-487a-9a4d-e356a251f745]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:05:27 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-db92366f-e8a6-41cf-a6c1-e7d940951a14 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:05:27 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c -p 172.16.0.220:3260 --logout {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:05:27 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:05:27 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d654c2-f173-4a1a-b25a-2f13c206529a]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:05:27 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-db92366f-e8a6-41cf-a6c1-e7d940951a14 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c, portal: 172.16.0.220,3260]
Apr 14 01:05:27 user nova-compute[82479]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c, portal: 172.16.0.220,3260] successful.
Apr 14 01:05:27 user nova-compute[82479]:  stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:05:27 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c -p 172.16.0.220:3260 --op delete {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:05:27 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=93289) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:05:27 user nova-compute[82479]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4fa078a-4b96-4891-b629-69028785476d]: (4, ('', '')) {{(pid=93289) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 01:05:27 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-db92366f-e8a6-41cf-a6c1-e7d940951a14 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=82479) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 01:05:27 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.base [None req-db92366f-e8a6-41cf-a6c1-e7d940951a14 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 01:05:27 user nova-compute[82479]: DEBUG os_brick.initiator.connectors.iscsi [None req-db92366f-e8a6-41cf-a6c1-e7d940951a14 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] <== disconnect_volume: return (324ms) None {{(pid=82479) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 01:05:27 user nova-compute[82479]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db92366f-e8a6-41cf-a6c1-e7d940951a14 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Disconnected iSCSI Volume {{(pid=82479) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 01:05:28 user nova-compute[82479]: DEBUG nova.objects.instance [None req-db92366f-e8a6-41cf-a6c1-e7d940951a14 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lazy-loading 'flavor' on Instance uuid 7d067330-8745-4e21-b93c-60c0902012c7 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:05:28 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-db92366f-e8a6-41cf-a6c1-e7d940951a14 tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "7d067330-8745-4e21-b93c-60c0902012c7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.609s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:05:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:05:32 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:05:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:05:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:05:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 01:05:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 01:05:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 01:05:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:05:36 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:05:37 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:05:37 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Starting heal instance info cache {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 01:05:37 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Rebuilding the list of instances to heal {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 01:05:37 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "refresh_cache-7d067330-8745-4e21-b93c-60c0902012c7" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:05:37 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquired lock "refresh_cache-7d067330-8745-4e21-b93c-60c0902012c7" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:05:37 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Forcefully refreshing network info cache for instance {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 01:05:37 user nova-compute[82479]: DEBUG nova.objects.instance [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lazy-loading 'info_cache' on Instance uuid 7d067330-8745-4e21-b93c-60c0902012c7 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:05:38 user nova-compute[82479]: DEBUG nova.network.neutron [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Updating instance_info_cache with network_info: [{"id": "4f9eadfb-1571-4235-85ba-05511a343c4d", "address": "fa:16:3e:66:d8:ca", "network": {"id": "c6603c41-74dd-4b44-952c-0df4228a8b77", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2088791125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed63b19014f048f5bf3f9938a151d30c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9eadfb-15", "ovs_interfaceid": "4f9eadfb-1571-4235-85ba-05511a343c4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:05:38 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Releasing lock "refresh_cache-7d067330-8745-4e21-b93c-60c0902012c7" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:05:38 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Updated the network info_cache for instance {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 01:05:39 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:05:39 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:05:42 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:05:42 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82479) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 01:05:44 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:05:44 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:05:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:05:45 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:05:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:05:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:05:45 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:05:45 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Auditing locally available compute resources for user (node: user) {{(pid=82479) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 01:05:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d067330-8745-4e21-b93c-60c0902012c7/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:05:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d067330-8745-4e21-b93c-60c0902012c7/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:05:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d067330-8745-4e21-b93c-60c0902012c7/disk --force-share --output=json {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 01:05:45 user nova-compute[82479]: DEBUG oslo_concurrency.processutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d067330-8745-4e21-b93c-60c0902012c7/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=82479) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 01:05:46 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:05:46 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:05:46 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Hypervisor/Node resource view: name=user free_ram=8800MB free_disk=26.11353302001953GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82479) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 01:05:46 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:05:46 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:05:46 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Instance 7d067330-8745-4e21-b93c-60c0902012c7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=82479) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 01:05:46 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 01:05:46 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 01:05:46 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:05:46 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:05:46 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Compute_service record updated for user:user {{(pid=82479) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 01:05:46 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.178s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:05:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:05:50 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:05:50 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:05:54 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:05:59 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:05:59 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:05:59 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 01:05:59 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 01:05:59 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 01:05:59 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:06:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:06:09 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:06:14 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:06:19 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:06:24 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:06:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:06:33 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:06:33 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:06:34 user nova-compute[82479]: DEBUG nova.compute.manager [req-5f6e7dab-ef92-48a8-9fa2-54a2a57489f6 req-72936c3d-beb7-43a2-8302-af9b1ad73048 service nova] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Received event network-changed-4f9eadfb-1571-4235-85ba-05511a343c4d {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:06:34 user nova-compute[82479]: DEBUG nova.compute.manager [req-5f6e7dab-ef92-48a8-9fa2-54a2a57489f6 req-72936c3d-beb7-43a2-8302-af9b1ad73048 service nova] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Refreshing instance network info cache due to event network-changed-4f9eadfb-1571-4235-85ba-05511a343c4d. {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 01:06:34 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-5f6e7dab-ef92-48a8-9fa2-54a2a57489f6 req-72936c3d-beb7-43a2-8302-af9b1ad73048 service nova] Acquiring lock "refresh_cache-7d067330-8745-4e21-b93c-60c0902012c7" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 01:06:34 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-5f6e7dab-ef92-48a8-9fa2-54a2a57489f6 req-72936c3d-beb7-43a2-8302-af9b1ad73048 service nova] Acquired lock "refresh_cache-7d067330-8745-4e21-b93c-60c0902012c7" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 01:06:34 user nova-compute[82479]: DEBUG nova.network.neutron [req-5f6e7dab-ef92-48a8-9fa2-54a2a57489f6 req-72936c3d-beb7-43a2-8302-af9b1ad73048 service nova] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Refreshing network info cache for port 4f9eadfb-1571-4235-85ba-05511a343c4d {{(pid=82479) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 01:06:34 user nova-compute[82479]: DEBUG nova.network.neutron [req-5f6e7dab-ef92-48a8-9fa2-54a2a57489f6 req-72936c3d-beb7-43a2-8302-af9b1ad73048 service nova] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Updated VIF entry in instance network info cache for port 4f9eadfb-1571-4235-85ba-05511a343c4d. {{(pid=82479) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 01:06:34 user nova-compute[82479]: DEBUG nova.network.neutron [req-5f6e7dab-ef92-48a8-9fa2-54a2a57489f6 req-72936c3d-beb7-43a2-8302-af9b1ad73048 service nova] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Updating instance_info_cache with network_info: [{"id": "4f9eadfb-1571-4235-85ba-05511a343c4d", "address": "fa:16:3e:66:d8:ca", "network": {"id": "c6603c41-74dd-4b44-952c-0df4228a8b77", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2088791125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed63b19014f048f5bf3f9938a151d30c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9eadfb-15", "ovs_interfaceid": "4f9eadfb-1571-4235-85ba-05511a343c4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:06:34 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-5f6e7dab-ef92-48a8-9fa2-54a2a57489f6 req-72936c3d-beb7-43a2-8302-af9b1ad73048 service nova] Releasing lock "refresh_cache-7d067330-8745-4e21-b93c-60c0902012c7" {{(pid=82479) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 01:06:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:06:35 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:06:35 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Cleaning up deleted instances {{(pid=82479) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 01:06:35 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] There are 0 instances to clean {{(pid=82479) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 01:06:37 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:06:38 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f9d964f6-c8e8-4f9e-b980-703ffd9c211d tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "7d067330-8745-4e21-b93c-60c0902012c7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:06:38 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f9d964f6-c8e8-4f9e-b980-703ffd9c211d tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "7d067330-8745-4e21-b93c-60c0902012c7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:06:38 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f9d964f6-c8e8-4f9e-b980-703ffd9c211d tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "7d067330-8745-4e21-b93c-60c0902012c7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:06:38 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f9d964f6-c8e8-4f9e-b980-703ffd9c211d tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "7d067330-8745-4e21-b93c-60c0902012c7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:06:38 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f9d964f6-c8e8-4f9e-b980-703ffd9c211d tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "7d067330-8745-4e21-b93c-60c0902012c7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:06:38 user nova-compute[82479]: INFO nova.compute.manager [None req-f9d964f6-c8e8-4f9e-b980-703ffd9c211d tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Terminating instance
Apr 14 01:06:38 user nova-compute[82479]: DEBUG nova.compute.manager [None req-f9d964f6-c8e8-4f9e-b980-703ffd9c211d tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Start destroying the instance on the hypervisor. {{(pid=82479) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 01:06:38 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:06:38 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:06:38 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:06:39 user nova-compute[82479]: DEBUG nova.compute.manager [req-ccf1e8cb-6b8d-45cb-ab31-91849b91c0b2 req-811bad1d-5e72-4a0f-b247-ef8fb34905a6 service nova] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Received event network-vif-unplugged-4f9eadfb-1571-4235-85ba-05511a343c4d {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:06:39 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-ccf1e8cb-6b8d-45cb-ab31-91849b91c0b2 req-811bad1d-5e72-4a0f-b247-ef8fb34905a6 service nova] Acquiring lock "7d067330-8745-4e21-b93c-60c0902012c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:06:39 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-ccf1e8cb-6b8d-45cb-ab31-91849b91c0b2 req-811bad1d-5e72-4a0f-b247-ef8fb34905a6 service nova] Lock "7d067330-8745-4e21-b93c-60c0902012c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:06:39 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-ccf1e8cb-6b8d-45cb-ab31-91849b91c0b2 req-811bad1d-5e72-4a0f-b247-ef8fb34905a6 service nova] Lock "7d067330-8745-4e21-b93c-60c0902012c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:06:39 user nova-compute[82479]: DEBUG nova.compute.manager [req-ccf1e8cb-6b8d-45cb-ab31-91849b91c0b2 req-811bad1d-5e72-4a0f-b247-ef8fb34905a6 service nova] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] No waiting events found dispatching network-vif-unplugged-4f9eadfb-1571-4235-85ba-05511a343c4d {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:06:39 user nova-compute[82479]: DEBUG nova.compute.manager [req-ccf1e8cb-6b8d-45cb-ab31-91849b91c0b2 req-811bad1d-5e72-4a0f-b247-ef8fb34905a6 service nova] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Received event network-vif-unplugged-4f9eadfb-1571-4235-85ba-05511a343c4d for instance with task_state deleting. {{(pid=82479) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 01:06:39 user nova-compute[82479]: INFO nova.virt.libvirt.driver [-] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Instance destroyed successfully.
Apr 14 01:06:39 user nova-compute[82479]: DEBUG nova.objects.instance [None req-f9d964f6-c8e8-4f9e-b980-703ffd9c211d tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lazy-loading 'resources' on Instance uuid 7d067330-8745-4e21-b93c-60c0902012c7 {{(pid=82479) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 01:06:39 user nova-compute[82479]: DEBUG nova.virt.libvirt.vif [None req-f9d964f6-c8e8-4f9e-b980-703ffd9c211d tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T01:00:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-944954764',display_name='tempest-SnapshotDataIntegrityTests-server-944954764',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-944954764',id=46,image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtF7w2+KjkkyJvNhd0vZprUfWYDPfNpaHTuDIX2lnLWSf6LX0U1r92inKRclfrXIDyWHz54xSsmhgtoY5GgciU/WUNeudS1fxVYXH4mrtpL0yTxtyHmVWIHfvCWuegCjw==',key_name='tempest-SnapshotDataIntegrityTests-920739646',keypairs=<?>,launch_index=0,launched_at=2023-04-14T01:00:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ed63b19014f048f5bf3f9938a151d30c',ramdisk_id='',reservation_id='r-zcywk9qk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6db62068-7278-4cd8-b41f-d0140d89e199',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-212903653',owner_user_name='tempest-SnapshotDataIntegrityTests-212903653-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T01:00:18Z,user_data=None,user_id='1c8816bdfcab4ebca17b0c7ca90e5d39',uuid=7d067330-8745-4e21-b93c-60c0902012c7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4f9eadfb-1571-4235-85ba-05511a343c4d", "address": "fa:16:3e:66:d8:ca", "network": {"id": "c6603c41-74dd-4b44-952c-0df4228a8b77", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2088791125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed63b19014f048f5bf3f9938a151d30c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9eadfb-15", "ovs_interfaceid": "4f9eadfb-1571-4235-85ba-05511a343c4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 01:06:39 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-f9d964f6-c8e8-4f9e-b980-703ffd9c211d tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Converting VIF {"id": "4f9eadfb-1571-4235-85ba-05511a343c4d", "address": "fa:16:3e:66:d8:ca", "network": {"id": "c6603c41-74dd-4b44-952c-0df4228a8b77", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-2088791125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed63b19014f048f5bf3f9938a151d30c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f9eadfb-15", "ovs_interfaceid": "4f9eadfb-1571-4235-85ba-05511a343c4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 01:06:39 user nova-compute[82479]: DEBUG nova.network.os_vif_util [None req-f9d964f6-c8e8-4f9e-b980-703ffd9c211d tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:66:d8:ca,bridge_name='br-int',has_traffic_filtering=True,id=4f9eadfb-1571-4235-85ba-05511a343c4d,network=Network(c6603c41-74dd-4b44-952c-0df4228a8b77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f9eadfb-15') {{(pid=82479) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 01:06:39 user nova-compute[82479]: DEBUG os_vif [None req-f9d964f6-c8e8-4f9e-b980-703ffd9c211d tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:d8:ca,bridge_name='br-int',has_traffic_filtering=True,id=4f9eadfb-1571-4235-85ba-05511a343c4d,network=Network(c6603c41-74dd-4b44-952c-0df4228a8b77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f9eadfb-15') {{(pid=82479) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 01:06:39 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:06:39 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4f9eadfb-15, bridge=br-int, if_exists=True) {{(pid=82479) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 01:06:39 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:06:39 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:06:39 user nova-compute[82479]: INFO os_vif [None req-f9d964f6-c8e8-4f9e-b980-703ffd9c211d tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:d8:ca,bridge_name='br-int',has_traffic_filtering=True,id=4f9eadfb-1571-4235-85ba-05511a343c4d,network=Network(c6603c41-74dd-4b44-952c-0df4228a8b77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f9eadfb-15')
Apr 14 01:06:39 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-f9d964f6-c8e8-4f9e-b980-703ffd9c211d tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Deleting instance files /opt/stack/data/nova/instances/7d067330-8745-4e21-b93c-60c0902012c7_del
Apr 14 01:06:39 user nova-compute[82479]: INFO nova.virt.libvirt.driver [None req-f9d964f6-c8e8-4f9e-b980-703ffd9c211d tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Deletion of /opt/stack/data/nova/instances/7d067330-8745-4e21-b93c-60c0902012c7_del complete
Apr 14 01:06:39 user nova-compute[82479]: INFO nova.compute.manager [None req-f9d964f6-c8e8-4f9e-b980-703ffd9c211d tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Took 0.91 seconds to destroy the instance on the hypervisor.
Apr 14 01:06:39 user nova-compute[82479]: DEBUG oslo.service.loopingcall [None req-f9d964f6-c8e8-4f9e-b980-703ffd9c211d tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=82479) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 01:06:39 user nova-compute[82479]: DEBUG nova.compute.manager [-] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Deallocating network for instance {{(pid=82479) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 01:06:39 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] deallocate_for_instance() {{(pid=82479) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 01:06:39 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:06:39 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Starting heal instance info cache {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 01:06:39 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Rebuilding the list of instances to heal {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 01:06:39 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Skipping network cache update for instance because it is being deleted. {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9809}}
Apr 14 01:06:39 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Didn't find any instances for network info cache update. {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 01:06:39 user nova-compute[82479]: DEBUG nova.network.neutron [-] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Updating instance_info_cache with network_info: [] {{(pid=82479) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 01:06:39 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Took 0.48 seconds to deallocate network for instance.
Apr 14 01:06:39 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f9d964f6-c8e8-4f9e-b980-703ffd9c211d tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:06:39 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f9d964f6-c8e8-4f9e-b980-703ffd9c211d tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:06:39 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-f9d964f6-c8e8-4f9e-b980-703ffd9c211d tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:06:39 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-f9d964f6-c8e8-4f9e-b980-703ffd9c211d tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:06:39 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f9d964f6-c8e8-4f9e-b980-703ffd9c211d tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.114s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:06:40 user nova-compute[82479]: INFO nova.scheduler.client.report [None req-f9d964f6-c8e8-4f9e-b980-703ffd9c211d tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Deleted allocations for instance 7d067330-8745-4e21-b93c-60c0902012c7
Apr 14 01:06:40 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-f9d964f6-c8e8-4f9e-b980-703ffd9c211d tempest-SnapshotDataIntegrityTests-212903653 tempest-SnapshotDataIntegrityTests-212903653-project-member] Lock "7d067330-8745-4e21-b93c-60c0902012c7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.709s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:06:40 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:06:41 user nova-compute[82479]: DEBUG nova.compute.manager [req-15cfc9f4-2469-4ed0-8ac2-21e2af377010 req-4cd353cd-a2e4-428f-b866-f56653542db9 service nova] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Received event network-vif-plugged-4f9eadfb-1571-4235-85ba-05511a343c4d {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:06:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-15cfc9f4-2469-4ed0-8ac2-21e2af377010 req-4cd353cd-a2e4-428f-b866-f56653542db9 service nova] Acquiring lock "7d067330-8745-4e21-b93c-60c0902012c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:06:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-15cfc9f4-2469-4ed0-8ac2-21e2af377010 req-4cd353cd-a2e4-428f-b866-f56653542db9 service nova] Lock "7d067330-8745-4e21-b93c-60c0902012c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:06:41 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [req-15cfc9f4-2469-4ed0-8ac2-21e2af377010 req-4cd353cd-a2e4-428f-b866-f56653542db9 service nova] Lock "7d067330-8745-4e21-b93c-60c0902012c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:06:41 user nova-compute[82479]: DEBUG nova.compute.manager [req-15cfc9f4-2469-4ed0-8ac2-21e2af377010 req-4cd353cd-a2e4-428f-b866-f56653542db9 service nova] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] No waiting events found dispatching network-vif-plugged-4f9eadfb-1571-4235-85ba-05511a343c4d {{(pid=82479) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 01:06:41 user nova-compute[82479]: WARNING nova.compute.manager [req-15cfc9f4-2469-4ed0-8ac2-21e2af377010 req-4cd353cd-a2e4-428f-b866-f56653542db9 service nova] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Received unexpected event network-vif-plugged-4f9eadfb-1571-4235-85ba-05511a343c4d for instance with vm_state deleted and task_state None.
Apr 14 01:06:41 user nova-compute[82479]: DEBUG nova.compute.manager [req-15cfc9f4-2469-4ed0-8ac2-21e2af377010 req-4cd353cd-a2e4-428f-b866-f56653542db9 service nova] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Received event network-vif-deleted-4f9eadfb-1571-4235-85ba-05511a343c4d {{(pid=82479) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 01:06:42 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:06:42 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82479) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 01:06:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:06:45 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:06:47 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:06:47 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:06:47 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:06:47 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:06:47 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Auditing locally available compute resources for user (node: user) {{(pid=82479) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 01:06:48 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:06:48 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:06:48 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Hypervisor/Node resource view: name=user free_ram=8887MB free_disk=26.124412536621094GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82479) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 01:06:48 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:06:48 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:06:48 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 01:06:48 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 01:06:48 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Refreshing inventories for resource provider 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 01:06:48 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Updating ProviderTree inventory for provider 3847975a-19aa-4b27-9180-14b5cc49044a from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 01:06:48 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Updating inventory in ProviderTree for provider 3847975a-19aa-4b27-9180-14b5cc49044a with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 01:06:48 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Refreshing aggregate associations for resource provider 3847975a-19aa-4b27-9180-14b5cc49044a, aggregates: None {{(pid=82479) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 01:06:48 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Refreshing trait associations for resource provider 3847975a-19aa-4b27-9180-14b5cc49044a, traits: COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_MMX,HW_CPU_X86_SSE42,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_STORAGE_BUS_IDE,HW_CPU_X86_SSE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO {{(pid=82479) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 01:06:48 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:06:48 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:06:48 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Compute_service record updated for user:user {{(pid=82479) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 01:06:48 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.248s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:06:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:06:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:06:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 01:06:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 01:06:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 01:06:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:06:52 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:06:52 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:06:54 user nova-compute[82479]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681434399.222126, 7d067330-8745-4e21-b93c-60c0902012c7 => Stopped> {{(pid=82479) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 01:06:54 user nova-compute[82479]: INFO nova.compute.manager [-] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] VM Stopped (Lifecycle Event)
Apr 14 01:06:54 user nova-compute[82479]: DEBUG nova.compute.manager [None req-8a062c0a-d56d-480e-abdf-cc6431f19519 None None] [instance: 7d067330-8745-4e21-b93c-60c0902012c7] Checking state {{(pid=82479) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 01:06:54 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:06:58 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:06:58 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Cleaning up deleted instances with incomplete migration  {{(pid=82479) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 01:06:59 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:06:59 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:06:59 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 01:06:59 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 01:06:59 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 01:06:59 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:07:04 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:07:09 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:07:09 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:07:09 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 01:07:09 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 01:07:09 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 01:07:09 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:07:14 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:07:14 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:07:14 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 01:07:14 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 01:07:14 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 01:07:14 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:07:19 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:07:24 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:07:26 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:07:28 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:07:29 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:07:31 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:07:33 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:07:34 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:07:35 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:07:38 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:07:39 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:07:39 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:07:39 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Starting heal instance info cache {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 01:07:39 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Rebuilding the list of instances to heal {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 01:07:39 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Didn't find any instances for network info cache update. {{(pid=82479) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 01:07:41 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:07:43 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:07:43 user nova-compute[82479]: DEBUG nova.compute.manager [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=82479) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 01:07:44 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:07:45 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:07:47 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:07:48 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager.update_available_resource {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:07:48 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:07:48 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:07:48 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:07:48 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Auditing locally available compute resources for user (node: user) {{(pid=82479) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 01:07:48 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:07:48 user nova-compute[82479]: WARNING nova.virt.libvirt.driver [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 01:07:48 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Hypervisor/Node resource view: name=user free_ram=9017MB free_disk=26.12255096435547GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=82479) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 01:07:48 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 01:07:48 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 01:07:49 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 01:07:49 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=82479) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 01:07:49 user nova-compute[82479]: DEBUG nova.compute.provider_tree [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed in ProviderTree for provider: 3847975a-19aa-4b27-9180-14b5cc49044a {{(pid=82479) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 01:07:49 user nova-compute[82479]: DEBUG nova.scheduler.client.report [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Inventory has not changed for provider 3847975a-19aa-4b27-9180-14b5cc49044a based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=82479) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 01:07:49 user nova-compute[82479]: DEBUG nova.compute.resource_tracker [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Compute_service record updated for user:user {{(pid=82479) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 01:07:49 user nova-compute[82479]: DEBUG oslo_concurrency.lockutils [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.124s {{(pid=82479) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 01:07:49 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:07:53 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:07:53 user nova-compute[82479]: DEBUG oslo_service.periodic_task [None req-1569d9a5-2eb9-48f5-b98d-c30a12b7e32c None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=82479) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 01:07:54 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 01:07:54 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 01:07:54 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=82479) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 01:07:54 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 01:07:54 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=82479) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 01:07:54 user nova-compute[82479]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=82479) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}